‘They label us antisemites or terrorists to silence us and paralyse our human rights work’