Am I in the wrong for making my best friend cry?

I’m a Jewish person and my whole life I’ve been targeted and bullied for it. My freind, (James) had recently lost his father to cancer and he and his family has suffered a lot after his death. James loves to make fun of my religion and the holocaust. I usually just brush it off and think it’s just friendly teasing but recently I’ve been starting to think it’s a hatred because everything I do, he makes it into some stereotype about how I’m Jewish. I always say stuff about how I don’t appreciate his comments yet he still continues to do so. I finally snapped when he said “ all Jews I are such dicks “. I don’t know why that was the last straw but that made me angry. I then said to james “it’s crazy how you never were able to wish your dad goodbye, you were supposed to have so much time left with him but you don’t and there’s nothing you can do about that.” He broke down in tears and then we started to argue about how I think making fun of the holocaust and stereotyping a whole group of people in a negative way is worse than his dead dad. I did apologize but I still feel as if I went too far but also that he is fine giving me hate but can’t take any. Am I in the wrong?