My boyfriend pressured me into sex

Okay so me and my boyfriend have been together for a while now and everything is great, but any time we have an argument I think back to the start of our relationship and kinda feel angry at him for past things. We fell in love very quickly and got together within two weeks of meeting each other, but he always pressured me to have sex with him. We’d both had sex before, but I’d never done it with someone I was in love with, only one night stands and friends with benefits and so I’d never really felt comfortable with the person. I told him this and explained that I wanted to wait until I felt completely comfortable with him as I felt like I could see this going somewhere. He said that was fine, but every time he came round my house I always felt pressured to do things. When I said I didn’t want to, he would say things like “but all my friends are having sex”(he used the term ****ing like rabbits). When I said no to things he would say “okay fine, we’ll never do anything then if you don’t want to. I don’t have to have sex. You seem like you’re not interested in sex” etc... when he said these things I felt like I had to prove to him that I wanted to do things( we had been together about two weeks at this point). So I ended up doing it anyway. I gave him a few blowjobs and had sex with him twice before I actually felt comfortable and ready to, I just did it because he wanted me to and I felt like I couldn’t say no. I even had a couple of panic attacks when we tried to do stuff. Anytime I tried to talk to him about it he would get really self deprecating and say things like “I’m a **** boyfriend, you should break up with me, I’m no good”. This led me to comfort him and the conversation completely shifted from what I was trying to discuss. Everything is fine now and I feel completely comfortable with him. I recognise that this is not okay, but I guess I forgive him as it’s all good now. I really love him and I don’t want us to break up, but every time we have a disagreement this just pops into my head and I start to resent him for it. What should I do? Do I talk to him? I’m worried that if I try to talk to him, he’ll get self deprecating again. Sorry this is so long.