I fear my boyfriend wishes i was different

I (22F) have only been seeing my boyfriend (23M) for a couple of months now and it’s been really good so far it’s been really fun and comfortable. However, he likes to go out and drink whereas I don’t, I suffered a trauma when drinking and I no longer engage in drinking or going out clubbing etc but there was this party with his friends for the holidays and he begged me to come with him and I wanted to be there for him so I agreed.

We get to the party and I try and mingle with people but they’re not that interested in talking to me - even his friends girlfriends talk to him rather than me, so this obviously downs my mood - we stand awkwardly in the corner and he keeps trying to get me to drink,dance,sing, take photos when he knows I struggle a lot with anxiety so I was really hesitant, every time I declined a drink etc I could feel him get more and more disappointed in me. We came home and it seemed fine but this morning he’s slowly started to show how unhappy he was that I wasn’t enjoying the party like he was, I feel really guilty but I did try my best to go and show face and have a good time but I was excluded the whole night, the atmosphere was horrible etc. I’m just worried incase he now wishes I was a party animal and that this will be the end of our relationship, any advice on what to do?

(I’ve already explained to him why I don’t drink/go clubbing etc and he’s understanding about it but he keeps offering club/nightclub etc to go to whenever we plan a date)