Little of column A little of column B.... The language you use is pretty controlling,, you 'let' him go, and when he wanted to stay out you said 'no'. Unless he's given you good cause to doubt him it's a bit out of line saying where he can and can't go. You don't like his friends and they don't like you so that kinda sucks, and puts him in a pretty nasty position in the middle if it means arguments and fights if he wants to see them.
Yeesh, i'm trying to find a nicer way to say this, but yeah your attitude sounds pretty possessive and controlling, and his friends will see that and not like it. This seems to stem from your insecurities about the old friend (not even an ex?) which are getting projected onto him. You MIGHT not be wrong, and picking up what you see as a clear threat, but trying to control where he goes and talks to will not help and if anything will just push him towards someone else.
Thinking on it, I've seen plenty poor guys come to parties, and then have to spend most of the evening in the bathroom or outside on the phone to their partner the whole time, basically being nagged for being there (Boyfriends are different, they tend to physically show up uninvited at or outside parties loudly demanding if any men know where their girl is, usually giving the evil eye and wearing a tank top).