maybe hes shy? he might not seem like it with his friends but some guys are just shy around girls. i went out with a guy who was really shy went on a date and was really p***ed off because we hadnt kissed and as his bus turned up i pushed him against the wall and just snogged his face off lol! he was surprised (to say the least especially the telltale sign of a bulge down there lol) but liked it. it was only a fling in the end but sometimes you have to go for it.
try and get him alone sometime or stay behind him when coming out of a room and pinch his bum lol
at least youd know for sure. if he doesnt do anything perhaps he really doesnt want to hurt your feelings (also experienced that too, but prefered this approach rather than going 'i dont like you')