It usually does, maybe you should rearrange the date, try and make an excuse and say "I've always wanted to see so and so film" so you can go to the cinema, or else bring up a restaurant you've always wanted to eat it. If he refuses then maybe he has other intentions, and you could either handle this by cancelling the date or being very tactful when you go to his, ie not cuddles, and using the right body language, as well as not staying too late. He might not necessarily be wanting sex per se, but since you barely know his it's best not to take risks! Good luck.