Whilst no expert, it sounds like you "consented" the night before, but was raped in the morning. These are 2 separate incidents and people are judging them as one incident. At NO point did you consent in the morning, so that was definitely rape, based on your version of events.
That being said, if the guy was sober and you were clearly drunk, then surely it was statutory rape the night before