This reminds me of a time when a friend said:
"You know, if I was having sex with a sleeping girl...what would that be?"
The answer is - rape
no simple way about it. And in this case, not only had you said no, but you were so out of it you couldn't properly consent, so it's an undeniable case, boyfriend or not. Even a husband can't have sex with his own wife when she's asleep/comatose/paralytic regardless of a "yes" or "no".