I'm really sorry this is happening to you. Below I've offered a solution for you, but I don't think you'll like it. Please read my reasoning, and think it through. I'm not trying to be cruel, or to hurt you. You posted on this forum for help and that's all I'm trying to offer.
My solution to your problem is to end your relationship with him. (And what you described, insofar as I understand, is a relationship whether or not HE wants to call it that.)
To be completely honest, it sounds like he's just not that into you or the relationship anymore. He sounds fairly immature and so he probably doesn't know how to straightforwardly tell you, which can be maddening and I'm sorry. First of all (and this is general) if a guy fancies you -- he will start conversations and he will want to see you. If he doesn't fancy you (or likes you fine, but isn't THAT interested) he won't. It's harsh and I'm sorry, but it's also true. Second of all, I think it's probably the case because I've been in the same situation, except I was the one who didn't really want to be that close to my then-boyfriend. I evaded him and made excuses, when I should have told him what was going on.
My advice to you? Is to end it. Meet him for coffee (or meet him at his house or yours if you think there will be tears) and say, "I don't feel like you're interested in me anymore, and I think we both deserve to see other people... I wish you the best." I don't know you, but you sound nice and anyone who is a decent, kind person (and you sound like both) deserves someone who values them, who WILL call you his girlfriend, who WON'T avoid seeing you and who WON'T suddenly not want to cuddle and kiss you. You deserve better than him.
I won't lie to you, ending it is going to hurt. But let me promise you this -- it gets better. It gets way better, I promise. How can I promise this? Experience. The guy I was dating who was to me what this guy is to you broke up with me about two years ago, and at first... it hurt. It took a long time for us to finally stop grovelling over each other after the breakup. But what happens is that one day, I woke up and it hurt a little less... and then it hurt a little less the day after that... and I met new people, I got into another relationship and life moved on, and I realised that there was a bigger world, and I had dreams that somehow, magically -- were bigger than the guy.
Do I still think about the guy sometimes? Yes, of course. Will I ever forget the guy, and how I felt about him? Nope, not for a second. Does it still feel like there's a gaping hole in my chest where he once was? Honestly... no. I miss him sometimes, I think about him sometimes... but no, the gaping, energy-sucking, emotional-sucking wound healed. There's a bigger world out there, that expands past him. And this will happen for you: It'll be hard at first, but slowly your life will expand past him and you'll meet people (friends, potential boyfriends) who will expand your world, and your horizons -- I promise!
Good luck, I hope this helped you. Whatever you decide to do, remember that you are someone who has a lot to offer the world and there IS someone out there who will see it, and honour everything you have to offer every day. Good luck.