Attachment does not equal love. You're attached to him by sentiment and sense of nostalgia, not by honest, emotional love and connection, as is evident by your post.
This person doesn't love you, this person doesn't respect you or treats you like an equal. To me, it sounds like you're basically his possession, a person from whom you have to ask permission!! Permission to do the things that you want to do. In 2016. In the dammed 21th century. Please understand how insane and horrible that is.
Love isn't controlling someone, setting up a double standard and making them feel bad for every indulgence and every bit of fun they have, while treating your own behavior differently. Love is accepting, love is equality, love is moderation, compromise and fairness. Your relationships seems to be utterly devoid of any of those values. This person is not only acting disrespectfully and cruelly, he is also actively making you feel about yourself and your actions and chastising every decision you make. Imagine your relationship years from now - every one of his bad habits will turn worse, every kindness within him with perish and you will be controlled and treated horribly day in and day out, not knowing how to get out of it all. This person will make you cut contact with your friends, then slowly with your family, isolate you from others and from every fun and every passion you once had in your life. Don't let him. Don't give him that opportunity.
Now is your chance to leave that all behind and start anew - enjoying life and feeling free to have your own direction and fun. Please, as hard as it might seem, leave him. Walk away from it. I wish you the very best.