I feel like I should be more pragmatic than this but please please please get rid of him. He's projecting his issues and insecurities onto you and punishing you for it. You've expressed how you wish to move on from the time when you were in a bad place and he just keeps putting you right back there-you don't need that. I know it's difficult when you're attached to someone, you're used to someone but this isn't a positive relationship and it'll likely get no better so I think you should cut ties. Good luck !