Don't let him emotionally manipulate you into staying. Simply explain that you don't want a sexual relationship, and so if this is important to him, you will be better off breaking up. Sorry that he's pressuring you to do things you don't want to, that's awful of him.