Just tell him the truth and be honest about why you don't want to talk anymore, then go no contact. Block him if you have to. There is obviously no need to be cruel or mean, but that doesn't mean you have to molly coddle him either. He's not your responsibility anymore.