At this point drop the friendship, it seems more one sided now and he's clearly not interested in wanting to see you. As harsh as it sounds the fact that he keeps giving you a sense of false hope and threatening you on top of all of this isn't worth it. You deserve better friends! Don't keep waiting around for him to come see you because he won't.