Please don't stop contact and forget about it! For one thing it'll freak the poor guy the **** out!
Personally, I find there are very, very few genuinely uninteresting people. Not doing a whole bunch of sports or 'activities' doesn't mean you don't have interesting ideas, opinions, styles, dreams etc. and hopefully he'll want to find out about all that.
Like you say: nothing to lose
Share your uni advice here