Perhaps it sounds weird, but when I'm talking to new people, I almost have a reserve of stories or jokes I like to tell. Often people follow one up with a related one of their own, and you can end up talking for hours just swapping your favourite anecdotes. Maybe that sounds silly, but I find that you can discover a lot about a person this way: their sense of humour, their outlook on life, their past. I don't care how boring your life is, something funny must have happened to you, or you must be able to make fun of something. If you can make the other person laugh then that builds rapport and makes for enjoyable conversation.
A common objection is that conversation is often 'inane', well that's just the way it is. If you look at any aspect of society from a detached point of view it looks stupid, so what. If you considering yourself 'above' petty small-talk then it comes off as arrogant and nobody likes that. It's really important to not take yourself too seriously. Personally I can have a casual, stupid and ultimately pointless conversation with a total idiot and enjoy it very much. On the other hand, discussions about religion and politics don't exactly brew goodwill (people take themselves seriously, get offended, etc). If you look at it pragmatically, small talk doesn't seem such a bad idea after all...
Anyway, I really think you have to enjoy the conversation. Are you interested in music? Then ask your best mate something like 'What kind of music are you into at the moment?' - it shows genuine interest but stays at the level of casual conversation, could lead to an hour-long discussion. If making conversation is your aim, don't ask closed questions like 'Do you like that new song X by the band Y'? - may lead to a 'no not really' followed by an awkward silence, then you asking another question and them feeling like it's an interrogation.