If it's where I'm thinking of then it's not really far away at all - like laser said, 3 mins walk and there will be plenty of people around... Some of Vanbrugh is off campus anyway in Fairfax House. You'll get to know people living near you and at the Vanbrugh fresher events you can meet lots of people - and once you know one person and they let you into the main Vanbrugh bit, you can go anywhere you want!