I would avoid it for the social reasons too. For example, a boy at my college also applied to Christ's and didn't get in and thereafter it was really awkward walking through corridors and seeing him. It would only affect your application, theoretically, if you apply for the same course because, I suppose, then there's more competition at that college than there would otherwise have been. That, to me, seems like a silly reason not to apply to that college though.