It all depends on what degree you do/are planning on doing. For example, I want to study veterinary medicine and the unis that I'm thinking of applying to probably won't make most people's top five (Surrey, Royal Veterinary College, Nottingham, Bristol). I think that as long you go to a uni that you like, doing a subject you enjoy, it shouldn't matter to much about the prestige etc.