I personally don't think it matters. Doctors come in all shapes and sizes. Provided you're still a good person with decent communication skills, respect for the patient and the relevant knowledge, I don't think people will mind! Be prepared for a great deal of affection from old grannies and the Orthopaedic team attempting to recruit you as one of the 'lads'.
Also, a lot of being a clinical student is getting out of the way of the people you're following around like a desperately loyal puppy and crushing yourself in to join the other 8 people behind a curtain designed really to hold a single relative. Being agile, nimble and able to crush yourself into small spaces is a genuine advantage.