It definitely wouldn't stop me from considering a guy on it's own. I've dated shy guys before and provided they're not shy to the point they can't leave the house, which is problematic, it's no issue. In fact it may even swing towards their favour if they're blatantly nervous but bit the bullet and spoke to me anyway, that shows a lot more courage in my eyes than a pitch perfect delivery.