Stop talking to him. He's clearly not supportive and thinks his role as a doctor means his opinion on all things medical is far superior to yours when that's simply not the case. Remember he's not your doctor, he's not the one who can actually prescribe you anything or refer you for any counselling groups, so don't worry. He can't possibly start giving out his medical opinion when he's not even assessed you directly.
From what you've described, your reactions to anxious stimuli are way over the top and definitely causing you distress. There's a difference between having anxiety and feeling anxious - everyone feels nervous about public speaking but not everyone will hyperventilate, shake, feel sick etc. I understand that some doctors don't feel comfortable prescribing pills for every person they see who says they're depressed etc but completely dimissing your symptoms is wrong, he's also not given you any viable alternatives or coping strategies so as far as him being helpful is concerned....nothing. Great doctor there.
The bit in italics is so patronising and non-sensical I can't understand why he's still a friend in the first place. What a tool.