I certainly feel this way, but my confidence can literally transform in seconds if I'm with the "right" people and back down with the people with whom I can't hold a decent conversation - the best way to improve your confidence is to reinforce your personality with people who you can talk to - and make sure it is regular so it becomes normality. It's not always easy, but changing who with or how you interact is the best way - often you can feel more secure in negative feelings, even if it they are painful. You are certainly not alone and there will be people you can interact with - one or one million, it doesn't matter.