When I first looked at the title, I thought you were at least 40. Then, I read that you are...20. So, I will give you some perspective.
When I started my first undergrad, I was 27.
Now, I am about to start another degree, and I am 34.
In reality, age does not matter. The most important factor is what you have in mind and how mature you are.
Personally, I think that 'older' students are fascinating because they are real examples of how sometimes life can be difficult. There is not always a straightforward pathway towards your goals; sometimes, you do not know what you want to do. Everything comes with time and experience.