It's not an easy choice and the answer will be different for everyone.
Most people only find out after doing something for years and discovering they wished they had done something else. A bit like 'the grass is greener on the other side' syndrome.
Here's the dilemma: One of my close friends dad is a CEO of a respected company. He loves his job, gets a huge salary and can afford the toy's most of us only dream about. My friend (when she was still at home) lived in a big house with a garden measured in hectares. Here's the thing, she hardly ever saw her dad. He was always away on business, or coming home after the children had gone to bed, or leaving before they woke in the morning. And holidays were no better with work going with them. She always said that he compensated by buying them stuff. In short, she wishes she had what she thinks of as a normal life: a dad who was there and loved his family more than his work and she would trade all of the trappings for that.
So it comes down to a balance of doing something that you enjoy enough to keep you motivated but also with prospects of career advancement if you so choose and that all important mobility because careers can and probably will change in the future.
And keep in mind that your motivations/concerns/aspirations today may not be the same at some time in the future, like, when you are ready to settle down and have a family for example.