As much as I want to tell you to follow your heart and do what makes you happy, that annoying voice in my head, aka my common sense, tells me otherwise. I have been thinking about this too and have come to the conclusion that you don't have to choose one over the other.
You can always do what you love in your spare time.
I really thought about what I want in life, I want to travel and see the world, experience new things and you can't do that without money.
I also realized that I'm content with a varied job that allows me to be independent, creative and not doing the same boring routine everyday.
I don't need to be CEO or some hotshot, I just want a job that allows me to do what I love.
My advice to you is to think about what you want to in life, what's important to you.
Because that is what matters in the end not others opinions or expectations.
If your ambition is to be somebody or do something special then go down the smart career path. If not, then consider the other option.
One more thing to think about. I like reading literature too, but if I were to do it all the time and talk about the same things over and over again every day as you would do as a teacher, I don't think I would enjoy it as much as I do now.
But that is just me it might not be the same for you
Do what makes you happy, whether it's the one way or the other