Just because you hear people say "uni wasn't for me" or "uni didn't work out for me", doesn't mean it isn't going to work out for you. There are dozens of people who say "teaching didn't work out for me", or "medicine didn't work out for me" or "marriage didn't work for me". Doesn't mean you should avoid life possibilities because it didn't work out for others. Life will always be an uphill battle and a struggle. Doesn't mean you should spend your life trying to avoid the difficulties of life.
Uni is a hit and miss entirely, or some people have better years or worse year, etc etc. There are endless possibilities as to why uni was great for some and not so great for others.
You should consider your own personal circumstances first - whether you're a mature student, your finances, what you want to study and where, etc etc. before considering university.