Hey, I first went to uni in 2011 at 18 and failed the first year spectacularly due to declining mental health. I repeated the year in 2012, but decided to drop out halfway through as I could feel that I wasn't going to make it again. I was failing essays when I'd been getting A*s at A Level, I felt so embarrassed and like a disappointment.
After that, aside from working for money obviously, I took time to recover before going back to college in 2014 to train in another subject. After a year my tutors advised that I was ready to go to uni so I did, completing a BA from 2015-2018. I went straight into an MA, which took me an extra year to complete due to managing ADHD through working and Covid. Now I'm about to start a PhD!
If I hadn't have dropped out of the first course, it's unlikely I would have achieved any of that. It also gave me space to understand my research interests, the wellbeing support I need to get through study, and rule out what I didn't want to do.
As for worrying that being a "drop-out" will affect your chances, the only time it was brought up in uni interviews was with intrigue. Obviously, there will be institutions or employers who take a "perfection and nothing less" stance, but I would ask yourself if those are places you would like to be. Many people find that they can actually thrive more in less restrictive environments, which may be the case for you.
BUT, having said all of that, it's not a decision to make lightly. I would suggest trying out all of the avenues of support you have before choosing to leave, it will ensure that you're as confident as possible in any decision you take. University Wellbeing services are very experienced in helping with this kind of query, and they won't share your worries with lecturers or course leaders.
I hope that helps a little and that things become clearer for you soon.