I laughed when I read your post then I realised this way my life every day for two years at college. The only bus stop to get me home would have about 5 different buses stop there. To be honest I just had to learn, if I left class early then my bus would come at a specific time or round about. And I just learnt from experience where my bus happens to stop, although depending on the traffic, the driver, or number of students it could change and put me at the back of the queue even if I was there first.
In my experience, most people don't care about getting onto the bus first or getting onto the bus which is most efficient for their journey. Which I why I was always first in line, because I do care as I want to get my ass home quickly. I hardly think these people are as concerned as you when it comes to who should get priority, even if you're right. After all, I've seen morons get on the bus for just two stops clogging up the whole bus for people who are going to be taking that bus for an hour plus just because they don't want to walk to their destination for 5 minutes.