It would be a real shame for you to stop going or stop enjoying badminton because of the people in your group. When you say you don't really like them, is that because of anything in particular or just because you've never really settled in with them?
It's difficult when you feel like an 'outsider' of the group, but you do think it would help to get to know them a bit better? Maybe suggesting a group meal out somewhere after a session, or doing something together just to 'bond' a bit?