I don't get why it has to be all or nothing. Any kind of physical activity could plausibly be useful for dropping weight/increasing conditioning depending on where you're at. Start small and work your way up. You'll adapt in time.
Sport is useful primarily because it should be fun. It's a way of doing cardio without feeling godawful about it.