Does it matter, probably not. May it give you some indications, maybe. Just my opinion and observation. I know I generalise a lot here, but I observed a trend here.
I had some interesting experiences with girls who were really proud of their low 'body count' (I hate that expression). One was blocking everything that went further than kissing. With the other it took idk 8 or 9 months until we finally had sex. And guess what, it was absolutely awful. Talking about sex was nearly impossible, so neither of us (definitely me) did not have a lot of fun and there was no drive to change that. Believe me I am not the person to blackmail someone into having sex so I waited patiently, but I definitely learnt my lesson. Sex is an important part of a relationship (at least in my opinion), it's a bit of a bummer to realise after months that this part of your relationship is not what you want. It's really hard for me to break up with someone, because I always feel that I failed and it felt really horrible to break up with someone just because you did not like the way you were having sex (I hope I am better than reducing a relationship just to the having sex part).
Well, I finally had to admit, that I don't want to have a relationship where the sex isn't good (guess I am a lot less sophisticated than I hoped to be). So after these experiences I definitely prefer to have sex early. And that means I am looking for someone who is not maintaining a low body count. I don't think that mixes well with having sex on the first or second date.
Body count doesn't really matter, but I would be reminded of bad experiences if you emphasize how low your number is. It's totally okay if you want to keep it low and are proud of it, but it's likely that we aren't compatible.
So fellow gentleman: Think wisely what you wish for. I'd rather have someone with a high body count than going through the same experience again.