99% of my friends are guys and my boyfriend never seems to have been bothered by it. They're all totally platonic and I know it would annoy me if someone implied otherwise and started getting controlling over it, so for that reason I would never become that person to someone else. As long as they're just friends and your boyfriend hasn't given you any reason not to trust him, I don't see a problem with it.
Although it would start being a problem if he flirted with them and they were quite obviously crossing the friendship line. I wouldn't outright tell him to ditch his friends in that scenario, but I would bring it up.