What's the worse thing he can do? Deny it. So what if he does. Do you intend work there for the res tof your life. You're going to Uni soon! Just keep your head down and concentrate on your work. People gossip. They'll move on to talk about more interesting things.
Find out how you've done here