OP are there any other aspects of his life that you are upset that you don't control? Maybe how he dresses, what he eats, what he reads? In a few years time, if you have a life together, would you want to control what time he gets home and who he socialises with?