One of the core perils of sharing a living space, you'll never have complete control/freedom over it or within reason who is there, best you can do is hope for a happy & respectful medium where you don't make a deal over guests as long as they don't try to move in by stealth. Bit of an extreme thing to move out over unless there was more to it.