Because when the negative repercussions of that persons actions come back to negatively effect them (Partner finds out / feeling of remorse) they then regret it
Think of a person on a diet eating a mcdonalds and cake.
You are correct its not a mistake, its myopic selfish greedy human behaviour that only becomes a mistake if they are forced to regret it through an overall negative outcome