Personally I would just tell your manager. The Olympics is a one-off event, any reasonable person would understand. I bought tickets Wednesday night and told my boss I am not coming in on Friday, she was absolutely fine with it and told me to have a nice time.
If it is a problem then just call in sick or make up a family emergency. It should be fine as long as you don't do it too often.