Oh what a load of bull.
Most Atheists also get together to celebrate Christmas, enjoy artwork and music that had a religious motive, and maybe even have a cheeky easter egg.
Personally I don't celebrate Christmas, I don't eat easter eggs, and I don't say 'oh my God'. I do enjoy the arts, even if they were motivated by religion. But it's nothing to do with religion, it's culture, and it signifies nothing.
P.S. it's spelt atheist, NOT athiest.