My partner and I have been together for 8 years long distance, so it definitely can work and stories like ours aren't all that uncommon. She's in the US and I'm in the UK. So it's not a short distance either.
It takes a lot of effort though. A lot of visits, a lot of Skyping, and a lot of patience. Really helps build communication skills. I'm thinking about putting it in my CV :P