I would only use salt and water, but make sure there's not too much salt as it can irritate it. Sometimes too much cleaning can make it worse I've found. I'm only speaking from my experience of my helix piercing, which kept getting a bump next to it, which would drain and go scabby then happen again, I went home for the weekend and didn't clean it (apart from shower) and it got a lot better, it seemed to dry out more when I didn't do salt water soaks. So I just don't clean it as often and it's starting to heal.
Only my story though.
I wouldn't reccommend taking it out unless you treat the infection, there's a chance it'll close up with the infection inside and you don't really want that.