Personally, I'd just keeping using painkillers, if they work. Some people find using hot water bottles helpful but they do nothing for me. TENS machines can also help (they are not really a natural remedy, but still worth looking into if tablets are what you have an issue with).