See a Dr ASAP, get an emergency GP appointment or got to A&E, there is a chance you'll get chemical burns. its good to wash it off however they should be able to give you something effective and safe to soothe it.
Hope the pain eases soon and you can get this sorted!