The only thing I've found that has noticeably reduced my KP is by properly exfoliating every now and then in the shower, followed up by moisturising regularly. I used to get it all over the outer side of my arms, thighs and the sides of my face on my cheeks. However now I only really get it on the backs of the top half of my arms but it's not that noticeable. I also use Sulphur soap as my daily face wash, morning and night which seems to have got rid of it on my cheeks!
However, different products work for different people so unfortunately I think it's just a case of trying products until you discover something that works for you.