The good news is: Keratosis Pilaris is unnecessary, unsightly, and very easy to control! Treatment includes smoothing away the bumps through exfoliation and hydration. This will eliminate the bumps and improve the overall appearance of your skin. Treatment for Keratosis Pilaris needs to be continuous – if stopped, skin begins reforming around hair follicles.