How To Get Rid Of Bumps On The Penile Shaft?

I have had a number of small bumps on the shaft of my penis for as long as I can remember, I looked on the internet and found out it could be folliculitis (I think that s how its spelt) they are not painfull but in the time i remember 2of them have became uncomfortable and red but they usualy go back small after a few weeks, how do I get rid of these?