What Causes Irritating And Sensitive Area At The End Of Cartilage In Nostril?

I have an area at the end of the cartilage in my right nostril that was an irritating bump. It was very sensitive to touch and I was able to pull off skin. This exposed a split, which is quite sensitive to touch. Skin then grew over causing it to be uncomfortable. I peeled the skin off exposing this irritation and the skin grows back more each time. I don't know what caused this or how to make it go away.