I've Had A White ,rough Patch Inside My Right Nostril

I've had a white ,rough patch inside my right nostril for years. I also have a deviated septum from maxillary surgery. That side clogs up easily. I used to pick at it to breathe easier until I looked inside my nose. I use Neil med sinus packets to wash out my nose.
Have I caused a callous or could this be something more serious?