What Causes Skin Tags In The Nose?

I just picked the inside of my nose thinking it was a booger, but it turns out it was skin. Now skin is sticking out inside my nose kind of blocking the air passage (meaning its clearly visible when comparing the two nostrils).

Am I going to be okay, in that it will swell down and the side of the inside of my nose go back to normal?