Suggest Treatment For Skin Tag In Vagina After Intercourse

I recently had sex for the first time in over a year and noticed this weird thing in my vagina. i could only describe it as an extra piece of cartilage. It feels like like the rest of my vagina except its extended like its not supposed to be there. It wasn't there before the sex unless i just never noticed it. Should I be worried?