Suggest Treatment For Small Bumps On The Labia Majora

Hi, I'm a 20 year old female. I just had a pap smear about 6 months ago, after getting out of the army to go back on birth control. My boyfriend came home for two weeks and in the course of that time we had a large amount of sex. I shave on a regular bases probably about twice a week. I have 3 bumps on the inner side of my vaginal lips, they are the same color as the area surrounding them and they are irrated by my undergarments. I was able to pull them off using my nails and they bled for a short period of time. I was wondering what they are from and if it's something serious.