Suggest Treatment For Red Itchy Lump On Vagina

Can boils form on the inside of the vagina? I have a red itchy/painful lump just down from the clitoris close to the top of the inner labia. I have been putting tea tree oil on it but it s still there. I recently went back on the birth control and have noticed I m getting boils again. I have 2 others on my chest. The one I m most concerned with though is the one inside my vagina. I have never had one there before. Any suggestions on how to get rid of this?