Suggest Remedy For Recurring Painful Cyst On My Labia

I have reoccurring cysts that appear on my labia. I get them once or twice a month around my menstrual cycle. They are quite hard and under the skin. I think they are sebaceous cysts. They can get large and very painful. Is there any way I can try to prevent these from reappearing?