Suggest Remedy For Bumps In Labia Minora

Found a bump on the inside of my left labia minora. It swell to a size about a pea & feel sore when touch. Otherwise no discomfort. Next day, when washing that area during bath, some puss let out & the after a while the bump get seem to sudside. However, I can feel that the bump is not totally cleared. Is this a serious problems & require to seek Doctor's help? Seem like many online encounter similar problem. Please advise. Thank you.