I Have A S Cluster Of Small Bumps, On My

I have a s cluster of small bumps, on my eyelid line, going into my lower eyelid, for 2 weeks.
I have applied warm compresses & Camille tea bags & style OTC meds daily.
It has shrunk them,
With some minor drainage , slowly over the last 2 weeks.
I am a contac lens wearer (come out every night), but haven't worn them since.
Should I see an opthomologist for stronger meds?
Or just keep doing what I have been?,
What exactly do I have? It is in only 1 eye.
Thanks!