Suggest Treatment For Ovarian Cyst

I had an appendisectomy two days ago. The doctors said they found a cyst on my ovary but the gyno surgeon was not available to remove it so they left it there. Will it go away on its own. The consultant said it was a normal fluid filled cyst that is normal and associated with woman's menstrual cycle. I am worried about cancer. Should I be asking for more appointments.