I Am A 64 Year Old Woman. Two Years Ago

I am a 64 year old woman. Two years ago was diagnosed with a small cyst on my left ovary - 3 cm - with a septum. It was followed every 3 months with no change for one year, then follow-up was once per year. At my recent checkup it was observed that the septum had blood flow based on doppler on ultrasound.
Should I have ovaries removed? Family history of three relatives (father, uncle, and aunt - all siblings) all getting cancer in their early 60s and early 70s. None of my sibs has had cancer except for skin cancer and I had cervical cancer at 32 years of age. I wondered if there was a family pattern of concern when I saw a gynecologist and that is when she discovered the cyst two years ago. What do you think?