I Was Told I Had Gallstones, But Have Never Been

I was told I had gallstones, but have never been bothered by them. They were discovered by a tech doing an ultrasound on my fatty liver (no I'm not a drinker). My daughter is studying medicine at Columbia University under Dr. Olive in his pancreatic cancer lab and thinks I should definitely get my gallbladder out. I have had episodes (maybe 3 or 4) in the last 6 months where I had to go to the bathroom (bowel movement) and would all of a sudden get nausea and vomit. Do you think I should have my gallbladder removed?
Debbie