How To Treat Varicocele?

Hi Dr. V.Sasanka,I was diagnosed by a left side varicocele, After my personal research I realised that my gym activities might elevate the swollen veins, It worried me so i stopped going to the gym and 6 months back. In between i tried to continue gym but when ever i would go to the gym after workout i would see my scrotum has changed its shape. the left testicle seemed to have shrunk and the veins would be visible.I had gone to a doctor as well, He checked it by ultra sound and said it is a mild varicocele and can continue with my workouts. But I am not mentally satisfied to see my scrotum change whenever i would workout. What should i do. I want to get it repaired I asked the doc to get the surgery done but he said no.