I Have Varicocele On Left Testi Of Mild Degree 3.5mm.

I have varicocele on left testi of mild degree 3.5mm. While my semen analysis says Sperm Count 55M, 40% progressive, 15% non progressive and 45% non Motile. Liqification time 1 Hour Agglutination ++.
My question is that i am recently married 5 months before and couldn't get my wife pregnant. is it a fertility problem or should i wait