My A1C Glucose Level Has Risen From 98 In 2016

My A1C Glucose level has risen from 98 in 2016 to 104 in 2017 and now 108 in 2018. I am healthy ( 5'10" 168 lbs. normal blood pressure and pulse. I SWIM 1 MILE A DAY AND WALK 2 MILES A DAY.eat healthy, low carbohydrate and good protein and fresh vegetable also four (4) times a week i drink a home made Vegtiable protein shake ( Vega Protein powder ) with Almond milk, strawberries, blueberries, bananas however in the summer I eat more red and green grapes, canteloupe, honey dew melons, strawberries, blueberries, bananas, peaches, watermelon. However during the year i do eat chocolate, ice cream and a chocolate candy bar, not to extreme. IS THE FRUIT EFFECTING MY BLOOD SUGAR LEVELS?