I Have Been On Levothyroxine For 14 Years. A New

I have been on levothyroxine for 14 years. A new doctor had me stop it for 6 weeks when my TSH showed 1.60. My TSH after the six weeks was 4.790. The doctor says I can go back on the med if I am having symptoms. I have been very fatigued and lots of trouble staying focused. Also gained about 7 lbs in the six weeks off the med. Would I be out of line with my doctor if I sought care from someone who specializes in thyroid problems