Should I Stop Taking Prozac If It Causes Dizziness And Vertigo?

I have had Labrynthitis for 10 weeks now. The vertigo/dizziness has been improving with physical therapy but the anxiety has been very high the since the beginning. I had been taking xanax along with meclizine, but my primary and physical therapist decided that prozac would be great for me in the long run. The prozac has actually made my vertigo and dizziness much worse. I just began taking it 3 days ago, but I am questioning whether it is right for me or not. I told my Ear, Nose, and Throat doctor that I began taking prozac and he told me that could make my balance much worse. My primary and physical therapist disagree. The prozac is certainly making me more dizzy right now, but I wasn t sure if that is just a normal side effect as my body is getting used to the medication, or if the ENT is right and I should stop before possibly making my balance from the labrynthitis worse. I really don t know what the correct answer is and I am tired of suffering from this.