I Have Dizziness When I Hold My Head Back To

I have dizziness when I hold my head back to look at the ceiling. I also have dizzyness when I move my head quickly to left or right. I also feel my balance is not good, and I am unable to walk in a heel to toe type of stepping. I have given up yoga because of the symptoms.