I Can Only Smell Out Of My Right Nostril. I

I can only smell out of my right nostril. I have a deviated septum affecting the left nostril, and noticeably less air flow on that side, but the ENT said it wasn't a major issue. He wants me to see a neurologist. I have a grandparent and parent with Alzheimers. I'm in my early 40's. I'm very concerned.