I Am Prescribed Adderall 20mg/2x A Day For My Adult

I am prescribed adderall 20mg/2x a day for my adult adhd and generalized anxiety. My husband and I are trying to get pregnant and I asked my primary physician about my options. We discussed some facts and what studies have shown but was told to ask my Obgyn her opinion as she would know more about affects in pregnacy more than her. My Obgyn is on vacation and it takes about a month to get in for an appointment. I personally want to go completely off of it, but scared it may affect my anxiety and cause it to worsen. Is it better to be on XR rather than IR..if working toward lessening dosage and working way slowly off of it.