My Ears Feel Full And I Hear Like I Am

My ears feel full and I hear like I am underwater. I had a cold that would not go away for several weeks, but my nose is now finally clear. I want to know how to relieve the ear pressure and noise quickly, as I sing for a living. But note that I am also a nursing mom to a 4 month old, so any meds I use would have to be safe for my baby.