Can Long-term Earplug Or Earbud Use Stretch Out (or Change

Can long-term earplug or earbud use stretch out (or change the shape of) my ear canal? I feel like large earplugs that used to cause pain after 30 minutes of use, no longer cause pain. I also feel that I need a larger size earbud (for music) to keep snug in my ear without falling out, when before the smallest size worked. Is this in my head or is this really happening?