Why Do I Notice A Small Bump On The Side Of The Throat On Yawning ?

Occasionally, when I yawn, I notice a small bump on the left side of my throat , about halfway in between my adam s apple and the bottom of my jaw that appears. If I don t push it back to it s correct spot before closing my mouth I will experience a sharp pain. When I do push it back it is mildly uncomfortable, but not really painful at all. I m 26, and I smoke and drink moderately. I experience very few headaches, maybe one or two per year.