I'm Having An Annoying Pain Vertical To My Belly Button

I'm having an annoying pain vertical to my belly button on my Right side, it comes and goes, not painful, but annoying, whenever i press on it, it seems to hurt a little ,but feels better when i release my fingers, when I lay down its fine. The pain comes and goes. What can it possible be, should I go to the ER immediately?