I Just Pulled A Tooth That Was Actually Being Pushed

I just pulled a tooth that was actually being pushed outwards by my adult tooth. Now a little thing that looks like piece of gum isn’t hanging from the side almost and it looks like a layer of gum is gone from the side of my teeth row where my baby tooth was. It is not in very much pain at all and I have a tissue over it now to prevent bleeding. Should I be concerned?