Is Pain In Foot After An Injury A Matter Of Concern?

I dropped a wooden pallet on my foot a couple days ago. It weighs around 45 pounds. It hit the top of my foot and caused a lot of pain. I took it easy and the pain went down by the end of my shift. It still hurt yesterday but I can walk perfectly fine with no pain. Only when I touch the area does it hurt. I had swelling the night I dropped it on my foot but no bruising. Still hurts today but same as yesterday. Only hurts to touch it. I can move all my toes just fine and theres no pain when walking. Still no bruise and the swelling went almost completely away. Should I be worried?