What Does Brown/red Semen Indicate?

I have had surgery on my left testicle because of an athletic accident. It has been 4 days since the surgery and I seen my doctor and he said everything is healing fine. I did not ask him about masturbation. I tried to see if I could still do that but my semen was discolored brown almost red. I was concerned about that being blood. Should i be worried?