How To Get Rid Of Acne?

I had a break out of acne on one spot of my face and used a benzoyl peroxide medication on it. However, now my skin is really irritated. It is red, raised, and slightly painful. I stopped using the acne medication and am moisturizing and drinking water. Is there anything else I can do to help my skin heal?