What Causes A Patchy Area With Itching And Pain After Intercourse?

I had sex with my boyfriend of a year and a half with a condom and developed a patchy area where the condom had been. It was a little itchy and kind of painful. We have used different condoms before without this reaction. It seems to develop many hours after we have sex, usually around 10-12 hours. Could I be allergic to the latex itself or maybe the spermicide used?