What Causes Ear Pain And Fever After Swimming?

we went swimming over the weekend now since monday my 7 yr old little boy has been complaining of both ears hurting. He started running an oral temp of 101f. I have tried otc earache relief, otc swimmers ear relief and otc children's motrin. What should I do now? When should I get him to the Dr.'s ?