What Causes White Spot On Enlarged Tonsil?

I am a 31 yo male, who has unilateral tonsillar enlargement. The enlarged tonsil has a large white spot that does not go away. It causes intermittent pain when swallowing. Should I be concerned? I have no fever, chills, in fact, I am asymptomatic in every other way.