Does Taking Penicillin With Orange Juice Cause Indigestion?

I went to my local walk in health centre today and was diagnosed with tonsillitis. I was prescribed penicillin vk tablets not the usual plastic coated ones. I took them with orange juice instead of water just because it was handy and have had fierce indigestion ever since. Was it the orange juice or can the fact the tablets have no plastic coatings be to blame. I have taken some gaviscon and it has nearly gone bit I am afraid to take my next dose. Please advise.