Is Stopping Celexa Abruptly Safe?

I started to take Celexa 10 mg 5 days ago. Last 2 nights I had really bad side effects like dry mouth,insomnia,sweating and stomach problems. I would like to stop Celexa and just take my Klonopin 0,5 mg twice a day. Can I stop Celexa since I just have taken it for 5 days or do I need to take smaller dose for few days? I do not have depression but GAD and mild panic attacks.