What Can Be The Effect Of Plastic Taste In Drinking Water?

I just recently moved into my new house and the refrigerator has a water dispenser on it. When I first tasted the water it was horrible so I went out and bout a filter and had it installed. Today I tried the water and I think it tasted like plastic may be in it. Could this be harmful to my stomach or body?