Can Cast On Wrist After A Fracture Be Taken Out If Having Pain?

i badly fractured my wrist yesterday, i had to have a cast on and then have it manipulated into place, the cast has caused serious pain because my wrist seems to be in a unnatural position . What are the risks if i take it off for the night and get a new cast put on tomorrow?