How Long Are Casts Advised For Wrist Swelling?

I am from the U.S. I am on a church mission in Panama. for about 15 more months, I fell and broke my wrist. Because of swelling I had a temporary brace for about a week. I just got a cast on it and the doctor said I could get it off in less than 3 weeks. Do I need to keep it on longer?