I get "unfortunately exchange services has stopped" a few days after setting up exchange email

On my Motorola Xoom running 4.0.3 I can set up an exchange email account and it will work for a day or so then it will give the "unfortunately exchange services has stopped" error after checking for new messages (takes a long time to check). I can re-create the account and it will re-download the emails and contacts but then it errors out again soon.