Most simple, yet most annoying injury you can do.
I fractured my scaphoid (right, through the waist, non-displaced) in April (easter weekend) and the cast came off nearly 9 weeks later (mid June). I then wore a cycling brace full-time because one doctor told me I should of been in a cast for another month, and another told me I should start moving it. My solution? A happy medium.
http://www.chainreactioncycles.com/Models.aspx?ModelID=59946
No direct scaphoid support (ie, thumb), but my pain was all in the flex of the wrist - which is how I broke it, landing on it.
Day to day tasks are OK now, so is riding. But pushups are still really painful, and some twisting motions cause me discomfort like opening a jar of pasta sauce etc.
I rested mine like a champ, and I don't think I will have any long term issues. Read the above post. You need to do the same. Just accept the fact that you won't be riding for a while, and man up and keep it in the cast as long as possible, and be patient with it. Because it has limited bloodflow, and more or less dictates the blood flow into the thumb, you really don't want problems with it later on. There is the potential for half the bone to literally die if you dont rest it. Just spend 30 mins reading off a google search to see the gravity of it.
It was the first bone I ever broke, and from what I read, one of the worst. Cleanly breaking your arm in three places is not as high risk long term as a hairline fracture of the little scaphoid (***not a medical practitioner)