Broke mine last year, no surgery.
I did easy 30-45 minute endurance rides in a sling 3 weeks after breaking it. I put no weight on that arm and it was fairly easy to do that. Get a mesh arm sling that is made to use in the shower as it gets really sweaty in a normal sling.