Have had a former rugby player as a coworker at some point. He told us it's even tougher than it seems.
The impact from falling is not the worst, from what told us once at a beer. During a fall, there still is plenty of time to react. The worst are those actions you don't have time to react. For example, he was telling how an action as simple as grabbing one's arm while running from opposite directions can have a tremendous impact. The initiator knows what action will perform next and prepares for it, while the other dude don't. The effect is that there is no time to react, the body turns from the momentum of grabbing, then suddenly stops. My understanding was that the effect of such a grab would be similar with that seen in the tip of a whip. He said he would prefer a hit in the face in a fist fight, rather than that shock that propagates through the entire body during an unforeseen grab at rugby.