... cross compiling still is a world of pain. The platforms available have so much processing power and memory that you can compile on the target itself.
Indeed, although it's perfectly possible to get a cross compiling environment up and going, it's an awful lot of noise and effort when you could be being productive compiling directly on a board. In that respect alone for example, the RPi 2 is so much better than the original version because native compiling is so fast now. The cross compiling for the RPi at the best of times was a continually changing environment, making it even harder. The Beaglebone seemed to me to be far more mature in that respect.
I do like your description, "a world of pain", pretty much sums it up: unless you live and breathe this sort of thing at this level, almost certainly better to take a prebaked distro and compile natively.