At higher power level a SMPS is not more efficient than a transformer. There is some advantage with regulating the voltage, but the difference is not very large.
At low power (like < 5 W) a SMPS can be more efficient, but at higher power the difference is not large anymore. It is there more a cost advantage.
The problem is the class A amplifier. The allways <50% and normally worse is hiding the real evil: the problem is that a class A amplifier has a high power consumption even when low output power is needed and for audio this is the normal case nearly all the time. The point to compare is more the idle power, not the best case efficiency.
For a comparable power level a class A amplifier may draw 100 W , a class AB more like 10 W and a class D maybe 5 W.