I don't think there's any chance of damage from operating an audio amplifier unloaded, but it's possible it might not work properly. Most modern class AB designs should be fine, but there could be problems with EMI on a class D amplifier, as the filter won't be optimised for operation without a load.