not necessarely, you may have an imbalance on the output stage, the output stage is a push pull type
Ex: you may have a transistor / mosfet who drive / leak a little to a supply line, in the end you end up with a dc voltage on the output speaker and you may fry a speaker if a protection doesnt kick, or if its not equiped with this circuit.
The speaker terminal is a cross over between the positive and negative supply, it should read zero, or pretty near zero in the millivolts range. Only the ac signal IE: audio is amplified