You need to account for amps that do not have a common ground. It looks like you're only switching one speaker wire.
Also, in amps that do have a common ground, you want to keep your wires next to each other to prevent noise from cross-talk and ground loops.