They become very leaky, and start to short-out... this can cause slow to sudden power supply failure if used to de-couple pre-amp DC supply rails, normally they take out the DC supply resistors.
Other problems can be audio distortion, un-balancing of channels, low level sound, and intermittent crackling from channels, where Tantalum's are used in the signal processing.