That's it. Nothing is worse, and speakers don't have nearly enough Q at anywhere near low enough of a frequency for regeneration to be a problem.
But seeing speakers are a reactive load, they present a low power factor, if you will. They can suck current on one part of the cycle and return some of it later in the cycle. How low that power factor can get, I'm not sure.
That's what I said, the Q is low, like maybe 2 at the most. Well, piezo tweeters could be more, near or above resonance; but at low frequencies yeh, voice coil resistance is a dominant fraction of the total at any frequency. In other words:
but unless there is DC offset or a very asymmetric waveform it all evens out over a few cycles
...Like that.

Note that impedance generally goes as sqrt(f) due to skin effect (the steel pole the voice coil moves over, is a diffusion resistance at essentially any frequency of interest), and, the peak at f_s should be small, well matched in a properly designed speaker box.
I have a plot here, that I have no idea what it's from; evidently a fairly large woofer, probably 16 ohms nominal, probably in open air (hence the relatively high peak). If it's reasonable, then we can interpret it this way...

Note that, even as prominent as the peak looks, it's still only 3x baseline, or about as much Q.
Bizarrely, the seeming asymptote, isn't: notice the plot is semilog, so that's actually logarithmic impedance, not sqrt!
Tim