Whoopsies. You are correct. It was 4am when I posted that and I have corrected the title. The other thread you linked to said that the caps were fake. Is there any definitive way of identifying fake caps?
Like you said, many compromises. I think this one should do me fine until I can pick up a Rigol or something similar. Old test gear is almost impossible to come by in my area and shipping things like that off eBay costs an arm and a leg. I don't do anything low voltage or sensitive and 99% of the things I do use have on board regulators that could handle the voltage if I inadvertently hit it with the line noise when powering it off. It's primary purpose is to prevent me having to look for power adapters or battery packs and I think it should be ok for that.
I would also be interested if anyone has any ideas on removing the noise from the line when its powered off.
An easy mistake to make. I am very, rare in that I never, ever make any m1shtraks,
A picture is worth a thousand words, your capacitors look a tiny bit like these...
(Please see bottom of post, if picture missing).

I think the first step to improving/reducing the switch off line noise, is to try and obtain schematics for your power supply. Or someone may have reverse engineered the circuit somewhere on the net, for you. Then it is much easier to work out, how to fix that glitch.
But I'm glad that your current usage is little affected, by that glitch/bug.
Somehow, buying bench power supplies is much more exciting than many other things.
E.g. Small solder fumes bench boxes.
I know which I would prefer to research buying. Clue: It does NOT make whirring sounds when you switch it on, and does not have a large black (carbon replaceable) foam pad in it.