My mantra is that a power supply should always protect its load.
And as Martin72 points out, that sensitive circuits should also already have protection themselves.
But the world is full of bean counters, so....
Then it still comes down to the users, this to know your equipment well and handle it with care.
If you have a Spectrum or an expensive VNA, when you make an initial measurement, there is always an attenuator on your input!
And if your noise floor is not that important, then leave that attenuator in place.
When developing electronics, I still regularly unplug banana sockets.
If I am testing something in the early stages of development, there is not always protection in place.
The world is not perfect, I certainly am not!
With kind regards,
Bram