This is how I made my first power supplies some decades ago. Stability was everything, ensured by a "fat" output capacitor creating a dominant loop pole so low that any other time constants had no choice to make it unstable.
A side effect was a sort of "electronic Widlarization", especially for the higher voltage versions. If a test circuit misbehaved and decided to go low-ohmic for whatever reason, the output cap would just dump a few or even a few ten Joules into it, causing the culprit to enter the eternal electronic hunting grounds immediately. Smaller circuit would even evaporate leaving a clueless operator behind. Happened once with a 400V supply.