I'm making a basic error here, I'm sure, but not sure what.
I was thinking about how to measure ripple from a linear PSU - obviously, as Dave pointed out in his video, the problem with doing this is watching out for common mode signals which aren't coming from the power supply under test.
I don't have a differential probe but I thought why not knock up a differential amplifier with an op-amp and try that. Thinking about it I decided to try the 3 op-amp "instrumentation amplifier" configuration. Partly because one advantage is just a single resistor adjustment to set the gain and partly because I haven't built one before.
This is the circuit - entirely standard.

and here is is on a breadboard

The left op-amp is used for the two buffers and the right for the difference amplifier. I used MC33072's because I had a few lying around. The 18k resistors are 1% metal film but hand picked for a group which are all 0.1% or better. The disadvantage of this configuration is that the CMRR is dependant on resistor matching which is why most of the time one would pick up a custom instrumentation amp IC rather than trying to build it from discreet components.
In fact it works fine, so far - adjusting the trim pot for a gain of 100 and feeding in a 10kHz sine wave from a sig gen shows no problems.

Channel 2 is the input signal at 10mV p-p and channel one the output at 1V p-p. Bandwidth could be better - about 100kHz - but I don't really need any more to look at 50Hz ripple. The lower (input) trace is a little noisy but that's the 'scope input amp.
Now as I want to look at a power supply I don't just want to reject common mode AC signals but the DC from the supply itself as well, so I need the amp to be AC coupled. I intended to modify the input as follows

I was going to use 1M resistors and 100n caps at the input. However as soon as I ground the non-inverting inputs of the two op-amps via a pair of 1Mh resistors I get an approx 20kHz square wave (with a lot of jitter) at the output as though the circuit were oscillating but I'm really not sure why.
"In theory there is no difference between theory and practice; in practice, there is"
- Yogi Berra (perhaps)