This would imply that the power supply and on board voltage regulator are to blame for the noise and outputs being out of spec.
I did try powering the Rev3 board with a battery but there was still noise created by the regulator.
Are you shure that the voltage regulator is not oscillating?
That what you describe is not the normal behavior.
Even with battery you may want to use a voltage regulator to stabilize the input voltage of the VREF because of the limited PSRR of the reference.
The noise at the output of the (battery supplied) regulator is well below 1 mV pp. The VREF will dampen the noise by at least a factor of 1000. So there should be no measurable noise at the output in this configuration.
On the other side: I usually use low noise (low drop) voltage regulators like the LT1763.
With best regards
Andreas