At first, sorry for the long delay, I was to busy and didn't get to look up the datasheets until now.
So... I guess I got what you are up to.
If I check the datasheet for my multimeters I can get the total precision I can get out of those.
For example my "main" Multimeter, the Metex M-3850D (branded Voltcraft but those are manufactured by Metex as I found out) it says for the volts range I am looking at:
Range...........Precision..........Resolution
400mV......+-0,3% +1dgt.......100µV
4V...................".................1mV
40V.................".................10mV
400V..............."..................100mV
1000V......+-0,5%+1dgt........1V
As far as it concerns the "reference-problem", we only look at the 4V and 40V ranges.
The datasheet says, at 4V there is a precision of +- 0,3% + 1dgt. So if I measure the assumed bang on 2.5000000000~ volts from the reference, there could be a reading somewhere between 2.500 +/- 0,076V -> 2.492 to 2.508.
At 5 volts it would have changed ranges to 40V, so the resolution is only 10mV, which means that it could show something between 4.85 to 5.15V. (That sounds like total crap o.o)
Put to a chart this would be like this:
For M-3850
VRef.....Min...........Max
2.5V....2.492V......2.508V
5V.......4.84V.......5.16V
7.5V....7,26V.......7.76V
10V.....9,69V.......10,31V
For VC655 (precision always +- 0,5%+1dgt, resolution as the other one...)
VRef.....Min...........Max
2.5V....2.374V......2.626V
5V.......4.74V.......5.26V
7.5V....7,12V.......7.88V
10V.....9,49V.......10,51V
So lets compare this to the AD584JH in standard configuration without any trimming or compensation at a fixed temperature.
Precision of AD584JH:
VRef........Tollerance........Min.............Max
2,5V...... +-7,5mV.......2,4925V......2,5075V
5V........ +-15mV.........4,985V.......5,015V
7.5V..... +-20mV..........7,48V........7,52V
10V...... +-30mV.........9,97V.........10,03V
If we correlate this now to the "better" of the two multimeters, the MD3850, we see, that the allowed tollerance of the AD584JH is much smaller than the deficit in precision of the multimeter. Which means, I should be able to build this thing up without thinking about any problems at all, as long as the measured reference voltages are within the precision range of the multimeters.
I should have considered the temperature drift of both the AD584JH and the multimeters, too, but as far as I don't have any device to measure more precise, this uncompensated, non temperature controlled device should do the work just fine!
Did I get it right?

And by the way, does anyone have a datasheet for the Gossen-Metravo 464 N? I would love to see the specs for that one, but couldn't find anything.