SMPS power supplies can be a bit unstable without load, that's why the resistor is there.
20.25V doesn't seem too far out of spec, i doubt your router needs exactly 19V but it might be some special router, i don't know.
If it didn't work before on 18V it was most probably because of the ripple due to failing caps.