I've seen too many capacitors from the 1980s & early 1990s with failed seals, that leak corrosive & conductive electrolyte over boards, for me to leave them in place. Sometimes it's not obvious there is capacitor pee until the cap is removed.
Some PSU failures caused by this, then go on to cause major damage elsewhere.
Brands that I've seen leak include; Philips, Panasonic, Nichicon, Rubycon, Chemicon, and Sprague.
Last week we had a failure of critical equipment at work, with strange fault codes & random shutdown, a Matsushita/Panasonic cap was responsible, the capacitor pee had even found it's way through a filled via to the other side of the PCB, the equipment in question dates from 1994.
Going too small in physical size for replacements can lead to SMPS caps, with high ripple running hotter than the old ones, in extreme cases they vent, yes we had this happen at work when bean-counters choose the replacements.
Of course there are different cap technologies, that can be smaller & have lower ESR, but they come with their own failure modes.
David