On Raspi3, I have used /dev/serial0 reliably, I think the key was to set force_turbo in /boot/config.txt, which removes CPU frequency throttling, of course increasing power dissipation, but on Raspi3, this won't cause thermal issues unless you have a tight, closed box with very poor cooling.
Don't know how it's on Raspi4, though.