I confirm the issue.
Charger NO BATTERY = 4.46V
Charger WITH BATTERY and the LED is flashing = 4.33V
Charger WITH BATTERY before turn off = 4.30V with several short peaks up to 4.50V during final 5-10 seconds, then turn off. The battery keeps 4.28V voltage that slowly reduces.
However, the battery is cold, it's just 1 degree Celsius higher than the environmental temperature (the device was open during the test and the battery was not discharged before the test, so it did not charge long). I don't think it will burn unless you change it with something that has no internal overcharge protection. Maybe it's a good idea to stop charging it at ~80% manually to prolong the battery life, but I understand that it is not convenient.
My guess is that it's not a design mistake. Most likely it's a marketing trick just to say in the reviews that their device works longer than the devices of the competitors, and no matter that the battery will die faster. The choice was made, the money was paid, that's the only thing that is important in the modern marketing

Besides, the trigger issues are not fixed in the latest firmware and I'm tired of waiting when they fix them. I've already started to look for another inexpensive multi-meter with tested firmware. ZEEWEII DSO2512G seems to have many good reviews, but some users noted that they probably changed some parts to cheaper ones in the last 1-2 years, and the modern devices have more noise than the devices that were initially produced under the same name. This is also a rather typical and disgusting Chinese marketing trick to sell absolutely different and cheaper hardware in the case and under the name of the hardware that was proved to be good some time ago.