I'd suggest using a small classic transformer to power your multimeter ... that meter will work fine with as little as 3-4v but will show low battery voltage at around 5.6v
Considering the meter uses a few mA to work, even a 1-2 VA transformer pcb mounted transformer would work
6-12v ac transformer > bridge rectifier > capacitor (something like 100uF 25/35v should be plenty) > a linear regulator (ex 7809 or 7805 or lm317) > capacitor
for example :
https://www.tme.eu/ro/en/details/bv302s12006/pcb-transformers/zettler/ or
https://www.tme.eu/ro/en/details/bv302s06006/pcb-transformers/zettler/with the 6v ac transformer you could even forget the regulator, a bridge rectifier followed by a capacitor would be plenty. 6v ac gets rectified to around 6 x 1.414 - 1.4v = ~7v give or take 1-2v at low load, and a capacitor would just smooth out the ac output.
edit: i read and assumed you meant a charger to power your meter for long duration measurements and that's why i recommended using classic transformer, to have the meter floating, isolated.
if meter runs on battery and has those issues, running on transformer most likely won't help.