One thing not mentioned: when measuring battery voltage you should apply some load.
Example: I have three CR2032 batteries that have been used for CMOS and RTC backup in mainboards till they failed.
With a 10M ohm input resistance DMM they measure 2,9v, 2.7v and 2.2v respectively.
With a 3K ohm input resistance meter (resulting in 1mA load) they measure 0.0v, 0.0v and 1.4v respectively.