I would first open it up and look at the circuit board and try to figure out what chip it uses, and see that chip's datasheet.
A lot of chips can function with a higher voltage range, like 2.5v ... 5.5v ... your 2 AAA batteries could give the multimeter anything between 2 x 1v (discharged rechargeable) to 2 x 1.65v = 3.3v (fresh alkaline ni-mh batteries)
some multimeters already contain a small voltage regulator which converts the battery input to a fixed 2.5v output or something similar, in which case you'd only have to check if that voltage regulator can handle 4-5v from your battery,
Anyway, if all the above fails, the easiest would be to use a fixed output voltage regulator set to 3.3v or 3v - you can easily find lots of them at stores like digikey, mouser, newark/farnell etc
Linear regulators would be the simplest, just the chip and a small ceramic capacitor on the output would be enough... but they will not be very efficient, because the difference between input voltage and output voltage is lost as heat. You can get 1-2$ step-down (buck) voltage regulators which will be more efficient.
Alternatively you could put several diodes in series with the batteries. For example, a simple 1n4001...1n4007 diode will cause a voltage drop of around 0.5v..0.8v so if you add two diodes in series with your 3.6..4.2v battery, you'll get 2v...3v just like you'd get with your 2 aaa batteries.
that extra battery power will be wasted in diodes as heat so just like linear regulators it wouldn't be efficient as a step-down regulator