You were right about bad connections, I connected circuit's input directly to battery terminals and now voltage drop is 140mV, I did keep two 220uF tantalums though, seem to make waveform smoother.
I have a silly question, sorry if it sound completely dumb, what causes voltage to drop, batterie's internal resistance or a load?