I would go with two smaller batteries in series for an amplifier. Why? Cheap boost converters are noisy and generally have modesr step response which is what an amplifier needs. Two smaller batteries would be the same weight or very close, very simple, and therefore reliable.
I did seriously consider this but discarded the idea given I already had a suitable battery (8400mAH) and charger. I had no other batteries (so purchase would have cost much more than the DC-DC converter).
As you mention a two battery solution with no DC-DC converter delivering equivalent watt hours will be weight competitive (ie 2 x 4200 batteries should weigh as much as 1 x 8400 mAH).
However if you have multiple applications where some times you only need one battery, and for that application it needs to be 8400 mAH then you'll end up with 3 batteries which takes up space at home and is a charging hassle (especially assuming the smart chargers are only good for charging one battery at a time).
Another possible complication with two batteries is in use - power draw from one battery will be much more than the other since one will be powering other parts of the gear other than the power amplifier. So they may need to be swapped in the field near the end of their charge.
Another benefit of 12 volt powered gear with its included DC-DC converter is easy use in a car (with 12v) and at home (if a high current 13.8v supply is available).