In some cases also with DC but 99.9% of the time just AC signals.
I am ok to design it just for AC if it relaxes the constraints and/or makes it easier to match the two INA outputs to a higher degree.
In terms of frequency, up to at least 100KHz, preferably 250KHz.
You haven't stated exact levels, but if we assume you want to take 1mV and amplify it 1000X to 1V and want an error of less than 0.1mV on the output, that means 0.01%. A 0.01% error at 250kHz exceeds the specs of some pretty high-end DMMs even at the 1V level. It also corresponds to 100
nanovolts of input noise or error.
If you assume higher levels, 0.1mV implies an even lower error in percent, while lower levels and 1000X gain imply some pretty low input levels. I don't know what state-of-the-art capabilities would be for this type of application, but your goals seem pretty ambitious.
You mention what appears to be nulling the outputs, which makes things even harder than something like a DMM. Every error in each amp--input offset, output offset, input noise, frequency response, phase shift any nonlinearity and more that I can't think of offhand--will show up in the difference signal.