The leakage will be amplified by the circuit, but if the gain isn't too high you should be ok. I'd be more worried about the polarity of the cap matching the polarity of what's being measured. As long as you only measure positive or negative supplies, and have the cap installed accordingly it's ok, but one mistake...
Inverting circuits are also typically quite low impedance (100 ohms in your case) and will load whatever you're measuring. If the thing you're measuring isn't affected by an ac coupled 100 ohm load, great. I wouldn't take that as a given. People usually build a high impedance amplifier with a smaller cap value. That way you don't load the device under test, the cap can be a very high quality film cap, and leakage isn't an issue. In either case, you should also have protection on the input so excess voltage, transients and such don't damage the input stage of opamp.