What is the output impedance of your source?
Gain + level shifting is trivial to achieve with a single inverting op-amp and three resistors but the input impedance will be set by your input resistor and should be large relative to the sensor to avoid voltage divider errors. A big advantage of this is that the op-amp inputs are always close to the virtual earth, so you can easily tie a +/- 2 volt sensor input to a 0-5 V rail-to-rail op-amp.
Input bias current is important for very high impedance circuits. In a non-inverting op-amp circuit, the bias current from the positive input must pass through the sensor, which is a problem with capacitive sensors -- they require a resistor in parallel to the sensor, which causes an RC high-pass filter and a DC offset. The lower bias current the bigger the resistor you can use. For both styles of op-amp, the bias current from the inverting input flows through the gain network causing an offset voltage, but only very rarely is this less than the amplifiers voltage offset.
++ on power switching the op-amp. If you get a 5V rail-to-rail op amp you can probably power it directly from a digital output pin on your AVR. With a 100 Hz bandwidth you don't need to sample any faster than 1 kHz, and an ADC conversion can probably be completed in 10 uS -- if the op-amp is only on 1% of the time you hardly need a low power device. The only thing to watch out for is SCR latchup if you leave the sensor powered up all the time -- when the op-amp is off, feedback will no longer keep the input voltage at ground, and some current will flow through the input protection diodes. Check the op-amp specs and pick an input resistor that limits the current to a safe value. This is a good idea anyway as it reduces the current consumption.
Is it possible to run the sensor on 0/+5 volt instead of +/- 5? If so, you might be able to power switch the sensor as well.