Resistor tolerances, or you are out of the input common mode voltage range. What is the offset if you connect the inputs to your analogue ground, and what supply rails are you using for the OP07 and what is the value of the resistors you used for the divider.