As noted above, bandwidth is an important parameter to answer your question.
As is DC offset.
A cheap op-amp, with 1 MHz unity-gain frequency, will then have 1 kHz bandwidth at gain 1000.
Also, that cheap op-amp may well have an initial DC offset voltage of 5 mV (referred to the input), so at gain 1000 the quiescent output will be 5 V DC.
Old textbooks go into the optimization for multiple stages, each of which is characterized by a gain-bandwidth product (normally equal to the unity-gain frequency for an unconditionally-stable op amp), to choose the appropriate number of stages and division of the required gain between them.
If you use multiple stages, and the amplifier is not to be used down to DC (e.g., an audio amplifier), then you can place coupling capacitors between stages to remove the DC offset.