The input capacitor could be replaced with 100n film, and be 3dB down at 16Hz. 220n gives 7Hz. But replacing it for a "posh" low-ESR or film type will make no obvious difference - suppose the original has an ESR of 10 ohms; as it works into 100k, the loss will be 0.00087dB. Doubt you'd measure that, let alone hear it.
We can't give any advice about the output capacitor without knowing the impedance this circuit has to drive.
If you bias the op-amp away from ground, you will reduce the maximum available voltage swing - never a good plan. Nothing is reverse-biased to any extent*, as the capacitors will always have 0V across them, whatever the input audio signal is doing.
* The input bias currents will multiply by 100k, so there will be a non-zero potential at the inputs (and hence output), but it'll be millivolts. The polarity depends on whether the input stage is NPN or PNP. For example, an NE5532 in that position would have something in the -20mV region at the inputs and output. That won't trouble the caps...
Replacing the opamp with an NE5532 would lower the distortion, but it takes about 2mA more than the 4558 (probably not an issue). But while the change might be measurable with the right gear, you'd never be able to identify it in a controlled ABX test scenario with any statistical validity. The audibility of (correctly implemented) op-amps is massively over-stated, to say the least.
Be aware that some op-amps will need more attention to power supply decoupling. And not all are unity-gain stable.
In short, leave it alone. If you want to learn about audio electronics, design something yourself; it's easy, and there is plenty of help out there. Learn to filter out the nonsense - of which there is plenty. Rod Elliot's site is an excellent place to start. Then progress to Douglas Self's writings.