Max output voltage of a few V RMS should be "enough for everyone™", unless you use crazy stuff like AKG K1000 or Hiifman HE6.
1.7V RMS may be enough for many uses too. Check if your headphones are listed on this site and check "power output for 90dB SPL" for reference.
https://www.innerfidelity.com/headphone-measurementsBTW, 3x more voltage is only 10dB more SPL.
RC4580 seems to be a clone of NJM4580, those are often used on outputs of audio gear, should be OK.
The 10Ω resistor will help against oscillation but it may affect frequency response because it sets output impedance to 10Ω. You may consider lowering it for specmanship or changing it to get whatever "sound" you want (if the effect is noticeable with the HPs you use) but check for oscillation by connecting capacitors like 10pF/100pF/1nF/10nF or pieces of unterminated cable before you plug in anything valuable.
DC offset may be produced by the source and some also exists in the opamp. The sum of these two is amplified by the gain (2x as of now). A few mV isn't going to damage anything. You are basically building a "CMOY" amplifier and AFAIK people typically build them without capacitors.
However, make sure that your power supply can never supply only one rail. When one rail is shut down and the input is shorted to ground, the output may be driven hard to the remaining rail.
15V is probably higher than you need and may be a problem with low impedance loads which draw a lot of current but little voltage, meaning that almost all power from those 15V is dissipated in the opamp.
I see no problem using 470Ω for feedback. That's 1kΩ load in addition to the headphone, makes little difference.
Inverting configuration will have somewhat less distortion for the price of 3dB more noise (at higher gains the noise difference is even smaller). Those are quiet opamps and feedback resistance is low, noise is unlikely to be audible in headphones so going inverting may be worthwhile. My soundcard uses inverting NJM4580 on the outputs.