I use 600 ohm headphones and two op-amps - one for the reconstruction filter and an second as a line driver.
I had a chinese Lehmann headphone amplifier clone, and it was total junk. It sounded annoyingly distorted and I found the usual- fake op-amps, and reject transistors, bad PCB layout etc. I tried to fix it but the distortion was never as low as direct drive which is what I use.