This topic actually comes at an opportune moment, as I've been working on something similar.
Now for the questions: Are there downsides to using regular opamps like the NE5532 to drive headphones directly? I can't find a definitive number on the current source capability of the NE5532. The short circuit current is given 38mA typical. But I don't know if that tells me anything.
If I use a dual supply and my signals are referenced to the supply ground, do I really need input and output caps? (Ultimately I want this amp at the end of the signal chain in a more complex audio device.) Input caps, I could propably use to make the amp more versatile when used with different sources. But if I kill any DC at the input, why would I need an output cap?
I've assembled this circuit:
http://www.paia.com/proddetail.asp?prod=9206KP (
direct PDF to schematics). It is a minimalist design that does not use any caps outside of the power supply, and as far as I can tell, it works fine, at least with the low-impedance headphones I've tested it with (Sennheiser HD555, Audio-Technica ATH-M50x, Beats Studio [don't hate, I got them cheap for airline travel

], and various ordinary iPhone earbuds) and also as an output to go to amplified desktop computer speakers. Mind you, I've not done any kind of scientific analysis, just "sanity testing" to see if I can hear any obvious problems. As far as my ears can tell after many hours of listening, it's totally transparent.
It definitely cannot drive anywhere near as much current as the Tascam MH-40 Mk II studio headphone amp I've got, but the Tascam inserts quite a bit of noise, whereas I cannot detect the NE5532 adding any at all. (And the Tascam uses lots of power and thus dissipates lots of heat, which I'd like to eliminate.) I'd say that as a sort of rule of thumb, the NE5532 can drive stuff similar to what an iPhone can drive.
A headphone presents at least some inductive load. With the NE5532 amp, do I need a Zobel-network to prevent oscillation aswell?
None of the several NE5532-based headphone amp circuits I looked at appear to use one, so I'm gonna say it's not necessary. The main differences between circuits are:
- one or two NE5532's per channel
- caps or not
- power supply configuration
Anyway, the pix show a single amp block (and the power supply on a separate board), and then a 5 amp unit (with power supply on same board). These work great on 12V DC that's then split up to ±6V with a virtual ground. To my surprise it also runs perfectly on a 9V battery. And yes, that's an LED crimped to a female dupont plug for testing. :p
The NE5532 tech specs recommend using 100nF bypass caps on the power rails, but since I didn't have any with 0.1" lead spacing on hand, I haven't installed any yet and haven't noticed any problems. I'll probably add them for good measure once I have small ones to do it with.
Anyhow, if anyone has any comments or suggestions (or questions if you want me to test something), let me know!