Hi SiBurning,
A great post with many items worth discussing; so I'll break my reply into multiple segments addressing each one, to make for easier reading.
I agree fully with your premise, but these studies require small labs to build standard test surfaces, and braze thermocouples to new test tips, so one need to sacrifice a new test tips. Brazing equipment isn't common, so its less likely many users can perform these test such as:
http://www.ipc.org/4.0_Knowledge/4.1_Standards/test/2.4.37.2.pdfYou can buy a test tip from Hakko, IIRC, that does this for you, but again it would only work for Hakko and compatible models.
A practical approach could be to first eliminate non-players, then among players, we can devise ways to find ok, better and best. Insure station meets minimum elements for electronics use by defining why such elements are needed and a simplest way to test for it.
In an older thread I posit that based on specifications made by IPC J-STD-001E for commercial requirements for soldering, any station that meets IPC standards is a minimum: for practical application it reduces wear on soldering tips and minimizes risk from heat damage to soldered components, if its used properly.
These IPC elements for stations are simply:
accuracy requirement of ±15°C (±27°F) [ i.e., dial setting vs thermocouple]
temperature stability of ± 5ºC (9ºF) [i.e., variations of tip temp]
In addition, there are the tip to ground resistance of <= 2 0hms and potential of no more than 2mV for the ESD safe models. Luckily one needn't think of these as most good stations meets these specs as 'standard issue'.
Users should know that an oft quoted stability of 1ºC for stations reflect just a IPC requirement of the station alone, not that of the iron. The above specs are for the whole station.
This is for the unloaded standard tip [ these are what are shipped from say the basic Hakko FX888 and are matched to the calibration settings].
https://www.eevblog.com/forum/index.php?topic=4208.msg56121#msg56121Among well known names like Oki, Weller, Hakko etc., one can have faith in the specs, but a simple tip thermometer can determine if the stations meet the criteria, even a well placed DMM thermocouple could work. In addition, a user suggested testing measurements with eutectic solder to insure the station readouts are true and confirm thermocouple readings; I also found a good IR thermometer helps correlate readings within 5
oC. These aren't ISO or IPC recommended test gear, but for home labs its practical and easy to do.
Its a good way to determine too whether the $20-30 you save buying a Quakko or Atten station isn't real money saved or great hidden value. If your station meets the requirements, then the next phase begins: who is better and why, and should you spend money for those better features?
I've done a few reviews of soldering stations elsewhere and always wished there were a template to follow--a repeatable, quantitative approach for those things that could be quantified, as well as a list of qualitative issues to be considered. Between the two, a more useful compare & contrast could be done by different people.