Author Topic: Local calibration labs  (Read 10293 times)

0 Members and 1 Guest are viewing this topic.

Offline Conrad HoffmanTopic starter

  • Super Contributor
  • ***
  • Posts: 1930
  • Country: us
    • The Messy Basement
Local calibration labs
« on: May 17, 2017, 03:42:04 pm »
We have a few local labs and I was looking at their "certificate & scope" documents. They're all about the same, using the same equipment. Unless I'm missing something, they're  not very good in terms of voltnut requirements. Heck, I think I can do better with the antiques in my basement! This is typical- am I missing something here?
 

Offline try

  • Regular Contributor
  • *
  • Posts: 112
  • Country: de
  • Metrology from waste
Re: Local calibration labs
« Reply #1 on: May 17, 2017, 04:23:41 pm »
Hi Conrad,

First of all, I'd like to thank you for your making your metrology mini lab article series available!

It could be that you are missing something there.

When checking calibration certifications on file the Elmtec company nearby (Germany) states two different figures.
 Their certification distinguishes between dc measurement devices >0,33V <=33V with 22ppm and dc sources between 0,2V and 20V with 6ppm.

Does your lab show similar differences or is there just one entry on file for the range in question?

Elmtec is not an extraordinary lab.

Fluke Germany, p.e. has a certificate entry for voltage references showing 0.2ppm for a 10V reference. This is probably the best you can get here. The only disadvantage with that annoying company is that they even refused to quote me a price for a self-built reference.

I doubt that you can do better just with the 731 models you own...

Regards
try











« Last Edit: May 17, 2017, 04:26:25 pm by try »
 

Offline ManateeMafia

  • Frequent Contributor
  • **
  • Posts: 730
  • Country: us
Re: Local calibration labs
« Reply #2 on: May 17, 2017, 04:29:49 pm »
For 10V DC transfers, there is usually another entry in the Scope of Accreditation. I usually look for a Fluke 732A/B entry as the standard used. If they don't have that entry, chances are they can't support it.

For the resistance, I use a lab in Pittsburg that has good pricing for standard resistors. This was recommended to me by Edwin Pettis.
 

Offline MisterDiodes

  • Frequent Contributor
  • **
  • Posts: 457
  • Country: us
Re: Local calibration labs
« Reply #3 on: May 17, 2017, 04:35:37 pm »
Correct: A lot of labs aren't setup to calibrate other "high accuracy" equipment.  You really need to talk to the lab manager at your local facility:  Trying to calibrate a 3458a blindly another 3458a + opt 002 is not doing much good especially if that 002 option unit is more than a few years old and not maintained at Loveland, CO.  At that point its golden LTZ Vref has morphed into any other 3458a Vref and the "002 option" is just more expensive voodoo fluff.  If possible, to maintain a 3458a it's just better to buy a 5 yr contract at Loveland, and then they take care of everything when you send in your 3458a for cal (batteries, adj. etc.) And all under warranty.  When you look at final cost, that's really the best value.  Even with shipping (or take a vacation in Colorado if you drive your stuff in yourself).  IF you make a living with your equipment, you don't complain about the maintenance charges.  There is no such thing as "zero drift" in the PPM world.

A real lab will have access to much more than just a 3458a - there will be at least one loaded 734 rack involved with routinely cal'd 732's on board to maintain a good volt.  Or the facility will have a JJA available that's ref'd to NIST, like at Fluke or Boeing in Washington state, two facilities that are local to the Pacific Northwest in USA.

Some well equipped labs are now able to use a "shippable" JJA that goes back and forth to NIST, but you have to check.  That's another option.

If you have your equipment calibrated at one of the cheaper "chain" labs, you're basically just buying paperwork and stickers.  Which is fine for a lot of companies who don't really care about absolute accuracy, they just want that sticker on the front of their equipment to pass an ISO 900x audit (usually).  That's sort of why the cheaper chain labs exist (TransCal, etc.).  A few of those labs are better equipped, but you have to call and talk to them directly.

A lot of times all someone really wants is that magical sticker and cal certificate, and they have no idea to what uncertainty and confidence the equipment was "calibrated" against. 

Do it right and have your equipment cal'd at a real lab. It probably won't be the cheapest, but you get what you pay for.



« Last Edit: May 17, 2017, 04:41:58 pm by MisterDiodes »
 
The following users thanked this post: dr.diesel, martinr33, 2N3055

Offline try

  • Regular Contributor
  • *
  • Posts: 112
  • Country: de
  • Metrology from waste
Re: Local calibration labs
« Reply #4 on: May 17, 2017, 04:42:22 pm »
Hi MisterDiodes,

I had sent you a personal question months ago regarding your LTZ1000 experience.
Would you mind looking at it?

January 16, 2017, 11:26:07 AM    "jumpy" LTZ1000    MisterDiodes

Regards
try
 

Offline CalMachine

  • Frequent Contributor
  • **
  • Posts: 477
  • Country: us
  • Metrology Nut
Re: Local calibration labs
« Reply #5 on: May 17, 2017, 05:02:22 pm »
Here is ENI Labs scope.  Bear in mind these uncertainties are old and haven't been improved recently.  They will be reduced significantly here in the next year or two, as I've been overhauling our DC/low frequency program.

https://www.a2la.org/scopepdf/2147-01.pdf


If you have your equipment calibrated at one of the cheaper "chain" labs, you're basically just buying paperwork and stickers.  Which is fine for a lot of companies who don't really care about absolute accuracy, they just want that sticker on the front of their equipment to pass an ISO 900x audit (usually).  That's sort of why the cheaper chain labs exist (TransCal, etc.).  A few of those labs are better equipped, but you have to call and talk to them directly.

A lot of times all someone really wants is that magical sticker and cal certificate, and they have no idea to what uncertainty and confidence the equipment was "calibrated" against. 

Soooooo much this!  Being in the cal industry, many labs are sticker machines, and some even purposefully fail items because they can charge more for them.  I could go on and on about the cal industry, but it's probably not smart for me to do so  :scared:  Most end customers have no clue what they really need or why they need it.  They just know that they need an accredited cal because their quality policy says so.  It's a little frightening how little some people know quality, in the quality field.  And these are people employed and some big name corporations.


Do it right and have your equipment cal'd at a real lab. It probably won't be the cheapest, but you get what you pay for.

Unfortunately, sometimes even the 'Big Names' will give a suspect cal on an item.
« Last Edit: May 18, 2017, 01:14:22 am by CalMachine »
All your volts are belong to me
 
The following users thanked this post: Conrad Hoffman, dr.diesel, MisterDiodes, bitseeker, martinr33, 2N3055

Offline Conrad HoffmanTopic starter

  • Super Contributor
  • ***
  • Posts: 1930
  • Country: us
    • The Messy Basement
Re: Local calibration labs
« Reply #6 on: May 17, 2017, 05:14:36 pm »
Nowhere in the equipment lists for the local labs did I see any reference to a trio of voltage standards, IMO the minimum requirement if you want to maintain the volt. Their calibrators aren't even close to the latest and greatest. My guess is the above is correct- everybody wants to pass their audits but they don't really need great absolute accuracy. It's all about stickers and paperwork.

Way back (1996!) when I did the MML articles, the local lab had me wait until right after their equipment came back from Fluke so everything was "fresh". They also had in-house standards. Alas, that guy retired and the lab is long gone.

CalMachine- good stuff, you cover a lot more area then the local labs.
« Last Edit: May 17, 2017, 05:18:29 pm by Conrad Hoffman »
 

Offline Vgkid

  • Super Contributor
  • ***
  • Posts: 2710
  • Country: us
Re: Local calibration labs
« Reply #7 on: May 17, 2017, 05:43:53 pm »
Here is IET Labs
https://www.a2la.org/scopepdf/2073-01.pdf
The best local lab, I wish these places would hire people. I would like to give it a try  :-\
https://www.a2la.org/scopepdf/2171-01.pdf
If you own any North Hills Electronics gear, message me. L&N Fan
 

Offline Cerebus

  • Super Contributor
  • ***
  • Posts: 10576
  • Country: gb
Re: Local calibration labs
« Reply #8 on: May 17, 2017, 05:47:12 pm »
For 10V DC transfers, there is usually another entry in the Scope of Accreditation. I usually look for a Fluke 732A/B entry as the standard used. If they don't have that entry, chances are they can't support it.

For the resistance, I use a lab in Pittsburg that has good pricing for standard resistors. This was recommended to me by Edwin Pettis.

In UKAS accreditations, they show different sections for sourcing and measuring voltage/resistance/whatever. My local-ish lab has an accreditation that shows an expanded (k=2) uncertainty for sourcing 10V DC at 0.80 ppm, sourcing 1.1 to 11V DC at 2.4 ppm + 20 uV and measuring 100mV to 100V DC as 20 ppm expanded uncertainty.
Anybody got a syringe I can use to squeeze the magic smoke back into this?
 

Offline Edwin G. Pettis

  • Frequent Contributor
  • **
  • Posts: 451
  • Country: us
  • The plural of anecdote is not data.
Re: Local calibration labs
« Reply #9 on: May 17, 2017, 05:54:26 pm »
I do not know of any high level calibration labs that will calibrate a 'private' voltage standard, they just will not do any 'privately' made equipment.  Even if you 'know' somebody at the lab it is unlikely they will do it.  You may be able to get a secondary lab to calibrate your 'private' standard, you'll have to contact the lab and talk to them about it.  If you are just looking to get an accurate reading of your 'standard', you might be able to find somebody with a recently cal'd 3458A and get them to give you a reading but of course that will still limit the accuracy and uncertainty of your unit.  The options available to get your LTZ checked to capability is very limited for a private individual.

At any rate, the 3458A, as good as it is, is not a voltage standard by definition, it is a DVM, it can be used as a short term transfer standard as long as it is in calibration and certified.  The only voltage standard, short of a JJA is 732s/734 A/B which can be used to calibrate and certify 'working' voltage standards and DVMs of high accuracy.  At around $1,400 per 732B for certification per year, you're looking at a pretty high cost to maintain a voltage standard (absolute minimum of three 732Bs which are rotated for calibration, usually four is the prescribed minimum).  You absolutely cannot use a 3458A to 'certify' a LTZ Vref, you can use it to get an accuracy to a few PPM and an uncertainty of maybe 1 or 2 PPM but you're not going to get 1 PPM in any way, shape or form.  You can't even get a guaranteed accuracy drift reading over a year's time, you're only comparing one LTZ's drift against another.

 
The following users thanked this post: lowimpedance, try, MisterDiodes, martinr33, 2N3055

Offline try

  • Regular Contributor
  • *
  • Posts: 112
  • Country: de
  • Metrology from waste
Re: Local calibration labs
« Reply #10 on: May 17, 2017, 09:56:15 pm »
For 10V DC transfers, there is usually another entry in the Scope of Accreditation. I usually look for a Fluke 732A/B entry as the standard used. If they don't have that entry, chances are they can't support it.

For the resistance, I use a lab in Pittsburg that has good pricing for standard resistors. This was recommended to me by Edwin Pettis.

I have never seen any reference to equipment used in the certification documents.
Could you show me a link for a certification document with an Fluke 732A/B entry?
 

Offline CalMachine

  • Frequent Contributor
  • **
  • Posts: 477
  • Country: us
  • Metrology Nut
Re: Local calibration labs
« Reply #11 on: May 17, 2017, 10:21:42 pm »
For 10V DC transfers, there is usually another entry in the Scope of Accreditation. I usually look for a Fluke 732A/B entry as the standard used. If they don't have that entry, chances are they can't support it.

For the resistance, I use a lab in Pittsburg that has good pricing for standard resistors. This was recommended to me by Edwin Pettis.

I have never seen any reference to equipment used in the certification documents.
Could you show me a link for a certification document with an Fluke 732A/B entry?

For every 17025 accredited cal there will be standards used and the date on which they were cal'd last.  And I can tell you for a fact, there have been many accredited certifications handed out in the industry with a Fluke 732B listed as a standard.  I have performed many cals, myself, using our Fluke 732B.   

If you happen to get a crappy NIST-traceable cal?  Sure... there might not be standards listed.
« Last Edit: May 17, 2017, 10:23:43 pm by CalMachine »
All your volts are belong to me
 

Offline MisterDiodes

  • Frequent Contributor
  • **
  • Posts: 457
  • Country: us
Re: Local calibration labs
« Reply #12 on: May 17, 2017, 10:31:10 pm »
The only real lab I know of that would do an accurate measure of a DIY box is Boeing  - IF they inspect your device and determine it is well-built zener reference they will measure for you at around $800 a pop.  No adjustments, just a measure against several 732's that are ref'd to the JJA down the hall.  They will have openings a few times a year on their measurement scanner rack, on a first-come, first served basis.  They will not measure DMM's or anything other than a good zener reference to make sure they aren't wasting anyone's time.  You get a small amount of shelf space, a small amount of power is supplied on a mains supply; they will plug it in and let it stabilize for a day or two and then take some measures over 18 or 24 hrs or so.  You get your device back with a printout.  That's it.  The will certify the measurement to NIST standard, but not the device itself.  If you want accurate drift data you keep sending your device in after a few months (or whatever time frame) and pay each time.  Knock yourself out.

If you have a Fluke box, send it to Fluke for Cal.  They will at least do an adjust for you (if you pay for that).

There might be a few others but usually labs aren't going to bother with hobbyist boards - that's not going to be a good profit center for the lab.  You can always call the lab direct though and find out.  I know there are a few labs on the west coast that would measure a hobby board, but you wouldn't trust the result too much if you're after true absolute voltage values.

If you're in it as a business, you probably won't be trying to characterize a self-built-in-the-garage reference anyway.

If you're going to be in PPM world, it's far better to acquire your own 732's, null meters, KVD's and maybe some 3458's or similar, and keep those in a working, cozy warm, cal'd condition.  And then measure your own self-built references to your own freshly cal'd equipment, in your own lab.  As pointed out countless times:  You need multiple voltage references to measure against even to get to accurate low PPM absolute measures - at least 3 references to get down in the 2 or 3ppm range usually, if not more.  More sources and measurement techniques lowers uncertainty and raises confidence.

If a lab says they just have a 3458a as their only Vref, look elsewhere if you really want true absolute accuracy.  That instrument is -not- a long-term voltage standard.
 
The following users thanked this post: lowimpedance, dr.diesel, try, 2N3055

Offline ManateeMafia

  • Frequent Contributor
  • **
  • Posts: 730
  • Country: us
Re: Local calibration labs
« Reply #13 on: May 17, 2017, 10:41:59 pm »
Here is Keithley's PSL.   https://www.a2la.org/scopepdf/2462-01.pdf


 
The following users thanked this post: try

Offline 0.01C

  • Regular Contributor
  • *
  • Posts: 91
  • Country: hk
Re: Local calibration labs
« Reply #14 on: May 17, 2017, 11:58:44 pm »
Here is ENI Labs scope.  Bear in mind these uncertainties are old and haven't been improved recently.  They will be reduced significantly here in the next year or two, as I've been overhauling our DC/low frequency program.

https://www.a2la.org/scopepdf/2147-01.pdf



The ENI Lab can cal.  1k-10k standard at +-1.7mOhm..... use calibrator and dmm only?
« Last Edit: May 18, 2017, 12:23:03 am by 0.01C »
0.01℃
 

Offline CalMachine

  • Frequent Contributor
  • **
  • Posts: 477
  • Country: us
  • Metrology Nut
Re: Local calibration labs
« Reply #15 on: May 18, 2017, 12:41:30 am »
The ENI Lab can cal.  1k-10k standard at +-1.7mOhm..... use calibrator and dmm only?


Up to 10K, yes.  The DMM is used as a transfer from the calibrator.  At 10k, you would drop down to the 0.017 Ohm uncertainty.  Our scope is fairly weird and it will be more intuitive in the future, once I am the one in charge of our uncertainty budget.  Most of these were written/set up and done before I started working @ ENI.
All your volts are belong to me
 

Online doktor pyta

  • Frequent Contributor
  • **
  • Posts: 488
  • Country: pl
Re: Local calibration labs
« Reply #16 on: September 10, 2017, 10:12:52 am »
Maybe slightly off-topic, but I need help from colleagues located in the U.S.

Could You please reccomend a calibration lab in Minnesota capable of calibrating standard capacitors (with proper certificate)?
Lowest value is 1 fF (one femtofarad) with uncertainty of +/-(0.01%+0.03fF) or better.
I could use google off course - but it's better to have someone's recommendation.

Thanks !

Offline thermistor-guy

  • Frequent Contributor
  • **
  • Posts: 372
  • Country: au
Re: Local calibration labs
« Reply #17 on: September 11, 2017, 02:43:01 am »
I do not know of any high level calibration labs that will calibrate a 'private' voltage standard, they just will not do any 'privately' made equipment.  Even if you 'know' somebody at the lab it is unlikely they will do it.  You may be able to get a secondary lab to calibrate your 'private' standard, you'll have to contact the lab and talk to them about it..."

Several years ago I was looking at forming a test equipment startup, with a focus on temperature measurement to near primary-level uncertainties. I asked the Australian primary calibration lab, NMI (formerly CSIRO) at Lindfield NSW, to give me a tour and discuss if/how they could help me. NMI showed me their primary PRTs, temperature baths, black body references and so on. Very educational.

NMI was willing to test my company's prototypes. Most of the expense of the testing was in the report writing and checking. If I wanted just the measurement data, without an official NMI report, it would cost me much less.

I didn't go ahead with the start-up, but as it turns out, I have returned to that area of technology. If I talk to NMI again re prototype testing against its standards, I'll post an update on a suitable thread here.
 

Offline Moon Winx

  • Regular Contributor
  • *
  • Posts: 83
  • Country: us
Re: Local calibration labs
« Reply #18 on: September 11, 2017, 03:06:01 am »
As far as accredited measurements go, keep in mind that the values listed in these documents that are linked in this thread are for the lab's best measurement uncertainty, not the measurement uncertainty you would be receiving on your device. As an example, we are accredited for a 42 nV uncertainty in the 10 V DC voltage measurement parameter, but it would be rare if we turned out a device with a reported measurement uncertainty of 42 nV. Probably somewhere close to that, but uncertainties listed in these accreditation documents usually are based on an exceptionally good test unit and most customer items, even of the same model, don't match the performance of the device used for the analysis.
 

Offline Theboel

  • Frequent Contributor
  • **
  • Posts: 278
  • Country: id
Re: Local calibration labs
« Reply #19 on: September 11, 2017, 03:24:27 am »
I deal with 2 NMI lab in south east asia region and they are very helpful even when I asked them for a special task for my DIY voltage reference.   
 

Offline martinr33

  • Frequent Contributor
  • **
  • Posts: 363
  • Country: us
Re: Local calibration labs
« Reply #20 on: September 11, 2017, 06:23:18 am »
In thinking about the thread, it seems that we have three levels of calibration out there, something like this (and please do edit my numbers!). I'm sort of thinking publicly accessible when I do these numbers. Using Government numbers could double them? Triple them?

Type               Access      Uncertainty             Metrology Use
Josephson           10         0.2 microvolt          Calibrate reference devices eg 732. Not very accessible. I assume that all the tech governments have one of these including China, Japan, Taiwan and a few others in the G7.
Many 732           30         1 microvolt             Microvolt calibration of other 732; metrology grade 8.5 digit calibration. Top cal labs, government labs, some research universities.
Single 732         200        2 microvolt             Short term metrology grade calibration of 8.5 digit DMM (i.e. like a many 732 cal 6 months later...)
Fluke calibrator   800        20 microvolt           Calibration for 6.5 and 7.5 meters. If not under contract, the 7.5 is very doubtful.

For most activity, the lowest grade of calibration is fine. And, although your 6.5 digit meter can be calibrated to a couple of digits in the last place, it is actually allowed something like +/-20 counts - which is +/- 200uV. I have a couple of current cal 6.5s   that look to me to be 120uV off. That's within spec, of course.

I'd figure our 8.5 digit voltnuts  to be headed to the 10uV  zone, with some doing better. 6.5 digit owners might get to 30uV.

 

Offline Cerebus

  • Super Contributor
  • ***
  • Posts: 10576
  • Country: gb
Re: Local calibration labs
« Reply #21 on: September 11, 2017, 01:19:44 pm »
As far as accredited measurements go, keep in mind that the values listed in these documents that are linked in this thread are for the lab's best measurement uncertainty, not the measurement uncertainty you would be receiving on your device.

For UKAS certifications, the certification is for the deliverable. So if a lab runs multiple streams of deliverable then, as I understand it, each of those gets its own accreditation. That's why UKAS accreditation certificates sometimes list the same basic capability twice with different uncertainties. You just have to make sure that you order the right service to get that level of uncertainty.
Anybody got a syringe I can use to squeeze the magic smoke back into this?
 

Offline Moon Winx

  • Regular Contributor
  • *
  • Posts: 83
  • Country: us
Re: Local calibration labs
« Reply #22 on: September 11, 2017, 01:35:35 pm »
As far as accredited measurements go, keep in mind that the values listed in these documents that are linked in this thread are for the lab's best measurement uncertainty, not the measurement uncertainty you would be receiving on your device.

For UKAS certifications, the certification is for the deliverable. So if a lab runs multiple streams of deliverable then, as I understand it, each of those gets its own accreditation. That's why UKAS accreditation certificates sometimes list the same basic capability twice with different uncertainties. You just have to make sure that you order the right service to get that level of uncertainty.

I wonder what the reasoning is behind that? It would be impossible to know the uncertainty of a measurement before the measurement is made, so stating that one would receive a specific uncertainty doesn't seem very forthright. I know that in practice the uncertainty contributors that can only be determined at the time of measurement are usually swamped by other sources of uncertainty, but I also know of many cases where that is definitely not true.
 

Offline Cerebus

  • Super Contributor
  • ***
  • Posts: 10576
  • Country: gb
Re: Local calibration labs
« Reply #23 on: September 11, 2017, 04:43:44 pm »

It would be impossible to know the uncertainty of a measurement before the measurement is made, so stating that one would receive a specific uncertainty doesn't seem very forthright.

Eh? If you don't know the uncertainties inherent in a making a particular type of measurement with a particular method and particular instruments before making the measurement how will you suddenly know them after making the measurement. I think you're conflating absolute error and uncertainty.
« Last Edit: September 11, 2017, 04:49:26 pm by Cerebus »
Anybody got a syringe I can use to squeeze the magic smoke back into this?
 

Offline Moon Winx

  • Regular Contributor
  • *
  • Posts: 83
  • Country: us
Re: Local calibration labs
« Reply #24 on: September 11, 2017, 11:03:51 pm »

It would be impossible to know the uncertainty of a measurement before the measurement is made, so stating that one would receive a specific uncertainty doesn't seem very forthright.

Eh? If you don't know the uncertainties inherent in a making a particular type of measurement with a particular method and particular instruments before making the measurement how will you suddenly know them after making the measurement. I think you're conflating absolute error and uncertainty.

You can have an incomplete picture of the uncertainty before a measurement, but there are components of the total uncertainty that are unknown until the measurement occurs. Repeatability is probably the most common. Sometimes this component completely swamps the other, referenced uncertainty contributors.
 

Offline Cerebus

  • Super Contributor
  • ***
  • Posts: 10576
  • Country: gb
Re: Local calibration labs
« Reply #25 on: September 11, 2017, 11:22:35 pm »

It would be impossible to know the uncertainty of a measurement before the measurement is made, so stating that one would receive a specific uncertainty doesn't seem very forthright.

Eh? If you don't know the uncertainties inherent in a making a particular type of measurement with a particular method and particular instruments before making the measurement how will you suddenly know them after making the measurement. I think you're conflating absolute error and uncertainty.

You can have an incomplete picture of the uncertainty before a measurement, but there are components of the total uncertainty that are unknown until the measurement occurs. Repeatability is probably the most common. Sometimes this component completely swamps the other, referenced uncertainty contributors.

That just doesn't make any sense. It, frankly, just sounds like handwaving. What are these "components of the total uncertainty that are unknown until the measurement occurs"? How are they different from any other components of the total uncertainty that can be determined either from prior knowledge of systematic errors or prior statistical observations of the measurement process?
Anybody got a syringe I can use to squeeze the magic smoke back into this?
 

Offline Moon Winx

  • Regular Contributor
  • *
  • Posts: 83
  • Country: us
Re: Local calibration labs
« Reply #26 on: September 12, 2017, 12:05:37 am »
That just doesn't make any sense. It, frankly, just sounds like handwaving. What are these "components of the total uncertainty that are unknown until the measurement occurs"? How are they different from any other components of the total uncertainty that can be determined either from prior knowledge of systematic errors or prior statistical observations of the measurement process?

For a quick example, say you have a magical measurement system that that makes perfect resistance measurements with absolutely zero uncertainty. You bring in a bunch of artifacts to measure, different models of resistors, and even multiples of the same model. Now, due to variations in the manufacturing, you would have different levels of defectiveness (inadequate shielding, oxidation of components, overloaded internal resistors, etc.) in the groups of resistors that produce errors during the measurement. These show up as a stability component, short term and long term drift and offsets from a previously known history of that item. All of these things affect the measurement uncertainty, so even using a perfect measurement system you would have components of the measurement uncertainty that come from the individual test units. We have a couple of systems in our lab where 99% of measurement uncertainty comes from test unit noise. The Fluke 792A is an example. Depending on when it was manufactured, we end up with significantly different measurement uncertainties even though the they all share the same model.
 

Offline CalMachine

  • Frequent Contributor
  • **
  • Posts: 477
  • Country: us
  • Metrology Nut
Re: Local calibration labs
« Reply #27 on: September 12, 2017, 01:13:54 am »

It would be impossible to know the uncertainty of a measurement before the measurement is made, so stating that one would receive a specific uncertainty doesn't seem very forthright.

Eh? If you don't know the uncertainties inherent in a making a particular type of measurement with a particular method and particular instruments before making the measurement how will you suddenly know them after making the measurement. I think you're conflating absolute error and uncertainty.

You can have an incomplete picture of the uncertainty before a measurement, but there are components of the total uncertainty that are unknown until the measurement occurs. Repeatability is probably the most common. Sometimes this component completely swamps the other, referenced uncertainty contributors.

That just doesn't make any sense. It, frankly, just sounds like handwaving. What are these "components of the total uncertainty that are unknown until the measurement occurs"? How are they different from any other components of the total uncertainty that can be determined either from prior knowledge of systematic errors or prior statistical observations of the measurement process?

You're failing to take into account the repeatability of the DUT. 
All your volts are belong to me
 

Offline Cerebus

  • Super Contributor
  • ***
  • Posts: 10576
  • Country: gb
Re: Local calibration labs
« Reply #28 on: September 12, 2017, 01:41:08 am »
That just doesn't make any sense. It, frankly, just sounds like handwaving. What are these "components of the total uncertainty that are unknown until the measurement occurs"? How are they different from any other components of the total uncertainty that can be determined either from prior knowledge of systematic errors or prior statistical observations of the measurement process?

For a quick example, say you have a magical measurement system that that makes perfect resistance measurements with absolutely zero uncertainty. You bring in a bunch of artifacts to measure, different models of resistors, and even multiples of the same model. Now, due to variations in the manufacturing, you would have different levels of defectiveness (inadequate shielding, oxidation of components, overloaded internal resistors, etc.) in the groups of resistors that produce errors during the measurement. These show up as a stability component, short term and long term drift and offsets from a previously known history of that item. All of these things affect the measurement uncertainty, so even using a perfect measurement system you would have components of the measurement uncertainty that come from the individual test units. We have a couple of systems in our lab where 99% of measurement uncertainty comes from test unit noise. The Fluke 792A is an example. Depending on when it was manufactured, we end up with significantly different measurement uncertainties even though the they all share the same model.

OK, if I get you right your "there are components of the total uncertainty that are unknown until the measurement occurs" are all attributable to the DUT. Fine, we all understand that, and we'd have got there a lot faster if you'd said something like "those figures don't include the inherent uncertainties of the DUT itself" instead of going around the houses.

Your implication in
Quote
"It would be impossible to know the uncertainty of a measurement before the measurement is made, so stating that one would receive a specific uncertainty doesn't seem very forthright."
is that there's something misleading in the accreditation of cal labs to "measure X to y%" or "source x to y%". There isn't. This doesn't amount to a claim to something like "after supplying 10V to your DVM it will be calibrated to 0.3ppm uncertainty" it's "we will supply 10V to an uncertainty of 0.3ppm at the end of the leads we plug into your DVM".

If you still think this is not "very forthright", what quantification of a cal lab's capabilities would you deem reasonable to make? How is a national accreditation scheme going to account for every random bit of test gear that an end-user's might turn up with at the cal lab being accredited?
Anybody got a syringe I can use to squeeze the magic smoke back into this?
 

Offline Cerebus

  • Super Contributor
  • ***
  • Posts: 10576
  • Country: gb
Re: Local calibration labs
« Reply #29 on: September 12, 2017, 01:57:52 am »
You're failing to take into account the repeatability of the DUT.

That's ***** easy for you to say after we've been around the houses.  :)

It would have been helpful if Moon Winx had been just a tad clearer in what he was saying. Like perhaps saying something like "Ah, but that doesn't account for DUT variability that the cal lab can't know in advance". It's a little difficult to second guess that when it's cal lab's accredited capabilities that's the subject in hand.

We've got some very clever, knowledgable, and experienced people on here, but sometimes I do wish that perhaps some of them had taken an extra writing  class or two.
Anybody got a syringe I can use to squeeze the magic smoke back into this?
 

Offline CalMachine

  • Frequent Contributor
  • **
  • Posts: 477
  • Country: us
  • Metrology Nut
Re: Local calibration labs
« Reply #30 on: September 12, 2017, 02:11:51 am »
You're failing to take into account the repeatability of the DUT.

That's ***** easy for you to say after we've been around the houses.  :)

It would have been helpful if Moon Winx had been just a tad clearer in what he was saying. Like perhaps saying something like "Ah, but that doesn't account for DUT variability that the cal lab can't know in advance". It's a little difficult to second guess that when it's cal lab's accredited capabilities that's the subject in hand.

We've got some very clever, knowledgable, and experienced people on here, but sometimes I do wish that perhaps some of them had taken an extra writing  class or two.

Hahaha I wish I had seen the comments earlier :)  and I totally agree, but sometimes I guess things get lost in translation..  This is an international forum and English might not be everyones' native tongue.
All your volts are belong to me
 

Offline Cerebus

  • Super Contributor
  • ***
  • Posts: 10576
  • Country: gb
Re: Local calibration labs
« Reply #31 on: September 12, 2017, 02:30:44 am »
Hahaha I wish I had seen the comments earlier :)  and I totally agree, but sometimes I guess things get lost in translation..  This is an international forum and English might not be everyones' native tongue.

Exactly why I said 'writing class' for what in school we called 'English'.

Do other nationalities use the same idiom, do they call their writing, literature and comprehension classes by the name of the native language?
Anybody got a syringe I can use to squeeze the magic smoke back into this?
 

Offline Moon Winx

  • Regular Contributor
  • *
  • Posts: 83
  • Country: us
Re: Local calibration labs
« Reply #32 on: September 12, 2017, 02:34:32 am »
OK, if I get you right your "there are components of the total uncertainty that are unknown until the measurement occurs" are all attributable to the DUT. Fine, we all understand that, and we'd have got there a lot faster if you'd said something like "those figures don't include the inherent uncertainties of the DUT itself" instead of going around the houses.

Your implication in
Quote
"It would be impossible to know the uncertainty of a measurement before the measurement is made, so stating that one would receive a specific uncertainty doesn't seem very forthright."
is that there's something misleading in the accreditation of cal labs to "measure X to y%" or "source x to y%". There isn't. This doesn't amount to a claim to something like "after supplying 10V to your DVM it will be calibrated to 0.3ppm uncertainty" it's "we will supply 10V to an uncertainty of 0.3ppm at the end of the leads we plug into your DVM".

If you still think this is not "very forthright", what quantification of a cal lab's capabilities would you deem reasonable to make? How is a national accreditation scheme going to account for every random bit of test gear that an end-user's might turn up with at the cal lab being accredited?

I don't think the accreditation bodies are interested in that. In my experience, they care if you have your process and procedures documented and your process of determining measurement uncertainty is compliant. You show your auditor how you've calculated what you claim your best measurement uncertainty is and maybe demonstrate the measurement to prove it if needed. I've never witnessed an auditor giving grief about calculating a measurement uncertainty at the time of measurement and they have always allowed an "estimated" Type A to be included in a typical budget. This is probably a holdover from the days before automated measurement systems. Having said that, in order to do a proper measurement uncertainty you must calculate it at time of measurement because you fail to capture variations in the test units (AND how the system and test unit interact (which is why I didn't specifically state the variation in uncertainty at time of measurement is due solely to the test unit)) if you don't. I believe this is going to be addressed in the newer 17025, and is mostly addressed in the ANSI Z540.3 which requires proper TUR to be determined and reported. The TUR (test:uncertainty ratio) replaced the TAR (test:accuracy ratio) for the very reason we are having this discussion: it's not about the accuracy of your measurement system but of the combined measurement process of the system and the test unit.
« Last Edit: September 12, 2017, 02:36:27 am by Moon Winx »
 
The following users thanked this post: Mickle T., CalMachine

Offline Cerebus

  • Super Contributor
  • ***
  • Posts: 10576
  • Country: gb
Re: Local calibration labs
« Reply #33 on: September 12, 2017, 01:00:29 pm »
Much better, now you're making some sort of sense.
Anybody got a syringe I can use to squeeze the magic smoke back into this?
 

Offline Moon Winx

  • Regular Contributor
  • *
  • Posts: 83
  • Country: us
Re: Local calibration labs
« Reply #34 on: September 12, 2017, 07:03:52 pm »
Much better, now you're making some sort of sense.

If you don't understand something, just ask questions. I'd be more than happy to answer what I can. There's no need to act like an ass.
 
The following users thanked this post: The Soulman

Offline Cerebus

  • Super Contributor
  • ***
  • Posts: 10576
  • Country: gb
Re: Local calibration labs
« Reply #35 on: September 12, 2017, 07:40:28 pm »
Much better, now you're making some sort of sense.

If you don't understand something, just ask questions. I'd be more than happy to answer what I can. There's no need to act like an ass.

I'm not having a go, and I did ask questions. It's just that you were expressing yourself so badly that you were incomprehensible. You had something very simple and non-controversial  to say (and could probably have been put clearly into one sentence) but you managed to say it in a way that was impenetrable and initially sounded quite close to nonsense. Note, I was not the only one to think so, as you can see above.

If you think you're having problems with me, wait until you hit the non-native English speakers on here, some of whom who shoot first and ask questions after.
Anybody got a syringe I can use to squeeze the magic smoke back into this?
 

Offline Moon Winx

  • Regular Contributor
  • *
  • Posts: 83
  • Country: us
Re: Local calibration labs
« Reply #36 on: September 12, 2017, 07:50:34 pm »
I'm not having a go, and I did ask questions. It's just that you were expressing yourself so badly that you were incomprehensible. You had something very simple and non-controversial  to say (and could probably have been put clearly into one sentence) but you managed to say it in a way that was impenetrable and initially sounded quite close to nonsense. Note, I was not the only one to think so, as you can see above.

If you think you're having problems with me, wait until you hit the non-native English speakers on here, some of whom who shoot first and ask questions after.

Obviously I'm biased, but what's so hard to understand about this:

"It would be impossible to know the uncertainty of a measurement before the measurement is made, so stating that one would receive a specific uncertainty doesn't seem very forthright. I know that in practice the uncertainty contributors that can only be determined at the time of measurement are usually swamped by other sources of uncertainty, but I also know of many cases where that is definitely not true."

Read carefully. I'm stating that a lab that tells the customer that they will receive a certain measurement uncertainty before the measurement is made is not being forthright. And that's true. The Scope of Accreditation lists the lab's capabilities, not the uncertainty you will see on a test report as a customer.

You finding this incomprehensible says more about you than it says about me.




« Last Edit: September 12, 2017, 07:54:41 pm by Moon Winx »
 

Offline Cerebus

  • Super Contributor
  • ***
  • Posts: 10576
  • Country: gb
Re: Local calibration labs
« Reply #37 on: September 12, 2017, 08:43:25 pm »
You finding this incomprehensible says more about you than it says about me.

Now who's being insulting?

The man you're talking down to to used to be a section editor on a national magazine and writer for several others. I know how to write and I know how to edit other people's writing so that it makes sense to a target readership. I've had to take writing from specialist contributors who can't write for toffee and get it to make sense.

It also means that I've been edited by others and learned how to not get in a huff if someone says "You're not being clear here". If I took your attitude I'd have blamed the readers instead of learning how to write clearly.

I'll leave others to judge whether all that qualifies me to talk about writing clarity.

As to what says what about whom, I haven't stooped to insults - pause and think about the implications of that.
Anybody got a syringe I can use to squeeze the magic smoke back into this?
 

Offline Moon Winx

  • Regular Contributor
  • *
  • Posts: 83
  • Country: us
Re: Local calibration labs
« Reply #38 on: September 12, 2017, 10:54:25 pm »

I'm not having a go, and I did ask questions. It's just that you were expressing yourself so badly that you were incomprehensible. You had something very simple and non-controversial  to say (and could probably have been put clearly into one sentence) but you managed to say it in a way that was impenetrable and initially sounded quite close to nonsense. Note, I was not the only one to think so, as you can see above.

If you think you're having problems with me, wait until you hit the non-native English speakers on here, some of whom who shoot first and ask questions after.

...to me, this is a little insulting and I hope you did better work in your editing job than you've displayed here. I would hope that you would offer more feedback to a writer instead of "whah... I don't understand so this must be incomprehensible and you are expressing yourself badly!". This is a message board, not an academic journal, so I expect the conversations to be in a casual tone and again, if you find something confusing there are more polite ways to ask for clarification rather than insulting the poster's writing style.

But I'm tired of this back and forth that brings no value to the thread, so this will be my last post in here.
 

Offline Cerebus

  • Super Contributor
  • ***
  • Posts: 10576
  • Country: gb
Re: Local calibration labs
« Reply #39 on: September 12, 2017, 11:07:44 pm »
But I'm tired of this back and forth that brings no value to the thread, so this will be my last post in here.

Good!
Anybody got a syringe I can use to squeeze the magic smoke back into this?
 


Share me

Digg  Facebook  SlashDot  Delicious  Technorati  Twitter  Google  Yahoo
Smf