EEVblog Electronics Community Forum

Electronics => Metrology => Topic started by: TiN on April 10, 2015, 07:58:10 pm

Title: DMM Noise comparison testing project
Post by: TiN on April 10, 2015, 07:58:10 pm
RAWR, voltnuts,

How about idea of testing ADC/front-end noise performance on various DMMs and making a common chart for reference?
To start, only two variables to check, NPLC settings and VDC range.
All testing to be done with short on inputs.
Offsets irrelevant and can be nulled by math on captured data.

As a starting point, here's some data from Agilent 34970A (34901A mux card, channel 118 shorted) and Keithley 2001, 2002.

Data is live, on this D3.js generated chart page (http://xdevs.com/zero_comp/).

Current data status

(http://xdevs.com/static/data/k2001_k2002_34461a_s.png) (http://xdevs.com/zero_comp/)



Any meter can be added. For fair comparison I'd suggest to pick 1 hour of sampling time.

Guide:

1. Have to use interface to log data from meter, such as RS232 or GPIB/LAN. If there is USB port to transfer data from meter , that will work too.
2. Disable all filtering / math functions on meter. We want get clean data from ADC subsystem. Processing can be done later on PC, in case if needed.
3. Set fixed range, for example 100mV or 2V. Enable synchronous autozero if there is such in meter.
4. Set NLPC aligned to power cycles (for example 1.00 NPLC, not 1.01 or 0.95)
5. Enable high-impedance mode, if meter allows selection between 10Meg/Hi-Z (for example 34970A, 344xxA).
6. Capture data. Suggest to capture at least 30 minutes, or leave overnight for example. I can cut stable part, when drift due to thermal changes is minimal from overall capture.
7. Add meter information, mains parameters (60Hz or 50Hz, etc).
8. Add special notes, if meter modified/non-standard (e.g. after repair with different parts, or changed parts, etc)
9. Post CSV here, or send to ftp://xdevs.com/ (http://ftp://datashort:datashort@ftp.xdevs.com) with login and password datashort

If you have limited time, just run single setting set:

* 10 NPLC (or maximum NPLC if it's less than 10 for your meter) + base range (10V or 20V, it's the one which have most accuracy per DMM spec), Autozero on, line sync on, filtering OFF.

If want run more , use settings from table. Number meaning order to run (for example run only tests 2,3,4, if you not interested in fast NPLCs settings and ranges over 20V)

        0.01 NPLC0.1 NPLC1 NPLC10 NPLC50 NPLC100 NPLC1000 NPLC
200mV       +11    +10   +7      +3     +4      +5       +9   
2V          +11    +10   +7      +2     +4      +5       +9   
20V         +11    +10   +1    Primary  +4      +5       +5   
200V        +11    +10   +8      +6     +8      +9       +9   
1000V       +11    +10   +8      +6     +8      +9       +9   

Autozero should be on, it will reduce time to get stready repeatable. With autozero off I saw little drift on 2001, which can be confused with more noise.

I will add simple application in few days, to do GPIB capture and send data automatically.

CSV-data for every measurement setup run
RAW CSV data location for download (http://xdevs.com/datashort/)

Example GPIB command query to capture sample from Keithley 2001 is

Code: [Select]
:SYST:AZER:TYPE SYNC;           // Here we enable autozero sync
:SYST:LSYN:STAT ON;             // Here enable line sync
:SENS:FUNC 'VOLT:DC';           // Measure voltage DCV
:SENS:VOLT:DC:NPLC 10;          // Set NPLC to 10
:SENS:VOLT:DC:RANGE 2;          // Set range manual to 2V
:SENS:VOLT:DC:DIG 8.5;          // Set resolution to 8.5 digits
:SENS:VOLT:DC:AVER:STAT OFF;    // Filter off
:TRIG:SEQ:SOUR TIM;             // Set trigger source from timer
:TRIG:SEQ:DEL 1;                // Set timer to 1 second
:READ?                          // Read data

For Keithley 2182 nanovolt meter it would be something like this:

Code: [Select]
:SYST:AZER:STAT ON;             // Here enable autozero
:SYST:FAZ:STAT ON;              // Here we enable front end autozero
:SYST:LSYN:STAT ON;             // Here enable line sync
:SENS:FUNC 'VOLT:DC';           // Measure voltage DCV
:SENS:VOLT:CHAN1:LPAS:STAT OFF; // Analog filter off
:SENS:VOLT:CHAN1:DFIL:STAT OFF; // Digital filter off
:SENS:VOLT:CHAN1:NPLC 5;        // Set NPLC to 5
:SENS:VOLT:CHAN1:RANG 10;       // Set range manual to 10V
:SENS:VOLT:CHAN1:DIG 8.5;       // Set resolution to 8.5 digits
:TRIG:SEQ:SOUR TIM;             // Set trigger source from timer
:TRIG:SEQ:DEL 1;                // Set timer to 1 second
:READ?                          // Read data

I am not sure if it work without modify 100%, since I never had 2182 :) 8.5 digit mode probably will work, similar to 2001, but official value max is 7.5 digits.
Title: Re: DMM ADC Noise comparison testing project
Post by: opa627bm on April 10, 2015, 09:20:28 pm
RAWR,
I have one 7/1/2 keithely nanovolt meter.
How to collect it's noise?
Title: Re: DMM ADC Noise comparison testing project
Post by: dom0 on April 10, 2015, 09:35:26 pm
1. Set up automated meas data retrieval (GPIB, RS-232, Ethernet)
2. Collect data
3. Apply high pass (<-- should have a common stepness and cutoff for all tests by everyone!) to remove offset and drift
4. Calculate peak peak, RMS
Title: Re: DMM ADC Noise comparison testing project
Post by: Marco on April 10, 2015, 10:26:24 pm
Do all meters throw moving average filters on top of the NPLC based samples by default ... or only Keithley?

Ideally you'd have some stimulus near 1/NPLC frequency to make sure the meter isn't cheating.
Title: Re: DMM ADC Noise comparison testing project
Post by: TiN on April 11, 2015, 04:02:25 am
1. Have to use interface to log data from meter, such as RS232 or GPIB/LAN.
2. Disable all filtering / math functions on meter. We want get clean data from ADC subsystem. Processing can be done later on PC, in case if needed.
3. Set fixed range, for example 100mV or 2V. Enable synchronous autozero if there is such in meter.
4. Set NLPC aligned to power cycles (for example 1.00 NPLC, not 1.01 or 0.95)
5. Capture data. Can capture few hours, or leave overnight for example. I can cut stable part, when drift minimal from overall capture.
6. Post CSV here, or send to ftp://xdevs.com/ (http://) with login and password datashort

I will add simple application in few days, to do GPIB capture and send data automatically.

Example GPIB command query to capture sample from Keithley 2001 is

Code: [Select]
:SYST:AZER:TYPE SYNC;           // Here we enable autozero sync
:SYST:LSYN:STAT ON;             // Here enable line sync
:SENS:FUNC 'VOLT:DC';           // Measure voltage DCV
:SENS:VOLT:DC:NPLC 10;          // Set NPLC to 10
:SENS:VOLT:DC:RANGE 2;          // Set range manual to 2V
:SENS:VOLT:DC:DIG 8.5;          // Set resolution to 8.5 digits
:SENS:VOLT:DC:AVER:STAT OFF;    // Filter off
:TRIG:SEQ:SOUR TIM;             // Set trigger source from timer
:TRIG:SEQ:DEL 1;                // Set timer to 1 second
:READ?                          // Read data

For Keithley 2182 nanovolt meter it would be something like this:

Code: [Select]
:SYST:AZER:STAT ON;             // Here enable autozero
:SYST:FAZ:STAT ON;              // Here we enable front end autozero
:SYST:LSYN:STAT ON;             // Here enable line sync
:SENS:FUNC 'VOLT:DC';           // Measure voltage DCV
:SENS:VOLT:CHAN1:LPAS:STAT OFF; // Analog filter off
:SENS:VOLT:CHAN1:DFIL:STAT OFF; // Digital filter off
:SENS:VOLT:CHAN1:NPLC 5;        // Set NPLC to 5
:SENS:VOLT:CHAN1:RANG 10;       // Set range manual to 10V
:SENS:VOLT:CHAN1:DIG 8.5;       // Set resolution to 8.5 digits
:TRIG:SEQ:SOUR TIM;             // Set trigger source from timer
:TRIG:SEQ:DEL 1;                // Set timer to 1 second
:READ?                          // Read data

I am not sure if it work without modify 100%, since I never had 2182 :) 8.5 digit mode probably will work, similar to 2001, but official value max is 7.5 digits.

Marco,
Filter on any Keithley is optional, and can be disabled by press of one button "FILTER" :)
Title: Re: DMM ADC Noise comparison testing project
Post by: ManateeMafia on April 11, 2015, 04:56:56 am
TiN,

I have been using EZGPIB to access the 2K1 today. I will try and tweak it add the extra commands. Are you writing your own programs or are you using some open-source utilities?
Title: Re: DMM ADC Noise comparison testing project
Post by: TiN on April 11, 2015, 05:01:44 am
I am doing it all wrong, LabView.  :phew: Hardware guy here...
My software skills are not good enough to write something to take data from GPIB, plot a graph, toss into CSV file, send over to FTP at same time.
On LV side it took few days to figure everything out to get this spaghetti producing my data.

Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on April 11, 2015, 06:42:07 am
To really measure the noise of the ADC, you need to do the measurement on one fixed DCV range, where only the ADC is in the signal path, but no amplifier or divider.
Otherwise, you'd measure additionally the noise of these components.

Therefore, you have to measure on the 10V range on most bench DMM.

Then, it would be a good idea to use Ulrich Bangerts program PLOTTER to crunch the data fir modified Allan variation, which gives the noise / stability over sampling period. A single sampling interval does not tell so much about the noise performance.. See noise figure diagram of the 3458A in its DCV specifications.
Proper setting of aperture and sampling time , i.e. the correct normalization of data would be required for that, maybe Autozero to turn off for seamless sampling..

Then I wonder, if simply sampling Zero will give an adequate measure of the noise. Maybe it's necessary to measure at Full Scale (10V), with an appropriate, very quiet source.

I think it's better to make a proper definition of such a measurement setup and to put a little bit of investigation in that beforehand,   otherwise people measure wildly 'something', and you only get useless, contradicting data.
These measurements  can be checked against the instruments specifications, if latter one is done well.

Frank.
Title: Re: DMM noise comparison testing project
Post by: TiN on April 11, 2015, 06:59:03 am
That's exactly a reason, why suggested measuring zero and nothing else for now. Already changed topic name to avoid confusion of "ADC noise term" and "DMM noise".
Expecting people (who may have time to have DMM run overnight to collect data) to have quiet and stable 10V reference source (which as we know can be a challenge itself for hiend 6.5/7.5+digit meters) is a lot to ask. But copper wire and short is available everywhere.

As of range, yes, most accurate range will have less frontend switching/components on A/D signal path, but does not avoid problem altogether.

Adding extra ranges and different NPLC settings to comparison have simple purpose - to get more data between instruments. Also this will be rather indicative to overall performance people can see using meter, rather than purely scientific ADC-only noise, which is far less easy to measure properly. It would also have less meaning for most of us, since it's important to see what noise levels can be expected from instrument as a whole.

I bring this topic from a question of few members in 2001 repair thread, that their meters showing excessive noise after repair, and wondering if that was normal, or there is actually hidden issue.
Having raw data available will also let to do all different analysis, to anyone's liking. I think bell frequency occurrence histogram would be better and easier to represent noise performance as well. Will try to make some later.

Another thought is having multiple members run collect same data setup will work as guard band against measuring "something". As per simple statistics, multiple meter of same model doing same stuff should get pretty close in results. If members A, B and C get 100nV median figure, and only member D got 200nV then it's likely later one have some issues with setup. Checking against specs is another guard band too.
Title: Re: DMM Noise comparison testing project
Post by: quarks on April 11, 2015, 05:04:59 pm
bookmark
Title: Re: DMM Noise comparison testing project
Post by: lukaq on April 11, 2015, 05:46:57 pm
is it worth adding 34401a here?
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 11, 2015, 05:50:22 pm
Yes, why not. We can add any bench DMM to overall list.
Title: Re: DMM Noise comparison testing project
Post by: Galaxyrise on April 11, 2015, 06:19:17 pm
One of my Keithley 2000s.  "slow" speed, no filtering, 10V range, 1 hour and 4 days.  Data was rounded to microvolts.

Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 11, 2015, 06:45:00 pm
TiN,

Do you have a sample CSV file for reference?

I think I have the 2K1 working in EZGPIB, I just need to save the results in a format that has all the needed fields.
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 11, 2015, 08:53:26 pm
Galaxyrise
You have CSV or log data capture?

ManateeMafia
All CSV from my graphs are linked in first post.
Title: Re: DMM Noise comparison testing project
Post by: tszaboo on April 11, 2015, 09:05:06 pm
OK, I might add a few sample points, we have quite a few type of meter at work. In fact, I'm interested how well my designs are stacking up with some DMMs.
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 11, 2015, 09:25:20 pm
Got it.
Title: Re: DMM Noise comparison testing project
Post by: macboy on April 11, 2015, 09:32:17 pm
TiN,

Do you have a sample CSV file for reference?

I think I have the 2K1 working in EZGPIB, I just need to save the results in a format that has all the needed fields.
Please post your EZGPIB code here. I can help you to test and debug it, and provide output formatting if needed.
Since the 2001 is a SCPI meter, the same code should work with little or no modification with other SCPI meters.
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 11, 2015, 09:51:41 pm
Will do here in a little while. I have been trying to clean it up and not embarrass myself (too much). It has been 20+ years since I even thought about Pascal.
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 11, 2015, 10:34:03 pm
macboy,

Attached is what I have written so far.

The list of improvements that probably should be made, besides cleaning up my horrible formatting is ...
1. Change format of date (universal format, 24hr time preferred)
2. I used 'SecondsBetween()' to speed up testing. Probably can be changed to 'MinutesBetween()'
3. I wanted to extract the serial number of the meter using *idn? but the result contained spaces and the EZGPIB_StringNthArgument() would not work with a comma delimiter. This is probably not that important of a feature. I wanted to use it for the filename or 2nd column name.
4. I have added lots of remarks, but it makes it a little difficult to read.

Any help would be appreciated.
Title: Re: DMM Noise comparison testing project
Post by: HighVoltage on April 12, 2015, 09:03:32 am
I had my 34461A running over night and this is the result:
- Manual 10V range
- Shortage through wires (Not a block)
- NULL set before data collection
- 100 NPL

I am not sure how meaningful the data is without the shortage block.
But it is about 8h of data
Title: Re: DMM ADC Noise comparison testing project
Post by: KedasProbe on April 12, 2015, 12:53:05 pm
1. Have to use interface to log data from meter, such as RS232 or GPIB/LAN.
Why? I don't see the problem using the internal memory and then save it to file. (assuming you have enough memory)


edit: csv attached, DM3068, Short, 2V range,100PLC, 10MOhm, auto zero on. (2 hours, step 4 sec, 1800 measurements)  stddev: 134nV

edit2 (file fixed)
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 12, 2015, 03:01:54 pm
Quote
Why? I don't see the problem using the internal memory and then save it to file. (assuming you have enough memory)
That's fine too, I was just assuming that not much meters have USB interface to copy data. Keithley 2001/2002 for example don't have even RS232, only GPIB, even tho it can store data in NVRAM.

Quote
I am not sure how meaningful the data is without the shortage block.
If you used fresh clean copper wire with good contact, it should be no visible difference.
After you get shorting PCBs you could try that as well, if there will be any difference.

I will add new data to first post and page soon, was busy fixing another 2001  ;) Now I have three which can collect data for us.
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 12, 2015, 03:31:57 pm
TiN,

I feel like I should get that last 2K1 fixed now just to keep up with you.

I am currently modifying the code for the non SCPI devices like the 3457A and 3458A. Hopefully macboy can do some tweaking on the original code and I can dump it into this one.
I have several (older) meters that I would like to get added including the HP 3456A, Flukes 8502A & 8506A, Solartrons 7061 & 7081, and Keithley 181. At least that is my wish list.

Any ideas about measurement settings would be helpful. There are a lot less settings on the older meters like filtering.
Title: Re: DMM Noise comparison testing project
Post by: Smith on April 12, 2015, 04:05:05 pm
I guess I'll give the 6517A a try if when I get the time. If I can get the software running I might also try the Keithley 2000's, 2700 and 2701.
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 12, 2015, 04:40:15 pm
Filtering should be disabled on any case.
Also I noticed HighVoltage's data, it's captured with 10meg input impedance. Should be Hi-Z mode, not 10meg, if available. Updated top post for this detail.

ManateeMafia, you wish list is great, would love to see all them.
Title: Re: DMM Noise comparison testing project
Post by: macboy on April 12, 2015, 08:14:17 pm

If you used fresh clean copper wire with good contact, it should be no visible difference.
After you get shorting PCBs you could try that as well, if there will be any difference.

I will add new data to first post and page soon, was busy fixing another 2001  ;) Now I have three which can collect data for us.
I am also using a copper wire loop formed to fit across the two input terminals. The sense terminals are not used for voltage readings and I left them open.

I don't have solid data yet, but I can tell you that after an adequate warm up, I set one 2001 into 8.5 digit mode, 10 plc, no filter, and after 48 hours of readings it showed a max +0.00000085 to -0.00000065 min/max span (using the 2nd display functionality). In the shorter term, the noise looked to have under 100 nV rms amplitude. Enabling a filter of just 10 readings for effectively 100 plc per reading seemed to reduce noise to the last (9th) digit, with the 8th digit changing infrequently.
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 13, 2015, 11:11:53 am
macboy

That sounds about right. Also little offset indicates that calibration likely be good :)

Here some tests with histogram view.
As for me, looks much better and also now can see deviation.

(https://www.eevblog.com/forum/testgear/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=146940)

On graph there are  three meters:
Blue - 34461A data from HighVoltage.
Green - K2002
Red - K2001

Offsets nulled from all samples, -66nV for 34461A, +2100nV for K2002, -670nV for K2001.

Also last histogram shows that K2001 and 34461A lack resolution (gaps between bins) ?
Title: Re: DMM Noise comparison testing project
Post by: EEVblog on April 13, 2015, 12:23:43 pm
I'll have to get the DMM7510 and 34670A
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 13, 2015, 01:33:02 pm
Thanks, would be awesome to see some fresh instruments as well.
Title: Re: DMM Noise comparison testing project
Post by: robrenz on April 13, 2015, 01:40:11 pm
8846A  100mV scale.

22 mins before any of the random spikes
(https://www.eevblog.com/forum/testgear/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=146969;image)

2 days including the random spikes. Notice the small sine effect from the daily ambient temp swings
(https://www.eevblog.com/forum/testgear/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=146971;image)

Title: Re: DMM Noise comparison testing project
Post by: tszaboo on April 13, 2015, 03:15:37 pm
3458A noise about 20cm plain stupid not plated banana cable
1000 NPLC Autozero off, measurement about every minute.
http://pastebin.com/QrzNP2xK (http://pastebin.com/QrzNP2xK)
251nV peak to peak
-131nV offset
RMS 44nV.
Title: Re: DMM Noise comparison testing project
Post by: lukaq on April 13, 2015, 03:23:26 pm
34401a

100mVdc, 100 NPLC, auto zero ON, "1s" interval, but it takes far more then 1s to so 100 NPLC anyway 9 and 1/4 hours
I hope it is ok.

Also can someone tell me, why there was that drop at 4h-ish?
Title: Re: DMM Noise comparison testing project
Post by: macboy on April 13, 2015, 06:24:01 pm
User Galaxyrise mentioned suspecting a noisy 2001 but didn't have a GPIB interface to log the data.

In this case, try capturing multiple samples into the buffer, then look at the statistical results. With the default 8k memory, you should get around 850 samples (compact format); with the 128k MEM2 option you should get up to 30000 samples. After capturing, you can get the statistics by pressing RECALL, then NEXT (2nd display) multiple times to view Min, Max, Average, and Standard Deviation. Since a standard deviation is defined as the root of the sum of the squares of the difference between each sample and the mean, it is mathematically the same thing as RMS Noise (with a lower bandwidth cutoff extending to inverse of capture time, i.e. super sub-Hz). Ensure that the instrument is well warmed up beforehand to help ensure minimal drift. I recommend 2 hours.

I also recommend using the 2 V range since the 200 mV range adds an amplifier into the signal chain. I also recommend disabling the analog (10 kHz low-pass) filter under Config->DCV to remove that extra circuitry. To emulate a 100 PLC integration time, configure the Advanced filter to 10 samples, 10% window, and repeat mode (not moving). This will return one reading per ten samples.
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 14, 2015, 04:14:56 am
Here's new representation. I think much cleaner now.

(http://xdevs.com/static/data/k2001_k2002_34461a_s.png) (http://xdevs.com/zero_comp/)

Need to add legends and range/settings data.
Title: Re: DMM Noise comparison testing project
Post by: lukaq on April 14, 2015, 05:32:45 am
Also note, that some graphs will probably in # of samples, while others (my) are in % of samples for the Y axis

And we should also have the same number of bins (10 or 20 or something), which I will assume, there already are, to really show the same data in graphs.
Title: Re: DMM Noise comparison testing project
Post by: KedasProbe on April 14, 2015, 07:25:16 am
I thought the 34461A would be better than what this is showing...
Title: Re: DMM Noise comparison testing project
Post by: HighVoltage on April 14, 2015, 09:10:25 am
the 34461A test has to be repeated. I did this only with some loose wires as shortage and not a proper shortage block.
I will run a new test soon, also on the 34470A

Title: Re: DMM Noise comparison testing project
Post by: tszaboo on April 14, 2015, 11:48:36 am
http://pastebin.com/QgQ55cKc (http://pastebin.com/QgQ55cKc)
34410A
NPLC,NullState,Function,Range,ApertureEnable,Impedance,AutoZero,NullValue,AutoRange,
100,False,DC Voltage,0.1,False,10 M,On,0,On,

I've deleted the first ~1000 samples as there was significant turn-on heating effects.
Now, I see a long term change happening on this data, in my experience it has to do something with the air conditioning turning on and off in the building.
Peak to peak :755 nV
Average -370nV
RMS 112nV

Title: Re: DMM Noise comparison testing project
Post by: macboy on April 14, 2015, 01:23:24 pm
For "apples to apples" comparison, all meters should be running the same NPLC. The K2001 unfortunately only goes up to 10 PLC, but 34401A/34410A data here is using 100 PLC; 3458A data here is using 1000 PLC! No wonder the data is less noisy! If we take K2001 data and average each 10 or 100 samples into 1 (for effectively 100 or 1000 PLC per sample) then it would very much change the shape of its histogram. The 3458A is taking about 1 minute per reading, but the K2001 is doing better than 1 reading per second. This is not level ground.

Also for K2001, ensure autozero is set to "synchronous" which does the autozero on each sample. When set to "normal", autozero is only done periodically which is great for taking high speed measurements, but definitely not great for this purpose.  Setting line-sync to On is also helpful to ensure the greatest amount of line noise rejection. (Both are in the General menu).
Title: Re: DMM Noise comparison testing project
Post by: lukaq on April 14, 2015, 03:06:16 pm
Then lets set the rules, that all can use and redo the tests.
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 14, 2015, 03:29:52 pm
I agree on the rules. We need data that at least can be compared to the same make/model.

A set of rules that are 'Best Practice' methods that make sense based on the fact some of us are doing this from a home lab.  Temperature and humidity regulation will be difficult to control.
Perhaps listing any HW/FW revs with the readings. Either attach it in a separate file or on the top couple lines of the CSV file. Serial numbers probably should be optional in case people are concerned about privacy.

Also,
I have been working with code for the 3458A and also reading the programming commands. I have run across a minor setting that NANDBlog should try if you haven't already.

Set your NRDGS 1,8

The 8 is set for zero line crossing. My readings dropped significantly making this one change. I am surprised it is not a default setting.

I will take a 1hr reading tonight and I hope the AC does not interfere with the readings too much.

My settings will be...

AZERO ON
NPLC 10
DCV .1, 1E-6
NRDGS 1,8

I will hold off uploading the data until we can agree on a format. I just need to get an idea if my data can be collected reliably.

If there are any suggestions to try, I can try different runs on the same meter. I also have a second that I will run the following night. I have a third that, much to my surprise(not!), has a defective GPIB port. I will be t/s it the next couple of days and will probably be replacing at least one line driver IC.

I will welcome anyone with experience repairing the GPIB port on the 3458A.  The most likely components are U904-U906. There is a HP service note to check the port, but it passes their test. You can bet the replacement parts will be in sockets like the NVRAM.
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 14, 2015, 03:35:38 pm
Ultimately I had a goal to have all ranges and main NPLC ranges measured, and thats what I do on my side. So I dont think measured data was useless.

But yes, its a good point, not all of us have meter without use to collect hours of data, so need set minimum data config to run first:

1. NPLC 10 (or maximum before it if meter dont have NPLC 10, like 2182 have only 5)

2. Autozero enabled, line sync enabled.

3. High impedance mode if  selectable.

4. Base range (one with most accuracy per spec, e.g. 20V or 10V)

5. Use copper short or clean wire to minimize thermal EMF.

If run others ranges, should be as extra.
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 14, 2015, 04:08:13 pm
I will be making a slight change to what I will do with the 3458A. Instead of DCV .1, 1E-6 , I will just do DCV .1;NDIG 8

The 1E-6 forces the meter into NPLC=100.
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 14, 2015, 04:18:35 pm
Question:

Is it normal practice to clean meter binding posts with Deoxit or any other similar product? I have not seen it mentioned in any owner's manual, except for the 34420A. I just thought it might be worth considering.
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on April 14, 2015, 04:33:50 pm
OK, finally, some rules?  >:D

Anyhow, one single point does not tell so much, I have to point out again.

See the noise diagram of the 3458A below, how the results may be presented in a systematic and clear manner.

you will get similar graphs for every DMM, I suppose, and also, the relationship to the different DC ranges might also be expressed similarily.
Therefore, several NPLC points should be taken, from 0.01 to 100 ..1000 NPLC, if possible, and in a more intelligent way, maybe.

To gather these data, I think, it's not necessary to blindly log hours of  data.. The statistics will converge sufficiently quickly for higher NPLC numbers, I assume.

It will be sufficient, to gather 10.000 samples for NPLC 0.01,  down to 100 samples for NPLC 100, to get a reasonably stable statistics, and to reduce the measurement time.

That would be a maximum of 6 measurements per range, less than 20 for all three ranges of interest (10V, 1V, 100mV), and about 20 minutes per range.

Then, all the measurements of the participants must be properly and completely specified, which range, NPLC, etc., so that a proper normalization can be done!
In the case of the 3458A, HP normalized to ppm relative to full scale.

Btw.: As the input is shorted brutally, there will absolutely be no difference between 10 MOhm or Hi-Z mode of the front-end.
The 10MOhm divider will be in turn shorted, as will be its noise.

Also, if the measurement time is kept short, the actual offset voltage will not play a role, neither its drift.
Therefore, on the short NPLC numbers, AZERO may be turned off, to get a faster result.

You won't draw any conclusion either from hours of offset / Null stability monitoring, especially if you only want to measure the input noise .

Frank
Title: Re: DMM Noise comparison testing project
Post by: tszaboo on April 14, 2015, 05:13:34 pm
I have been working with code for the 3458A and also reading the programming commands. I have run across a minor setting that NANDBlog should try if you haven't already.
Set your NRDGS 1,8
This log was made over GPIB, and the actual length of the data is more than 8 digit. The logging script is "combat tested", this is what I had on hand to run quickly, I'll try to modify it to 10 NPLC.On the other hand I dont think the setting would be unfair. I see two meaning of this tests to find out
1. You connect the multimeter to your DUT, you take a measurement, and you are curious how much the multimeter affects the measurement. I agree, 1000 NPLC is 20 seconds, but this is the best measurement the 3458A can do.
2. You are logging some DC voltage, it has some noise, and you are interested, how much of the noise is made by the multimeter. Now you can average the Keithley, and end up with the same noise as the Agilent but all you did was reducing the number of samples to gain some accuracy (oversampling). The 3458A can make 1000NPLC measurement, and this will be your result, so the conclusion: The DMM with best settings will make this amount of noise is true.
It is unlikely for anyone to go to the math menu start averaging for taking a single measurement.
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 14, 2015, 05:14:08 pm
Higher sample count allows to remove initial / spurious drift/noise (e.g. if user turned on AC during measurement process).
Having just hundred samples is enough, but it require more care to run test setup.

As I mention before, having matrix of typical NPLC + ranges will allow to have full chart for each particular meter, but this may need some automation.
I'm not seeing much people switching NPLC's , ranges for dozen times and sitting with timer to capture just enough data, but not too much.
Guess I will be first to write test program to automate testing then.

        0.01 NPLC0.1 NPLC1 NPLC10 NPLC50 NPLC100 NPLC1000 NPLC
200mV       +11    +10   +7      +3     +4      +5       +9   
2V          +11    +10   +7      +2     +4      +5       +9   
20V         +11    +10   +1    Primary  +4      +5       +5   
200V        +11    +10   +8      +6     +8      +9       +9   
1000V       +11    +10   +8      +6     +8      +9       +9   

So to simplify:

1. If you just run one test - let it be 10NPLC, 20V(10V) main range.
2. To do full test - add data setups as per number priority, +1 meaning run first after primary test, +2 run second, etc.
3. Add meter information, mains parameters (60Hz or 50Hz, etc).
4. Add special notes, if meter modified/non-standard (e.g. after repair with different parts, or changed parts, etc)

Autozero should be on, it will reduce time to get stready repeatable. With autozero off I saw little drift on 2001, which can be confused with more noise.
Attached screenshot. Greenline - K2001 calibrated, redline K2002, both max NPLC.  Stready data before "spike" - autozero enabled, syncronous (meter takes autozero measurement on every sample trigger), waivy lines after spike - autozero disabled.

I don't think we need chase board revisions or firmware version, unless there is huge difference in data, repeated at least by two different members.

Averaging by math (either by meter functions or computer-aided) should be avoided, as it's just a pandora box of post-processing and not exactly what this study here for. One can take 0.01 NPLC set of data, and give a median from it with zero noise, but that would not show anything about noise pk-pk.
Title: Re: DMM Noise comparison testing project
Post by: lukaq on April 14, 2015, 05:56:31 pm
It will take time, but i'm for it, will go over all ranges, NPLCs

Will be interesting to see, that's for sure
Title: Re: DMM Noise comparison testing project
Post by: Marco on April 14, 2015, 06:05:54 pm
How about just throwing a 0.01 Hz high pass filter over the results?
Title: Re: DMM Noise comparison testing project
Post by: barnacle2k on April 14, 2015, 08:28:51 pm
I am currently gathering data with my Solartron 7081,  NPLC is not an option on this device for 8.5 digits its fixed to 2560 PLC :=\.

From i read this is the current rule set for this experiment?

Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on April 14, 2015, 08:56:02 pm
Hi everybody,

I own a 34461A since more than 1 month now. This is my first decent bench DMM. Hope than I will not become a volt nut !!! :palm:

I am ready to play that game, and already collected some data, but before posting them I would like to submit some observations (see graph below) I made 2 weeks ago.
Initially I wanted to know the warmup time of this DMM, but, when looking at the large drifts, I was a bit disapointed.
I suspected there was a relation between this drifts and the forced cooling system used on this DMM, and decided to log data with the DMM in normal "configuration", and also with the series of holes placed on both sides blocked whith a piece of paper and adhesive tape (but fan still running).
The results are shown on the graph below and pretty obvious.
Furthermore, I noticed that the temperature reported by the DMM is less (yes LESS), when the air entrance are blocked  (-1.5 to -2 degrees Celsius)!!!
I repeated this test 3 times and there is absolutly no doubt about the results.
So, I am really wondering about this cooling design and it's effects.
If I am right, other DMMs like the 34401A do not have any forced colling system.
The 34460A do not have any fan. Is anybody there could do some data logging?
Same with the 34461A. I am curious to see the results of other users doing the same (with and without blocking the air entrance).

Anyway, you are the experts !!! I am looking for your comments.
It would be interesting to know how is measured the internal temperature, where is placed the sensor, etc ...
I am really curious to understand what is happening there.

In addition, a picture of the shunt that I am using.

Jean
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 14, 2015, 09:18:21 pm
I think I can modify my code but the older meters may or may not play well with the prologix. I will give it a quick test tonight. The SCPI code should be easier.
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on April 14, 2015, 09:28:08 pm
Hi everybody,

I own a 34461A since more than 1 month now. This is my first decent bench DMM. Hope than I will not become a volt nut !!! :palm:


Hi Jean,

Why not becoming a volt-nuts?
It's fun.. And.. Sorry, you already lost the game.. You are already a volt-nuts, as you bought that DMM, I think.

Btw.: It's Koningsdag, soon.. I' m curious how the Dutch  will celebrate that!

Frank
Title: Re: DMM Noise comparison testing project
Post by: blackdog on April 14, 2015, 09:44:34 pm
Hi Dr. Frank,

"Koningsdag" most peaple wil be drunk around noon, here in Amsterdam.

I celebrate it likely, with several multimeters  :-DD

Kind regarts,
Blackdog
Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on April 14, 2015, 09:52:58 pm
Hi everybody,

I own a 34461A since more than 1 month now. This is my first decent bench DMM. Hope than I will not become a volt nut !!! :palm:


Hi Jean,

Why not becoming a volt-nuts?
It's fun.. And.. Sorry, you already lost the game.. You are already a volt-nuts, as you bought that DMM, I think.

Btw.: It's Koningsdag, soon.. I' m curious how the Dutch  will celebrate that!

Frank

Hi Frank,

I am afraid you are right, I am contaminated ...!
An yes, it's fun ... but ... expensive and time consuming !

By the way, I am not Dutch, but French. But I spent time in Netherland for my job, years ago, and was there one time during the Koningsdag. Yes, it's something you don't forget!

Jean
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on April 14, 2015, 09:59:47 pm
Hi Blackdog,

I already heard some rumors .. we'll be invited by friends to Ouddorp..
dressed in orange, drinking Genever maybe??
Perhaps, we'll find some electronics on the flea markets..

Unfortunately, the next day will be my own birthday..  :clap:

Frank

Title: Re: DMM Noise comparison testing project
Post by: lukaq on April 15, 2015, 05:21:40 am
If I am right, other DMMs like the 34401A do not have any forced colling system.
Correct, no fan and no holes on case for cooling
Title: Re: DMM Noise comparison testing project
Post by: barnacle2k on April 15, 2015, 05:56:27 am
i quickly put lukaq's data through a high pass filter that takes care of any drift quite nicely.
It completely smoothed out the weird spikes in that capture.
The histograms look Ok too.
Its an equiripple 600Tap FIR-HP relative corner frequency 0.02. (Propably a bit too high)

Did that to debug the my data processing, the histogram of my 7081 looks abnormal.

(SW used: Matlab)
Title: Re: DMM Noise comparison testing project
Post by: macboy on April 15, 2015, 01:41:19 pm
...
Averaging by math (either by meter functions or computer-aided) should be avoided, as it's just a pandora box of post-processing and not exactly what this study here for. One can take 0.01 NPLC set of data, and give a median from it with zero noise, but that would not show anything about noise pk-pk.
I completely disagree. Oversampling (averaging multiple samples) is a legitimate way of reducing noise and increasing the effective resolution of an ADC, within the limitations of its linearity.

The Solartron meter does 2560 PLC integration? How strange. Then you see that 2560 is 256 x 10 ... I would wager that internally the meter does 256 measurements at 10 PLC each and averages them to provide a single "2560 PLC" reading. I strongly suspect that the HP/Agilent/Keysight 3458A does something similar; multiple sources from data sheets to user manual specifications to technical articles (for example, the April 1989 HP Technical Journal) unambiguously state that integration time is settable from 500 ns to 1 second. Its 1000 PLC setting then must average multiple readings each with a ~1 second integration time. Logically, it makes more sense to assume that multiple shorter readings are taken and averaged than to think that the meters integrate for 20 seconds (1000 PLC @ 50 Hz) or over 50 seconds (2560 PLC @50 Hz).

It is unlikely for anyone to go to the math menu start averaging for taking a single measurement.
It is not necessary to do that. Set the filter to N samples, Repeat mode (not windowed or moving average). Then you get one reading per N samples. Filter can be enabled or disabled with a single button press.
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 15, 2015, 02:46:14 pm
Was not saying that math is useless, key was to reduce number of variables between different meter / participants, so we can have common base for data sets.
We have just range (5 ranges usually) and most popular NPLC (7 values), and it's already 35 data sets for single meter, single member. If every dataset takes 15 minutes to get, excluding setup/change settings - it would already take a day to get everything. Adding math here (which can be calculated differently in different meters or different member applications) - will overcomplicate everything.

And 1000 nplc should be changed to MAX NPLC, as some meters have it as 200 at max, others - 2560, like Solartron example.
Title: Re: DMM Noise comparison testing project
Post by: Mickle T. on April 15, 2015, 02:48:26 pm
ADC of the Solartron 7081 DMM have a single measurement interval equal to 6.25 ms (so-called 1 "GLUG" or 1 quantum of charge). In 8.5-digits mode the floating logic MPU accumulates (not averages!) 8192 of single conversion results. With a 5.24288 MHz clock frequency 51.2 sec interval gives a maximum of 268435456 full scale (bipolar) readings.
Title: Re: DMM Noise comparison testing project
Post by: 6thimage on April 15, 2015, 03:27:09 pm
I suspected there was a relation between this drifts and the forced cooling system used on this DMM, and decided to log data with the DMM in normal "configuration", and also with the series of holes placed on both sides blocked whith a piece of paper and adhesive tape (but fan still running).
The results are shown on the graph below and pretty obvious.
Furthermore, I noticed that the temperature reported by the DMM is less (yes LESS), when the air entrance are blocked  (-1.5 to -2 degrees Celsius)!!!
I repeated this test 3 times and there is absolutly no doubt about the results.
So, I am really wondering about this cooling design and it's effects.
If I am right, other DMMs like the 34401A do not have any forced colling system.
The 34460A do not have any fan. Is anybody there could do some data logging?
Same with the 34461A. I am curious to see the results of other users doing the same (with and without blocking the air entrance).

How stable is the temperature of the environment you are in?

I have been told (by someone at Keysight) that the lesser specifications of the 34460A is due to the lack of a fan, with the readings changing depending on whether the tilting bail is covering the side holes. They also said that the fan, in the 34461/65/70A, moves very little air at room temperature and is largely there for use in equipment racks (although this isn't a recommendation to unplug it).

The 34401A does not have a fan, but some of the Keithley's do (e.g. 2001). So a fan is not necessarily a bad thing, but it requires that the airflow is properly designed.

I am intending to perform these noise measurements on my 34461A and 2000, but I currently don't have a good way of shorting the input jacks - has anyone got any cheap recommendations on something I can pick up here in the UK?
Title: Re: DMM Noise comparison testing project
Post by: barnacle2k on April 15, 2015, 05:31:04 pm
Mickle very nice to see you here, you are the undisputed Solartron expert.   :-+
Could you provide a capture of your highly modified 7081?
(LTZ1000 + OP amps's + modified firmware + resistor TC compensation + and god knows what else.)
I used the binary floating point output mode not the DMM style output for maximum resolution. (uses only 48Bit of the 64Bit Double)
Command: FOrmat=Binary, Compressed

The shape of the histogram of my 7081 suggests there is averaging applied. (like you said they accumulate)
There might even be some numerical issues in their implementation, have you had a look at the floating point routines of the floating MCU Mickle?
Or is the floating point conversion done on the earthy MCU?
Because the noise suppression of this averaging doesn't appear to work as well as it should be.
Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on April 15, 2015, 07:36:45 pm
I suspected there was a relation between this drifts and the forced cooling system used on this DMM, and decided to log data with the DMM in normal "configuration", and also with the series of holes placed on both sides blocked whith a piece of paper and adhesive tape (but fan still running).
The results are shown on the graph below and pretty obvious.
Furthermore, I noticed that the temperature reported by the DMM is less (yes LESS), when the air entrance are blocked  (-1.5 to -2 degrees Celsius)!!!
I repeated this test 3 times and there is absolutly no doubt about the results.
So, I am really wondering about this cooling design and it's effects.
If I am right, other DMMs like the 34401A do not have any forced colling system.
The 34460A do not have any fan. Is anybody there could do some data logging?
Same with the 34461A. I am curious to see the results of other users doing the same (with and without blocking the air entrance).

How stable is the temperature of the environment you are in?

I have been told (by someone at Keysight) that the lesser specifications of the 34460A is due to the lack of a fan, with the readings changing depending on whether the tilting bail is covering the side holes. They also said that the fan, in the 34461/65/70A, moves very little air at room temperature and is largely there for use in equipment racks (although this isn't a recommendation to unplug it).

The 34401A does not have a fan, but some of the Keithley's do (e.g. 2001). So a fan is not necessarily a bad thing, but it requires that the airflow is properly designed.

I am intending to perform these noise measurements on my 34461A and 2000, but I currently don't have a good way of shorting the input jacks - has anyone got any cheap recommendations on something I can pick up here in the UK?
Thanks for your feedback.

My room is facing north, and the temperature is pretty stable. May be 1 to 1.5 °C  max. variation over the day when I ran this 9 hours test. For sure, no quick temperature variation that could explain the quick voltage variations. Except my presence, from time to time very close to the DMM ...

For shorting the input jacks, I use a simple copper cable creased like in my previous post. It costs nothing and it's fully efficient.

Looking for your tests results with your 34461A.

Jean
Title: Re: DMM Noise comparison testing project
Post by: Mickle T. on April 15, 2015, 08:06:02 pm
In the Solartron 7081 all of the floating point routines located in the earthed MPU ROM. In "normal" mode (with DIG FILT=off) there is no any filtering of the ADC results, but only (a*x+b) calculations with raw data.
Unfortunately, I can't capture 7081 now, but I have some old data.
Title: Re: DMM Noise comparison testing project
Post by: barnacle2k on April 15, 2015, 09:45:03 pm
In the Solartron 7081 all of the floating point routines located in the earthed MPU ROM. In "normal" mode (with DIG FILT=off) there is no any filtering of the ADC results, but only (a*x+b) calculations with raw data.
Unfortunately, I can't capture 7081 now, but I have some old data.

Thank you Mickle  :).
That's exciting news, it mean i could capture the raw Glug data off the serial isolation interface and do my own processing on it.
(but that is offtopic in this thread, i'll let you know if i find anything interesting)

If you do a new capture try using the floating point mode i mentioned above, i cobbled together a small python script to convert the raw captured rs232 bytes to csv floats.
It gives a lot more resolution then the DMM format, which is very advantageous in this specific experiment.
Title: Re: DMM Noise comparison testing project
Post by: radioFlash on April 16, 2015, 02:21:05 am
Here's a log for a Keysight 34465A on 10V scale with 10 NPLC.

Sample Count   9296
Aperture Enable:   FALSE
Auto Range:   Off
Auto Zero:   On
Input Impedance:   10 M?
Measurement:   DC Voltage
NPLC:   10
Null State:   FALSE
Null Value(Vdc):   0
Range(Vdc):   10
   
   
Measurement:   DC Voltage
Average Reading   3.75852E-08
Min Reading   -1.42748E-06
Max Reading   1.81982E-06
Max-Min   3.247300E-06
Standard Deviation   4.232794E-07

(uploaded as .txt because the forum doesn't like .csv-ugh!)
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 16, 2015, 04:34:14 am
It does look way too waivy. Please check if there is some AC hum coupled to meter.
Title: Re: DMM Noise comparison testing project
Post by: tszaboo on April 16, 2015, 09:40:40 am
So 34410A 10NPLC as you asked:

http://pastebin.com/EfHKZJ9t (http://pastebin.com/EfHKZJ9t)
Model: ,DMM 34410A
Serial Number:,MY47018945
Address: ,USBInstrument1
Date: ,2015-04-16 11:36:11

Sample Count,8772,
Aperture Enable:,False,
Auto Range:,Off,
Auto Zero:,On,
Input Impedance:,High-Z,
Measurement:,DC Voltage,
NPLC:,10,
Null State:,False,
Null Value(Vdc):,0,
Range(Vdc):,10,
Title: Re: DMM Noise comparison testing project
Post by: Jf2014 on April 16, 2015, 10:03:08 am
Here's a log for my Keithley 2001,B06  /A01 ( not calibrated )

CALIBRATION DATE : 15.04.1994
FRONT INPUT SHORT
30 min warm up
Temp 22.8 C - 23.5 C

// SETTING
:SYST:AZER:TYPE SYNC;              // enable autozero sync
:SYST:LSYN:STAT ON;                 // enable line sync
:SENS:FUNC 'VOLT:DC';               // voltage DCV
:SENS:VOLT:DC:NPLC 10;            // NPLC to 10
:SENS:VOLT:DC:RANGE 2;           // range  2V
:SENS:VOLT:DC:DIG 8.5;             // resolution to 8.5 digits
:SENS:VOLT:DC:AVER:STAT OFF; // Filter off
Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on April 16, 2015, 07:45:20 pm
Here is my log for my 34461A (2 months old).

Ranges: 0.1, 1 and 10Volts
Aperture: 10PLC (will come later with 100PLC)
Auto Zero: ON
Input impedance: HighZ (10 Giga Ohms)

Software used : Tera Term and Excel

Edit: Sorry, forgot to name X axis ... Samples ...
Title: Re: DMM Noise comparison testing project
Post by: radioFlash on April 17, 2015, 01:57:52 am
It does look way too waivy. Please check if there is some AC hum coupled to meter.

I suspect it's thermal effects from my air conditioner as it cycles on and off and the vent unfortunately points towards the meter. I've run the test a couple of times with essentially the same results. I'm using the Fluke 884X-SHORT as the shorting block.
Title: Re: DMM Noise comparison testing project
Post by: barnacle2k on April 17, 2015, 05:51:07 am
It does look way too waivy. Please check if there is some AC hum coupled to meter.

Use the suggested highpass filtering on the data.
Had good success with a simple IIR filter. (two biquads)
-3db point 0.006 with >60db attenuation for below 0.001.

i can give you the coefficients if you need them, i don't know with what you process the data.
But a filter could be easily scripted in python/c/java/basic/whatever.
Title: Re: DMM Noise comparison testing project
Post by: KedasProbe on April 18, 2015, 08:09:08 am
To compare the ADC I assume you will need to divide by the used range, also only compare the same number of PLCs, the distribution graphs would then be in ppm. (not nV)
Title: Re: DMM Noise comparison testing project
Post by: macboy on April 18, 2015, 03:32:06 pm
To compare the ADC I assume you will need to divide by the used range, also only compare the same number of PLCs, the distribution graphs would then be in ppm. (not nV)
I agree that ppm makes a lot more sense than absolute voltage.

Need to keep in mind too that different meters have different ranges. Agilent usually to 1 V, Keithley 2001 to 2 V, Keithley 199 to 3 V (and multiples). This of course affects ppm of range type data.
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 18, 2015, 04:26:14 pm
Meaning ppm from range?
Representation is easy to modify.
Title: Re: DMM Noise comparison testing project
Post by: macboy on April 18, 2015, 04:39:42 pm
Meaning ppm from range?
Representation is easy to modify.
Yes, ppm of (nominal) full scale of the range being tested. The range being tested (e.g. 2 VDC) should be including in each graph to give proper context.
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 19, 2015, 02:42:01 pm
        0.01 NPLC0.1 NPLC1 NPLC10 NPLC50 NPLC100 NPLC1000 NPLC

TiN,

I have been busy this past week but I believe I have the 3458A working with all 35 data sets in an automatic acquisition. I hope to modify it with little changes on the newer SCPI meters. I can create all 35 files with one run.

I just need clarification on the data set sizes. I have the script written to acquire based on NPLC size. Would you break down a list of samples / NPLC? Dr Frank mentioned up to 10K samples on the .01NPLC setting and decreasing from there. I just have to plug in the numbers and run the test.

I do have one odd issue that is nagging me. Occasionally, the meter will output a perfect 0.0000000 reading.  It is annoying and I don't think it is a good sample. I will add code to ignore it unless you believe there is reason to keep it. I have attached the file. I will try this on another 3458A to see if this may be part of the controller or software.

Title: Re: DMM Noise comparison testing project
Post by: TiN on April 19, 2015, 03:33:38 pm
I was thinking to get fixed timeset for each set. I have three 3 x 2001 gathering data + 2002 now since evening. Can you try 30min?
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 19, 2015, 03:56:25 pm
I will make the changes and give it a test.
Title: Re: DMM Noise comparison testing project
Post by: macboy on April 19, 2015, 11:59:45 pm
        0.01 NPLC0.1 NPLC1 NPLC10 NPLC50 NPLC100 NPLC1000 NPLC

TiN,

I have been busy this past week but I believe I have the 3458A working with all 35 data sets in an automatic acquisition. I hope to modify it with little changes on the newer SCPI meters. I can create all 35 files with one run.

I just need clarification on the data set sizes. I have the script written to acquire based on NPLC size. Would you break down a list of samples / NPLC? Dr Frank mentioned up to 10K samples on the .01NPLC setting and decreasing from there. I just have to plug in the numbers and run the test.

I do have one odd issue that is nagging me. Occasionally, the meter will output a perfect 0.0000000 reading.  It is annoying and I don't think it is a good sample. I will add code to ignore it unless you believe there is reason to keep it. I have attached the file. I will try this on another 3458A to see if this may be part of the controller or software.
Why would you think that a 0.00000000 is not a valid sample? It is just as valid as any other!
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 20, 2015, 12:54:56 am
I got these sometimes too on Keithley's, don't see how that should be a problem.
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 20, 2015, 02:40:50 am
I will leave the data as is and send it in once it is collected. If there is an issue with the samples it should show up in the plots.
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 20, 2015, 04:13:01 am
Here's are view with ppm/range representation.
Combined data from 4 meters, 2V range, 10NPLC.

There are offset correction (align tip to 0.0 xAxis) for all samples to eliminate constant offset from data.

PPM calculation:

Code: [Select]
function parserk(d) {
    d.vmeas = +((d.vk15 / 2) * 1e6)-0.395;
    d.v2002 = +((d.vk2002 / 2) * 1e6)+1.42;
    d.vk13 = +((d.vk13 / 2) * 1e6)+0.74;
    d.vk12 = +((d.vk12 / 2) * 1e6)+0.32;
    return d;
}

This gives histogram like on attached quad_hist2.png screenshot.

It could be easier to split histograms horisontally, so they don't overlap, by manual offsets via chart engine
Then it would look like quad_hist.png

X-scale need to be split by 4 as well, but need to think how to align them with graphs.
Also it could be confusing if ppm-scale would not match between all meters (let's say +/-5ppm vs +/-2ppm), as they will visually look same, if someone not carefully look on scales.

Why I want combine multiple data sets on same graph? Well, this will allow to have multiple ranges and/or multiple NPLC settings shown by one graph on same meter. I don't think comparing 32 graphs for one meter with 32 graphs for another meter would be great idea..

Any suggestions?

P.S. Graphing and processing is done by D3.js script, which is Javascript. I don't know javascript language, just fiddling with values based on google'd examples/charts.
Title: Re: DMM Noise comparison testing project
Post by: 6thimage on April 20, 2015, 07:18:15 pm
Why I want combine multiple data sets on same graph? Well, this will allow to have multiple ranges and/or multiple NPLC settings shown by one graph on same meter. I don't think comparing 32 graphs for one meter with 32 graphs for another meter would be great idea..

Any suggestions?

Combining multiple sets of data on a graph is the only useful way of doing comparisons - but the overlapping histograms are difficult to read. The only thing I can think of is drawing the different data as a line graph - essentially a line running from the top of each histogram bin. That would probably make it a lot easier to read, but I'm not sure how you would do that with D3.js (I looked at it once, then went with highcharts because it was a lot easier for what I was doing).

With regard to performing the measurements - I'm a bit against sticking some copper wire between the inputs for two reasons. The first is that I don't have any decent wire that is thick enough to do it properly and the second reason is repeatability. I was thinking about getting one of the Fluke shorts (884x-short), but they seem a little expensive (especially as I would like 2 of them).

So I've made a little board (in eagle) that is similar and I wondered what were people's thoughts on it. I'm intending to use Multi-Contact 22.1053 plugs (gold plated copper-zinc plugs that have an M4 screw on them) with aluminium locking nuts (as I can't find any gold plated nuts). I don't think the nuts will cause any problems as the plugs are only making a contact with the front of the board.
Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on April 20, 2015, 09:01:21 pm

Why I want combine multiple data sets on same graph? Well, this will allow to have multiple ranges and/or multiple NPLC settings shown by one graph on same meter. I don't think comparing 32 graphs for one meter with 32 graphs for another meter would be great idea..

Any suggestions?


Yes, there will be too many combinations. You should limit to 2 or 3 data sets per graph, and have 2 to 4 graphs.
You need then, for each graph, a quick and convenient way of selecting what data set you want to display.

That D3.js that I discovered reading this topic looks pretty nice, but I have very limited programming skills, and will not be of great help.

Anyway, for those interested, in the attachement below is an Excel worksheet where I am using the "Offset" fonction ( https://support.microsoft.com/en-us/kb/324991 ) to select in a graph a data set to be displayed. The number of data sets, and number of graphs can be extended.

This is a  very simple way of doing the job. No code, no bug ...
I have been using it numerous times in my job on huge data collections for brainstorming sessions !

Jean
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 20, 2015, 11:52:02 pm
For shorting PCBs I have few boards I could send out. No banana plugs, only PCB, I did not find copper banana plugs.
Photo attached.
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 21, 2015, 12:06:28 am
I purchased a few of these last year for replacement plugs on one of my Keithley 181 cables

http://www.douglasconnection.com/Furez-TSTWP30NP-Bare-Copper-Banana-Plug-Connectors-Pair-FZTSTWP30NP.htm?categoryId=-1 (http://www.douglasconnection.com/Furez-TSTWP30NP-Bare-Copper-Banana-Plug-Connectors-Pair-FZTSTWP30NP.htm?categoryId=-1)

They are good quality but the red and black covers are made of Aluminum and I used some heat shrink for isolation. I do not know what thread pitch it is and I think it is too fine for my die set.

They do sell these ...
http://www.douglasconnection.com/Furez-TSTW25NP-Bare-Copper-Banana-Plug-Connectors-Pair-FZTSTW25NP.htm?categoryId=-1 (http://www.douglasconnection.com/Furez-TSTW25NP-Bare-Copper-Banana-Plug-Connectors-Pair-FZTSTW25NP.htm?categoryId=-1)

You should be able to trim excess copper from the end and solder it in place. I think someone else is selling a similar product in France with the te-b38np part number.
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 21, 2015, 02:44:24 am
I have attached a script that works with the Keithley 2001 and EZGPIB. It will acquire all 20 different Range/NPLC combinations and has been tested with both the Prologix USB and Ethernet adapters.
The original script I posted was rewritten and and is based on the 3458A script. The output was formatted similar to TiN's sample data.
 
I will post the 3458A script tomorrow when I finish the first run and verify the results.
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 21, 2015, 05:22:37 pm
Attached are the scripts for the HP 3458A and Fluke 8846A.

Unless there is some show stopper with these scripts, I will continue to make more of them. I think any issues will be easy to fix and will be specific to individual scripts.

The 3458A ran last night and it went well. The only noted issue is that on the 0.1 and 0.01 NPLC settings, there was a discrepancy with the amount of data compared to different voltage ranges. The 100mV range had x4 the samples as the 1V & 10V ranges. My PC was possibly downloading or installing something even though I disabled Windows Update. A dedicated network connection would be the best scenario.

I ran the two NPLCs again this morning and so far the quantity of data is closer but there is still room for improvement. I will look into separating my test equipment from my home network.
I will upload the data to xDevs for TiN to look at this evening.

The 8846A is based on the 2001 script and has fewer settings to control. The analog and digital filters are off and the NPLC settings have some different allowed values. A quick run was performed and all range/nplc combos were acquired. The connection is through the GPIB port as it was the quickest for me to use and test.
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 21, 2015, 06:25:33 pm
Great, I never used EZGPIB before, but gave it a try, work a threat.
I use NI USB-GPIB-HS, not Prologix. EZGPIB detected it thru NI-VISA, and worked just fine.
I will leave it running overnight and report back.

What is meaning for sequence?

Code: [Select]
Sequence[0]  := '32'; Sequence[1]  := '22'; Sequence[2]  := '31'; Sequence[3]  := '30'; Sequence[4]  := '--'; Sequence[5]  := '--'; Sequence[6]  := '--';
Sequence[7]  := '--'; Sequence[8]  := '--'; Sequence[9]  := '--'; Sequence[10] := '--'; Sequence[11] := '33'; Sequence[12] := '34'; Sequence[13] := '20';
Sequence[14] := '21'; Sequence[15] := '23'; Sequence[16] := '24'; Sequence[17] := '--'; Sequence[18] := '--'; Sequence[19] := '--'; Sequence[20] := '--';
Sequence[21] := '--'; Sequence[22] := '--'; Sequence[23] := '--'; Sequence[24] := '--'; Sequence[25] := '10'; Sequence[26] := '11'; Sequence[27] := '12';
Sequence[28] := '13'; Sequence[29] := '14'; Sequence[30] := '00'; Sequence[31] := '01'; Sequence[32] := '02'; Sequence[33] := '03'; Sequence[34] := '04';

NPLC+Range?
With little help I hope I would be able to modify your .488 script to run on Agilent 34970A, Keithley 2400 and 2002 (this one can run same code as 2001, just have extra NPLC up to 50.
Also I noticed in your code ranges are 1V, 10V etc, but Keithley have 2V,20V etc ranges. Just a minor thing, as it seem to work fine even with that.
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 21, 2015, 10:19:08 pm
TiN,

You are correct on the NPLC + Range. I set it up based on the order you wanted the acquisitions. Some of the code looks odd because I was relearning Pascal as I was writing. I prefer C/C++ but that is not an option, at least not for now.

I started with the 3458A since it had the largest range+nplc combinations. From there, I can subtract unused combinations with the -- . You can also change the values to whatever you want like the 8846A that uses .02 and .2 NPLC. I left the ranges with 1's instead of 2's because they worked, but I should have followed the user manual. I changed them for the 8846A.

Your next three meters are also on my to-do list. Let me know which ones you are writing so that I can work on the others. The 34970A should be close to the 34401A but I have not seen the programming guide on either. That should cover a large number of people with the older meters. I will probably follow those with the 34420A.
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 21, 2015, 10:28:22 pm
The data from the first 3458A has been uploaded to your ftp server. The file was too large to attach. I should be acquiring another set from one with opt 002. The last one still needs repair on the GPIB interface.
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on April 22, 2015, 10:56:10 am
Hi,

I also made zero-input noise measurements on the 3458A, full speed with AZ OFF, at NPLC 0.1 and NPLC 1, i.e. 500 and 50 samples/s and NPLC 10, NPLC 100 with AZ ON, each for 1V and 10V so far.

I only collected as many data  as needed to get a stable statistics, i.e. 10000 and 1000 samples for NPLC 0.1 and NPLC 1 (20 sec each), and 100 samples for NPLC 10 and 100 (40 and 400 sec, respectively).

Then I made the usual xls population statistics, deriving the average (= DC Offset) and the standard deviation (= RMS Noise w/o DC offset).

The 10V RMS noise fits quite exactly the HP RMS noise specification, 1V is about 3x worse (instead of specified 2x)

I will measure 100mV also, and will try to program for full speed NPLC 0.01, which requires a different output format and special fast data acquisition.


TiN, besides the distribution diagrams, does your script also calculate RMS noise?

Then I would upload the data files to your server.

Frank
Title: Re: DMM Noise comparison testing project
Post by: macboy on April 22, 2015, 01:29:11 pm
I have attached a script that works with the Keithley 2001 and EZGPIB. It will acquire all 20 different Range/NPLC combinations and has been tested with both the Prologix USB and Ethernet adapters.
The original script I posted was rewritten and and is based on the 3458A script. The output was formatted similar to TiN's sample data.
 
I will post the 3458A script tomorrow when I finish the first run and verify the results.
I had meant to reply earlier.
I played a little with the earlier version of the script, and it seems fine except for one important change that I would make: Use the FETCH? or DATA? command instead of READ?. The READ command does a full reset/init of the meter before each reading (notice the "---------" display between readings). This is unnecessary, time consuming, and perhaps may lead to less stability in the readings. The DATA? and FETCH? commands will return readings without affecting the instrument in any other way. The DATA? command always immediately returns the most recent reading, and will return the same data more than once if you request data again before the next reading is ready. The FETCH? command differs in that it will return only a fresh reading; if you FETCH again before the next measurement is ready, it will block until one is ready.

So, if you only want to poll infrequently and don't care about missing a few measurements in between, then you can use either DATA or FETCH. If you want every single reading (and why not?), then you can still use either but in different ways. With DATA, you can discard repeats by looking at the reading number (you might need to configure the instrument to include that in the readings). The program will need to deal with the duplicates, but you will never block/hog the IEEE bus. With FETCH, the program is a little simpler, since the readback will only complete when fresh data is available, but it will block the bus until then. This is only important if you have multiple instances of EZGPIB running on multiple meters for example. If the bus is dedicated to this task then it doesn't matter as long as the timeout is set long enough to account for the delay imposed by the meter.
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 22, 2015, 02:22:50 pm
Dr. Frank
Graphing script does not calculate RMS noise, as well as SD, mean, min, max values and sample window math, but that would be not hard to add after we get all display data format and representation finalized.

macboy

I used READ? as well before. And simply changing READ to FETCH or DATA does not work well, with DATA it does not actually trigger measurement, but just takes reading, while FETCH gives bunch of errors when trying to run on two meters, blocking both.

P.S. Also funny note, running EZGPIB makes my one of my 2001's emit high-pitched buzz. I hear electrons moving in meter's brain, as buzz is different when sampling at different NPLCs :) Did not had it before with LabView.
Title: Re: DMM Noise comparison testing project
Post by: macboy on April 22, 2015, 03:20:30 pm
Dr. Frank
Graphing script does not calculate RMS noise, as well as SD, mean, min, max values and sample window math, but that would be not hard to add after we get all display data format and representation finalized.

macboy

I used READ? as well before. And simply changing READ to FETCH or DATA does not work well, with DATA it does not actually trigger measurement, but just takes reading, while FETCH gives bunch of errors when trying to run on two meters, blocking both.

P.S. Also funny note, running EZGPIB makes my one of my 2001's emit high-pitched buzz. I hear electrons moving in meter's brain, as buzz is different when sampling at different NPLCs :) Did not had it before with LabView.
The script should issue one "READ" to initiate measurements, then go into the big loop doing "DATA?" repeatedly.
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 22, 2015, 05:53:48 pm
Thanks, will try tomorrow.

Here some data normalized to range.
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on April 22, 2015, 06:51:48 pm
Not so good, sorry!

Legend is missing (NPLC is the difference????)

And different X-scaling.

Please improve!

Frank
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 22, 2015, 07:08:04 pm
That is a question there, how to show diffent X scales for different settings? If use same scale, graphs end up thin line for base ranges and slow NPLC and spread all over for fast NPLC and high voltage ranges.
Group by only by NPLC does not solve it either. Need a better way. Matrix of graphs with own scales on each range perhaps?
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on April 22, 2015, 09:38:23 pm
well I think, as this should be comparative, the x-scale should always be the same, to show the width  of the distribution.
Naturally, the NPLC determines greatly the noise figure, therefore, this parameter should be indicated always, and also in a comparative manner, i.e. same NPLC at the same graphical position.

Btw.: I've finished the 3458A measurements, no surprise, as specified, and obviously the best performer here, currently.

Frank
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 22, 2015, 09:48:27 pm
The script should issue one "READ" to initiate measurements, then go into the big loop doing "DATA?" repeatedly.

I will test this out on the 8846A tonight. I have found an issue with the 8846A script, it seems that I am calling some commands too often and it is hanging on the second 100NPLC acquisition.

Anybody who has run this script has probably seen it already. I should have tested this more thoroughly.

TiN,

Maybe all the test scripts can be listed on the first page to keep everything in one place? I can send them to you after some more testing with macboy's recommendations.
Title: Re: DMM Noise comparison testing project
Post by: jlmoon on April 22, 2015, 09:58:59 pm
Will make every attempt to gather data from my 3458.. as of yet have not had a reason to use the NI / 488 interface in my computer.  Hope I am able to climb up the steep learning curve on that one. 

JLM
Title: HP3458A RMS Noise performance
Post by: Dr. Frank on April 23, 2015, 11:49:18 am
Hi,

I did 12 measurements, NPLC 0.1 / 1 / 10 / 100 for DC 0.1V / 1V / 10V.

The standard deviation for each measurement equals the RMS noise.

The attached diagram clearly summarizes the HP3458A noise specification and the real measurements.

(csv files uploaded)

Frank
Title: Re: HP3458A RMS Noise performance
Post by: macboy on April 23, 2015, 01:05:05 pm
Hi,

I did 12 measurements, NPLC 0.1 / 1 / 10 / 100 for DC 0.1V / 1V / 10V.

The standard deviation for each measurement equals the RMS noise.

The attached diagram clearly summarizes the HP3458A noise specification and the real measurements.

(I will upload the csv files later.)

Frank
I like this chart, it is a very informative way to present the data. It clearly shows the tradeoff between integration time (i.e. sampling speed) and noise or effective resolution. It also illustrates that the 100 mV range on this instrument is practically limited by the ten-fold increase in noise over the 1 V range, and that the 1 V range still has good noise performance. I would be curious to see at what point the noise takes off for other insturments.

I think that it would be quite easy to compare multiple instruments on a single chart too. Lines in shades of blue for one instrument, red for another, green for another, etc.

We can see here that noise is inversely proportional to the square root of the integration time (100x longer ~= 1/10 noise). We know from the histograms that the noise is essentially gaussian - it has a nice bell curve. We also know that if you have gaussian noise in your samples, you can reduce noise by averaging samples; the reduction in noise is proportional to the square root of the number of samples(*). So, in theory, we should see a similar noise level when averaging 100x 1.0 PLC samples per reading, as when taking 100 PLC readings. We should be able to confirm this by applying the math to the raw data, provided there are sufficient samples.

*refer to Silicon Labs AN118  (https://www.silabs.com/Support%20Documents/TechnicalDocs/an118.pdf)for theory and application.
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on April 27, 2015, 10:53:29 am
Hartlijke Groeten van de Koningsdag in Ouddorp!

Frank
Title: Re: DMM Noise comparison testing project
Post by: 6thimage on April 27, 2015, 10:45:55 pm
@TiN: thanks for the offer of a short board, but its difficult to find decent plugs here. I considered what to do for a short while, and then bought the fluke 884x-short.

I've run some initial data collection on my 34461A - I aimed at an hour for each of the PLC settings on 10 V, with the meter sampling as fast as it can. I tried to figure out the number of measurements that would take an hour for all of the PLCs, which seemed to work quite well with the exception of the 0.02, which ended up being around 45 minutes.

This is the python script I've been using to perform the measurements:
Code: [Select]
import time

#import usbtmc as tmc
#inst=tmc.instrument(tmc.KEYSIGHT_34461A)
import ethernet
inst=ethernet.instrument('192.168.0.19')

def error_check():
    while True:
        error=inst.ask('syst:err?')
        if error[:2]=='+0':
            return
        print error

print 'ID: {}'.format(inst.ask('*idn?'))
uptime=inst.ask('syst:upt?').split(',')
print 'Uptime: {} {:02}:{:02}:{:02}, line frequency: {} Hz, temperature: {}'.format(
        int(uptime[0]), int(uptime[1]), int(uptime[2]), int(uptime[3]),
        int(inst.ask('syst:lfr?')), float(inst.ask('syst:temp?')))
print 'Cal string: {}, cal date: {}, cal temperature: {}'.format(
        inst.ask('cal:str?'), inst.ask('cal:date?'), float(inst.ask('cal:temp?')))

inst.write('*rst')
inst.write('*cls')
inst.write('abort')

inst.write("sens:func 'volt:dc'")
inst.write('volt:null:stat off')
inst.write('volt:zero:auto on') # auto zero on
inst.write('volt:imp:auto on') # enable high impendance for 0.1, 1 and 10 vdc
inst.write('disp:stat off') # disables the screen

# triggering
inst.write('trig:sour imm')
# as fast as possible
inst.write('trig:del:auto on')
# once per second
#inst.write('trig:del 1')

inst.write('volt:range 10')

error_check()

#dcv ranges - 0.1 1 10 100 1000
#plc - 0.02 0.2 1 10 100 (rdgs/s 1000, 300, 50, 5, 0.5)
nplc=         ['0.02', '0.2',  '1',    '10',   '100']
sample_count= ['1000', '300',  '50',   '5',    '1']
trigger_count=['1800', '1800', '1800', '1800', '900']

for i in range(0, 5):
    print 'nplc: {}, samples: {}, count: {}'.format(nplc[i], sample_count[i], trigger_count[i])
    print 'temperature: {}, time: {}'.format(float(inst.ask('syst:temp?')),
            time.strftime('%d%m%y-%H%M%S'))

    # measurement set up
    inst.write('volt:nplc {}'.format(nplc[i]))
    inst.write('samp:count {}'.format(sample_count[i]))
    inst.write('trig:count {}'.format(trigger_count[i]))

    error_check()

    inst.write('init')

    num_results=int(sample_count[i])*int(trigger_count[i])

    # reading
    results=[]
    while len(results)<num_results:
        resp=inst.ask('r?')
        header_length=int(resp[1])
        data_length=resp[2:2+header_length]
        if int(data_length)==0:
            time.sleep(1)
        else:
            results+=resp[2+len(data_length):].split(',')

    print 'temperature: {}, time: {}'.format(float(inst.ask('syst:temp?')),
            time.strftime('%d%m%y-%H%M%S'))

    with open('34461a-10vdc-{}-{}.dat'.format(nplc[i], time.strftime('%d%m%y-%H%M%S')), 'w') as f:
        for result in results:
            f.write('{}\n'.format(result))

error_check()
The second temperature and time output (after the reading loop) was added after I had started the first run.

I've thrown the data files up onto dropbox https://www.dropbox.com/sh/ubsqjr8d5uiaufj/AACm2P6GARq0H5nqs6Y39ybfa?dl=0 (https://www.dropbox.com/sh/ubsqjr8d5uiaufj/AACm2P6GARq0H5nqs6Y39ybfa?dl=0) - the meter was allowed to warm up for just under 3 and a half hours with the short in the front connectors.

I have attached two plots - one is the histograms with a fitted normal distribution, the other is the same histograms but with the density plotted on top. The 0.02 range shows some strange behaviour - with some strange oscillations. The data on dropbox, also has a second run on the 0.02 range completed after the first run through, which does exactly the same. So I'm not sure what is going on there.
Title: Re: DMM Noise comparison testing project
Post by: blackdog on April 28, 2015, 07:47:40 am
Hi Dr Frank,

You are looking good  :-DD
But i expected at least a 4,5 Digit DMM under your arm, scored on the flea market, not Silly Willie and his wive  ;)

Kind regarts,
Blackdog
Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on April 28, 2015, 02:52:16 pm
The 0.02 range shows some strange behaviour - with some strange oscillations. The data on dropbox, also has a second run on the 0.02 range completed after the first run through, which does exactly the same. So I'm not sure what is going on there.

I already observed that behaviour with my 34461A / 50Hz, but this does not occur only at 0.02 PLC. If you look carrefully, you will observe the same at other PLC n°.
The "step" value at 10V, 0.02 PLC is close to 100µV, but not exactly. A bit less ... Hummm ...

I can't yet explain it. Something to do with the sampling / AD mechanism?
I'am close to 60 years old but still an "apprentit" voltnut. May be the "senior" voltnuts here have some ideas ?

Below, some datas at 10 Volts and 0.02 PLC.
Title: Re: DMM Noise comparison testing project
Post by: LaurentR on April 28, 2015, 03:22:42 pm
The 0.02 range shows some strange behaviour - with some strange oscillations. The data on dropbox, also has a second run on the 0.02 range completed after the first run through, which does exactly the same. So I'm not sure what is going on there.

I already observed that behaviour with my 34461A / 50Hz, but this does not occur only at 0.02 PLC. If you look carrefully, you will observe the same at other PLC n°.
The "step" value at 10V, 0.02 PLC is close to 100µV, but not exactly. A bit less ... Hummm ...

I can't yet explain it. Something to do with the sampling / AD mechanism?
I'am close to 60 years old but still an "apprentit" voltnut. May be the "senior" voltnuts here have some ideas ?

I wonder how the resolution really works (not familiar with the ADC of the 34461A). The real 10V range is 11V, so we should see 1.1mV steps but you;re seeing slightly less than 100uV...
Below, some datas at 10 Volts and 0.02 PLC.

Is the issue the discrete steps? If you believe the resolution tables, e.g.:
http://rfmw.em.keysight.com/bihelpfiles/Truevolt/WebHelp/US/Content/Misc_Definitions/Range-Resolution_Relationships.htm#kanchor581 (http://rfmw.em.keysight.com/bihelpfiles/Truevolt/WebHelp/US/Content/Misc_Definitions/Range-Resolution_Relationships.htm#kanchor581)
The 34461A at 0.02PLC has a resolution factor of 100ppm, which would mean 1mV on the 10V range.

So I am not surpised to see discrete steps, but I am surprised to see them at 100uV...
As far as the jitter still noticeable at 0.02PLC, it could be due to AutoZero being ON? Even at 10V there will be small offsets that will be compensated and create jitter (although the offsets should also be read out with the same 0.02PLC resolution). I wonder if you'll see pure discrete steps if you turn it off.
Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on April 28, 2015, 03:55:28 pm
The 0.02 range shows some strange behaviour - with some strange oscillations. The data on dropbox, also has a second run on the 0.02 range completed after the first run through, which does exactly the same. So I'm not sure what is going on there.

I already observed that behaviour with my 34461A / 50Hz, but this does not occur only at 0.02 PLC. If you look carrefully, you will observe the same at other PLC n°.
The "step" value at 10V, 0.02 PLC is close to 100µV, but not exactly. A bit less ... Hummm ...

I can't yet explain it. Something to do with the sampling / AD mechanism?
I'am close to 60 years old but still an "apprentit" voltnut. May be the "senior" voltnuts here have some ideas ?

Below, some datas at 10 Volts and 0.02 PLC.

I wonder how the resolution really works (not familiar with the ADC of the 34461A). The real 10V range is 11V, so we should see 1.1mV steps but you;re seeing slightly less than 100uV...
Is the issue the discrete steps? If you believe the resolution tables, e.g.:
http://rfmw.em.keysight.com/bihelpfiles/Truevolt/WebHelp/US/Content/Misc_Definitions/Range-Resolution_Relationships.htm#kanchor581 (http://rfmw.em.keysight.com/bihelpfiles/Truevolt/WebHelp/US/Content/Misc_Definitions/Range-Resolution_Relationships.htm#kanchor581)
The 34461A at 0.02PLC has a resolution factor of 100ppm, which would mean 1mV on the 10V range.

So I am not surpised to see discrete steps, but I am surprised to see them at 100uV...
As far as the jitter still noticeable at 0.02PLC, it could be due to AutoZero being ON? Even at 10V there will be small offsets that will be compensated and create jitter (although the offsets should also be read out with the same 0.02PLC resolution). I wonder if you'll see pure discrete steps if you turn it off.

Thank's for your feedback.

I moved your sentence "I wonder how the resolution really works (not familiar with the ADC of the 34461A). The real 10V range is 11V, so we should see 1.1mV steps but you;re seeing slightly less than 100uV..." at the right place.

A resolution factor of 100ppm at 10V range means a resolution of 100µV. Am I correct?
I ran a short trial with AutoZero OFF, and it looks like it is the same. But to be confirmed.
You put me on a new track, and I will collect more datas to get the exact step value.

Anyway, this "issue" is may be off topic...
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on April 28, 2015, 04:45:00 pm
This looks like limited resolution of the raw ADC data at the high speed reading. For calibration the raw data are multiplied with a floating point number and that rounded to a fixed number of decimal places. So each bin of the histogram may not cover the same number of possible values from the raw ADC reading. Some bins may correspond to just 1 ADC reading and other to 2.

Some of the curves can not be explained with this. My guess, is there is also some digital filtering involved that may some readings even less likely.

So these strange looking histograms are cases where DNL erorrs are rather large.
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on April 28, 2015, 06:16:33 pm
The 0.02 range shows some strange behaviour - with some strange oscillations. The data on dropbox, also has a second run on the 0.02 range completed after the first run through, which does exactly the same. So I'm not sure what is going on there.

I already observed that behaviour with my 34461A / 50Hz, but this does not occur only at 0.02 PLC. If you look carrefully, you will observe the same at other PLC n°.
The "step" value at 10V, 0.02 PLC is close to 100µV, but not exactly. A bit less ... Hummm ...

I can't yet explain it. Something to do with the sampling / AD mechanism?
I'am close to 60 years old but still an "apprentit" voltnut. May be the "senior" voltnuts here have some ideas ?

Below, some datas at 10 Volts and 0.02 PLC.


I'm a relative Junior volt-nuts  :-DMM, but all HP DMM will deliver lesser resolution by shorter aperture / NPLC.

The 3458A goes down from 8 1/2 digits at NPLC10 to 4 1/2 digits at 100kHz, therefore up goes the noise, and very similar behave all other HP DMMs.

It's all in the digitizing specification, I think.

Frank
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 29, 2015, 04:56:53 am
I uploaded the latest file for the 2001 to TiN's FTP server. I made a lot of adjustments based on macboy's recommendations. For now, it will not be posted it here. Perhaps TiN could create a central location if he wishes.

I had to do a lot of reading from different operator's manuals to understand what macboy meant. The Read? command will only read from the external buffer, where the INIT / Data? / Fetch read from the internal buffer which is much faster.

The 8846A was relatively easy to configure. The Keithley meters are so configurable, it took me a while to find enough sample code to get it functional. I have been making improvements to both scripts but the 2001 is first to be uploaded. I would like TiN, macboy, or anyone with spare time (and 2001) to test it while I finish the 8846A. I can email it if someone can't find it on the ftp server.

Any more suggestions are welcome.
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 29, 2015, 03:52:54 pm
I will try it as well as process data we gathered on friday, we have national holiday here , so will finally get some time to do something.  :bullshit:
Will also test it on 2002 and 2400 for you.
Title: Re: DMM Noise comparison testing project
Post by: barnacle2k on April 30, 2015, 05:03:38 pm
I will try it as well as process data we gathered on friday, we have national holiday here , so will finally get some time to do something.  :bullshit:
Will also test it on 2002 and 2400 for you.

Oh dear, that means i gotta finish my data collection on the 7081 till then.
All the super long integration time stuff is done so it should be quick, i am gathering about 2.5k samples per range&integration-time.

Edit:
All done, file attached.
Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on May 03, 2015, 12:30:33 pm
Hi Volnuts gang's members !

I have collected a lot of data during the past days but I am dealing with 2 issues:
I reported the first one in this topic : https://www.eevblog.com/forum/testgear/34461a-line-frequency-setting-wrong-after-front-panel-reset/ (https://www.eevblog.com/forum/testgear/34461a-line-frequency-setting-wrong-after-front-panel-reset/)
I don't know how much of my data collection was created with the wrong LF value, and don't know how it really affects the noise measurement.
If anyone here owns a 344xxA model running on 50 Hz power line, please test it, and give me your thoughts about this bug.

My second issue is related to quick temperature drifts affecting the 10 and 100 PLC datas series (Added: for 0.1 and 1 V ranges). Again, it seems that this fan is bringing more trouble than benefit, at least in a normal room temperature condition.  (see post #61, page 4). The story is certainly different in a rack configuration in a hot environement where a forced cooling system is necessary.

I ran a test with different cooling configurations and will report later ...

Jean


Title: Re: DMM Noise comparison testing project
Post by: 6thimage on May 03, 2015, 01:19:21 pm
I don't know how much of my data collection was created with the wrong LF value, and don't know how it really affects the noise measurement.
If anyone here owns a 344xxA model running on 50 Hz power line, please test it, and give me your thoughts about this bug.

For the data collection, were you performing a front panel reset before hand? And how were you collecting the data - front panel or remote script?

My second issue is related to quick temperature drifts affecting the 10 and 100 PLC datas series. Again, it seems that this fan is bringing more trouble than benefit, at least in a normal room temperature condition.  (see post #61, page 4). The story is certainly different in a rack configuration in a hot environement where a forced cooling system is necessary.

I ran a test with different cooling configurations and will report later ...
I have ran some tests of my own (I need to upload the data), and whilst covering the sides seems to effect the offset value, it does not affect the noise - the histograms with and without the sides covered look almost identical.

How much of a temperature drift are you talking about? I've noticed that if the ambient temperature changes by 1 to 2 degrees (C) the histogram will be double peaked.

It is very easy to blame the fan, but with regards to noise and warm up time, I haven't seen any difference with the sides covered or not. I did notice similar behaviour to the graph in your post (#51), but this seems to just be a change in the offset value.
Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on May 03, 2015, 01:46:57 pm
I don't know how much of my data collection was created with the wrong LF value, and don't know how it really affects the noise measurement.
If anyone here owns a 344xxA model running on 50 Hz power line, please test it, and give me your thoughts about this bug.

For the data collection, were you performing a front panel reset before hand? And how were you collecting the data - front panel or remote script?

My second issue is related to quick temperature drifts affecting the 10 and 100 PLC datas series. Again, it seems that this fan is bringing more trouble than benefit, at least in a normal room temperature condition.  (see post #61, page 4). The story is certainly different in a rack configuration in a hot environement where a forced cooling system is necessary.

I ran a test with different cooling configurations and will report later ...
I have ran some tests of my own (I need to upload the data), and whilst covering the sides seems to effect the offset value, it does not affect the noise - the histograms with and without the sides covered look almost identical.

How much of a temperature drift are you talking about? I've noticed that if the ambient temperature changes by 1 to 2 degrees (C) the histogram will be double peaked.

It is very easy to blame the fan, but with regards to noise and warm up time, I haven't seen any difference with the sides covered or not. I did notice similar behaviour to the graph in your post (#51), but this seems to just be a change in the offset value.

Line frequency issue:
I collected the data from remote scripts, but over several days, playing with different scripts. I am now looking to all files and from the recorded time data, I should be able to extract those with the right frequency line setting.

Fan:
I suspect that the fan is creating some turbulences into the DMM resulting into non homogeneous temperature over sensitive components.
I am surprised that you don't see any difference with the sides covered or not. I ran yesterday another test from front panel, with the correct LF setting and manual recording of the DMM internal temperature. To cover the sides, I used some rectangular pieces of magnetic rubber.

Everything is summarized in the graph below.

The results are, for me, obvious, and best results are achieved with sides covered and fan off ...

Regards,
Jean

Edit: Added DMM screen capture from cooling experiments
Title: Re: DMM Noise comparison testing project
Post by: 6thimage on May 03, 2015, 02:32:38 pm
Fan:
I suspect that the fan is creating some turbulences into the DMM resulting into non homogeneous temperature over sensitive components.
I am surprised that you don't see any difference with the sides covered or not. I ran yesterday another test from front panel, with the correct LF setting and manual recording of the DMM internal temperature. To cover the sides, I used some rectangular pieces of magnetic ribbon.

Everything is summarized in the graph below.

The results are, for me, obvious, and best results are achieved with sides covered and fan off ...

I do see a difference in the offset, but not in the noise. I've attached a few graphs - the first two show the histograms with either a fitted normal distribution or the density. The last (density-plot-comp.png) is a comparison of the densities of the covered and non-covered histograms. The covered is blue, the non-covered is red. There are very little differences between the two.

Numerically comparing the two:
non-coveredcovered
min-9.024061e-07-6.228938e-06
max7.918318e-07-4.592069e-06
range1.694238e-06-5.314253e-06
mean-1.44677e-081.636869e-06

Data is on dropbox again @ https://www.dropbox.com/sh/ubsqjr8d5uiaufj/AACm2P6GARq0H5nqs6Y39ybfa?dl=0 (https://www.dropbox.com/sh/ubsqjr8d5uiaufj/AACm2P6GARq0H5nqs6Y39ybfa?dl=0)

Now, why are we seeing different results? My guess is either the rate of change of ambient temperature or the method for blocking the sides (I used paper held in place by the straps of my accessory bag). I am going to try disconnecting the fan to see if that produces any difference.

Something that I meant to ask before - are you shorting the front or rear terminals?

Additionally, when you use the front panel to make measurements, do you start the measurements then leave it alone? I have noticed, when doing other measurements (resistance), that moving near the input jacks can affect the readings.
Title: Re: DMM Noise comparison testing project
Post by: 6thimage on May 03, 2015, 02:36:41 pm
@OldNeurons

I also just noticed that you are using the 100 mV range - have you been consistently using 100 mV for these readings?

All of the readings I have been doing are on the 10 V range (as it will have the best accuracy for measuring the noise of the ADC).
Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on May 03, 2015, 02:43:25 pm
@OldNeurons

I also just noticed that you are using the 100 mV range - have you been consistently using 100 mV for these readings?
Yes ...!

All of the readings I have been doing are on the 10 V range (as it will have the best accuracy for measuring the noise of the ADC).
I have no problem with 10 V range as I already mentionned.
Title: Re: DMM Noise comparison testing project
Post by: 6thimage on May 03, 2015, 02:48:46 pm
@OldNeurons

I also just noticed that you are using the 100 mV range - have you been consistently using 100 mV for these readings?
Yes ...!

All of the readings I have been doing are on the 10 V range (as it will have the best accuracy for measuring the noise of the ADC).
I have no problem with 10 V range as I already mentionned.

Where the hell did you mention that? It seems I've been comparing apples and oranges :palm:

Right then, I will try doing some measurements on the 100 mV, and probably 1 V, ranges.
Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on May 03, 2015, 02:50:54 pm

Something that I meant to ask before - are you shorting the front or rear terminals?

Additionally, when you use the front panel to make measurements, do you start the measurements then leave it alone? I have noticed, when doing other measurements (resistance), that moving near the input jacks can affect the readings.

Front terminals, but front or rear, why should that make a difference? It's a short.
Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on May 03, 2015, 02:56:27 pm

Where the hell did you mention that? It seems I've been comparing apples and oranges :palm:

Right then, I will try doing some measurements on the 100 mV, and probably 1 V, ranges.

DMM main settings are indicated on the X axis graph.
Title: Re: DMM Noise comparison testing project
Post by: 6thimage on May 03, 2015, 03:05:33 pm
It shouldn't make any difference, but the rear terminals are closer to the fan so their temperature rate of change might be different. If we are trying to do accurate comparisons, we need to have setups that are as close as possible.

On a separate note - I have just added another python script to my dropbox folder above that will read the internal temperature of the meter without putting it into remote mode, so you can use it whilst other remote scripts are running or whilst you are controlling it from the front panel. It turns out that the 3446xA series have two network ports they answer on - 5025 is the standard sockets port, which will put the meter into remote on almost all commands, but there is also 5042 which is the web port - it is what the java interface uses and has exactly the same SCPI interface. The only exception is that you cannot change any of the meter's settings without putting it into remote mode first (via diag:remote).
Title: Re: DMM Noise comparison testing project
Post by: 6thimage on May 03, 2015, 03:07:01 pm

Where the hell did you mention that? It seems I've been comparing apples and oranges :palm:

Right then, I will try doing some measurements on the 100 mV, and probably 1 V, ranges.

DMM main settings are indicated on the X axis graph.

Yeah, in a nice title ... I don't know how I missed that
Title: Re: DMM Noise comparison testing project
Post by: Galaxyrise on May 04, 2015, 05:00:27 am
I finally repeated my Keithley 2000 measurements, this time without losing the data ;)  I also wrote a program to test the entire matrix of {100V, 10V, 1V, 0.1V} x {1 NPLC, 10 NPLC }.  I only attached the histogram from 10V, 10NPLC.  Not surprisingly, it's about 10x as noisy as Tin's 2001 and very similar to the 34461 data.

The data is a tsv.  The first column is reading number, the first row is range and the second row is nplc.
Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on May 04, 2015, 04:51:28 pm
Hi all,

Finally, it's there !
No… not the 'Beaujolais Nouveau', but my DMM noise data.  :clap:

I have been battling  :box: with temperature drifts, and finally decided to move the DMM in a guest bedroom, away from any heat source (including humans), stopped the fan, covered right and left sides of the DMM and let it warm up  until I get a stable temperature at 31°C +0 / +0.3 ... and collected data again!

I uploaded the files on TiN’s ftp server.

ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_01_344641A_10V_%200.02PLC.csv
ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_02_344641A_10V_%200.2PLC.csv (http://ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_02_344641A_10V_%200.2PLC.csv)
ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_03_344641A_10V_1PLC.csv (http://ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_03_344641A_10V_1PLC.csv)
ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_04_344641A_10V_%2010PLC.csv (http://ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_04_344641A_10V_%2010PLC.csv)
ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_05_344641A_10V_100PLC.csv (http://ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_05_344641A_10V_100PLC.csv)
ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_06_344641A_1V_%200.02PLC.csv (http://ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_06_344641A_1V_%200.02PLC.csv)
ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_07_344641A_1V_%200.2PLC.csv (http://ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_07_344641A_1V_%200.2PLC.csv)
ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_08_344641A_1V_1PLC.csv (http://ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_08_344641A_1V_1PLC.csv)
ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_09_344641A_1V_%2010PLC.csv (http://ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_09_344641A_1V_%2010PLC.csv)
ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_10_344641A_1V_%20100PLC.csv (http://ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_10_344641A_1V_%20100PLC.csv)
ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_11_344641A_0.1V_%200.02PLC.csv (http://ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_11_344641A_0.1V_%200.02PLC.csv)
ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_12_344641A_0.1V_%200.2PLC.csv (http://ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_12_344641A_0.1V_%200.2PLC.csv)
ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_13_344641A_0.1V_%201PLC.csv (http://ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_13_344641A_0.1V_%201PLC.csv)
ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_14_344641A_0.1V_%2010PLC.csv (http://ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_14_344641A_0.1V_%2010PLC.csv)
ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_15_344641A_0.1V_%20100PLC.csv (http://ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_RAW_15_344641A_0.1V_%20100PLC.csv)


All are RAW data, with a pretty  large DC offset due to DMM temperature.

I also added an Excel file containing the raw and normalized data,  a summary with the RMS values for each combination, DMM infos and settings.

ftp://datashort@xdevs.com/OldNeurons/Noise_Data_04_05_2015/OldNeurons_34461A_Noise_Data.xlsx

I also like the chart proposed by Frank some days ago. A very nice way to summarize all that stuff.
https://www.eevblog.com/forum/testgear/dmm-adc-noise-comparison-testing-project/msg658530/#msg658530 (https://www.eevblog.com/forum/testgear/dmm-adc-noise-comparison-testing-project/msg658530/#msg658530)

It’s close to cocktail hour here in France …
So …
Cheers, Prosit, Proost, Salud, Skal, Cin cin, Kanpai, Na zdrowie, Noroc, Santé …
Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on May 06, 2015, 09:36:24 am
I updated the Excel file on TiN's FTP (Added graph).
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on May 06, 2015, 11:14:32 am
OldNeurons,

these measurements, and especially the overview diagram are well done!

I think we'll open une bouteille de Moussy Maurice, ce soir..  :popcorn:

One question: the NPLC 0.02 and NPLC 0.2, are these measurements done in real time, i.e.  each 40µs / 400µs?

Frank
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on May 06, 2015, 04:37:56 pm
TiN,

Did you get time to run your 2001 and 2400 last week? I would like to know if you were able to get it to work as expected?
Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on May 06, 2015, 07:40:54 pm
these measurements, and especially the overview diagram are well done!

Thank you Frank, but for the diagram, you showed me the way, which is, to my opinion, the most concise one.
I return the compliment to you.

I think we'll open une bouteille de Moussy Maurice, ce soir..  :popcorn:

Seems to be be a good choice! Birthday?
Santé !

One question: the NPLC 0.02 and NPLC 0.2, are these measurements done in real time, i.e.  each 40µs / 400µs?

At 0.02 and 0.2 NPLC the 34461A, running either at 50Hz or 60 Hz have the same aperture times: 3ms at 0.2 NPLC and 0.3ms at 0.02 NPLC. The Auto Zero fonction doubles the time between 2 samples. Some time ago I measured 6.444 ms at 0.2 NPLC, AutoZero ON (from the front panel).

You have probably looked carefully to the Excel file and noticed that NPLC 0.02 and 0.2 data are not the 14 decimal places as for the other measurements, and this is probably why you are asking.

This is my mistake.

As previously mentionned, I moved my device in a bedroom with no LAN connection. So, all measurements have been performed the same way, from the front panel, data saved on a USB stick.
My mistake occured during the moves from the USB stick to Excel, and saving from Excel to CSV format. You probably know that within Excel, when saving to the csv format, you save what is visible in your cells. In my case, I had data in scientific notation, with 2 decimal places and saved to csv format like this.
When I discovered my mistake, all original files on my USB stick where deleted ...
So, I performed again all measurements except the 0.2 and 0.02 NPLC measurements because in fact that does not affect really the final results.
A long story ...

Jean
Title: Re: DMM Noise comparison testing project
Post by: timofonic on May 07, 2015, 12:25:23 am
Are there going to be a explained summary about the less noise ones in different price ranges and such? That would be amazing!
Title: Re: DMM Noise comparison testing project
Post by: TiN on May 07, 2015, 04:24:23 am
ManateeMafia,

I did some runs on 2001, but had some issues (unrelated to script) and still need little more time.
Hope to post summary and details this weekend.
Title: Re: DMM Noise comparison testing project
Post by: Fsck on May 07, 2015, 04:26:06 am
Are there going to be a explained summary about the less noise ones in different price ranges and such? That would be amazing!

that kind of summary would be hell with the used markets.
Title: Re: DMM Noise comparison testing project
Post by: timofonic on May 07, 2015, 05:22:05 am
Are there going to be a explained summary about the less noise ones in different price ranges and such? That would be amazing!

that kind of summary would be hell with the used markets.
What do you mean? Sorry, maybe my English skills need improvements.
Title: Re: DMM Noise comparison testing project
Post by: PedroDaGr8 on May 07, 2015, 05:26:22 am
Are there going to be a explained summary about the less noise ones in different price ranges and such? That would be amazing!

that kind of summary would be hell with the used markets.
What do you mean? Sorry, maybe my English skills need improvements.
Since these are mostly models of DMMs which are no longer produced, all purchases would be used items. Prices vary so widely on the used market, it would be very difficult to provide the breakdown you requested.
Title: Re: DMM Noise comparison testing project
Post by: Fsck on May 07, 2015, 05:29:32 am
Are there going to be a explained summary about the less noise ones in different price ranges and such? That would be amazing!

that kind of summary would be hell with the used markets.
What do you mean? Sorry, maybe my English skills need improvements.

the fluctuating prices. like the keithley 2000 and 2001, you probably wouldn't buy new with the great used market and age of the design. the 2002 is sort of uninteresting in comparison to the agilent 3458 or the fluke 8508. the agilent 34401 hasn't been discontinued, but it's not a great buy with the 34461/65/70, etc.
Title: Re: DMM Noise comparison testing project
Post by: timofonic on May 07, 2015, 06:16:33 pm
Are there going to be a explained summary about the less noise ones in different price ranges and such? That would be amazing!

that kind of summary would be hell with the used markets.
What do you mean? Sorry, maybe my English skills need improvements.

the fluctuating prices. like the keithley 2000 and 2001, you probably wouldn't buy new with the great used market and age of the design. the 2002 is sort of uninteresting in comparison to the agilent 3458 or the fluke 8508. the agilent 34401 hasn't been discontinued, but it's not a great buy with the 34461/65/70, etc.
Those can be marked as special cases, right?

Anyway, a summary of the less noisy ones would be great. Data is cool, but it's better if it's in a didactical and easier to read form for us newbies.

I understand this data is targeted for hardcore geeks , the task is difficult to do and very probably too much time consuming. Take it as an ingenious suggestion! ;)
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on May 08, 2015, 02:30:46 pm
TiN,

I have uploaded a dataset from the 2002. It looks small but it may be the meter itself. The script is nearly identical to the 2001 except there is no analog filter option.

I also uploaded the 2002 and 2001 scripts. I made a small change to the 2001, it appeared that I could set the trigger count after calling the INIT function, but I should have set the count before it. I had to make the change for the 8846A and 2400.

The 8846A is being retested but it should be uploaded tonight. The 2400 script is being worked on now and should be finished in the next day.
Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on May 09, 2015, 08:20:19 pm
Added 100 V data from my 34461A and updated Excel file.
ftp://datashort@xdevs.com/OldNeurons/Noise_Data_09_05_2015
X axis now shows integration time as defined in user manual.
Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on May 10, 2015, 03:17:36 pm
Finally added 1000 V range data ... No more to come now.
Excel file updated and uploaded, as well as new files.
As you can see below, the 10 and 1000 V curves overlap.
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on May 11, 2015, 11:48:03 am
I uploaded several scripts to the xDevs ftp server. They are for the Keithley 2400, HP 34420A, and Fluke 8846A (finally). The 8846A was challenging and several of the changes were added to all the scripts to deal with the random timeouts from the 8846A. The 2001 and 2002 scripts were also modified and replaced. The 34420A is configurable to either input channel.

I am finally getting around to collecting data. I just uploaded a dataset for one 8846A. I will be adding more through the week.





Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on May 11, 2015, 01:47:48 pm
I uploaded several scripts to the xDevs ftp server. They are for the Keithley 2400, HP 34420A, and Fluke 8846A (finally). The 8846A was challenging and several of the changes were added to all the scripts to deal with the random timeouts from the 8846A. The 2001 and 2002 scripts were also modified and replaced. The 34420A is configurable to either input channel.

I am finally getting around to collecting data. I just uploaded a dataset for one 8846A. I will be adding more through the week.

Can't find your scripts or dataset ... Where are they?
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on May 11, 2015, 02:28:33 pm
I was using a different login/pwd.   I followed the link in the first post and created a directory called EZGPIB_Scripts.

They should be downloadable now.



Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on May 11, 2015, 02:55:01 pm
The Keithley 2400 is running slower than the other Keithley scripts. I changed the Timeout value from 15 to 5 and it is running a little faster now.
Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on May 11, 2015, 03:22:05 pm
I was using a different login/pwd.   I followed the link in the first post and created a directory called EZGPIB_Scripts.

They should be downloadable now.
They are visible now. Thank you.
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on May 11, 2015, 04:15:53 pm
@OldNeurons

I made one (hopefully) last change. I added a version line to the files so I can track which file gets changed. I recommend only downloading the 2400 file again since one other change was overlooked late last night.
Title: Re: DMM Noise comparison testing project
Post by: OldNeurons on May 26, 2015, 02:32:55 pm
ManateeMafia,

I did some runs on 2001, but had some issues (unrelated to script) and still need little more time.
Hope to post summary and details this weekend.

Hello TiN,

Have you solved your problems? Can we expect to see your data?
Title: Re: DMM Noise comparison testing project
Post by: TiN on May 29, 2015, 04:19:32 am
50/50 :)
Let me work on it this weekend, almost got all server stuff updated to fresh system.
Want finish and start working already on new storage RAID, so all data and links would be kept permanent.
Title: Re: DMM Noise comparison testing project
Post by: barnacle2k on June 15, 2015, 09:18:38 am
Any updates on this TiN?
Would be a shame to let that mountain of data rot.
Title: Re: DMM Noise comparison testing project
Post by: TiN on July 01, 2015, 05:16:15 pm
Sorry for delay, really busy lately.

Cooked little dirty python script to collect data from ManateeMafia's EZGPIB script CSV-format and calculate RMS values automatically.

Code: [Select]
import csv
import sys
import math
import glob
from math import exp, expm1
from datetime import datetime

#with open('Keithley2002_DCVOLT1000_NPLC1.csv','r') as i:
with open('output.txt','wb') as o:
    for filename in glob.glob('*.csv'):
        i = open(filename, 'r')
        reader = csv.DictReader(i)
        #o.write ("date,Keithley2002\r\n")
        sum = 0
        sqsum = 0
        cnt = 0
        for row in reader:
            #d = datetime.strptime(row['date'], '%d-%m-%Y %H:%M:%S')
            #date = d.strftime('%Y-%m-%d %H:%M:%S')
            sum = sum + float(row['Keithley2002'])
            sqsum = sqsum + pow(float(row['Keithley2002']),2)
            cnt = cnt + 1
            avg = sum / cnt
            rms = math.sqrt(sqsum / cnt)
            #print ("Counts %d, RAW:%s SUM:%.8f AVG: %.8f" % (cnt,row['Keithley2002'],sum,avg))
        print ("%s ; Counts %d ; RAW:%s ; SQSUM:%.12f ; AVG: %E ; RMS: %E ;" % (filename,cnt,row['Keithley2002'],sqsum,avg,rms))
        i.close()
        o.write ("%s ; Counts %d ; RAW:%s ; SQSUM:%.12f ; AVG: %E ; RMS: %E ;\n" % (filename,cnt,row['Keithley2002'],sqsum,avg,rms))

It works but need some manual inputs and finetuning.
Then will need to bring other's data format to this one (which should be pretty easy) and import results into nice excel spreadsheet with graphs.

Here's example output from my Keithley 2002 EZGPIB data:

Code: [Select]
Keithley2002_DCVOLT.1_NPLC.01.csv ; Counts 25173 ; RAW:+0.001932E-03 ; SQSUM:0.000000108820 ; AVG: 1.866774E-06 ; RMS: 2.079154E-06 ;
Keithley2002_DCVOLT.1_NPLC.1.csv ; Counts 3087 ; RAW:+0.006889E-03 ; SQSUM:0.000000172460 ; AVG: 7.467759E-06 ; RMS: 7.474385E-06 ;
Keithley2002_DCVOLT.1_NPLC1.csv ; Counts 29111 ; RAW:+0.002913E-03 ; SQSUM:0.000000296672 ; AVG: 3.187090E-06 ; RMS: 3.192345E-06 ;
Keithley2002_DCVOLT.1_NPLC10.csv ; Counts 3171 ; RAW:+0.003173E-03 ; SQSUM:0.000000030584 ; AVG: 3.101818E-06 ; RMS: 3.105641E-06 ;
Keithley2002_DCVOLT1000_NPLC.01.csv ; Counts 36037 ; RAW:+0.00042E+00 ; SQSUM:0.423976726800 ; AVG: 7.061392E-04 ; RMS: 3.430020E-03 ;
Keithley2002_DCVOLT1000_NPLC.1.csv ; Counts 27187 ; RAW:-0.00007E+00 ; SQSUM:0.004349389700 ; AVG: 2.049807E-04 ; RMS: 3.999756E-04 ;
Keithley2002_DCVOLT1000_NPLC1.csv ; Counts 3085 ; RAW:+0.00017E+00 ; SQSUM:0.000122373500 ; AVG: 1.851572E-04 ; RMS: 1.991664E-04 ;
Keithley2002_DCVOLT1000_NPLC10.csv ; Counts 3146 ; RAW:+0.00018E+00 ; SQSUM:0.000123968200 ; AVG: 1.930960E-04 ; RMS: 1.985070E-04 ;
Keithley2002_DCVOLT100_NPLC.01.csv ; Counts 37259 ; RAW:+0.008344E+00 ; SQSUM:1.047291303500 ; AVG: -1.429550E-04 ; RMS: 5.301737E-03 ;
Keithley2002_DCVOLT100_NPLC.1.csv ; Counts 27343 ; RAW:+0.000114E+00 ; SQSUM:0.000865851267 ; AVG: 1.351317E-04 ; RMS: 1.779502E-04 ;
Keithley2002_DCVOLT100_NPLC1.csv ; Counts 24049 ; RAW:+0.000233E+00 ; SQSUM:0.001122555603 ; AVG: 2.130842E-04 ; RMS: 2.160506E-04 ;
Keithley2002_DCVOLT100_NPLC10.csv ; Counts 3155 ; RAW:+0.000228E+00 ; SQSUM:0.000136496793 ; AVG: 2.070285E-04 ; RMS: 2.079991E-04 ;
Keithley2002_DCVOLT10_NPLC.01.csv ; Counts 37220 ; RAW:+0.0000020E+00 ; SQSUM:0.005388871941 ; AVG: 1.830596E-04 ; RMS: 3.805053E-04 ;
Keithley2002_DCVOLT10_NPLC.1.csv ; Counts 6671 ; RAW:+0.0000119E+00 ; SQSUM:0.000001456198 ; AVG: 1.244638E-05 ; RMS: 1.477457E-05 ;
Keithley2002_DCVOLT10_NPLC1.csv ; Counts 32311 ; RAW:+0.0000139E+00 ; SQSUM:0.000003083435 ; AVG: 9.409851E-06 ; RMS: 9.768822E-06 ;
Keithley2002_DCVOLT10_NPLC10.csv ; Counts 3080 ; RAW:+0.0000012E+00 ; SQSUM:0.000000008606 ; AVG: 1.401396E-06 ; RMS: 1.671587E-06 ;
Keithley2002_DCVOLT1_NPLC.01.csv ; Counts 29560 ; RAW:+0.00000191E+00 ; SQSUM:0.000022246224 ; AVG: 5.251152E-06 ; RMS: 2.743317E-05 ;
Keithley2002_DCVOLT1_NPLC.1.csv ; Counts 3086 ; RAW:+0.00000786E+00 ; SQSUM:0.000000169236 ; AVG: 7.365016E-06 ; RMS: 7.405402E-06 ;
Keithley2002_DCVOLT1_NPLC1.csv ; Counts 6726 ; RAW:+0.00000300E+00 ; SQSUM:0.000000052482 ; AVG: 2.784019E-06 ; RMS: 2.793349E-06 ;
Keithley2002_DCVOLT1_NPLC10.csv ; Counts 3080 ; RAW:+0.00000317E+00 ; SQSUM:0.000000026442 ; AVG: 2.924023E-06 ; RMS: 2.930037E-06 ;

MM's K2002:

Code: [Select]
Keithley2002_DCVOLT.2_NPLC.01.csv ; Counts 28500 ; RAW:+0.012987E-03 ; SQSUM:0.000001055413 ; AVG: 3.677938E-06 ; RMS: 6.085394E-06 ;
Keithley2002_DCVOLT.2_NPLC.1.csv ; Counts 28500 ; RAW:-0.000484E-03 ; SQSUM:0.000000002879 ; AVG: 8.280295E-08 ; RMS: 3.178376E-07 ;
Keithley2002_DCVOLT.2_NPLC1.csv ; Counts 28500 ; RAW:+0.001461E-03 ; SQSUM:0.000000050083 ; AVG: 1.319546E-06 ; RMS: 1.325635E-06 ;
Keithley2002_DCVOLT.2_NPLC10.csv ; Counts 1190 ; RAW:+0.001523E-03 ; SQSUM:0.000000001753 ; AVG: 1.209540E-06 ; RMS: 1.213718E-06 ;
Keithley2002_DCVOLT1000_NPLC.01.csv ; Counts 28750 ; RAW:+0.00110E+00 ; SQSUM:0.060372603700 ; AVG: 1.076401E-03 ; RMS: 1.449109E-03 ;
Keithley2002_DCVOLT1000_NPLC.1.csv ; Counts 28500 ; RAW:-0.00038E+00 ; SQSUM:0.004084380200 ; AVG: 1.501102E-04 ; RMS: 3.785652E-04 ;
Keithley2002_DCVOLT1000_NPLC1.csv ; Counts 28500 ; RAW:+0.00016E+00 ; SQSUM:0.000835754000 ; AVG: 1.568912E-04 ; RMS: 1.712446E-04 ;
Keithley2002_DCVOLT1000_NPLC10.csv ; Counts 1190 ; RAW:+0.00020E+00 ; SQSUM:0.000025156800 ; AVG: 1.392437E-04 ; RMS: 1.453966E-04 ;
Keithley2002_DCVOLT200_NPLC.01.csv ; Counts 28500 ; RAW:+0.001165E+00 ; SQSUM:0.522674665140 ; AVG: 3.491382E-05 ; RMS: 4.282460E-03 ;
Keithley2002_DCVOLT200_NPLC.1.csv ; Counts 28500 ; RAW:+0.000166E+00 ; SQSUM:0.000580846443 ; AVG: 3.007274E-05 ; RMS: 1.427606E-04 ;
Keithley2002_DCVOLT200_NPLC1.csv ; Counts 28500 ; RAW:+0.000166E+00 ; SQSUM:0.000487367848 ; AVG: 1.260648E-04 ; RMS: 1.307694E-04 ;
Keithley2002_DCVOLT200_NPLC10.csv ; Counts 1190 ; RAW:+0.000117E+00 ; SQSUM:0.000014781988 ; AVG: 1.099160E-04 ; RMS: 1.114533E-04 ;
Keithley2002_DCVOLT20_NPLC.01.csv ; Counts 28250 ; RAW:+0.0000094E+00 ; SQSUM:0.000002496170 ; AVG: 9.400000E-06 ; RMS: 9.400000E-06 ;
Keithley2002_DCVOLT20_NPLC.1.csv ; Counts 28250 ; RAW:+0.0000094E+00 ; SQSUM:0.000001865081 ; AVG: 5.507855E-06 ; RMS: 8.125305E-06 ;
Keithley2002_DCVOLT20_NPLC1.csv ; Counts 28250 ; RAW:+0.0000014E+00 ; SQSUM:0.000000234585 ; AVG: 2.560676E-06 ; RMS: 2.881647E-06 ;
Keithley2002_DCVOLT20_NPLC10.csv ; Counts 1190 ; RAW:+0.0000021E+00 ; SQSUM:0.000000005694 ; AVG: 2.013445E-06 ; RMS: 2.187497E-06 ;
Keithley2002_DCVOLT2_NPLC.01.csv ; Counts 28000 ; RAW:+0.00000480E+00 ; SQSUM:0.000080723282 ; AVG: 8.961264E-07 ; RMS: 5.369334E-05 ;
Keithley2002_DCVOLT2_NPLC.1.csv ; Counts 28000 ; RAW:-0.00000018E+00 ; SQSUM:0.000000021068 ; AVG: 1.519464E-07 ; RMS: 8.674316E-07 ;
Keithley2002_DCVOLT2_NPLC1.csv ; Counts 28250 ; RAW:+0.00000111E+00 ; SQSUM:0.000000040999 ; AVG: 1.182998E-06 ; RMS: 1.204699E-06 ;
Keithley2002_DCVOLT2_NPLC10.csv ; Counts 1190 ; RAW:+0.00000106E+00 ; SQSUM:0.000000001203 ; AVG: 9.911765E-07 ; RMS: 1.005444E-06 ;

Here MM's 3458A_ID111 data:

Code: [Select]
HP3458A__ID111_DCV.1_NPLC.01.csv ; Counts 43366 ; RAW:1.934592131E-06 ; SQSUM:0.000000075188 ; AVG: -1.572004E-07 ; RMS: 1.316741E-06 ;
HP3458A__ID111_DCV.1_NPLC.1.csv ; Counts 37203 ; RAW:5.277066847E-07 ; SQSUM:0.000000007471 ; AVG: 1.015909E-07 ; RMS: 4.481187E-07 ;
HP3458A__ID111_DCV.1_NPLC1.csv ; Counts 26937 ; RAW:-1.160974125E-07 ; SQSUM:0.000000001669 ; AVG: -1.766057E-07 ; RMS: 2.489070E-07 ;
HP3458A__ID111_DCV.1_NPLC10.csv ; Counts 4909 ; RAW:1.409000080E-07 ; SQSUM:0.000000000104 ; AVG: -1.177160E-07 ; RMS: 1.453049E-07 ;
HP3458A__ID111_DCV.1_NPLC100.csv ; Counts 444 ; RAW:-9.322971815E-08 ; SQSUM:0.000000000006 ; AVG: -1.081460E-07 ; RMS: 1.118537E-07 ;
HP3458A__ID111_DCV.1_NPLC1000.csv ; Counts 54 ; RAW:-1.465289721E-07 ; SQSUM:0.000000000004 ; AVG: -2.635645E-07 ; RMS: 2.857508E-07 ;
HP3458A__ID111_DCV.1_NPLC50.csv ; Counts 1050 ; RAW:-1.359746644E-07 ; SQSUM:0.000000000017 ; AVG: -1.218833E-07 ; RMS: 1.284038E-07 ;
HP3458A__ID111_DCV1000_NPLC.01.csv ; Counts 35418 ; RAW:-1.760964367E-03 ; SQSUM:0.247285785299 ; AVG: 1.443854E-04 ; RMS: 2.642333E-03 ;
HP3458A__ID111_DCV1000_NPLC.1.csv ; Counts 31322 ; RAW:1.761266916E-04 ; SQSUM:0.003887161804 ; AVG: 1.327557E-04 ; RMS: 3.522829E-04 ;
HP3458A__ID111_DCV1000_NPLC1.csv ; Counts 21212 ; RAW:1.585166738E-04 ; SQSUM:0.000154840219 ; AVG: 4.540910E-05 ; RMS: 8.543800E-05 ;
HP3458A__ID111_DCV1000_NPLC10.csv ; Counts 4696 ; RAW:-1.109616452E-04 ; SQSUM:0.000026941396 ; AVG: -6.692175E-05 ; RMS: 7.574361E-05 ;
HP3458A__ID111_DCV1000_NPLC100.csv ; Counts 517 ; RAW:-7.045183825E-05 ; SQSUM:0.000001151042 ; AVG: -4.487046E-05 ; RMS: 4.718461E-05 ;
HP3458A__ID111_DCV1000_NPLC1000.csv ; Counts 53 ; RAW:-4.579369486E-05 ; SQSUM:0.000000095233 ; AVG: -4.064273E-05 ; RMS: 4.238933E-05 ;
HP3458A__ID111_DCV1000_NPLC50.csv ; Counts 1019 ; RAW:-7.221313421E-05 ; SQSUM:0.000002797342 ; AVG: -4.867849E-05 ; RMS: 5.239450E-05 ;
HP3458A__ID111_DCV100_NPLC.01.csv ; Counts 31954 ; RAW:-1.759903619E-04 ; SQSUM:0.012203052480 ; AVG: 2.890893E-04 ; RMS: 6.179760E-04 ;
HP3458A__ID111_DCV100_NPLC.1.csv ; Counts 31054 ; RAW:1.408164788E-04 ; SQSUM:0.003746873958 ; AVG: 3.253337E-04 ; RMS: 3.473568E-04 ;
HP3458A__ID111_DCV100_NPLC1.csv ; Counts 21556 ; RAW:3.696494398E-05 ; SQSUM:0.000056098800 ; AVG: 3.553526E-05 ; RMS: 5.101439E-05 ;
HP3458A__ID111_DCV100_NPLC10.csv ; Counts 4696 ; RAW:-8.625151540E-06 ; SQSUM:0.000001555449 ; AVG: -1.120778E-05 ; RMS: 1.819969E-05 ;
HP3458A__ID111_DCV100_NPLC100.csv ; Counts 517 ; RAW:6.512869530E-06 ; SQSUM:0.000000010226 ; AVG: 1.896423E-07 ; RMS: 4.447513E-06 ;
HP3458A__ID111_DCV100_NPLC1000.csv ; Counts 53 ; RAW:5.280705025E-07 ; SQSUM:0.000000000970 ; AVG: 3.742990E-06 ; RMS: 4.277578E-06 ;
HP3458A__ID111_DCV100_NPLC50.csv ; Counts 1019 ; RAW:-1.179357455E-05 ; SQSUM:0.000000048509 ; AVG: -2.418380E-06 ; RMS: 6.899579E-06 ;
HP3458A__ID111_DCV10_NPLC.01.csv ; Counts 44629 ; RAW:5.282965900E-05 ; SQSUM:0.000033473378 ; AVG: 2.829167E-07 ; RMS: 2.738679E-05 ;
HP3458A__ID111_DCV10_NPLC.1.csv ; Counts 40296 ; RAW:-3.522582372E-06 ; SQSUM:0.000001245022 ; AVG: -4.628066E-06 ; RMS: 5.558499E-06 ;
HP3458A__ID111_DCV10_NPLC1.csv ; Counts 21586 ; RAW:1.409056517E-06 ; SQSUM:0.000000034038 ; AVG: 1.080365E-06 ; RMS: 1.255721E-06 ;
HP3458A__ID111_DCV10_NPLC10.csv ; Counts 4910 ; RAW:-2.113584272E-07 ; SQSUM:0.000000000902 ; AVG: 1.639140E-07 ; RMS: 4.285837E-07 ;
HP3458A__ID111_DCV10_NPLC100.csv ; Counts 367 ; RAW:-5.283960681E-08 ; SQSUM:0.000000000004 ; AVG: -1.665335E-08 ; RMS: 1.080092E-07 ;
HP3458A__ID111_DCV10_NPLC1000.csv ; Counts 54 ; RAW:-5.283960681E-08 ; SQSUM:0.000000000000 ; AVG: -5.707982E-08 ; RMS: 7.202534E-08 ;
HP3458A__ID111_DCV10_NPLC50.csv ; Counts 1059 ; RAW:1.409056182E-07 ; SQSUM:0.000000000033 ; AVG: -1.184525E-07 ; RMS: 1.768822E-07 ;
HP3458A__ID111_DCV1_NPLC.01.csv ; Counts 39630 ; RAW:-3.519855741E-06 ; SQSUM:0.000000382711 ; AVG: 2.404746E-07 ; RMS: 3.107589E-06 ;
HP3458A__ID111_DCV1_NPLC.1.csv ; Counts 26059 ; RAW:3.520460482E-07 ; SQSUM:0.000000007892 ; AVG: 5.182273E-08 ; RMS: 5.503157E-07 ;
HP3458A__ID111_DCV1_NPLC1.csv ; Counts 26998 ; RAW:2.640389526E-07 ; SQSUM:0.000000000876 ; AVG: 6.759768E-08 ; RMS: 1.801146E-07 ;
HP3458A__ID111_DCV1_NPLC10.csv ; Counts 4909 ; RAW:-2.763607045E-07 ; SQSUM:0.000000000155 ; AVG: -1.511198E-07 ; RMS: 1.779424E-07 ;
HP3458A__ID111_DCV1_NPLC100.csv ; Counts 365 ; RAW:-5.984881499E-08 ; SQSUM:0.000000000005 ; AVG: -1.088564E-07 ; RMS: 1.139828E-07 ;
HP3458A__ID111_DCV1_NPLC1000.csv ; Counts 54 ; RAW:-4.224622234E-08 ; SQSUM:0.000000000000 ; AVG: -7.455024E-08 ; RMS: 7.752065E-08 ;
HP3458A__ID111_DCV1_NPLC50.csv ; Counts 1059 ; RAW:2.640388897E-08 ; SQSUM:0.000000000010 ; AVG: -8.820412E-08 ; RMS: 9.886552E-08 ;
Title: Re: DMM Noise comparison testing project
Post by: TiN on August 05, 2015, 05:47:50 pm
Initial data processed, now doing graphs for each range.

Starting off 0.1(0.2)VDC:

(http://xdevs.com/datashort/_done/dmm_noise_0v1.png)
Title: Re: DMM Noise comparison testing project
Post by: TiN on August 06, 2015, 10:23:02 am
Summary results in range DCV 100mV (200mV)

(http://xdevs.com/datashort/_done/dmm_noise_0v1.png)

Summary results in range DCV 1V (2V)

(http://xdevs.com/datashort/_done/dmm_noise_1v.png)

Summary results in range DCV 10V (20V)

(http://xdevs.com/datashort/_done/dmm_noise_10v.png)

Summary results in range DCV 100V (200V or 300V in case of HPAK 34970A)

(http://xdevs.com/datashort/_done/dmm_noise_100v.png)

Summary results in range DCV 1000V

(http://xdevs.com/datashort/_done/dmm_noise_1000v.png)

Article with scripts and EZGPIB setup (http://xdevs.com/article/dmm_noise/)

Excel-file with all data and graphs (http://xdevs.com/datashort/_done/summary_7_aug_2015_graph.xlsx)
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on August 06, 2015, 11:40:31 am
Hi TiN,

well done, great job!  :-+ :-+ :-+

Very interesting to see these direct comparisons.

Frank
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on August 06, 2015, 02:42:53 pm
i noticed in some of the values ... some results from some benches seem consistently higher in just a bit of noise
just to speculate ...

what if ambient noise added alot of undesirable result to the figures? (example manatee's 3458a vs Dr franks) ... or maybe a noisy cell phone tower nearby? HV power line? a bad PC PSU?

if so, what if the contributor switched off everything and re-collect the results? or used something like a RF-sniffer to "probe" out and eliminate some equipment that is inputting some spurious readings?
(or is there a way to measure ambient noise ? like dosimeter measure ambient radiation? and note down that this measurement is taken with this amount of ambient noise during the measurement process?)

just a thought
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on August 06, 2015, 04:43:07 pm
I have no doubt that my tests were made in less than perfect conditions.

I think Dr. Frank has a  more suitable environment compared to my home. I did cover the connections to reduce air flow across the inputs. I should add the ability to track the internal temp of the 3458A and perform an ACAL DC as needed. I performed the tests in a spare room but I had no way to monitor external influences.

Running the acquisition at night time is the best time for me as I am not playing with the thermostat and interfering in other measureble ways.

I could disconnect wi-fi and my phone repeater. All CFL's will have to be disconnected too.
Title: Re: DMM Noise comparison testing project
Post by: TiN on August 07, 2015, 04:20:27 am
All data is still considered beta and initial, so yes, some results and tests are off.
I do hope eventually we will get statistics to work for us, and when let's say five different members run same test on same multimeter model, we should get pretty close results. If one of datasets would be off to much - we would sort that out. This way we can have confidence and some degree of trust in data.

But since that will take time and more wide participation, we will try do best to make everything EASY to test and maintain. That's main goal for now.

Good points tho, I'll add more information regarding testing environment into project article (https://xdevs.com/article/dmm_noise/). Perhaps even try some comparison tests on same meter with different conditions (noisy switcher PSU on same breaker, CFL lights all around meter, cell phone laying on top of meter, etc).
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on August 07, 2015, 05:44:22 am
I have no doubt that my tests were made in less than perfect conditions.

I think Dr. Frank has a  more suitable environment compared to my home. I did cover the connections to reduce air flow across the inputs. I should add the ability to track the internal temp of the 3458A and perform an ACAL DC as needed. I performed the tests in a spare room but I had no way to monitor external influences.

Running the acquisition at night time is the best time for me as I am not playing with the thermostat and interfering in other measureble ways.

I could disconnect wi-fi and my phone repeater. All CFL's will have to be disconnected too.

Maybe..

My basement has a very constant temperature, also during the current heat wave outside. Outside: 40°C, basement: 22°C max! Very comfortable, best place to be!

All HF sources as switching PSUs , cell phones etc were abandoned, the concrete ceiling is full of iron armouring, shielding every radiation from outside.

But the most probable reason is, that I configured the 3458A for digitizing, by switching Auto Zero off. I think I mentioned already, that especially the fast readings, NPLC 0.01 = 200µs were done in real time.

cmd:= 'DCV 1;AZERO OFF;DISP OFF;NPLC 0.01;TRIG SYN;TARM AUTO;INBUF ON;NRDGS 10000,AUTO;';

I suppose, that the auto zeroing might create additional noise.. to be checked..
Frank
Title: Re: DMM Noise comparison testing project
Post by: TiN on August 07, 2015, 05:52:53 pm
Okay, I did some testing here regarding one particular issue:

As lot of homelab user instruments are usually not commonly calibrated, there is issue of having possible DC offsets during measurement of input short. These offsets translate to noise RMS offset as well. Meaning that measurement is not noise itself but noise+offset.

I tried to modify script and run on same unit in same conditions, one with just sampling data as it's described before (No REL), and second dataset - performing REL capture of initial DC voltage sample and then capturing data with offset removed by meter's math. Then for next NPLC+range new REL value taken and everything repeat. This is (REL) graph line.

And here's result:

(http://xdevs.com/doc/xDevs.com/dmm_noise/rel_test_0v1.png)

(http://xdevs.com/doc/xDevs.com/dmm_noise/rel_test_1v.png)

(http://xdevs.com/doc/xDevs.com/dmm_noise/rel_test_10v.png)

(http://xdevs.com/doc/xDevs.com/dmm_noise/rel_test_100v.png)

(http://xdevs.com/doc/xDevs.com/dmm_noise/rel_test_1000v.png)

If we decide to go this way, it could be V2.0 script naming, as data would be not comparable to current V1.0
Title: Re: DMM Noise comparison testing project
Post by: macboy on August 07, 2015, 06:03:04 pm
Okay, I did some testing here regarding one particular issue:

As lot of homelab user instruments are usually not commonly calibrated, there is issue of having possible DC offsets during measurement of input short. These offsets translate to noise RMS offset as well. Meaning that measurement is not noise itself but noise+offset.

If you want to eliminate the offset, take the standard deviation of the dataset, not the RMS value. This removes the offset by the definition of standard deviation, leaving only the RMS noise compared to the average value (i.e. offset).
Title: Re: DMM Noise comparison testing project
Post by: TiN on August 08, 2015, 03:29:12 pm
 :palm: You right, wasn't thinking right.

Changed python parser and added test data with both 2002 and 2001 to check SD:

(http://xdevs.com/doc/xDevs.com/dmm_noise/sd_test1.png)

(http://xdevs.com/doc/xDevs.com/dmm_noise/sd_test2.png)

Red line = K2002, raw RMS ppm/Range, no REL
Green line = K2002, raw RMS ppm/Range, with REL
Blue line = K2002, same dataset as red line, but with SD ppm/Range instead of RMS
Dashed orange line = K2001, SD ppm/Range, no REL
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on August 11, 2015, 03:40:31 pm
I have no doubt that my tests were made in less than perfect conditions.

I think Dr. Frank has a  more suitable environment compared to my home. I did cover the connections to reduce air flow across the inputs. I should add the ability to track the internal temp of the 3458A and perform an ACAL DC as needed. I performed the tests in a spare room but I had no way to monitor external influences.

Running the acquisition at night time is the best time for me as I am not playing with the thermostat and interfering in other measureble ways.

I could disconnect wi-fi and my phone repeater. All CFL's will have to be disconnected too.

i am not trying to nit pick, i hope i did not sound that way, i apologize if i did. i think many of our surroundings are in a middle of a dense electronic jungle, cant be helped (i for 1 is surrounded by 20 blasting wifi APs, i cant turn those off for sure  |O). if i have a 6.5 digit measuring these, im sure my ambient noise would be far worse, my T5 lights up like a radio station
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on August 11, 2015, 08:28:32 pm
I didn't take it as a nit-pick. I will setup a 3458A and run the tests again with Dr. Frank's suggested settings for a like-for-like comparison. I will also try and remove anything else nearby and see how much difference it makes.

I hope to get some different readings by this weekend.
Title: Re: DMM Noise comparison testing project
Post by: lukaq on August 12, 2015, 05:22:10 am
Could someone make script for EZGPIB to automate data gathering for 34401a via RS232?

I have user guide if some needs it for what are the commands
Title: Re: DMM Noise comparison testing project
Post by: cncjerry on August 14, 2015, 06:14:05 pm
Tin, couple of questions:

1) Do you have data for an HP 3457a?

2) I started making some runs just for the heck of it.  According to the instructions I should be using the 10v range which on this unit implies 30v.

3) as far as NPLC, I started with 10 and did hi-res reads.  There is a big difference between the noise at 30v and 3v.  Also, taking NPLC to 100 improved things from two perspectives, the resolution increased and noise dropped.

So to get a fair comparison against the other units being tested, where should I set the 3457a?

Interesting data so far.

Thanks.

Jerry
Title: Re: DMM Noise comparison testing project
Post by: TiN on August 14, 2015, 07:50:36 pm
1. No, I don't. All data is already posted on graphs/article. Will be happy to see your results on 3457A, and any other meters.
2. Yes, use base ranges which you meter have. It's not matter much what range voltage exactly, and end result is ppm/Range, not ppm/Volt.

If you have GPIB interfacing setup, you can try modify 3458A's EZGPIB script, so you can run all NPLC and ranges automatically.
Title: Re: DMM Noise comparison testing project
Post by: cncjerry on August 15, 2015, 01:26:35 am
Tin, how are you calculating PPM from this data?  I'll admit to not reading the entire thread again, so if it is in there, please just say, "read the thread."

I ran some tests with my 3457a in hi-res.  For example, the STDEV on the various ranges I've tested so far are below:

Range   30v                30V                  3V                3V                300mv           30mv             30mv
NPLC    10                  100                  10                100               10                  10                 100
STDEV  1.32596E-5     4.18793E-6       3.4401E-7    1.7943E-7     1.56618E-7      1.31822E-7    1.67786E-7

Are do you calculate PPM from this?  Also, with the data I have so far, increasing the NPLC from 10 to 100 increases the STDEV except for the 3v scale.  Seems odd.

Thanks
Title: Re: DMM Noise comparison testing project
Post by: deadlylover on August 15, 2015, 03:15:36 am
Remember the E is multiply by 10x, so your results look okay. To get PPM I *think* you just divide the STDEV by the range (in volts), then multiply by 1 million.

The 3V range is the primary range on the 3457A, I'm still waiting for a GPIB cable to arrive but I'll use the STAT function to see if it kinda sorta agrees with yours.

I'm sure there are others who want to see the R6581 dogfight with the 3458A. Well the results aren't reeeaally going to surprise anyone, it would be like the Top Gear episode where the McLaren F1 went up against the Bugatti Veyron.  :-DD
Title: Re: DMM Noise comparison testing project
Post by: TiN on August 15, 2015, 03:56:15 am
You can read my article here (https://xdevs.com/article/dmm_noise/) regarding methodology and calculations.
ppm/Range = SD/range, simple as it is.
Title: Re: DMM Noise comparison testing project
Post by: cncjerry on August 15, 2015, 05:08:03 am
Stdev/range or (stdev/range) x 1e6?
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on August 19, 2015, 01:18:57 pm
Could someone make script for EZGPIB to automate data gathering for 34401a via RS232?

I have user guide if some needs it for what are the commands

I hope to get my hands on a 34401a sometime next week. I thought about putting my 8846a in compatibility mode, but it should be easier with the real thing.
Title: Re: DMM Noise comparison testing project
Post by: Jf2014 on August 20, 2015, 07:54:35 pm
hi,
I uploaded the files for the Keithley 2001 ( calibriert 07/2015)  to TiN's FTP server.
ftp://xdevs.com//Jf2014 (ftp://xdevs.com//Jf2014)

Title: Re: DMM Noise comparison testing project
Post by: plesa on August 20, 2015, 08:30:28 pm
I also uploaded dataset from K2002, but it is not complete and for second time I received error.
I used old version of scripts, so in few hours will be new run.
Does anybody ported scripts to 34410A, 34411A or 34401A?
Title: Re: DMM Noise comparison testing project
Post by: Macbeth on August 21, 2015, 08:03:05 pm
I ran all the EZGPIB tests overnight on my Keithley 2015 using the K2000 script. I got a few error -213s reported on the meter on some NPLC tests but can't say which as I was asleep through most of it. It didn't error in the script and appeared to log ok. FTP'd to xdevs.

I am running ancient firmware B12 and hope to upgrade to B17 this weekend. Will do another run after the upgrade, maybe the error -213's will be fixed?

I've posted my old ROMs and cal stuff (https://www.eevblog.com/forum/testgear/keithley-2015-upgrading-firmware-from-b12-to-b17-backup-of-calibration/) as I know TiN likes to archive them on his excellent xdevs site, and the 2015 stuff is a bit sparse.
Title: Re: DMM Noise comparison testing project
Post by: plesa on August 21, 2015, 08:32:56 pm
The error is due to string conversion float to integer ( NPLC <1 is only affected).
Title: Re: DMM Noise comparison testing project
Post by: Macbeth on August 21, 2015, 10:28:36 pm
The error is due to string conversion float to integer ( NPLC <1 is only affected).
Hmm... I could swear when I spotted it it was on NPLC 5 and 200V range. Also the error was only displayed on the meters VFD, not the app. It was consistently coming up on some NPLC's and not others.

Ok, I just ran the python "parse_noise_sd.py" and it failed parsing the 0.2V range on NPLC 5 ... (I was in bed when it was doing that range  :-DD)

Code: [Select]
c:\MyMeasurements\Keithley2015>parse_noise_sd.py
| Multimeter    | Range         | NPLC  |                       Counts  |    Sq.sum     |  Average   |    SD
|    SD,uV      |
| Keithley2015          | .2            | .01   |       5751    | 0.07879803    | 1.370162E-05  | 7.952572E-05  |  79.526       |
| Keithley2015          | .2            | .1    |       5771    | -0.02028955   | -3.515777E-06 | 7.034879E-05  |  70.349       |
| Keithley2015          | .2            | 1     |       5771    | -0.01809268   | -3.135102E-06 | 5.318539E-07  |   0.532       |
| Keithley2015          | .2            | 10    |       1977    | -0.00604425   | -3.057284E-06 | 2.250274E-07  |   0.225       |
| Keithley2015          | .2            | 2     |       5691    | -0.01771140   | -3.112177E-06 | 3.840305E-07  |   0.384       |
| Keithley2015          | .2            | 3     |       5651    | -0.01761382   | -3.116938E-06 | 3.198932E-07  |   0.320       |
Traceback (most recent call last):
  File "C:\MyMeasurements\Keithley2015\parse_noise_sd.py", line 28, in <module>
    sum += float(row[setname[0]])
ValueError: could not convert string to float:

c:\MyMeasurements\Keithley2015>

Looking at the csv files there is definitely data missing on NPLC 5. I will go and rename them all and try again...
Title: Re: DMM Noise comparison testing project
Post by: Macbeth on August 21, 2015, 10:39:08 pm
Ok, removed all the NPLC5's

Code: [Select]
| Multimeter    | Range         | NPLC  |                       Counts  |    Sq.sum     |  Average   |    SD            |    SD,uV      |
| Keithley2015          | .2            | .01   |       5751    | 0.07879803    | 1.370162E-05  | 7.952572E-05  |  79.526       |
| Keithley2015          | .2            | .1    |       5771    | -0.02028955   | -3.515777E-06 | 7.034879E-05  |  70.349       |
| Keithley2015          | .2            | 1     |       5771    | -0.01809268   | -3.135102E-06 | 5.318539E-07  |   0.532       |
| Keithley2015          | .2            | 10    |       1977    | -0.00604425   | -3.057284E-06 | 2.250274E-07  |   0.225       |
| Keithley2015          | .2            | 2     |       5691    | -0.01771140   | -3.112177E-06 | 3.840305E-07  |   0.384       |
| Keithley2015          | .2            | 3     |       5651    | -0.01761382   | -3.116938E-06 | 3.198932E-07  |   0.320       |
| Keithley2015          | 1000          | .01   |       5771    | 94.36460087   | 1.635152E-02  | 8.457514E-03  |8457.514       |
| Keithley2015          | 1000          | .1    |       5761    | 0.92711376    | 1.609293E-04  | 3.231371E-03  |3231.371       |
| Keithley2015          | 1000          | 1     |       5791    | -1.60507862   | -2.771678E-04 | 1.998223E-04  | 199.822       |
| Keithley2015          | 1000          | 10    |       1979    | -0.56855857   | -2.872959E-04 | 1.093811E-04  | 109.381       |
| Keithley2015          | 1000          | 2     |       5781    | -1.44770361   | -2.504244E-04 | 1.380668E-04  | 138.067       |
| Keithley2015          | 1000          | 3     |       5621    | -1.44242376   | -2.566134E-04 | 1.150069E-04  | 115.007       |
| Keithley2015          | 200           | .01   |       5771    | 77.94191925   | 1.350579E-02  | 8.357463E-03  |8357.463       |
| Keithley2015          | 200           | .1    |       5741    | 1.32347618    | 2.305306E-04  | 3.198915E-03  |3198.915       |
| Keithley2015          | 200           | 1     |       5761    | -1.33002973   | -2.308679E-04 | 2.014754E-04  | 201.475       |
| Keithley2015          | 200           | 10    |       1983    | -0.50748620   | -2.559184E-04 | 1.025495E-04  | 102.549       |
| Keithley2015          | 200           | 2     |       5771    | -1.23013294   | -2.131577E-04 | 1.483873E-04  | 148.387       |
| Keithley2015          | 200           | 3     |       5271    | -1.16701184   | -2.214024E-04 | 1.216449E-04  | 121.645       |
| Keithley2015          | 20            | .01   |       5781    | 9.22793018    | 1.596252E-03  | 2.811790E-03  |2811.790       |
| Keithley2015          | 20            | .1    |       5781    | -0.93055499   | -1.609678E-04 | 2.621365E-03  |2621.365       |
| Keithley2015          | 20            | 1     |       5771    | -1.65190293   | -2.862421E-04 | 6.020111E-05  |  60.201       |
| Keithley2015          | 20            | 10    |       1981    | -0.46382246   | -2.341355E-04 | 2.073555E-05  |  20.736       |
| Keithley2015          | 20            | 2     |       5731    | -1.52624034   | -2.663131E-04 | 4.305638E-05  |  43.056       |
| Keithley2015          | 20            | 3     |       5091    | -1.28699979   | -2.527990E-04 | 3.755184E-05  |  37.552       |
| Keithley2015          | 2             | .01   |       5771    | 0.86413454    | 1.497374E-04  | 1.060543E-04  | 106.054       |
| Keithley2015          | 2             | .1    |       5771    | 0.00289789    | 5.021472E-07  | 8.178690E-05  |  81.787       |
| Keithley2015          | 2             | 1     |       5771    | -0.02076525   | -3.598207E-06 | 1.954389E-06  |   1.954       |
| Keithley2015          | 2             | 10    |       1977    | -0.00668119   | -3.379459E-06 | 9.923083E-07  |   0.992       |
| Keithley2015          | 2             | 2     |       5741    | -0.01858068   | -3.236488E-06 | 1.398587E-06  |   1.399       |
| Keithley2015          | 2             | 3     |       5521    | -0.01898148   | -3.438051E-06 | 1.270776E-06  |   1.271       |

c:\MyMeasurements\Keithley2015>

I will take note not to trust the 1000V range at 0.01 NPLC, it looks pretty bad to me  :-/O
Title: Re: DMM Noise comparison testing project
Post by: plesa on August 22, 2015, 04:44:15 pm
If someone else has the same problem I reported  in attachment is repaired script.
The 34410A/34411A and 34401A will follow.
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on August 22, 2015, 05:05:54 pm
Thanks for posting the fix. The other scripts will have to be fixed as needed.
Title: Re: DMM Noise comparison testing project
Post by: plesa on August 28, 2015, 06:23:12 pm
Initial noise measurement with Agilent 34411A.
Currently I'm dealing with the reading rate, because for valid noise testing we needs all data from e.g 30 min period and my current Python script is not capable to read everything on NPLC 0.001.
So I used my Labview program which can take 50k reading per second.
My modification will take on all ranges and all NPLC data for statistic. I hope that it will be ported to Python soon.
Title: Re: DMM Noise comparison testing project
Post by: plesa on August 31, 2015, 04:40:55 am
Labview program for noise measurement almost finished. Automatically calculate statistic (St. Dev, Variance, Spread and Mean) save raw data and statistic.
It takes preselected ammount of samples on each NPLC settings and plot histogram, nothing too fancy :)
Let me know what next should be implemented.
Title: Re: DMM Noise comparison testing project
Post by: plesa on September 03, 2015, 09:25:24 pm
Measured noise on L4411A,34411A and 34410A. The noisiest are ranges 1V and 100V, about 3 times less noise is on 10V range and 1000V range.
Noise calculation has been calculated as st. Dev on NPLC 1,2,10 and 100.
Noise on 100mV was quite high 4 ppm/Range, compared to 0.1 at 10V range.
Source data are in attachment, including .xlsx spreadsheet and Labview program (works only with 34411,34410 and L4411.
Instruments like 34465,34461 and 34401 will follow (measurement data and program support as well).

Program was too big to upload, so I used TiN FTP /Plesa/Agilent
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on September 03, 2015, 09:38:41 pm
Measured noise on L4411A,34411A and 34410A. The noisiest are ranges 1V and 1000V, about 3 times less noise is on 10V range and 1000V range.
Noise calculation has been calculated as st. Dev on NPLC 1,2,10 and 100.
Noise on 100mV was quite high 4 ppm/Range, compared to 0.1 at 10V range.
Source data are in attachment, including .xlsx spreadsheet and Labview program (works only with 34411,34410 and L4411.
Instruments like 34465,34461 and 34401 will follow (measurement data and program support as well).

Program was too big to upload, so I used TiN FTP /Plesa/Agilent

You mean 1V and 100V are noisier, than 10V and 1kV?

No wonder.

100V and 1kV is first divided by 100 each. (in mostly each HP DMM)

So 100V range - divider  output is amplified and measured on the 1V range, 1kV on the 10V range.

Therefore, 1V and 100V are practically identically, as 10V and 1kV are.

No use to measure these HV ranges.

Frank
Title: Re: DMM Noise comparison testing project
Post by: plesa on September 04, 2015, 05:46:27 pm
Hi Frank,

my mistake, it was calculated ppm/range and not absolute value.
Everything indicated that 34411 is better than L4411, small difference compared to 34410 ( slightly worse).
Title: Re: DMM Noise comparison testing project
Post by: plesa on September 18, 2015, 07:08:44 pm
Added other Agilent DMM, looks like some marketing material. Because more recent 34465A is better than predecessor 34411A on 10V/1V range at NPLC 100/10/2. At NPLC1 is better on all  ranges 3441XA/L4411A series.
It would be quite interesting to make this measurement on 34470A and compare it to Keithley DMM7510.
Is there any vollunteer with 34470A or DMM7510?
Title: Re: DMM Noise comparison testing project
Post by: 6thimage on September 22, 2015, 09:54:10 pm
I've got a 34470A now (cal'd end of July) and I've been running a noise test script on it when I can to try and get the best results (i.e. hoping the temperature doesn't change too much). All have these have been done using the front terminals with a Fluke short, which was left in overnight. The 34470A was warmed up for around an hour and a half before the first data was collected (to collect all takes 4.5 hours).

Data summary:
nplcstddevmin1st quartilemedianmean3rd quartilemax
0.0012.30602238797611e-04-1.14229665000e-03-1.51375433000e-041.69011405000e-052.09932992126e-051.55784426000e-041.21614729000e-03
0.0021.15148534465426e-04-5.42673578000e-04-8.19337900000e-052.20449659000e-062.05098039046e-067.16461393000e-056.01827570000e-04
0.0064.66714749030745e-05-2.44258223000e-04-2.63069927000e-051.46966440000e-062.16718026217e-063.51249791000e-052.27430565000e-04
0.021.68439537307131e-05-8.31095216000e-05-9.74877382000e-063.42921692000e-062.01999992659e-061.26881026000e-058.53385126000e-05
0.066.82210110147248e-06-2.88505975000e-05-2.93346187000e-061.23205398000e-061.28789662138e-065.96959490000e-063.24734229000e-05
0.23.86900389895176e-06-1.38171905000e-05-1.81753708000e-066.84019333000e-079.25507110739e-073.55690053000e-061.72177438000e-05
11.27393700250821e-06-4.12866614000e-064.45708276000e-071.29020817000e-061.29184723605e-062.15816639000e-066.59179082000e-06
103.79754719542073e-07-1.05562487000e-079.89941540000e-071.25971234000e-061.25422712073e-061.50602481000e-062.79388714000e-06
1001.3879052042004e-079.35518214000e-071.17784276750e-061.26674983500e-061.26971653494e-061.36644774000e-061.67961645000e-06

The full data is available on dropbox https://www.dropbox.com/sh/ff4m3vacz5lg1ll/AADX41mw3C1xsYGs4EuEmQQya?dl=0 (https://www.dropbox.com/sh/ff4m3vacz5lg1ll/AADX41mw3C1xsYGs4EuEmQQya?dl=0).

The two images show the collected data (plot.png is histograms with fitted gaussians, density-plot.png is histograms with density) - I don't like the look of the density for the 100 PLCs, so I will try and collect it again.

If anyone wants the script, shout and I'll clean it up a little - it should work on all of the 3446xA series, but I haven't tested it on my 34461A yet.
Title: Re: DMM Noise comparison testing project
Post by: HighVoltage on September 23, 2015, 08:06:15 am
It would be quite interesting to make this measurement on 34470A and compare it to Keithley DMM7510.
Is there any vollunteer with 34470A or DMM7510?

I also have a 34470A and I am willing to do the test as well.
What procedure do I have to do in detail?
Title: Re: DMM Noise comparison testing project
Post by: 6thimage on September 23, 2015, 10:38:55 am
You can use the data logging mode of the 34470A to measure 10 V DC with the input terminals shorted, with auto zero and high impedance on, for different NPLCs. Ideally all, but the main interest is 1, 10 and 100. The difficulty comes in trying to keep the multimeter at the same temperature, so you don't affect the results (I've noticed skewing of the histogram for around 0.2 deg C change).

You can alternatively use the same script that I'm using (which is attached on dropbox here - https://www.dropbox.com/sh/roz4d2nwjoa0sla/AABnY3lGTschvG2dqIN9Wi-3a?dl=0 (https://www.dropbox.com/sh/roz4d2nwjoa0sla/AABnY3lGTschvG2dqIN9Wi-3a?dl=0) as the forum doesn't allow python extensions) - it can either use USB or ethernet to communicate with the multimeter (depending on which of lines 5-9 are commented out).

Hopefully the script should work, but I have only tested it on a 34470A with the dig and mem options so far, with the script running on a linux machine using the latest pyusb from github (https://github.com/walac/pyusb (https://github.com/walac/pyusb)). Using ethernet only requires a standard python installation.
Title: Re: DMM Noise comparison testing project
Post by: Alex Nikitin on September 24, 2015, 06:11:20 pm
I've run the tests overnight on one of my Keithley 2015. Below is the result:

Cheers

Alex

(http://www.ant-audio.co.uk/Service/K2015noise_.gif)
Title: Re: DMM Noise comparison testing project
Post by: Alex Nikitin on September 24, 2015, 06:25:06 pm
I will take note not to trust the 1000V range at 0.01 NPLC, it looks pretty bad to me  :-/O

Not really. The 100V range is worse, actually, if you look at the ppm of range figure (the worst is 100mV, but that is expected  ;) ).

Cheers

Alex
Title: Re: DMM Noise comparison testing project
Post by: Alex Nikitin on September 24, 2015, 06:32:22 pm
I've tried also to look at the noise of the Keithley 617 electrometer in the Volts mode. However even over GPIB (which adds one more digit and makes it into a 5.5 digits meter) the noise is at most 4LSB p-p at 200mV range (1LSB = 1uV) and below 1LSB on all other ranges  :) .

Cheers

Alex
Title: Re: DMM Noise comparison testing project
Post by: Macbeth on September 24, 2015, 09:35:06 pm
I will take note not to trust the 1000V range at 0.01 NPLC, it looks pretty bad to me  :-/O

Not really. The 100V range is worse, actually, if you look at the ppm of range figure (the worst is 100mV, but that is expected  ;) ).

Cheers

Alex
Actually I think my figures are nonsense - the ranges are all in 2's, so I expect my 100V measurements are in the 1000V range. I used the K2000 EZGPIB script. I had to throw out the NPLC5 stuff.

I have to admit I just ran the script as is, and it was stated as beta.
Title: Re: DMM Noise comparison testing project
Post by: Alex Nikitin on September 24, 2015, 10:19:57 pm
I have to admit I just ran the script as is, and it was stated as beta.

I've run the script (a somewhat modified version for K2001) overnight, so it is possible that some results are wrong. I will try to verify 100V and 1000V ranges separately. 1V and 0.1V results look correct to me thought.

Cheers

Alex
Title: Re: DMM Noise comparison testing project
Post by: TiN on September 25, 2015, 04:08:52 am
I'll get back on this project tomorrow, so if you have raw CSV data from scripts, that could help to check as well.
Upload as usual, ftp://xdevs.com/ (http://ftp://datashort:datashort@xdevs.com/) with login and password datashort
Title: Re: DMM Noise comparison testing project
Post by: plesa on October 11, 2015, 10:39:18 am
Uploaded data from long term measurement on 34411A,34410A and L4411A on ftp. Data has been acquired simultaneously.
What I found on all ranges is strange behavioral between 10<NPLC=<100, in this range the ppm/range error decreased by significant factor.
On NPLC>100 the error is increasing, but these NPLC setting are not supported I suppose.

For direct comparison I propose to add all data into Excel pivot table to add user configurable comparison between available multimeters.
Title: Re: DMM Noise comparison testing project
Post by: TiN on October 11, 2015, 10:52:19 am
Simple explanation would be if actual NPLC used by ADC was set to 1, instead of unsupported 200.  ;)
Title: nanovolt limit of DMM
Post by: 3roomlab on November 02, 2015, 02:28:20 pm
hi folks, i was trying out a "new" way of "binning" a bell curve, and i think i have hit the internal resolution limit of the keithley 2015.

originally i was "binning" noise count with 1000 bins from -5uV to +5uV, this gave me about 10nV per bin. while i was trying to expand this to widen the scale (to cater to wider noise of 100v and 1000v). i discovered that the internal limit of the DMM is 5nV (the sorters are only filled in approx "5x" intervals). the FETChing are done @ 1NPLC 100mV, but i have found similar limits at 100v and 1000v

has anyone found similar "limit effects" in your DMM?
it is an interesting find :P for me, hitting the smallest unit of a DMM
for those who own 7.5/8.5 digits, i wonder what are their limits :P
Title: Re: DMM Noise comparison testing project
Post by: TiN on November 05, 2015, 05:43:02 pm
It's not limit effects I believe, it's resolution effect, as with faster sample rates, A/D resolves less bits, so your minimum LSB become bigger.
Use slower NPLC, and you should see smaller "steps".

I did first test on my 3458A, so I leave these graphs here as well:

Simple AWG26 copper wire short.
Added ManateeMafia's data from July 2015 on his 3458A for reference (red lines on graph).
This is standard deviation data, not RMS values.

100mV range.

(http://xdevs.com/datashort/_done/c100mv.png)

1VDC range.

(http://xdevs.com/datashort/_done/c1v.png)

10VDC base range

(http://xdevs.com/datashort/_done/c10v.png)

100VDC

(http://xdevs.com/datashort/_done/c100v.png)

1KV range

(http://xdevs.com/datashort/_done/c1000v.png)
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on November 27, 2015, 01:08:18 pm
Data from a K2450.  No windows machine to run the automated tool, 10 NPLC, 2V etc.  Full setup data included below.

Happy to do more, also have a K2010 if desired.
Title: Re: DMM Noise comparison testing project
Post by: TiN on November 27, 2015, 02:24:24 pm
Yey, desired everything you have :)
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on November 27, 2015, 08:54:35 pm
Results from a K2010, in cal, Keithley 4-term shorting block.  Instrument setup is mirrored in the output text.   :-+  I initially started at 30 min captures, then realized that was a bit excessive when noise and not drift was the focus.

I partially automated this, I will redo the K2450 run tomorrow in the same manor, except all at 10 min runs.

(my lab is not particularly quiet either  :palm: )

EDIT:

Range 2 on a k2010 is 10v, FYI.
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on November 28, 2015, 04:56:11 pm
Hmmm, anyone got ezgpib to work with Win 64 bit / Agilent visa / 82357B?

A.
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on November 28, 2015, 05:59:50 pm
Results from a K2450.  Slightly different as I forgot the k2450 doesn't have rs232,  :palm:

Instrument warmed up ~2 hours, 2V range, 6.5 digit mode, autozero, no filter/math, Keithely 4-term shorting block, 10 min each.
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on November 30, 2015, 01:12:20 pm
in my separate noise "adventure" with long boring posts (related to this DMM noise logging), i was trying to tinker with my K2015 to lower/find noise problems with my pre-loved korean set. i think i have hit a place where i would need some input from anyone with some relevant data.

i have summarised some of my noise "findings" of my slightly modified K2015 (see pic, atm still collecting 1NPLC data). but i am unsure as to where i stand in terms of pk-pk noise of the DMM (it is influenced by my environment AC noise, as i have yet to get any AC isolation done).

the calculations i used in my sheet are using opencalc, the opencalc SYNTAX for this peak-peak is [MAX(data-range) minus MIN(data-range)] to get the value. it does not exclude outliers

i hope this is not too off topic. if anybody can put out some numbers of your peak-peak noise for comparison, it would be greatly appreciated TYVM :P (esp 1v/10v range 10NPLC, and also if any solartron 7081 n any 7.5digits owners :P, i am particularly curious at solartron for it is older than 3458a in technology). i recall forumner Robrenz mentioned in a thead he has his tek4050 log 152hrs with only 1uV pk-pk noise, and that was amazing.

then again, should pk-pk data become a part of the main noise data here? (it did help identify popcorn noise in my DMM, thanks to kleinstein)

*edit : there is an error in the PPM range column, 0.1v range PPM should be x10 more
Title: Re: DMM Noise comparison testing project
Post by: TiN on November 30, 2015, 01:34:42 pm
I was reading your adventures, interesting stuff.
Can you upload your data, I'll definately make comparison graphs with datasets people already had sent.
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on November 30, 2015, 01:45:45 pm
i hope this is not too off topic.

It's a really fun topic set!

Perhaps if we standardized on a file format, TiN's website could automagically parse datasets?

@3roomlab, your thread has inspired me to source a busted DMM, just for modding.   :-+

Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on November 30, 2015, 01:48:33 pm
i recall forumner Robrenz mentioned in a thead he has his tek4050 log 152hrs with only 1uV pk-pk noise, and that was amazing.

I have a vague memory of this, was it done without filtering/math?

Either Way, the 4050/8045A is a very underestimated instrument IMO.
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on November 30, 2015, 02:00:27 pm
i recall forumner Robrenz mentioned in a thead he has his tek4050 log 152hrs with only 1uV pk-pk noise, and that was amazing.

I have a vague memory of this, was it done without filtering/math?

Either Way, the 4050/8045A is a very underestimated instrument IMO.

iirc it was inside either the resistor or LTZ discussion thread :P. it was the 1 i noted specifically because i was still discovering how low STDEV could K2015 go as all these are new territories to me. i was speed reading thru and saw his STDEV was 76nV, and in the other thread, i think he had another test and it was 73nV. and it was for 152 hrs ! wow !

(and then now, the peak peak value, i think this could be the 1 that will really interfere with alot of serious measurements, and i think mine is crazy. some of my logs, there are 10v range pk-pk as high as 7uV. making a voltage reference will be useless as i dont think i can log anything useful with this noise, am i right?)

(@ TiN : edit and a package for NPLC10 in xls/ods, first column is time elapsed. the wonders of PYTHON 2.7!)
(edit ** : the file extension in XLS, rename to ODS/CSV where applicable)

(@dr.diesel ... i missed the chance to grab a used solartron 7081 for under 1.5k.  :'( ...)

on a sidenote, my measurements are done w/o special thermal considerations in terms of special cables etc. so it could be i have higher thermal noise in shorting plug or 4mm jacks etc. i do notice that my 4mm socket on the DMM is always shedding material when i wipe it, just black stuff on the cotton buds. it is making me itch to not use the sockets at all :P
Title: Re: DMM Noise comparison testing project
Post by: TiN on November 30, 2015, 02:42:03 pm
Can you save in excel or at least CSV? I don't have this openy-thingy-software, sorry :(
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on November 30, 2015, 03:30:45 pm
.csv files:
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 10, 2015, 01:30:05 pm
Wife bought me a DMM7510 for X-Mas, so those tests coming up once it arrives.
Title: Re: DMM Noise comparison testing project
Post by: SharpEars on December 10, 2015, 02:56:08 pm
Wife bought me a DMM7510 for X-Mas, so those tests coming up once it arrives.

Fucking finally, already!

Pardon my French, but I've been waiting for a DMM7510 to be (measured for noise and/or) added to the list for forever. Dave tested it, Shariar (of SignalPathBlog fame) tested it, others tested it and noone but a single random internet engineer has said dick about or measured its noise characteristics.

Nothing but empty promises of "I'll take a look at it and report back." Hopefully you will not become another data point in that trend of promising and not delivering.

Title: Re: DMM Noise comparison testing project
Post by: lukier on December 10, 2015, 03:21:54 pm
Pardon my French, but I've been waiting for a DMM7510 to be (measured for noise and/or) added to the list for forever. Dave tested it, Shariar (of SignalPathBlog fame) tested it, others tested it and noone but a single random internet engineer has said dick about or measured its noise characteristics.

Nothing but empty promises of "I'll take a look at it and report back." Hopefully you will not become another data point in that trend of promising and not delivering.

Well said  :-+

Teardowns or playing around with simple experiments on the camera is nice, but not a replacement for proper testing and pushing the instrument to its limits. Maybe that is not a content that would generate enough views, no entertainment value, thus ignored by video bloggers?

On the other hand this is of great importance when talking about the instrument like DMM7510. Potential buyers would like to know if it is really worth spending quite a bit extra to get DMM7510 instead of 34470A.
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 10, 2015, 03:34:15 pm
Nothing but empty promises of "I'll take a look at it and report back." Hopefully you will not become another data point in that trend of promising and not delivering.

Not to worry, but these come directly from Keithley, so maybe 2-3 weeks, atleast that's why my K2450 took to arrive.
Title: Re: DMM Noise comparison testing project
Post by: TiN on December 10, 2015, 04:03:16 pm
Wife bought me a DMM7510 for X-Mas, so those tests coming up once it arrives.

Fucking finally, already!

Pardon my French, but I've been waiting for a DMM7510 to be (measured for noise and/or) added to the list for forever. Dave tested it, Shariar (of SignalPathBlog fame) tested it, others tested it and noone but a single random internet engineer has said dick about or measured its noise characteristics.

Nothing but empty promises of "I'll take a look at it and report back." Hopefully you will not become another data point in that trend of promising and not delivering.

I did not tested it :D I asked Keithley though about loaner, no reply at all. Perhaps they did not like my DIY repair endavours  :box:.
Can't wait to see it's data. It's yet to be determined if it can compete with K2002.
Title: Re: DMM Noise comparison testing project
Post by: deadlylover on December 14, 2015, 04:00:58 pm
Shamelessly stolen graph from Dr. Frank, I hope you don't mind, many many thanks in advance. =P

Small teaser from the Advantest R6581 8.5digit meter, statistics done in instrument. (where the hell is my GPIB-USB cable grr)

100NPLC done with 100 total samples, 10 and 1NPLC done with 1000 samples, 10k for the rest. Auto Zero was on, I thiiink it was the same as what Dr Frank did. I will try them again with more samples and on other ranges when my damn cable shows up.

I ran the 10V 100NPLC test a few times, ranged from 0.0084 to 0.0092 ppm/range stdev. I was using the Fluke shorting block, and you know what, I was expecting the R6581 to be much worse than the 3458A on 100NPLC but it's not that bad is it? Maybe I don't need want a 3458A after all...

I'll also do the same with Advantest's R6871 and R6561 7.5/6.5 digit meters, but going through their instrument menus is hell.
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 15, 2015, 12:44:23 am
So Keithley has outdone themselves, DMM7510 will be here tomorrow according to UPS tracking.

Any interested in standardizing on a .csv format?  Items like what header info, submitter info, sample rate, instrument setup, etc?
Title: Re: DMM Noise comparison testing project
Post by: lukier on December 15, 2015, 12:51:41 am
So Keithley has outdone themselves, DMM7510 will be here tomorrow according to UPS tracking.

Any interested in standardizing on a .csv format?  Items like what header info, submitter info, sample rate, instrument setup, etc?

Check TiN's website for more info and useful scripts: https://xdevs.com/article/dmm_noise/
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 15, 2015, 02:01:02 am
Ok, unless otherwise requested I'll use the expected format of TiN's parse_noise.py script.   :-+
Title: Re: DMM Noise comparison testing project
Post by: TiN on December 15, 2015, 04:13:24 am
I think there is need to revamp my python knowledge to make it more useful though.
Would be nice if you just follow existing format for now.
What you will run to get GPIB data? I can try to make an script for 7510, but haven't read it's docs yet.
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on December 15, 2015, 08:34:21 am
Shamelessly stolen graph from Dr. Frank, I hope you don't mind, many many thanks in advance. =P
..
Small teaser from the Advantest R6581 8.5digit meter, statistics done in instrument. (where the hell is my GPIB-USB cable grr)


I ran the 10V 100NPLC test a few times, ranged from 0.0084 to 0.0092 ppm/range stdev. I was using the Fluke shorting block, and you know what, I was expecting the R6581 to be much worse than the 3458A on 100NPLC but it's not that bad is it? Maybe I don't need want a 3458A after all...


Hello, you are very welcome using this diagram!

Do you have any idea, on which basis this R6581 does the Auto Cal , in comparison to the 3458A?

Frank
Title: Re: DMM Noise comparison testing project
Post by: deadlylover on December 15, 2015, 09:43:17 am
Do you have any idea, on which basis this R6581 does the Auto Cal , in comparison to the 3458A?

Unfortunately I have no idea, even in the Japanese manual there is barely any info. Maybe I can run the Auto Cal and write down the processes it displays on the screen if it will help at all? The whole process takes about 11 minutes.

I think it is done more simply than the 3458A, some clues are in the 24hr range error specification. From 10V>1V>0.1V the range error is 0.1>1>10 ppm. I don't know if the difference are from a worse ADC, or different Auto Cal scheme, or both.

If you have any free time with the 3458A, can you check the error from applying 100mVDC to the 10V range and then reading it from the 100mV range? I get a difference of about 2-5ppm of reading even after an Auto Cal.

Another deviation is that the 3458A has a 40k reference resistor inside right? The R6581 has a 10k reference inside instead, the value can be pulled over GPIB same with the LTZ1000 reference data.
I didn't know the R6581 had a clock inside that stores the last external calibration time, I should have read it before I sent it for calibration!

When I find another cheap R6581/D I will get it and see if I can do any investigation. There is a D model (no AC functions) available for ~USD800 but it's too expensive for me, the AUD is too weak right now.  :'(
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 15, 2015, 11:05:28 am
I think there is need to revamp my python knowledge to make it more useful though.
Would be nice if you just follow existing format for now.
What you will run to get GPIB data? I can try to make an script for 7510, but haven't read it's docs yet.

No problem I will use existing format, poll at 1 sec.  I don't have a Windows box so can't use the EZGPIB tool, I will just use my own and fetch over TCP.

Output of python script on my k2010 and k2450:

Code: [Select]
| Multimeter | Range | NPLC | Counts |    Sq.sum |  Average |    SD |    SD,uV |
| k2010 | 10 | .01 | 120 | 0.00427245 | 3.560375E-05 | 9.487653E-05 |  94.877 |
| k2010 | 10 | .1 | 120 | -0.00019567 | -1.630594E-06 | 1.470821E-05 |  14.708 |
| k2010 | 10 | 10 | 360 | -0.00070481 | -1.957792E-06 | 5.162154E-07 |   0.516 |
| k2010 | 10 | 1 | 120 | -0.00023459 | -1.954949E-06 | 1.273443E-06 |   1.273 |
| Multimeter | Range | NPLC | Counts |    Sq.sum |  Average |    SD |    SD,uV |
| k2450 | 2 | 1 | 121 | -0.00503126 | -4.158066E-05 | 3.858809E-06 |   3.859 |
| k2450 | 2 | 10 | 121 | -0.00469228 | -3.877919E-05 | 3.558100E-06 |   3.558 |
| k2450 | 2 | .1 | 121 | -0.00864380 | -7.143638E-05 | 2.372225E-05 |  23.722 |
| k2450 | 2 | .01 | 121 | -0.04565281 | -3.772959E-04 | 5.115046E-05 |  51.150 |

Title: Re: DMM Noise comparison testing project
Post by: Vgkid on December 16, 2015, 02:29:09 am
Lookingforward to your K7510 update Dr.diesel.
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on December 16, 2015, 10:01:17 am

I think it is done more simply than the 3458A, some clues are in the 24hr range error specification. From 10V>1V>0.1V the range error is 0.1>1>10 ppm. I don't know if the difference are from a worse ADC, or different Auto Cal scheme, or both.

If you have any free time with the 3458A, can you check the error from applying 100mVDC to the 10V range and then reading it from the 100mV range? I get a difference of about 2-5ppm of reading even after an Auto Cal.


Hello,

I won't do that test again .. just a look into the hp journal 4/89 and its specifications is necessary to explain the problem.

The 3458A can do accurate 10:1  transfers, i.e. from one range to the other, on the order of 0.3ppm.

That means, 10V and 100mV gain should agree within 1ppm.
That is specified much more conservatively, i.e. the transfer 10V > 1V > 100mV is 1ppm each. The +0.3 and + 3 ppm / range can probably be assigned to offset errors.

Therefore, if one encounters bigger differences than 2 ppm between 100mV readings on the 10V and 100mV ranges in practise, it is also very probably due to such offset voltage effects.
If you have the possibility your measurement setup to cancel offsets, then you may get better results.

This is not a trivial aspect, as you often can not do precise zero measurements in your circuitry..

If I re-calibrate the 1V and 100mV ranges of  my 5442A standard, I indeed have the possibility to output 0V first, null the offset, and then measure the 100mV output.
So I always achieve transfer accuracies < 1ppm even in the 100mV range..

Same scheme applies, when I measure 1V on the 10V range and 100mV on the 1V range, to check the foregoing AutoCal.
Each time I find, that the transfer are  precise to << 1ppm, provided I had cancelled offsets before.

You may also experiment in that direction, if you own a stable, programmable DC voltage source.

Frank

Edit, because of an additional aspect!

A direct transfer 10V => 100mV range is about 10 times more unprecise than the path 10V => 1V => 100mV.

That's due to the linearity specification of typ. 0.02ppm of F.S. for the 3458A.
That gives about 0.3ppm for each 10:1 transfer, equivalently on a measurement at 1/10 of F.S., but  for a 100:1 transfer, that's already 3ppm!

So, even if you properly cancel all offsets, 2-5 ppm error is to be expected, depending on the linearity of your R6581.
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 16, 2015, 10:04:49 am
i just have to satisfy my logging obsession :P ... esp after a sparodic few days of troubleshoot (partially) and fix and "re-boot" up the K2015. although the DMM works, there is still a lingering fault in the form of a noise going around the DCV/ohm sense section. in the time of repairing, the fried AD822/LTC1050 is also replaced by OPA2140 + LTC2057. it should be noted the noise is very prominent in the 0.1v/1v/10v range, but lesser in the 100v/1000v range, but even so, it is still able to run out some very interesting logs. (the pic probably need to be open wide in its own window, the newer log are the bottom half, compared to old logs of AD822+ LTC1050)

the most interesting to note is that, after the opamp change, the 1NPLC STDEV has become a rival to it own old 10NPLC reading.
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 16, 2015, 10:56:41 am
Lookingforward to your K7510 update Dr.diesel.

Wait no longer!  Although unit was only out of the box for 2 hours last night when I started the run.

Code: [Select]
| Multimeter | Range | NPLC | Counts |    Sq.sum |  Average |    SD |    SD,uV |
| k7510 | .1 | .01 | 1800 | -0.00946209 | -5.256717E-06 | 7.585452E-06 |   7.585 |
| k7510 | .1 | .1 | 1799 | -0.00845946 | -4.702313E-06 | 4.205452E-06 |   4.205 |
| k7510 | .1 | 1 | 1801 | -0.00984773 | -5.467925E-06 | 4.684346E-07 |   0.468 |
| k7510 | .1 | 10 | 1801 | -0.00976237 | -5.420526E-06 | 1.885766E-07 |   0.189 |
| k7510 | 1 | .01 | 1801 | -0.00793555 | -4.406191E-06 | 7.629865E-06 |   7.630 |
| k7510 | 1 | .1 | 1799 | -0.00784621 | -4.361427E-06 | 3.954875E-06 |   3.955 |
| k7510 | 1 | 1 | 1801 | -0.00977324 | -5.426563E-06 | 4.579941E-07 |   0.458 |
| k7510 | 1 | 10 | 1801 | -0.00979378 | -5.437968E-06 | 1.943267E-07 |   0.194 |
| k7510 | 10 | .01 | 1801 | 0.00635690 | 3.529649E-06 | 1.290502E-05 |  12.905 |
| k7510 | 10 | .1 | 1799 | -0.00104714 | -5.820696E-07 | 4.829904E-06 |   4.830 |
| k7510 | 10 | 1 | 1801 | -0.00204352 | -1.134657E-06 | 7.491898E-07 |   0.749 |
| k7510 | 10 | 10 | 1801 | -0.00203306 | -1.128850E-06 | 4.907266E-07 |   0.491 |
| k7510 | 100 | .01 | 1801 | -0.09902185 | -5.498160E-05 | 1.346015E-03 |1346.015 |
| k7510 | 100 | .1 | 1799 | -0.20888873 | -1.161138E-04 | 1.807134E-04 | 180.713 |
| k7510 | 100 | 1 | 1801 | -0.31506582 | -1.749394E-04 | 5.533520E-05 |  55.335 |
| k7510 | 100 | 10 | 1801 | -0.32145543 | -1.784872E-04 | 1.786285E-05 |  17.863 |
| k7510 | 1000 | .01 | 1801 | 1.33690515 | 7.423127E-04 | 1.674120E-03 |1674.120 |
| k7510 | 1000 | .1 | 1799 | -0.16155031 | -8.980006E-05 | 2.495570E-04 | 249.557 |
| k7510 | 1000 | 1 | 1801 | -0.35094636 | -1.948619E-04 | 8.040639E-05 |  80.406 |
| k7510 | 1000 | 10 | 1802 | -0.35127405 | -1.949357E-04 | 5.129073E-05 |  51.291 |

Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 16, 2015, 11:25:54 am
^ Mmmm, not sure why code tags didn't preserve the formatting.  I have all of the raw data but would like to ensure my scripting, and would really like to kill more of my 2.4Ghz home automation devices, some of which are with feet of the DMM.

Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 16, 2015, 04:43:15 pm
Dangit.

Just found line sync turned off, which it wasn't initially.  Either my script testing killed it or the built in auto cal, so the above results are pretty much worthless.

Teaser set currently running at a shorter 5 min duration:

Code: [Select]
| Multimeter | Range | NPLC | Counts |    Sq.sum |  Average |    SD |    SD,uV |
| k7510 | .1 | 10 | 301 | -0.00024168 | -8.029273E-07 | 5.626927E-08 |   0.056 |
| k7510 | .1 | .1 | 301 | -0.00025192 | -8.369386E-07 | 3.502203E-07 |   0.350 |
| k7510 | .1 | 1 | 301 | -0.00022957 | -7.627042E-07 | 6.791389E-08 |   0.068 |
| k7510 | .1 | .01 | 300 | 0.00098528 | 3.284266E-06 | 5.638453E-07 |   0.564 |




Title: Re: DMM Noise comparison testing project
Post by: TiN on December 16, 2015, 04:49:57 pm
Now we talking.
Can you also drop CSV (you can find link in my article about noise testing) data so I can run median/sd to check zero calibration as well :)
Also it would be proper to have meter warm up at least overnight...
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 16, 2015, 04:52:57 pm
I'm going to let this 5 min teaser set finish (which I'll post), then start the 30min per Range/NPLC run overnight again, then will upload the data to your site.

Has been powered on since I got it yesterday, so plenty warm by now!   :-+

Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 16, 2015, 06:08:07 pm
5min run:

Code: [Select]
| Multimeter | Range | NPLC |  Counts |    Sq.sum |  Average |    SD |    SD,uV |
| k7510 | .1 | .01 |   300   | 0.00098528 | 3.284266E-06 | 5.638453E-07 |   0.564 |
| k7510 | .1 | .1 |   301   | -0.00025192 | -8.369386E-07 | 3.502203E-07 |   0.350 |
| k7510 | .1 | 1 |   301   | -0.00022957 | -7.627042E-07 | 6.791389E-08 |   0.068 |
| k7510 | .1 | 10 |   301   | -0.00024168 | -8.029273E-07 | 5.626927E-08 |   0.056 |
| k7510 | 1 | .01 |   301   | 0.00116343 | 3.865231E-06 | 1.363790E-06 |   1.364 |
| k7510 | 1 | .1 |   301   | -0.00021776 | -7.234496E-07 | 5.733036E-07 |   0.573 |
| k7510 | 1 | 1 |   301   | -0.00028301 | -9.402422E-07 | 1.024698E-07 |   0.102 |
| k7510 | 1 | 10 |   301   | -0.00028457 | -9.454107E-07 | 8.580283E-08 |   0.086 |
| k7510 | 10 | .01 |   301   | 0.00220821 | 7.336241E-06 | 1.301336E-05 |  13.013 |
| k7510 | 10 | .1 |   301   | -0.00016204 | -5.383527E-07 | 2.435271E-06 |   2.435 |
| k7510 | 10 | 1 |   301   | -0.00031698 | -1.053088E-06 | 7.528228E-07 |   0.753 |
| k7510 | 10 | 10 |   301   | -0.00034107 | -1.133112E-06 | 5.040502E-07 |   0.504 |
| k7510 | 100 | .01 |   301   | 0.16086693 | 5.344416E-04 | 7.598755E-04 | 759.875 |
| k7510 | 100 | .1 |   301   | 0.09894463 | 3.287197E-04 | 1.358261E-04 | 135.826 |
| k7510 | 100 | 1 |   301   | 0.10250599 | 3.405514E-04 | 3.750361E-05 |  37.504 |
| k7510 | 100 | 10 |   301   | 0.10177610 | 3.381266E-04 | 2.422995E-05 |  24.230 |
| k7510 | 1000 | .01 |   301   | 0.06277022 | 2.085389E-04 | 1.766823E-03 |1766.823 |
| k7510 | 1000 | .1 |   301   | -0.04796741 | -1.593602E-04 | 2.381594E-04 | 238.159 |
| k7510 | 1000 | 10 |   302   | -0.05574608 | -1.845897E-04 | 5.981283E-05 |  59.813 |
| k7510 | 1000 | 1 |   301   | -0.05423848 | -1.801943E-04 | 7.543913E-05 |  75.439 |


Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 16, 2015, 06:57:58 pm
hi dr.diesel. is there anyway to see/know p-p noise of the 7510?
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 16, 2015, 07:13:52 pm
You mean what is listed on the spec sheet?

Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 16, 2015, 08:00:41 pm
nope not the pdf
i meant the data you collected for 7510, which gave the STDEV. is there a way you can also output the peak-peak noise you have?
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 16, 2015, 08:13:01 pm
Oh, gotcha.  I can't do that and keep TiN's format, but I'll upload the raw data here if you'd like to import and play.

I'm gonna do the 30min runs overnight tonight, takes about 9 hours total, I'll then upload in the AM.
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 17, 2015, 11:19:44 am
30 min run results, will upload to TiN's site shortly.

Warmed up a couple days, auto zero, no REL/math, 60Hz, 1sec polling, Keithley 4 term shorting plug.

Code: [Select]
| Multimeter | Range | NPLC |  Counts  |    Sq.sum    |  Average |    SD |    SD,uV |
| k7510 | .1 | .01 |   1800   |   0.00649502 | 3.608347E-06 | 5.157321E-07 |   0.516 |
| k7510 | .1 | .1 |   1801   |   -0.00123428 | -6.853294E-07 | 2.515242E-07 |   0.252 |
| k7510 | .1 | 1 |   1801   |   -0.00110277 | -6.123113E-07 | 5.430182E-08 |   0.054 |
| k7510 | .1 | 10 |   1801   |   -0.00110202 | -6.118930E-07 | 3.105326E-08 |   0.031 |
| k7510 | 1 | .01 |   1801   |   0.00784606 | 4.356503E-06 | 1.394442E-06 |   1.394 |
| k7510 | 1 | .1 |   1801   |   -0.00105845 | -5.877040E-07 | 3.416894E-07 |   0.342 |
| k7510 | 1 | 1 |   1801   |   -0.00112253 | -6.232788E-07 | 8.595656E-08 |   0.086 |
| k7510 | 1 | 10 |   1801   |   -0.00101890 | -5.657409E-07 | 7.448410E-08 |   0.074 |
| k7510 | 10 | .01 |   1801   |   0.01771527 | 9.836353E-06 | 1.266939E-05 |  12.669 |
| k7510 | 10 | .1 |   1801   |   -0.00054103 | -3.004068E-07 | 2.496712E-06 |   2.497 |
| k7510 | 10 | 1 |   1801   |   -0.00143662 | -7.976804E-07 | 7.432814E-07 |   0.743 |
| k7510 | 10 | 10 |   1801   |   -0.00134081 | -7.444814E-07 | 5.072808E-07 |   0.507 |
| k7510 | 100 | .01 |   1801   |   0.89856873 | 4.989277E-04 | 7.725466E-04 | 772.547 |
| k7510 | 100 | .1 |   1801   |   0.56770246 | 3.152151E-04 | 1.102306E-04 | 110.231 |
| k7510 | 100 | 1 |   1801   |   0.59237881 | 3.289166E-04 | 3.473867E-05 |  34.739 |
| k7510 | 100 | 10 |   1801   |   0.58874287 | 3.268978E-04 | 1.637639E-05 |  16.376 |
| k7510 | 1000 | .01 |   1799   |   1.35719201 | 7.544147E-04 | 1.723659E-03 |1723.659 |
| k7510 | 1000 | .1 |   1801   |   -0.31368228 | -1.741712E-04 | 2.448538E-04 | 244.854 |
| k7510 | 1000 | 1 |   1801   |   -0.35386557 | -1.964828E-04 | 7.926890E-05 |  79.269 |
| k7510 | 1000 | 10 |   1802   |   -0.34549073 | -1.917263E-04 | 5.191135E-05 |  51.911 |
Title: Re: DMM Noise comparison testing project
Post by: TiN on December 18, 2015, 04:27:39 am
 :-+
I'll process it and add pk-pk readings into script as well. I think it's not a bad idea  to have more than one metrics.
Title: Re: DMM Noise comparison testing project
Post by: rigrunner on December 19, 2015, 11:15:35 pm
Just uploaded a little over 30 minutes worth of hp3457a 3V range.

90 minutes warm up. copper short, NPLC=10, Autozero=on, MATH=off, NDIG=6, 10GOhm, 1 second per reading.

Running 300mV now. Will upload when done.

Edit: 300mV uploaded. Running 30mV now.
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 19, 2015, 11:48:52 pm
hi rigrunner, in my curiosity to see the p-p noise. i DL your csv file but this is what i saw.
i may have converted the file wrongly, but could you check?
Title: Re: DMM Noise comparison testing project
Post by: rigrunner on December 19, 2015, 11:54:01 pm
Hi 3roomlab,


The data you have is correct. When loaded into librecalc i see it converted:

Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 20, 2015, 12:27:02 am
ah i see. this is my log in xls for your sample view (should open as with no problem?), column 1 is time reference, column 2 is data in nV. but for TiN's web format i think 9 decimals of data /w scientific notation? i think you need to unlock the numbers after the 6th decimals
Title: Re: DMM Noise comparison testing project
Post by: deadlylover on December 20, 2015, 12:44:35 am
Thanks for posting the 7510 results dr.diesel, very interesting stuff!

Its 1plc noise is extremely good, similar to 3458A spec for 10V, but it seems like going to 10plc doesn't give as significant a reduction in STDEV as some other meters. Perhaps it's one of their design compromises for very good 1plc noise performance?

3roomlab, I noted a few pk-pk readings when I was taking measurements from the R6581. Here they are for your amusement.  ^-^

10V Range, pk-pk
1plc = 6uV
10plc = 1.2uV
100plc = 0.4uV

100mV Range, pk-pk
1plc = 1.18uV
100plc = 0.22uV
Title: Re: DMM Noise comparison testing project
Post by: rigrunner on December 20, 2015, 12:46:40 am
ah i see. this is my log in xls for your sample view (should open as with no problem?), column 1 is time reference, column 2 is data in nV. but for TiN's web format i think 9 decimals of data /w scientific notation? i think you need to unlock the numbers after the 6th decimals

There are no further decimals that i'm aware of?

I sent TiN a sample of the data before i started logging and he said that was ok.

I've just uploaded the log for 30mV range.
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 20, 2015, 01:39:48 am
@rigrunner, i think if you look at manatee mafia's 3458a log in xdev website, you see that the data is 1.2345-Exx. but your data is only zero and one.

@deadlylover ty for the data. reference to your log, it seems we might have similar "specs" :P

this pic summary of my test logs so far. with alot of help from kleinstein, it has been rather fun so far (hope it wasnt too boring for those who try to help me). i have just changed some caps in zero buffer, IPA washed and spewing new logs looking for improvement (again) :P (crazy aim, pp noise below 0.5uV @ 1NPLC?)

** i editted the pic to include some of forumners data 263-270 (my K2015 logs are not to be taken seriously at this point, it is uncalibrated, and not a proven mod, it only proves the changes can provide lower noise)
Title: Re: DMM Noise comparison testing project
Post by: rigrunner on December 20, 2015, 02:15:20 am
@rigrunner, i think if you look at manatee mafia's 3458a log in xdev website, you see that the data is 1.2345-Exx. but your data is only zero and one.

The file contains exactly what was displaying on the 3457a LCD. i.e the only reason there is a 1 and all zeros is because only the single least significant digit was changing whilst logging.
The only other digit available it the 7 MATH HIRES and i do not see a way to get that whilst logging  :-//
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 20, 2015, 02:26:32 am
hmmm i see, try math then. result = reading x 1000. so you could at least log in millivolts 0.0001234? but im not familiar with hp, maybe somebody familiar can advice
Title: Re: DMM Noise comparison testing project
Post by: rigrunner on December 20, 2015, 03:52:24 am
Converting to millivolts is easy enough. You want the data like this?

Elapsed Seconds,Millivolt,Raw
1,0.0000, 0.0000000E+00
2,0.0000, 0.0000000E00
3,0.0000, 0.0000000E+00
4,0.0010, 1.0000000E-06
5,0.0000, 0.0000000E+00
6,0.0000, 0.0000000E+00
7,0.0000, 0.0000000E+00
8,-0.0010,-1.0000000E-06
9,0.0010, 1.0000000E-06
10,0.0000, 0.0000000E+00
11,0.0000, 0.0000000E+00
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 20, 2015, 05:25:36 am
errm not the 1 and 0 log, i think it can only be useful reference for DMM-ers if it show the rest of the digits. if you do a STDEV calculation on the 1 and 0, it is not going to be very useful. i think you yourself need a way to know your own STDEV too? no? i hope some HP veteran can tell you which SCPI command.

on my K2015, in 100mV, i estimate the resolution is probably down to 0.5nV. so i recall/read/fetch all the reading to 1234nV, in your case, you should probably try to read the full 0.00000123456V. so you are missing the "23456". you really need those numbers if you want to help yourself to some STDEV math,esp on a spreadsheet. but i think some HP users do the entire math inside the MCU. i have no idea what code they use
Title: Re: DMM Noise comparison testing project
Post by: rigrunner on December 20, 2015, 05:48:14 am
I can't get any better resolution in the 3V range.

The 30mV range logged this kind of data:

-450.00000E-09
-420.00000E-09
 540.00000E-09
 240.00000E-09
-340.00000E-09
 130.00000E-09
-210.00000E-09
-190.00000E-09
-40.000000E-09
-60.000000E-09
-160.00000E-09
 0.0000000E+00
 90.000000E-09
-210.00000E-09
-210.00000E-09
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 20, 2015, 05:56:46 am
yea thats the right data  :-+.
if you want to make it easy to read, just multiply by 1000,000,000. so you read it directly as -450nV, -420nV etc as integers. but otherwise i think this data is good for TiN's collection
if you want to DIY your own STDEV in spreadsheet, have a read in opencalc webpage on STDEV, AVERAGE, for peak-peak, read use of MIN(range), MAX(range)
Title: Re: DMM Noise comparison testing project
Post by: rigrunner on December 20, 2015, 05:58:31 am
I uploaded the data for the 3V, 300mV and 30mV data a while ago.  :-+

30mV log gives :

stdev   232.8749695261nV
max   860nV
min   -960nV
avg   -30.9714889124nV
Title: Re: DMM Noise comparison testing project
Post by: TiN on December 20, 2015, 04:45:50 pm
Got around and made graphs of dr.diesel's K7510 vs mine K2002 with few opamps vs sick evil 3458A (http://)..

No magic, folks. While Keithley 2040 (erm, 7510 :P) is bit better on low-range, difference on higher ranges vanishes at instant..

(https://xdevs.com/doc/xDevs.com/dmm_noise/0v1_k7510.png)

(https://xdevs.com/doc/xDevs.com/dmm_noise/1v_k7510.png)

At base range, they all very close:

(https://xdevs.com/doc/xDevs.com/dmm_noise/10v_k7510.png)

(https://xdevs.com/doc/xDevs.com/dmm_noise/100v_k7510.png)

(https://xdevs.com/doc/xDevs.com/dmm_noise/1kv_k7510.png)

3458A with it's averaging on NPLC > 10 still kills them all with ease.

Neeeext....

Thanks dr.diesel for stepping up and actually running test for us. Perhaps you can share your script, so I can add into article for other busy 7510 owners, so we can get more cross-relation.

P.S. Let's give little guy some credit too, 7510 at 4K$ price point being 7.5D meter still good instrument, comparing to 2002 (6K$, 8.5D) and 3458A (10K$, 8.5D).
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 21, 2015, 11:48:48 am
3458A with it's averaging on NPLC > 10 still kills them all with ease.

Thanks TiN!

We could simulate the NPLC > 10 and continue the fun on both the 7510 and 2002. 

Perhaps you can share your script

My program was integrated with another logging suit specifically written for my equipment and needs, so sharing won't help anyone.   :palm:

P.S. Let's give little guy some credit too

I have no buyers pride, but I think the 7510 has much value at $3700.  At the 20v range and below where many/most of us will be using it it really shines, and can compete with the mighty 2002/3458A.  Add in the beautiful screen and other included options, it's win win IMHO.  And I still bet a K8510 is in the works!

I may also redo some of the sets in the 7510 sweet spot and include NPLC 5:



Title: Re: DMM Noise comparison testing project
Post by: TiN on December 21, 2015, 12:27:58 pm
2002 have native NPLC up to 50. Not that much use of it though.....

As of 8510, I'm sceptical. But would be happy to be wrong.

Quote
7510 has much value at $3700.
It does indeed. As many already stated, and I agree, 3458A being more a metrology tool, rather than general-purpose bench DMM.
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on December 22, 2015, 01:21:43 am
Hi,

I completed the noise diagram for my HP3458A, from the fastet rate at 4 1/2 digits, NPLC 0.00007 = APER 1.4µs, to NPLC 1000.
Everything is done at maximum speed, e.g. 100kHz @ 1.4µs, and with AZERO OFF, apart from NPLC 1000, which uses AZERO, due to the long sampling time.
I omitted again 100V and 1kV as these should be practically identical to 1V and 10V, respectively.
 
The measurements are done at 50Hz line frequency, so compared to 60Hz , my curves look a little bit better at the same NPLC number, and NPLC >= 1.

At NPLC 1000, the 10V range nearly reaches 9 digits.
 
Frank
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 22, 2015, 04:15:18 am
hi dr frank, how do you use the APER parameter? or rather, how should 1 use APER? while i know its a measurement window, but thats about it :(
Title: Re: DMM Noise comparison testing project
Post by: TiN on December 22, 2015, 04:40:50 am
You can set it just like NPLC, using APER command instead. Maximum integration time is 1 sec.

When I get my meter working again, I'll test on different mains frequency, from 45Hz to 65Hz :)
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 22, 2015, 04:58:41 am
what i dont understand is, if we command APER to capture a window of x samples, it does not depend on cycles like NPLC ?

edit** if based on Dr Franks plot, when we set NPLC 1, i am guessing we should also set APER = 0.02, yes ?
if so, what if we set NPLC =1, but we set APER as something else, 0.5? or its going to introduce more noise?
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on December 22, 2015, 09:38:43 am
what i dont understand is, if we command APER to capture a window of x samples, it does not depend on cycles like NPLC ?

edit** if based on Dr Franks plot, when we set NPLC 1, i am guessing we should also set APER = 0.02, yes ?
if so, what if we set NPLC =1, but we set APER as something else, 0.5? or its going to introduce more noise?

APER and NPLC are equivalent commands. You can either specify the one or the other, following the fixed relation APER * Line_Freq = NPLC.
Therefore you cannot set APER and NPLC  independently. Setting one variable changes the other one automatically.

The APER parameter equals the A/D integration time. Therefore, everything below NPLC = 1 or APER 0.02 does not suppress line frequency, giving higher noise.
Maximum effective integration time is 200ms, or NPLC 10 = APER 0.2. All longer settings are done by averaging multiple NPLC 10s.

It is also important, that the sampling rate is always slower than the setting by NPLC or APER, due to some dead time between samples, plus time for other measurement phases like AZERO, or OCOMP with OHM measurements.

I configured for fastest possible acquisition by PRESET DIG and TIMER event triggering.

APER TIMER Rate
1.4µs  10µs  100kHz
10µs   20µs   50kHz
20µs   30µs   33kHz
200µs 250µs  4kHz
2ms    2.5ms 400Hz

As fast data transfer directly over GPIB is tricky, I instead used the internal 148kB memory, using SINT, DINT format, and downloaded data after complete acquisition.

For NPLC 1000, I had to use AZERO ON, as otherwise the 3458A already drifted a lot, giving erroneous / instable readings, as probably can be seen in TiNs measurements.
As one sample takes 40 seconds, I limited this measurement to 15 samples / 10 minutes.

Frank
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 22, 2015, 10:40:49 am
thanks TiN n Frank. that tip on AZERO also confirmed my assumption about its use. although in my case, it seem to add a tad of noise.

i tried experimenting with cycling AZERO (ie:1 AZERO per 100samples), but it seem to add some non-linearity to long term reading as well. so in my conclusion, i think i will just leave it 100% on. i got this cycling idea from reading the web, but i think it is only usable for certain machines

as i am using RS232, 1 sample of 100NPLC takes approx 6.6seconds to log to PC. NPLC1000 will take about 70 seconds :P (3600 samples = 7days/70days ! shiet ! :P)


non linearity is the wrong word
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on December 22, 2015, 11:10:17 am
thanks TiN n Frank. that tip on AZERO also confirmed my assumption about its use. although in my case, it seem to add a tad of noise.

i tried experimenting with cycling AZERO (ie:1 AZERO per 100samples), but it seem to add some non-linearity to long term reading as well. so in my conclusion, i think i will just leave it 100% on. i got this cycling idea from reading the web, but i think it is only usable for certain machines

as i am using RS232, 1 sample of 100NPLC takes approx 6.6seconds to log to PC. NPLC1000 will take about 70 seconds :P (3600 samples = 7days/70days ! shiet ! :P)

You may use AZERO ONCE to let precede one zero reading before the complete acquisition.
For longer sampling, like NPLC 1000, your 3458A will drift too much, anyhow.
That's not non-linearity, that's simply an offset, what you'll see.

It makes no sense to take so many samples for long integration times, as the standard deviation (per sample) is already extremely low.
You would erroneously measure mid-to-long term drifts, like LTZ and gain resistor drifts, instead of noise.

For these short apertures, I acquired 32768  or 65536 samples within 1 second, which makes sense, to get stable stdev values.

Frank


 
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 22, 2015, 12:07:47 pm
65k samples a sec. wow i dont think the K2015 is possible to do it that way. or maybe i dont know how
but in any case, it has been very interesting journey playing with the K2015 THD (nope i dont have a 3458a, thats TiN)


which means, with long windows of captures, i have included all kinds of environmental noise into my data
Title: Re: DMM Noise comparison testing project
Post by: plesa on December 22, 2015, 12:35:16 pm
Keithley 2000/2001/2002 can do 2000 samples per second. I expect same spec for 2015.
HP 3458A can make 100k, and for instance 34411A 50k samples per second.
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 22, 2015, 01:02:44 pm

At NPLC 1000, the 10V range nearly reaches 9 digits.
 
Frank

btw, how do we gauge usability of a last digit. is it using noise STDEV? say 10v range 12,345,678.9uV, what should STDEV look like so that the 9th is considered a usable reading?

and also what is the diff between RMS noise and STDEV?
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on December 22, 2015, 02:09:53 pm

btw, how do we gauge usability of a last digit. is it using noise STDEV? say 10v range 12,345,678.9uV, what should STDEV look like so that the 9th is considered a usable reading?

and also what is the diff between RMS noise and STDEV?

RMS noise equals STDEV. You can recognize that directly from comparing the STDEV and the RMS formulae.
For the 3458A, averaging gives converging results, obviously, whereas the FLUKE 7510 may be worse at higher averages (it diverges).
I am not able to identify the reason for that, but it has something to do with the character of the internal noise sources.

Provided that the mid- to long-term stability (determined by variations of temperature, reference voltage and  gain resistors over the measurement interval) are small enough, you may theoretically achieve 9 usable digits when averaging sufficiently.

The variance (or uncertainty) of a set of N measurements is given by stdv/ sqrt(N).

For the 10V range, you may average over about 50 measurements of NPLC 100 to have 1e-9 variance of the result.
4 averaged measurements of NPLC 1000 also give 1e-9.

I doubt that anything below 1e-8 is useful.
At first, the mentioned environmental parameters are worse, and second, the linearity of the A/D is 2e-8 'only'.

Therefore, any higher resolution is useless.

For classic analog references and DMM, an instability of 1e-8 is the absolute limit.

Below that, you need totally different working principles.

Together with our National Standards Office, PTB, a company named Supracon developed an AC  quantum voltmeter, having about 1e-10 stability, see here:
http://www.supracon.com/en/ac_quantum_voltmeter.html (http://www.supracon.com/en/ac_quantum_voltmeter.html)

Frank
Title: Re: DMM Noise comparison testing project
Post by: TiN on December 22, 2015, 02:25:55 pm
That's if DC offset on RMS is removed. STDev removes DC component by definition.

Also on 3458A APER does actually allow integration times longer than 10 NPLC, up to 1 second, while higher NPLC are averaged in digital domain. At least that's what in manual.

All my measurement are with autozero, unless clearly stated otherwise, so issue visible on my data is due other factors, not due autozero function. One of those was mentioned earlier in repair thread, reference output on A9 jumps ~1ppm in random matter, upsetting samples on long speeds. That is likely due to small airflow leaking into LTZ1000 pins.

I did run tests before with NPLC vs APER speeds, results are very close. Will dig data out and post later for clarity.

Have to get ADC fixed first before redoing any good measurements.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 22, 2015, 02:48:08 pm
The autozero has two functions: the obvious is to counteract drift. The second is that with autozero the 1/f noise is reduced, just like in chopper amplifiers. So when 1/f noise takes over it is better to use autozero and digital averaging than relying on A/D conversions with long integration times.

To be fair in comparision one should also note the minimum time between readings. For the user this is the more important factor than the actual time used for the integration phase. The fraction of time actually used for measurement is also important, is this sets the noise bandwidth for noise from the signal source. So the extra time spend in autozero and similar phases is bad in both ways.
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 22, 2015, 03:30:28 pm
i cant remember the ic pin of this trace (iirc its from U153), i caught this 2 pics while mucking around previously, they are while NPLC 1 /NPLC 10 are running. im not sure if each pulse represent the capturing of 1 sample but i assume it is, and it is pretty slow, nearly 500ms for NPLC10, and for some strange reason, NPLC10 at 100mV is faster than NPLC10 at 10v
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on December 22, 2015, 03:50:39 pm

Also on 3458A APER does actually allow integration times longer than 10 NPLC, up to 1 second, while higher NPLC are averaged in digital domain. At least that's what in manual.


TiN, you're fully correct, it's explained in the notes on pages 59/60 in the manual, and I just checked that on the OCOMP ohm function, where you can directly see the difference in the timing, when digitizing the voltage across the resistor.

That I did not know before, but it's pretty interesting for some reason, although maximum A/D conversion is limited to 1sec only.

Frank
Title: Re: DMM Noise comparison testing project
Post by: TiN on December 22, 2015, 04:34:14 pm
Here's data, just to back that discussion up:

3458A 10 and 1 NPLCs, RES 2W, OCOMP ON

(http://xdevs.com/doc/HP_Agilent_Keysight/3458A/test/3458_10nplc.png) (http://xdevs.com/doc/HP_Agilent_Keysight/3458A/test/3458a_1nplc.png)

3458A 0.6 and 1 sec APERs, RES 2W, OCOMP ON. Note 400ms timescale, instead of 100ms

(http://xdevs.com/doc/HP_Agilent_Keysight/3458A/test/3458a_0aper6.png) (http://xdevs.com/doc/HP_Agilent_Keysight/3458A/test/3458a_1aper.png)

Keithley 2001 10 NPLC, AZER,LSYNC OFF and AZER,LSYNC ON, RES 2W, OCOMP ON

(http://xdevs.com/doc/HP_Agilent_Keysight/3458A/test/kei2001_10nplc.png) (http://xdevs.com/doc/HP_Agilent_Keysight/3458A/test/kei2001_10nplc_az.png)
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 22, 2015, 04:45:37 pm
So in 10 NPLC mode the HP3458 need a little over 20 cycles and the Keithly2001 about 50 cycles. Thats quite a difference not to call it cheating, with even the shorter phase 20 cycles long.

Is there an extra setting that set the output rate of the Keitly to a fixed 1 Hz ?


Title: Re: DMM Noise comparison testing project
Post by: TiN on December 22, 2015, 04:52:16 pm
Offset compensation in Keithley works kinda different, and dead time is longer as well.
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 22, 2015, 05:52:19 pm
finally some 10v 100NPLC testing log. the entire log wasnt very successful as there is the mechanical switch problem. but still i could extract 1000 samples.
compared to the 3458a noise, K2015 is 3x more noisy  :-DD. now maybe i found something to want to mod again?

this segment is taken from the middle of the log
10NPLC x 10repeating-average (100NPLC). 6.5s x 1000samples. AZERO on.
STDEV 302.51nV, p-p noise 1744nV (kurt -0.20, skew -0.03)

the logged width of the p-p noise is just bad  :-DD

**edit @kleinstein, i am not sure about output timing consistency, but in the SCPI command page, there is an elaborate trigger and delay system.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 22, 2015, 06:24:03 pm
With autozero on the single 10 NPLC readings are essentially uncorrelated, except for noise from the reference, which does not really matter much in a zero voltage measurement anyway. So there is not much extra information gained in using simlulated higher NPLC readings.  Still getting about 0.9 ppm noise at 10 PLC for the modifyed K2015 is a good value for a 6 digit meter. But this is still something like 2-3 times the high end meters.

More could be gain from the longer runs, if the individual data are checked for correlations. This would give the information how much the curve will deviate form the square root n slope.
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on December 27, 2015, 11:33:24 am
Wow, this is a very interesting thread. My own results without auto zero below. I have a coupla questions:

@Dr. Frank

- presumably it was the upward tip of the graph which tipped you off to the need for auto zero?
- if we compare the non-azero vs the a-zeroed results, presumably that gives a measure for the instrument/ref flicker noise? Would you guess this is short term temperature fluctuation or something else?
- did you get your noise spec from reading values off the graph in the datasheet or from somewhere else? (I read mine off the graph)
- the split between the spec and the non-auto-zeroed results seems to occur earlier for 100mV and 1/100V ranges. Any thoughts?
- (also) does it matter that you're not triggering off the PLC? i.e. you can trigger anywhere in the cycle?
- (also) does it matter (re APER and NPLC) that the line frequency isn't an integer at any particular moment or is APER time effectively defined on a line frequency basis (I guess I could RTFM for this one)?

@everyone

Is there a way to run the characterisation for non-zero inputs?

Apologies for more questions that answers, but it does provoke a lot of thought.

Alan

(http://anagram.net/nuts/MeterNoiseFloor/Images/3458A-01704%20noise%20floor.png)
Title: Re: DMM Noise comparison testing project
Post by: TiN on December 27, 2015, 12:46:36 pm
Aha, so I'm not the only one to see worse data with higher NPLCs.
I need to rerun with meter in current condition, as in my case long NPLCs reading were compromised by LTZ's "popcorn" noise (random shifts ~1ppm).

Non-zero inputs require way more thought than zero tests, as it's rather difficult to have sub-ppm stable signals with sub-ppm noise, to match performance of reference in meter itself. Otherwise we will be testing source noise rather than DMMs.

Alan, can you drop your CSV's on my FTP, so we can see if your reference is suspected to jumps as well? That would explain bad results you seeing.
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 27, 2015, 12:54:27 pm
but how did Dr franks have such low STDEV?
surely it is something repeatable, to produce similar result if conditions could be similar?
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on December 27, 2015, 01:05:21 pm
>>> Non-zero inputs require way more thought than zero tests, as it's rather difficult to have sub-ppm stable signals with sub-ppm noise, to match performance of reference in meter itself. Otherwise we will be testing source noise rather than DMMs.

Ah yes, I'm thinking the answer is something like:

(1) measure the noise on a lowish noise source at a few chosen levels using an independent method (AN124 etc)
(2) measure the noise using the chosen meter at the same chosen levels using the same methods we've been using for zero levels
(3) RMS-subtract the meter-measured noise from the independently-measured noise to get the meter noise contribution at these levels

... but this is a new area for me.

The reason I bring this up is that it would be interesting (at least IMHO) to establish/measure the meter noise floor for non-zero inputs. This could be done automatically for, say, a dozen key levels and a reasonable stab at a noise surface estimated.

A.
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on December 27, 2015, 01:28:01 pm
>>> Aha, so I'm not the only one to see worse data with higher NPLCs.

Glad to have been of service :)

>>> I need to rerun with meter in current condition, as in my case long NPLCs reading were compromised by LTZ's "popcorn" noise (random shifts ~1ppm).

Maybe an AZERO on and off comparison would isolate the flicker/popcorn level?

>>> Alan, can you drop your CSV's on my FTP, so we can see if your reference is suspected to jumps as well? That would explain bad results you seeing.

I'm not saving the point-by-point results atm but will try writing them out in your format.

A.
Title: Re: DMM Noise comparison testing project
Post by: deadlylover on December 27, 2015, 01:33:24 pm
but how did Dr franks have such low STDEV?
surely it is something repeatable, to produce similar result if conditions could be similar?

My R6581 got pretty close and it's worse meter.  :P

I think you guys might be taking too many samples which means we're starting to measure short term drift and not noise, try a run at 100NPLC with only 100 samples with Auto Zero on as a sanity check.
Title: Re: DMM Noise comparison testing project
Post by: TiN on December 27, 2015, 01:37:20 pm
I had runs with 50 samples only, result was very close if not same.
Autozero does nothing to flicker reference noise, as reference voltage is inside the compensation loop already.
Title: Re: DMM Noise comparison testing project
Post by: deadlylover on December 27, 2015, 01:41:20 pm
I had runs with 50 samples only, result was very close if not same.
Autozero does nothing to flicker reference noise, as reference voltage is inside the compensation loop already.

Well, your 3458A has been to hell and back, back to hell, and back again.  :-DD
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 27, 2015, 03:43:42 pm
try a run at 100NPLC with only 100 samples with Auto Zero on as a sanity check.

using log from this afternoon (unit = uV), numbers all look smaller with smaller samples
0.1v 1NPLC azero=off (3600 samples, SD=0.122, pp=0.822)[200samples, SD=0.115, pp=0.575]
1v 1NPLC azero=off (3600 samples, SD=0.165, pp=1.240)[200samples, SD=0.141, pp=0.806]
10v 1NPLC azero=off (3600 samples, SD=1.010, pp=6.889)[200samples, SD=0.992, pp=4.592]
i still dislike my 10v range noise :(. cheap used n strange modded DMM cant be that picky i guess
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on December 27, 2015, 04:58:26 pm
Wow, this is a very interesting thread. My own results without auto zero below. I have a coupla questions:

@Dr. Frank

1) - presumably it was the upward tip of the graph which tipped you off to the need for auto zero?
2) - if we compare the non-azero vs the a-zeroed results, presumably that gives a measure for the instrument/ref flicker noise? Would you guess this is short term temperature fluctuation or something else?
3) - did you get your noise spec from reading values off the graph in the datasheet or from somewhere else? (I read mine off the graph)
4) - the split between the spec and the non-auto-zeroed results seems to occur earlier for 100mV and 1/100V ranges. Any thoughts?
5) - (also) does it matter that you're not triggering off the PLC? i.e. you can trigger anywhere in the cycle?
6) - (also) does it matter (re APER and NPLC) that the line frequency isn't an integer at any particular moment or is APER time effectively defined on a line frequency basis (I guess I could RTFM for this one)?



Alan

(http://anagram.net/nuts/MeterNoiseFloor/Images/3458A-01704%20noise%20floor.png)

Hi Alan,

1) Answer:
I used AZERO OFF only because I wanted to use DIGITIZE for small aperture times, i.e. getting data at the fastest possible rate, w/o dead time.
My measurements never showed an upward tendency for NPLC > 1, and my results are in good accordance with the 3458A specification, i.e. that the noise is going down for longer integration times.
I also did not get extraordinary better noise figures than the specification.

In the very beginning of this thread, I already made a comment, to avoid acquiring too many data especially for longer integration times. This also causes measurement periods which are also much too long, causing gain drifts of the 3458A.

In the region of NPLC >1 you already reach 1ppm noise level, and 0.001ppm for NPLC 1000!

The instrument has a gain drift of about 0.5ppm/K for the 10V range, and 1.2ppm/K for 1V and 100mV.
ACAL does NOT apply here!

Ambient temperature changes of a few tenths of °C therefore can easily cause drifts of many tenths of ppm.
And that's exactly, what you may see in your measurements.

Therefore I limited my measurements to a few seconds per run, where possible.
Also, the ambient temperature in my basement may be stable to 1/10°C  over hours.

To extract drift from noise, you may use the modified Allan distribution.

2) I made no measurements with AZERO ON, only for NPLC 1000, where the offset drift already affected my noise measurements, equivalently to the explanation above.
You may identify different noise sources by the different time scales.

3) the standard 3458A noise graph originates from the specification

4) which split? can you describe more precisely what you suppose?

5) For NPLC 1, 10, 100, 1000 all measurements are per definition in phase with the line frequency, or in other words, always over multiples of 20msec.
For NPLC < 1, sampling is of course over fractions of one line cycle, and there is no synchronization to the line frequency, so you may of course pick up additional noise.

It doesn't matter, because the pick up noise seems to be minor compared to the other noise sources.

6) I do not understand that question. The situation is as explained in 5)

Frank
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on December 28, 2015, 02:47:57 pm
Hi Dr Frank,

Thanks for your detailed replies.

>>> The instrument has a gain drift of about 0.5ppm/K for the 10V range, and 1.2ppm/K for 1V and 100mV.

Ah this has finally clicked with me now you mention the actual figures :) So it is critical to just run the minimum # of samples quickly - say to a target standard error / confidence level in the noise figure. (edit) ... or maybe watch the internal temperature and abandon any stats gathered over a detectable temperature change.

>>> For NPLC 1, 10, 100, 1000 all measurements are per definition in phase with the line frequency, or in other words, always over multiples of 20msec.

Apologies my question was a little cryptic. I was meaning as the line frequency is only ~50Hz i.e. +- 1% e.g.

http://www2.nationalgrid.com/uk/services/balancing-services/frequency-response/ (http://www2.nationalgrid.com/uk/services/balancing-services/frequency-response/)

... so 1 NPLC is only ~20ms at '50Hz'.

>>> TiN - Autozero does nothing to flicker reference noise, as reference voltage is inside the compensation loop already.

I don't quite get that - is it possible to explain that further?

Regards, Alan
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 28, 2015, 04:52:55 pm
When measuring with zero voltage, the reference noise is very much suppressed  - so you should not see it. It take a low noise source close to the maximum reading in the 10 V range to see the noise from the reference. This might be a 9 V battery, especially if first order drift is compensated for. Also noise from the ADC itself might be higher than at zero reading. Also gain drift (and fluctuations) gets important if measured with a signal.

Using AZ mode eliminates most of the very low frequency noise of the input amplifier and the ADC itselt. This 1/f type noise together with drift is the reason for the curve to go up at higher NPLC values. There may be also some extra low frequency noise before the point the AZ circuit kicks in, e.g. thermal fluctuations at the inputs / range switching relays. So Az is not perfect in elimination all the 1/f noise. The reference is anyway outside the part that AZ is used for.

With more points in a series, you add lower frequeny noise and drift. So the RMS and pp valles should not be lower but are expected to be slightly higher. For the really long runs (e.g. > 2000 points) it would make sense to use fourier transformation or similar to get the noise as a function of frequency.
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on December 30, 2015, 10:07:33 am
Many thanks for the explanation re ref noise and other noise contributors to the acquisition process - I am beginning to understand now. Also an interesting point about fourier analysis. Below a plot comparing azero on and off (I used the same setting on all nplcs) to counteract drift - presumably the difference is mainly down to temperature drift. With a coupla runs I was able to get an internal temp drift less than 0.1C during the nplc 1,000 run. These are at 60 samples per nplc for a relative standard error in the noise readings of 10% (see error bars). TiN - it would be interesting to run the 'azero on' test on your 'evil' meter - maybe your temperature environment is fairly drifty like mine.

(edit) fixed the error bars on the chart and added the intervening points.

Alan

(http://anagram.net/nuts/MeterNoiseFloor/Images/10V%20azero%20on%20and%20off%20b.png)
Title: Re: DMM Noise comparison testing project
Post by: TiN on December 30, 2015, 04:05:12 pm
Hi Dr.Frank,

Quote
The instrument has a gain drift of about 0.5ppm/K for the 10V range, and 1.2ppm/K for 1V and 100mV.
ACAL does NOT apply here!

Ambient temperature changes of a few tenths of °C therefore can easily cause drifts of many tenths of ppm.
And that's exactly, what you may see in your measurements.

I'm not sure if that's always correct, as according to recent testing (https://www.eevblog.com/forum/repair/repair-old-rusty-hp-3458a/msg826069/#msg826069), change of instrument temperature even 2C does not usually cause change more than 1ppm. That's of course if one to trust assumption that Fluke 732A does not drift same direction as three 3458A's with ambient temperature.

And why would ACAL not apply against temperature change, as it's exactly why it was implemented in first place, to battle temperature variations, no?

"Red" 3458A from results linked above was sampling at NPLC20, Autozero ON, 24/7 over temperature/environment variations more than a week long, and barely went outside 0.5ppm pk-pk, mostly staying in 0.2ppm pk-pk zone. That is with no ACAL between.

Quote
>>> TiN - Autozero does nothing to flicker reference noise, as reference voltage is inside the compensation loop already.

I don't quite get that - is it possible to explain that further?

Per my understanding, all measurements in 3458A are performed with reference to A9 LTZ1000 output. If that output jumps, or drifts, then all ACAL/CAL functions and readings will follow those variations as well, multiplied by range/function gain. I learned that hard way, observing ~1ppm jumps (7V zener voltage) causing clear jumps in DCV/Ohm measurements as well. So even if ACAL was performed - it would not remove any of these variations from output, as internally 3458A considers A9 voltage output as constant, and have no means to compare it to anything else.

All my tests on 3458A were done with autozero enabled, by default. :)
But since there were unstability in A9 output, my noise data from 3458A is invalid. I did not retest it again since I changed bad LTZ1000ACH on A9 to LTZ1000CH, but will do it after get GPIB interfacing on Windows PC fixed (we use Raspberry Pi to sample all drifty logs).
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 30, 2015, 05:43:17 pm
The noise tests with zero input signal are not sensitive to reference variations (unless rediculus large) and gain variations. It really does not change much by how much you amplifiy a value near zero. So even 10 % in gain or reference drift would hardy show up. This noise test only shows additive noise and offset drift. Its only with  DC signal that gain fluctuations / drift and reference noise are included.

The ACAL could compensate for gain drift in the 10 V range at least - it can't do it fully in the other modes.

I am wondering why the noise readings are not higher with AZ on - there should be a higher contribution from white noise, as the differece of two measurements is used. The zero measurement might be lower noise than the real input, as not input protection is involved.  So the extra noise from the AZ must not show up with all instruments. Also take into acout that the measurement with AZ active usually takes longer - so a non AZ mode could use a higher NPLC setting (e.g. twice as long) to get the same data rate. With AZ active the data rates seem to be not the same with all the instruments - so comparing just based on NPLC settings can be misleading. At least one must also note the possible data rate at the setting.
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 31, 2015, 07:49:52 pm
The variance (or uncertainty) of a set of N measurements is given by stdv/ sqrt(N).

For the 10V range, you may average over about 50 measurements of NPLC 100 to have 1e-9 variance of the result.
4 averaged measurements of NPLC 1000 also give 1e-9.

I doubt that anything below 1e-8 is useful.
At first, the mentioned environmental parameters are worse, and second, the linearity of the A/D is 2e-8 'only'.

Therefore, any higher resolution is useless.

i am trying to understand more about uncertainty/variance
from the K2000 spec, if i measure 10v on 10v range. this (using 24hr figures 15+4ppm), i am expecting 190ppmuV uncertainty based on factory spec.

however, if i base on my shorted noise measure of say 0.36uV (over 100 samples @ 100NPLC), = 3.6e-8. between the self shorted variance and a spec sheet, how should i effectively use the 2 now known variances to apply to the 10v on 10v range reading? should i only use the 3.6e-8 since this is the actual uncertainty measured?

 :palm: it is always after not thinking about it, then i come about to figure out after re-reading it again. the 0.36 STDEV = 36uV reading uncertainty. which means my machine uncertainty is 36+40uV in uncertainty for the 10v measured.  :palm: did i get this right? or the 36uV doesnt apply because @ 10v, we are talking about a possibly diff value of STDEV? (STDEV possibly scaling linearly with input resistance?)

update, i finally converted the data for last few weeks into a summary plot (it needs to be known the DMM is modified, for NPLC with multiple points - i have plotted several variants of same NPLC) unfortunately i do not have parrallel data on temp
(http://4.bp.blogspot.com/-zgbyfpbR40U/VodJiKXAzvI/AAAAAAAACi4/pKXR3fwM8TA/s1600/PPMR-NPLC_K2015xxx.gif)
Title: Re: DMM Noise comparison testing project
Post by: TiN on January 29, 2016, 04:08:36 am
Repeated my tests, this time bit different. Had program to take fixed 100 samples, disregarding NPLC rate, and first 10 samples thrown away.

New data is marked 90SMPL on graphs. Old 10minute fixed time data in light blue line.

(https://xdevs.com/doc/HP_Agilent_Keysight/3458A/test/100mvdc_noise.png)

(https://xdevs.com/doc/HP_Agilent_Keysight/3458A/test/1vdc_noise.png)

(https://xdevs.com/doc/HP_Agilent_Keysight/3458A/test/10vdc_noise.png)

(https://xdevs.com/doc/HP_Agilent_Keysight/3458A/test/100vdc_noise.png)

Mains voltage = 110V
Mains frequency = 60Hz
TEMP? =  33°?
Ambient temp = 22°?
AZERO ON
Title: Re: DMM Noise comparison testing project
Post by: pelule on February 03, 2016, 12:07:52 am
Hi,
I just have uploaded my Keithley 2000 noise measurements (CVS raw) via FTP.
Placed it into new created subfolder ".\PeluLe"
File "20160202 Keithley 2000 Noise Test PeLuLe" contains the relevant details.
BR
PeLuLe

Title: Re: DMM Noise comparison testing project
Post by: zlymex on March 05, 2016, 03:20:14 pm
Very good thread and informative data :-+
I had also made some similar tests before, here is the result in the ppm against NPLC manner:
(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=206185;image)

1. It was an old chart of mine, I cannot find all the supporting data now
2. Some of the data points were not measured by me.
3. All these were measurements of 10V Vrefs (not zero, or shorted)
4. More than 500 measurements for each test, select the best 100 portion, and calculate the standard deviation
5. Later, I calculate allan deviation instead, this gives better result when slow drift is present. If there is no drift, the two are equal.
6. For twice, I had six 8.5 DMM in my lab, but I didn't test them in systematic ways. :-[
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on March 05, 2016, 08:16:22 pm
Also looking at the input current and input current noise makes sense. Though a 10 M "source" resistance is rather high. This reading can also get sensitive to shielding / noise pickup. So it is not that reproducible.

When having the 10 M resistance one also has to take into account the capacitance at the input, as there is also a capacitance to ground. Here different meters can be quite different. This is especially important for fast readings.

For the input stage there are mainly two versions:
1) JFET differential stage and auto zero through a slow switching between the source and zero. (HP3457, 3458,...)
2) some kind chopper stabilized amplifier (CMOS OP or discrete with JFETs) (e.g. Solatron, Keithly 2000,...)

Much of the input current can come from charge injection, so not a smooth current but pulses that might not fully cancel out to zero. Here is also can make a big difference if AZ mode is used or not.
Title: Re: DMM Noise comparison testing project
Post by: zlymex on March 06, 2016, 09:38:27 am
, I'm seeing something that can only be described as "popcorn noise"-- little positive [or negative] "spikes" in the data that far exceed the input bias current-- seemingly random, but at a far lower rate than the more-or-less normal input noise. 
Is it something similar to my measurement as attached?
This is my femto-amp meter(DIY), the CMOS input with a very large feedback resistor. I cannot find the source of those spikes neither. Once I even suspect it was the cosmic ray or background radiation because I measure the similar background in my Geiger counter.
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on March 12, 2016, 05:49:03 pm
Thanks zlymex for the noise comparison chart - that's v interesting.

A.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on March 12, 2016, 09:33:17 pm
For sensitive experiments, that are disturbed by cosmic radiation one can do a parallel measurement of the radiation. This is nothing new - I know it is done in some experiment, dropping data from times with high radiation background. The cosmic background is not very smooth but to a large part comes in burst. So for short intervals of something like 10 µs you get bursts of high radiation, with reasonable long time in between with much lower level. So if these high radiation times can be identified, it can be better to ignore this part of the data. There are also variations from the sun, that can be so intense that even plane avoid some regions (near the magnetic north and south poles) at some times.

Though I don't think the input stages of typical DMMs are that sensitive - this might be different when measuring in the fA range.

For the input stages of a DMM or small amplifiers I would more think of the influence of single electronic states that are either occupied or not - at effective positions these can give measurable jumps. Also the position of single dislocations can have an effect.
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on March 21, 2016, 06:58:09 pm
This is a x-post from plesa's 34420a repair thread, but it should be interesting here - a first cut at a 34420a noise floor with an OK but not-perfect short...i.e. a Lemo connector with some copper wire - but not soldered in yet with the specified Sn/Ag solder.

Any 'turning up at the 200 nplc points' might be temperature drift (or just statistical variation - RSE is targeted at 10%). My meter is reporting firmware versions: 9.0-5.0-2.0 btw.

Curiously channel 2 has much lower noise. Whether this is my measurement error or a bad channel 1 or real results, I'm not fully sure - so I would be very interested in someone else verifying this result on their own meter. Looking at the schematic, the channels are asymmetrical (e.g. channel 1 can source current) so it is just possible that the channels have a very different spec. The docs are actually a bit brief on the specified noise floor which is a bit disappointing.

Anyway, I hope that's interesting.

(http://anagram.net/nuts/MeterNoiseFloor/Images/34420a%20noise%20floor - channel 1.png)

(http://anagram.net/nuts/MeterNoiseFloor/Images/34420a%20noise%20floor - channel 2.png)



Title: Re: DMM Noise comparison testing project
Post by: splin on March 21, 2016, 10:15:24 pm
This is a x-post from plesa's 34420a repair thread, but it should be interesting here - a first cut at a 34420a noise floor with an OK but not-perfect short...i.e. a Lemo connector with some copper wire - but not soldered in yet with the specified Sn/Ag solder.

Any 'turning up at the 200 nplc points' might be temperature drift (or just statistical variation - RSE is targeted at 10%). My meter is reporting firmware versions: 9.0-5.0-2.0 btw.

Curiously channel 2 has much lower noise. Whether this is my measurement error or a bad channel 1 or real results, I'm not fully sure - so I would be very interested in someone else verifying this result on their own meter. Looking at the schematic, the channels are asymmetrical (e.g. channel 1 can source current) so it is just possible that the channels have a very different spec. The docs are actually a bit brief on the specified noise floor which is a bit disappointing.

Anyway, I hope that's interesting.

A small point but are you sure about the 34420A 10V noise specs (the brown triangles)? The 10V range data sheet spec is 450nVrms for "6.5 digits (10 PLC) with Analog Filter Off and Digital Filter Medium (50 reading average)." Surely that is equivalent to 500 PLC rather than the 10 PLC shown in the graphs?

Also the legends for the blue dashed (green in 2nd graph) '344020A noise spec' should actually read '1mV range, typical' - though there doesn't seem to be much difference between them; datasheet spec is 1.3nVrms @ 500 PLC whereas the typical (from page 63 of user guide) is 1nV.

Title: Re: DMM Noise comparison testing project
Post by: plesa on March 22, 2016, 05:34:08 am
I know that there is a difference between channel-1 and channel-2 --- one of them can go up to 100V and the other one only goes up to 10V, but I can't remember which is which.  So, one of the channels is hooked up to a HV divider and possibly some different protection network that might explain the difference in noise performance.  What does the manual say about this?  My 34420A is in my home laboratory and I'm not there right now, but I will try to test this later tonight.
Channel 1 is max 120V rated and channel 2 is max 12V rated. On my repaired unit the channel 1 is little bit more noisier than channel 2.
It takes some time to settle down after changing the channel.
Title: Re: DMM Noise comparison testing project
Post by: zlymex on March 22, 2016, 07:09:19 am
, I'm seeing something that can only be described as "popcorn noise"-- little positive [or negative] "spikes" in the data that far exceed the input bias current-- seemingly random, but at a far lower rate than the more-or-less normal input noise. 
Is it something similar to my measurement as attached?
This is my femto-amp meter(DIY), the CMOS input with a very large feedback resistor. I cannot find the source of those spikes neither. Once I even suspect it was the cosmic ray or background radiation because I measure the similar background in my Geiger counter.

Yes, very similar, but my "spikes" are much larger.  I also thought that it might be cosmic radiation--- huge bundles of mixed particles and rays at incredibly high energy levels---  it would certainly explain the data perfectly.  It would be instructive to connect a recorder to the DMM output, and input a highly divided signal from a radiation detector to the DMM---  that way, you would see a "jump" in the signal with each event from the detector, and you would also be able to see if the spikes coincided with the radiation data ["spike" on top of the "jump"].  OR, if you have multiple DMMs, then record the data from them all simultaneously over GPIB, and then plot the data from each so that you can see if the spikes coincide on two or more meters.

If this is cosmic radiation, well then there is little we would be able to do about it other than a sophisticated filter designed to pass the "normal" data while blocking the "spikes".  That would be material for a master's degree thesis...
I came across similar "spikes" several times when I measure a 10V or 7V with my 3458A. Strangely, those spikes were all downwards. This not only happened to me, also happened to others thousand miles away. The reason could be interference from the mains or from the air.

As for the femto current meter, I made another one to test them at the same time, the spikes were not synchronized.
(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=210731;image)
Title: Re: DMM Noise comparison testing project
Post by: zlymex on March 22, 2016, 01:03:21 pm
Not cosmic radiation then-- you would see it in both channels.  Might be radioactive particles in the packaging, but I thought they solved that decades ago...

These are very low current levels, so maybe just shifts in the local field getting picked up?  [People walking by, truck goes by in street, etc.]  At these levels, to be very honest, we should be using shielded and guarded measurements and special cables [like triax, with the middle shield a driven guard, etc.].  Circuits should have careful consideration to shielding and guarding, etc.  Most DMMs don't have this [the 3458A does, but few people make use of it].

Also maybe just quantum mechanics getting us [possibly "hot" electrons being randomly generated in silicon lattice imperfections, with some chips better than others]...  Don't know...  Beyond my knowledge at this point...
Well, the current sources, current-voltage converters, and handheld voltmeters(with data recording ) are all battery powered. The current sources and current-voltage converters are all in their own aluminium cases. I put all of them into a large aluminium box with 4 holes but I cover those holes by coins. Thru one of the holes I can see the voltmeters reading. So I believe what ever the noise is, must come from inside. The earth connection was not shown because I moved the box to the floor for photo.
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on March 22, 2016, 08:43:22 pm
>>> A small point but are you sure about the 34420A 10V noise specs (the brown triangles)? The 10V range data sheet spec is 450nVrms for "6.5 digits (10 PLC) with Analog Filter Off and Digital Filter Medium (50 reading average)." Surely that is equivalent to 500 PLC rather than the 10 PLC shown in the graphs?

Hmmm, that's an interesting thought - I took that to mean that the noise was calculated over 50 readings - but maybe it was ~50 readings @ 500nplc equivalent.

>>> Also the legends for the blue dashed (green in 2nd graph) '344020A noise spec' should actually read '1mV range, typical' - though there doesn't seem to be much difference between them; datasheet spec is 1.3nVrms @ 500 PLC whereas the typical (from page 63 of user guide) is 1nV.

Yes you're right re '1mV range, typical' - I see that if I take the 10nplc figures from the datasheet and the 'typical' behaviour of page 61 of the user manual I should be able to plot ~noise floor for each range.

BTW I should have a general purpose test executable debugged over the next few days for others to test with.

Alan
Title: Re: DMM Noise comparison testing project
Post by: zlymex on March 25, 2016, 12:38:54 pm
Many thanks for the explanation re ref noise and other noise contributors to the acquisition process - I am beginning to understand now. Also an interesting point about fourier analysis. Below a plot comparing azero on and off (I used the same setting on all nplcs) to counteract drift - presumably the difference is mainly down to temperature drift. With a coupla runs I was able to get an internal temp drift less than 0.1C during the nplc 1,000 run. These are at 60 samples per nplc for a relative standard error in the noise readings of 10% (see error bars). TiN - it would be interesting to run the 'azero on' test on your 'evil' meter - maybe your temperature environment is fairly drifty like mine.

(edit) fixed the error bars on the chart and added the intervening points.

Alan

(http://anagram.net/nuts/MeterNoiseFloor/Images/10V%20azero%20on%20and%20off%20b.png)
This is a very good chart :-+
Did you measure a 10V voltage reference or the input shorted? And what that 01704 means on the title?
Title: Re: DMM Noise comparison testing project
Post by: plesa on March 27, 2016, 04:47:13 pm
Alan provided me his test program so we have direct comparison. Measures on bench in my lab without any additional enclosures with 34103A short.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on March 27, 2016, 08:25:41 pm
There must be something very wrong with the noise curves for the 34420. It does not make sense for the lower ranges to show lower relative noise. Except for the higher ranges that use the divider, the noise relative to full scale should go up when going to higher amplification (if limited by the input amplifier, which is expected for the low ranges) or stay constant if limited by the ADC itself (may be the case for the 10 V and 1 V range of the 34420). So it seems to be more the absolute noise that is plotted.

I also doubt the 34420 with it's rather simple ADC could be better or even close to the 3458 in the 10 V range. It may be in the 100 mV range due to the better amplifier and less protection.
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on March 29, 2016, 04:16:36 pm
>>> Did you measure a 10V voltage reference or the input shorted? And what that 01704 means on the title?

This is with a not-great short rather than 10V - a couple of ordinary Pomona shorting plugs if I remember, not the low thermal ones.  '01704' is the last part of the serial #.

>>> There must be something very wrong with the noise curves for the 34420. It does not make sense for the lower ranges to show lower relative noise.

Yeah there's some add behavior here - I can't see why the channels are so different either. That's why I'm interested in some independent verification. I guess it's possible to use the built-it stats functions to check these results...

Regards, Alan
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on March 29, 2016, 08:10:38 pm
The 34420 specs are for 50 the average of 50 conversions and only a rather limited time frame (only 2 minutes with only 5 independent readings per minute) - so the specs mark should be for effectively 500 PLC and slightly (e.g. 5-10%) corrected up for the too short frame.  The 10 PLC value would than extected to be about 7.5 times higher than marked, thus more like 3-4 µV_RMS für 10 PLC in the 10 V range.

Most of the measured curves for the 34420 are also somehow  not plausible - more like using numbers for RMS noise in µV - but the scale shown in ppm of range !. This at least would be about at the specs.

The data for the second channel like all the same - like using one of the lowest ranges for all curves. Maybe setting the range did not work with channel 2 ?

From the schematics the two channels do not look much different - so not much different noise expected.There are possibly slightly different paths for different gain setting and also the amplifier can change. Chances are that the 10 V range noise is due to the ADC
Title: Re: DMM Noise comparison testing project
Post by: Cerebus on April 10, 2016, 02:44:03 am

These are very low current levels, so maybe just shifts in the local field getting picked up?  [People walking by, truck goes by in street, etc.]  At these levels, to be very honest, we should be using shielded and guarded measurements and special cables [like triax, with the middle shield a driven guard, etc.].  Circuits should have careful consideration to shielding and guarding, etc.  Most DMMs don't have this [the 3458A does, but few people make use of it].

Also maybe just quantum mechanics getting us [possibly "hot" electrons being randomly generated in silicon lattice imperfections, with some chips better than others]...  Don't know...  Beyond my knowledge at this point...

To put this into perspective, 100 fA is 624,151 electrons per second (i.e. less than 1 electron per microsecond). At those rates it doesn't take too many electrons to upset the apple cart. I don't trust my maths to work out a theoretical noise current at these levels but I know it won't look good; whatever, once you take basic statistics and quantum effects (this is Fermi-Dirac territory) the shot noise alone is going to be significant simply because the arrival of one single extra electron in a bit more than a microsecond doubles your current.

To look at it another way, you're not measuring DC any more, you're measuring a 624kHz square wave with terrible phase noise and significant random amplitude modulation. :-)

More prosaically, I think the noise being seen is probably good old popcorn noise. Some level of popcorn noise is unavoidable and at these levels what would normally be insignificant noise suddenly looks like a big event.
Title: Re: DMM Noise comparison testing project
Post by: Alex Nikitin on April 12, 2016, 10:54:02 am
At last I had a chance to measure noise on the HP3458A (Option 002) in my work lab. Here is the result - looks quite close to specs?

Cheers

Alex

Title: Re: DMM Noise comparison testing project
Post by: TiN on April 12, 2016, 03:11:59 pm
That's what I see on my box too.
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on April 13, 2016, 03:18:08 pm
Re 34420a - apologies I have lots of parallel projects running v slowly :)

I would be very happy, of course, for someone to use some alternate technology: ezgpib / labview / the built-in stats etc ... to come up with some comparison numbers.

Also I would be interested to see the numbers for the Keithley nanovoltmeter.

AoE, of course, has a lot of description of the 34420A front end.

Regards, Alan
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 15, 2016, 04:40:34 am
I need to get around measuring mine 182M.

Quote
use some alternate technology

Alternate to what? Pi+linux-gpib? Numbers should be same, disregarding of data transfer method, I'd expect.
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on April 16, 2016, 03:20:37 pm
OK these are my 34420a results (well for 6 data points) punching the buttons on the front and using the meter's own built-in stats functions:

duh :)

Methodology (if anyone wants to replicate with their own meter) was:

0 apply the short
1 power-up into default settings
2 set filters off
3 set the channel and range
4 set the nplc in the MEAS/INTEGRATE menu
5 set on the NULL and then STATS functions (toggle to clear the NULL/STATS)
5a wait for 60+ samples
6 read out the stats with Shift >
7 GOTO 3 (or 4)

(http://anagram.net/nuts/MeterNoiseFloor/Images/34420a%20manual%20tests.png)

(http://anagram.net/nuts/MeterNoiseFloor/Images/34420a%20manual%20results.JPG)
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on April 16, 2016, 06:16:01 pm
The new data / table for the 34420 make much more sense.
It's interesting that the 1 PLC reading at 0.1 V range still seems to be limited by the ADC, not the amplifier. So a very good amplifier, but a not that good ADC, especially at high speed - about what one expects from a low level meter.
Title: Re: DMM Noise comparison testing project
Post by: Jorn on April 17, 2016, 07:04:40 am

The results for Keysight 34470A. Measured directly on the instrument using build in instrument statistics. Rising curve from 10 to 100 NPLC on 100mV range must be due to input circuit drift...

Sample count as follows:

NPLC#samples
0.02
100000
0.06
30000
0.2
10000
1
2000
10
200
100
50

Using to many samples on the 100 NPLC measurement results in drift contribution however using to few increases uncertainty on stats :-// 

Hope anyone can confirm the results. Quite satisfied with 10V - 10 NPLC result ;)

-jorn
(Posting his very first message in the eevblog forum)
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on April 17, 2016, 09:55:56 am
Ah thanks Jorn for the 34470A results, very interesting.

Hey Kleinstein re:

>>> It's interesting that the 1 PLC reading at 0.1 V range still seems to be limited by the ADC, not the amplifier. So a very good amplifier, but a not that good ADC, especially at high speed - about what one expects from a low level meter.

Could you explain how you made that deduction - are you working backwards from the theoretical noise floors of the amplifier and adc?

TIA, Alan
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on April 17, 2016, 11:29:07 am
There are four main noise sources in a DMM:
1) the ADC itself: this gives a constant noise contribution relative to the range.
2) The reference noise: this only applies if a voltage other than 0 is measured - so it does not matter for data on shorted input.
    It is proportional to the measured voltage.
3) The noise from the input Amplifier. This noise depends on the range / amplification chose. Usually a constant noise voltage and thus increasingly important in the low voltage ranges.
4) Noise from the input protection / divider: High resistance in the input protection (e.g. series resistance) gives noise, that behaves similar to the amplifier noise. A special case is the typical 9.9 M - 100 K divider resistance, that can contribute to noise especially in the 100 V range.

The noise relative to the full scale in the 0.1 V range at 1 PLC is even lower than in the 10 V range, which is a little strange, but might come from the special kind of range switching used. It's also possible to have quite some quantization noise at 1 PLC and thus a noise level that can change with offsets / the exact measured voltage.

If there would be significant amplifier noise, the 0.1 V range should show a much higher noise than the 10 V range. So the noise must be mainly the range independent ADC noise. It's also typical to have very little amplifier noise for the range without extra amplification (e.g. 10 V range).

A second factor that point towards noise from the ADC is that the noise at 1 PLC is much higher than at 20 PLC. White noise from the amplifier would make the noise go down with the square root of the integration time. With a contribution of 1/f noise the noise would go down even slower with longer time. In contrast to this the ADC can have a noise contribution (e.g quantization or determination of residual charge) that goes down inverse proportional with the integration time - this about what is found here for the 34420. So that ADC is much better at 10/20 PLC than at 1 PLC.
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on April 21, 2016, 10:36:27 pm
Ah v interesting, thanks for taking the time to explain that.

Alan
Title: Re: DMM Noise comparison testing project
Post by: Jorn on May 09, 2016, 04:10:57 pm
Below follows the detailed report for Keysight 34470A Noise floor measurements. Data capture is automated using a small python script communicating through GPIB. (The 34470A build in statistics has limited resolution and is somewhat tedious to utilise for an extensive analysis of the noise floor.)

All measurements are performed with auto zero on. Time unit on x-axis is power line cycles.
This means that the x-axis spans from 2s to 2000s(!). Multiply by 2 to get actual acquisition time using azero.

The first point for all NPLC100 measurements is absent because it consists of only one sample.

I think the graph's indicates that statistics settles around 2000-5000 PLC and that drift kicks in from 5000-10000 PLC.

This leads to the conclusion that noise floor measurements can be tricky to carry out and that the results has to be used with caution in comparisons with other instruments...
 
-jorn
Title: Re: DMM Noise comparison testing project
Post by: TiN on May 10, 2016, 04:45:39 am
That is interesting angle and good details on your test.
I'd like to try that python script, it should be easy to adopt it for other meters to perform equal comparison.
Title: Re: DMM Noise comparison testing project
Post by: Jorn on May 10, 2016, 10:30:18 pm
Attached is the small script that generates the data for DMM noise floor measurements. Beware, it is an early crude version to be improved...

I use Jupyter Notebook http://jupyter.org/ (http://jupyter.org/) for python execution. It's perfect for instrument control due to the interactive behavior of the jupyter notebook.

The script uses the pyvisa library because I use a visa compatible GPIB adapter (F82357 from BEIMING technologies).
If a prologix adapter is used consider trying the pyserial library instead of pyvisa.

The script is attached in 3 different versions (in one zip file):
1) The .ipynb is the Jupyter Notebook binary (don't open unless you run Jupyter)
2) The .py is the exported python file. This file should be able to run (with very few changes) in an ordinary Python 3 environment with numpy, pyvisa and matplotlib installed.
3) The last .html file shows the jupyter environment with all the python code mixed with instrument data and graphs - the Jupyter way of programming...  ;)

-jorn 
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on May 21, 2016, 01:08:12 pm
Ah at last I got a couple of hours to debug my 34420A code. Results below:

http://anagram.net/Nuts/MeterNoiseFloor/HP34420A noise floor v2.xlsx (http://anagram.net/Nuts/MeterNoiseFloor/HP34420A noise floor v2.xlsx)

(http://anagram.net/Nuts/MeterNoiseFloor/Images/34420a%20noise%20floor%20v2.png)

Title: Re: DMM Noise comparison testing project
Post by: alanambrose on June 27, 2016, 12:42:17 pm
OK here are results for a K2182A. This is no filters at all, no averaging, autozero on, line sync on. Also, the front-end block schematic below. The reported temp variation from the internal sensor was <0.2C for each run - so the slight upward sloping on some ranges > 5nplc is curious. Also, the channel asymmetry for 1V and 100mV ranges < 1nplc is interesting - the spec does detail approx 40% more noise on channel 2.

Alan

http://anagram.net/nuts/2182A/K2182A%20noise%20floor.xlsx (http://anagram.net/nuts/2182A/K2182A%20noise%20floor.xlsx)

(http://anagram.net/nuts/2182A/Images/2182a%20noise%20floor.png)

(http://anagram.net/nuts/2182A/Images/2182a%20block%20schematic.png)
Title: Re: DMM Noise comparison testing project
Post by: TiN on November 13, 2016, 03:42:48 pm
I'll just leave this in face of DMM7510 owners who did not do homework  :=\

Comparison of DCV shorted inputs noise on two 3458A in same conditions.

(https://xdevs.com/doc/HP_Agilent_Keysight/3458A/u3/test_noise/hp3458c_r01.png)

(https://xdevs.com/doc/HP_Agilent_Keysight/3458A/u3/test_noise/hp3458c_r1.png)

(https://xdevs.com/doc/HP_Agilent_Keysight/3458A/u3/test_noise/hp3458c_r10.png)

(https://xdevs.com/doc/HP_Agilent_Keysight/3458A/u3/test_noise/hp3458c_r100.png)

(https://xdevs.com/doc/HP_Agilent_Keysight/3458A/u3/test_noise/hp3458c_r1000.png)
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on November 13, 2016, 03:54:29 pm
Do you have time to try it again with a stable reference (3245A) on the inputs? Of course that would leave out readings from the 1kV range.
Title: Re: DMM Noise comparison testing project
Post by: TiN on November 13, 2016, 04:38:12 pm
As of noise test with 3245A actually found recently good article on interwebs about testing LDO noise using 3458A as sampling box.
Output result is provided as 0.1Hz - 10Hz spectrum. I'm interested to write small app in python for it and check how good it works.
Title: Re: DMM Noise comparison testing project
Post by: VintageNut on November 13, 2016, 05:29:56 pm
Hello TiN

I am not following your comment about the DMM7510. I read back to in this thread for the comparison of the 7510 with the 3458A and do not see any large difference. Please give a brief summary/conclusion under what conditions there is a large difference and how much the difference is.
Title: Re: DMM Noise comparison testing project
Post by: TiN on November 13, 2016, 05:36:24 pm
It was more a poke for all (rightfully busy) people with DMM7510's who had no time to run noise test script on the box  :horse:
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on November 13, 2016, 05:39:15 pm
You mean aside from me, or did I miss a new challenge?  :D
Title: Re: DMM Noise comparison testing project
Post by: bingo600 on November 13, 2016, 06:13:20 pm
@TIN

If you are using something linux compatible (linuxgpib) , to measure your 3458 with , could you upload it here ?
Or if you convert JORN's python to linuxgpib & 3458 settings ?

Then i'm ready to test my 58' Opt-02

/Bingo
Title: Re: DMM Noise comparison testing project
Post by: TiN on November 13, 2016, 06:34:04 pm
I had bits and pieces written in python to do same test using Pi, but nothing functional.
So to run these tests I still plug NI USB-GPIB-HS into my Windows WS and run EZGPIB, as listed in the article.
Sorry.  :'(
Title: Re: DMM Noise comparison testing project
Post by: VintageNut on November 13, 2016, 09:45:18 pm
It was more a poke for all (rightfully busy) people with DMM7510's who had no time to run noise test script on the box  :horse:

Where is this magical script? I have python 2.7 and pyvisa running on two different Win 7 machines.
Title: Re: DMM Noise comparison testing project
Post by: TiN on November 14, 2016, 04:05:41 am
It's EZGPIB. Details here (https://xdevs.com/article/dmm_noise/). :)
Title: Re: DMM Noise comparison testing project
Post by: VintageNut on November 14, 2016, 12:36:34 pm
It's EZGPIB. Details here (https://xdevs.com/article/dmm_noise/). :)

Thanks. I downloaded the program. Is there a script for the DMM7510?
Title: Re: DMM Noise comparison testing project
Post by: VintageNut on November 14, 2016, 03:12:27 pm
Here is maybe enough data to give a comparison. My short plug is a crappy banana short. I will try a piece of hookup wire to see if that improves the results.

      DMM7510      
            
Range   NPLC   FILT   STD DEV   READINGS
            
100mV   10   10   24.3nV   60
100mV   10      off   35.9nV   600
100mV   1      off   39.1nV   6000
            
1V   10   10   32.7nV   60
1V   10      off   65.6nV   600
1V   1      off   77.3nV   6000
            
10V   10   10   216nV   60
10V   10      off   344nV   600
10V   1      off   665nV   6000
Title: Re: DMM Noise comparison testing project
Post by: VintageNut on November 14, 2016, 03:42:53 pm
No significant change using a bare solid copper wire.

Here is maybe enough data to give a comparison. My short plug is a crappy banana short. I will try a piece of hookup wire to see if that improves the results.

      DMM7510      
            
Range   NPLC   FILT   STD DEV   READINGS
            
100mV   10   10   24.3nV   60
100mV   10      off   35.9nV   600
100mV   1      off   39.1nV   6000
            
1V   10   10   32.7nV   60
1V   10      off   65.6nV   600
1V   1      off   77.3nV   6000
            
10V   10   10   216nV   60
10V   10      off   344nV   600
10V   1      off   665nV   6000
Title: Re: DMM Noise comparison testing project
Post by: VintageNut on November 14, 2016, 06:22:30 pm
10V range 1000PLC 19 readings, standard deviation  85 nV. I will let this run all week and see what happens.



Here is maybe enough data to give a comparison. My short plug is a crappy banana short. I will try a piece of hookup wire to see if that improves the results.

      DMM7510      
            
Range   NPLC   FILT   STD DEV   READINGS
            
100mV   10   10   24.3nV   60
100mV   10      off   35.9nV   600
100mV   1      off   39.1nV   6000
            
1V   10   10   32.7nV   60
1V   10      off   65.6nV   600
1V   1      off   77.3nV   6000
            
10V   10   10   216nV   60
10V   10      off   344nV   600
10V   1      off   665nV   6000
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on November 14, 2016, 06:37:40 pm
10V range 1000PLC 19 readings, standard deviation  85 nV. I will let this run all week and see what happens.

Did you change instruments?  7510 has a max NPLC of 15.
Title: Re: DMM Noise comparison testing project
Post by: VintageNut on November 14, 2016, 08:31:30 pm
10V range 1000PLC 19 readings, standard deviation  85 nV. I will let this run all week and see what happens.

Did you change instruments?  7510 has a max NPLC of 15.

NPLC 10, Digital filter 100. This is similar to the 3458A which has no aperture greater than 1 second ( if I recall the number correctly from reading in this forum). Everything beyond that is digital filtering. 
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on November 14, 2016, 08:44:35 pm
NPLC 10, Digital filter 100. This is similar to the 3458A which has no aperture greater than 1 second ( if I recall the number correctly from reading in this forum). Everything beyond that is digital filtering.

Mmmmmmm.  If that is an accepted standard with the rest of the folks here then I will do the same for another data point.
Title: Re: DMM Noise comparison testing project
Post by: HighVoltage on November 15, 2016, 08:04:38 am
10V range 1000PLC 19 readings, standard deviation  85 nV. I will let this run all week and see what happens.

Did you change instruments?  7510 has a max NPLC of 15.
Are you sure about Keithley DMM7510 to have a max NPLC of 15
If I remember right, the max NPLC value I could set in DC Volts was 12

Title: Re: DMM Noise comparison testing project
Post by: VintageNut on November 15, 2016, 08:35:30 am
Yes 15 NPLC.
Title: Re: DMM Noise comparison testing project
Post by: HighVoltage on November 15, 2016, 08:44:12 am
Hmm, how do you set 15 NPLC on the 7510?
I am getting an error above 12

Title: Re: DMM Noise comparison testing project
Post by: VintageNut on November 15, 2016, 08:59:40 am
Do you have the latest firmware installed?
Title: Re: DMM Noise comparison testing project
Post by: HighVoltage on November 15, 2016, 09:07:19 am
Do you have the latest firmware installed?
Yes, latest FW 1.6.1 is installed

Really interesting, that you can set yours to 15.
Title: Re: DMM Noise comparison testing project
Post by: VintageNut on November 15, 2016, 09:15:03 am
Do you have the latest firmware installed?
Yes, latest FW 1.6.1 is installed

Really interesting, that you can set yours to 15.

50HZ vs 60 Hz

I am in the USA where one PLC is 1/60 of a second.
Title: Re: DMM Noise comparison testing project
Post by: HighVoltage on November 15, 2016, 09:28:09 am

50HZ vs 60 Hz

I am in the USA where one PLC is 1/60 of a second.

Thanks,
that might be the reason, to get almost equal integration time.

15NPLC  x 60 Hz = 900 cycles
1/60 *15 = 0,250 sec integration time

12NPLC  x 50 Hz = 600 cycles
1/50 *12 = 0,240 sec integration time
 
Title: Re: DMM Noise comparison testing project
Post by: Le_Bassiste on November 18, 2016, 05:21:27 pm
There are four main noise sources in a DMM:
1) the ADC itself: this gives a constant noise contribution relative to the range.
2) The reference noise: this only applies if a voltage other than 0 is measured - so it does not matter for data on shorted input.
    It is proportional to the measured voltage.
3) The noise from the input Amplifier. This noise depends on the range / amplification chose. Usually a constant noise voltage and thus increasingly important in the low voltage ranges.
4) Noise from the input protection / divider: High resistance in the input protection (e.g. series resistance) gives noise, that behaves similar to the amplifier noise. A special case is the typical 9.9 M - 100 K divider resistance, that can contribute to noise especially in the 100 V range.

The noise relative to the full scale in the 0.1 V range at 1 PLC is even lower than in the 10 V range, which is a little strange, but might come from the special kind of range switching used. It's also possible to have quite some quantization noise at 1 PLC and thus a noise level that can change with offsets / the exact measured voltage.

If there would be significant amplifier noise, the 0.1 V range should show a much higher noise than the 10 V range. So the noise must be mainly the range independent ADC noise. It's also typical to have very little amplifier noise for the range without extra amplification (e.g. 10 V range).

A second factor that point towards noise from the ADC is that the noise at 1 PLC is much higher than at 20 PLC. White noise from the amplifier would make the noise go down with the square root of the integration time. With a contribution of 1/f noise the noise would go down even slower with longer time. In contrast to this the ADC can have a noise contribution (e.g quantization or determination of residual charge) that goes down inverse proportional with the integration time - this about what is found here for the 34420. So that ADC is much better at 10/20 PLC than at 1 PLC.

thx kleinstein for clarifying on the possible noise sources!

here's another one that i have observed. however, i still can't fully get my head around it as to how much contribution it may have to the overall noise level of a DMM:
1) take your beloved KEI2001, set it to 200mVDC and connect the input terminals to a 10KOhms resistor. this is, if i got the figures correctly, approximately the highest allowable source impedance to keep source voltage measurement errors at no higher than 1 ppm. thus it presents (to me) something close to the "worst case" when trying to measure DC voltages.
2) now, connect your scope in parallel to the resistor. set coupling to AC, amplitude to 100mV/div, timebase to, say, 10 usec, trigger to norm and 100 mV trig level. BW of 20 MHz is fully sufficient.
3) what do you see? can somebody explain to me whether this does actually contribute to the noise?

curious to get your comments on this!





Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on November 18, 2016, 05:45:42 pm
The input amplifier can have current noise too - this can be a problem with high impedance signal sources. One special case here can be spikes from input auto zero switching. So there can be quite some spikes, but these are in the short phase when the DMM is not actually measuring. So they may not fully contribute - but a capacitive source could stretch / delay those spikes so they will contribute.

Also a chopper stabilized amplifier like in the Keithley 2000 and a few others (solartron, datron 1281) can contribute to input current noise and show spikes.

Input current noise could be important for high impedance sources. So it would be a second parameter to measure. With good shielding it should be possible to have considerable more than 10 K source impedance - some DMMs have more internal for protection. Input current noise is a parameter less looked at - so more surprises to be expected.
Title: Re: DMM Noise comparison testing project
Post by: TiN on November 23, 2016, 04:11:11 am
(https://xdevs.com/doc/xDevs.com/Lab/dmms_noise.png) (https://xdevs.com/de1_dmm_comp1/)

Setup:

No filters on Keithleys.
3458A - NPLC 100, AZER ON
Keithley's - NPLC 10, AZER SYNC, no filter
Number after dash is just GPIB address.
All meters measure same KX LTZ1000 reference, direct 7V, module from Fairy-tale 1 (https://www.eevblog.com/forum/metrology/(ft)-ltz1000a-fairy-tale-or-the-story-of-little-jumper/).

Stuff in the middle of the graph - just me, messing with other gear nearby, causing jumps due to knocking on cables and such.

Results so far:

3458A : <1.2 uV noise ~0.12 ppm/range
2002-4 : <2.5 uV noise ~0.125 ppm/range
2002-6 : <2.5 uV noise ~0.125 ppm/range
2001-20 : <15 uV noise ~0.75 ppm/range
2001-21 : <22 uV noise ~1.1 ppm/range

I had third 2001 in loop too, but it showed huge noise, so I think now it's faulty, even though passes self-test  :-BROKE
Had not enough GPIB cables to connect 4th 2001.
So I'll swap 2002's with 4th 2001 tonight.

Next step would be resistance, perhaps 1K first?
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on November 23, 2016, 03:26:38 pm
hmmm shouldnt the keithley be 10NPLC + 10 repeating average ( = 100NPLC) so that it is = HP 100NPLC. then it is apples = apples?
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on November 23, 2016, 03:58:36 pm
For a direct comparison to the 3458 filtering (average of 10 values) would be better.  However one could still do that on the data. As a rough estimate this would reduce the noise by something like 3 fold (cold be less with large fraction of 1/f noise). So the 2002 seems to be roughly on par with the 3458 but the K2001 seems to be much more noisy. A noise reading with a short for the same meters might be interesting - so one could about separate the reference contribution. The 2001 seems to be noisy with a short too, not just with a significant voltage.

The contribution from the reference in the meter depends on the actual voltage, not on the range. So the value relative to full scale is a little misleading.

At least with the 2002 and 3458 some of the noise comes from the source. So looking at the difference between the two 2002s would also be interesting: this should be sqrt(2) times the noise of the 2002, essentially without noise from the source.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on November 30, 2016, 05:19:21 am
Hello. I've been lurking around on this board recently and caught a bit of the noise bug :)

I noticed that the noise on the new Keithley DMM7510 does not go down as fast as it should for longer integration times, like 10 PLC, especially on 10 V scale. Here is a comparison of the time trace for DMM7510 and Keysight 34465A on 10 V scale, 10 PLC with autozero, continuous triggering. These data are saved to internal buffer, then transferred to USB stick, no computer connection.

(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=274682)

Even though the rms noise is similar, it is clear that DMM7510 data have much larger flicker noise component.  So, I started to look at Allan variance of the voltage (with shorted inputs) for my own meter as well as using the data that others have posted on TiN website. Allan variance tells you what is the rms scatter of the data on a particular time scale. It should go down as 1/sqrt(time) until the instrument reaches offset drift noise floor. Here are the plots for 10V range, using PLC of 1 and 10. All the data are with autozero on. Turning the line sync on or off does not make a difference.
(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=274684)
(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=274686)
It is clear that DMM7510 has a problem, where the Allan variance does not go down until about 30 sec timescale. It is present for three meters measured by different people. Keysight 34465A has the expected normal behavior, it goes down as 1/sqrt(time) and then reaches a floor given by the drift. One can obtain similar plots from any other long raw data files posted on TiN webste (having all the data available is really great!) For example, it would be interesting to compare to a nice long HP3458A file (I can do that if you tell me which one to use).

The really weird thing is that the noise in 7510 changes depending on measurement trigger time. I noticed that first from DrDiesel's data taken at 1 sec intervals (instead of continuous, as most other data). I found that I can get the best performance on my meter using 0.1 sec trigger and 1 PLC.  One can also notice that the noise decreases faster than 1/sqrt(time) after 30 sec. This indicates a quasi-periodic noise source, I suspect some kind of clock interference.

For reference, here are my measurements of the RMS noise for various ranges and speeds for the two meters:
RangeSpeed/Average34465A ppmDMM7510 ppm
100 mv1PLC2.60.43
100 mV10 PLC1.20.29
100mV100PLC From 1 PLC1.10.21
100 mV100PLC From 10 PLC0.970.2
1V1PLC0.320.081
1V10PLC0.140.055
1V100PLC From 1 PLC0.1030.04
1V100PLC From 10 PLC0.0980.033
10V 1PLC0.130.081
10V 10PLC0.040.051
10V100PLC0.016NA
10V100PLC From 1 PLC0.0140.043
10V100PLC From 10 PLC0.0140.038
10V1000PLC from 1PLC0.010.019
10V1000PLC from 10PLC0.00630.016

They are generally consistent with earlier measurements for these meters reported here. DMM7510 is better at 100 mV and 1V, but mostly worse than 34465A for main metrology range of 10V.

There is also a number of programming issues I found on the Keithley DMM7510 meter.  It gave me a blue screen of death several times (even Chinese instruments don't really do that). When using internal trigger timer, it tends to hang up and stop triggering after a few thousand to tens of thousand of points. When saving to USB, it does not warn if the file already exists.  Overall, 34465A is clearly a great deal with 7.5 digit performance. DMM7510 is questionable if its worth 2-3 times higher price, perhaps it can be improved with firmware.
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on November 30, 2016, 10:59:28 am

There is also a number of programming issues I found on the Keithley DMM7510 meter.  It gave me a blue screen of death several times (even Chinese instruments don't really do that). When using internal trigger timer, it tends to hang up and stop triggering after a few thousand to tens of thousand of points. When saving to USB, it does not warn if the file already exists.  Overall, 34465A is clearly a great deal with 7.5 digit performance. DMM7510 is questionable if its worth 2-3 times higher price, perhaps it can be improved with firmware.

maxwell3e10

Please lurk less often, thanks for a great post!

I have also seen the blue screen and general lock up issues, I have reported this to Keithley and they confirmed they are aware of the issue and working on a fix.  Though it's been several months with nothing so far.

I'd love to somehow make Keithley aware of your above data, but have doubts anyone there would take the time to carefully review.   :palm:
Title: Re: DMM Noise comparison testing project
Post by: TiN on November 30, 2016, 11:32:48 am
maxwell3e10
Very nice post, pleasure to see data being used well. If you like, DSV-file (https://xdevs.com/datashort/ltz-kkk4_3458_nplc100_tin.csv) - is also very long (5 days continuous) log with 7V on six meters (3458, two 2002 and three 2001s, with one faulty).

What software you used for these beautiful graphs? I'm interested to try and also add into article as another analysis method for noise, if you let so. I think would also be interesting to see 34470A in comparison too, to see if lower noise LTZ1000 ref helps on time/noise perf.
 
Title: Re: DMM Noise comparison testing project
Post by: HighVoltage on November 30, 2016, 12:26:51 pm

There is also a number of programming issues I found on the Keithley DMM7510 meter.  It gave me a blue screen of death several times (even Chinese instruments don't really do that). When using internal trigger timer, it tends to hang up and stop triggering after a few thousand to tens of thousand of points. When saving to USB, it does not warn if the file already exists.  Overall, 34465A is clearly a great deal with 7.5 digit performance. DMM7510 is questionable if its worth 2-3 times higher price, perhaps it can be improved with firmware.
Unfortunately, my DMM7510 is showing a blue screen of death from time to time as well.
Keithley claims they are working on a FW fix.

Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on November 30, 2016, 12:57:25 pm

 I think would also be interesting to see 34470A in comparison too, to see if lower noise LTZ1000 ref helps on time/noise perf.


A comparison between 34465A and 34470A has been done on 10V range already:
https://www.eevblog.com/forum/testgear/keysight's-new-34465a-(6-5-digit)-and-34470a-(7-5-digit)-bench-multimeters/msg889217/#msg889217 (https://www.eevblog.com/forum/testgear/keysight's-new-34465a-(6-5-digit)-and-34470a-(7-5-digit)-bench-multimeters/msg889217/#msg889217)

noise, i.e. mid term stability is improved over the LM399, also the long-term stability, of course.

short term noise is identical, as the A/D path is identical.

Frank
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on November 30, 2016, 02:35:27 pm
Thanks for good feedback.

It would be good to make an Allan plot comparison for all the meters, that I think would be the best way to compare the ultimate limits of their performance. To make things simple, lets stick to shorted input data first. TiN, if you tell me a list of good long files with 10V, 10 PLC for 3458, 2001, 2002, any others, I will make a plot. If the DMM7510 is really unique with this noise problem, that would be a good plot to advertise until Keithley take note.

I use Genplot, you can get it for free from www.genplot.com (http://www.genplot.com), its a pretty good data analysis and plotting program.
Just for fun, here is the histogram plot, similar to the ones made by Dr.Frank, showing the digital resolution of the meters. Its not really crucial, as both meters have resolution much higher than necessary based on noise. But interesting to note that "6.5" digit 34465A has better digital resolution. The numbers are just how they are written to internal buffer and saved to usb.
(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=274765)
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on November 30, 2016, 03:53:50 pm
Normally the auto zero type of measurement should essentially eliminate 1/f noise for time scales longer than one measurement cycle. Maybe the Keithley engineers were "clever" and did averaging one the zero measurements. This way 1/f noise of the input amplifier would be suppressed only from a lower frequency on.

It might be interesting to do a short test without AZ mode - just to see how much low frequency noise is expected from the input amplifier.

If the strange extra noise at the 7510 there also in the 1 V range ?

Reference noise should not be so important for data on a shorted input. This only comes with a real (low noise) voltage source source of significant hight.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on November 30, 2016, 05:11:55 pm
Yes, I agree the auto zero should take care of 1/f noise at least for analog noise after the switch. It could be some problem before the autozero switch or some quasi-periodic noise that doesn't exactly average out.  As far as I can tell, on 10PLC scale, the autozero is done between every measurement and the real measurement rate is about 2/sec. On 1 PLC scale, the autozero is every 5th measurement and the average sample rate is 47/sec (no line sync) and 25/sec (with line sync).

With autozero off, the signal just drifts off to many microvolts in seconds. I didn't bother taking systematic data.

(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=274784)
Here are the Allan variance data on 1V scale. Here the extra bump is less pronounced, but still present. It is a factor of 10 smaller in voltage, so must couple after input amplifier. Keithley can beat Keysight on this range.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on November 30, 2016, 06:04:43 pm
As the extra noise is lower by nearly a factor of 10 in the 1 V range, this points to noise from behind the input amplifier. It could be something like the zero of the ADC, e.g. +Ref / -Ref balance, or the integrator itself. Normally AZ should really take care of this kind of noise - so I suspect some kind of trouble with how AZ is used. If we are lucky this could get fixed by a FW update. The HW seems to be able to do better, as shown in the curves with 0.1 s trigger.

If this would be a kind of interference / beat frequency (e.g. 100 Hz to grid, crystal to crystal), I would not expect it to be so reproducible across instruments. One should also see a single frequency in an FFT (e.g. 0.1-0.3 Hz range).
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on November 30, 2016, 06:24:04 pm
One possibility is that using a timed trigger makes the measurements better synchronized with the internal clock than continuous measurements. But I found that using the trigger at 0.05 sec with 1 PLC  makes the noise worse than trigger at 0.1 sec. Perhaps this points to a settling issue with the autozero switch?  When using 10PLC, I tried to set the trigger to 1 sec or 2 sec, but this did not improve it.

I haven't looked at typical schematics, is the autozero switch usually before or after the input amplifier?
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on November 30, 2016, 07:02:14 pm
With most new meters the AZ switching is before the input amplifier. I know a few (Keithley 2000, Solartron 1071/1081, datron1280 ?) that use a chopper stabilized input amplifier and AZ switching after the amplifier, thus mainly for the ADC. One could test it, by looking at the LF noise / dirft in the non AZ mode. The versions with AZ behind the input stage are usually quite good even without AZ.
So this strongly points to AZ at the input for the DMM7510.

Here the extra noise seems to come from behind the amplifier that sets the x 10 gain for the 1 V range. With AZ active I see no real source for an analog memory up to the 2 second range - so I would really expect this to be a software problem. Doing AZ only every 5th reading needs some filtering / interpolation - with to much filtering here I would about expect what we see, as the AZ would loose its effect to reduce 1/f noise in a limited frequency range.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on November 30, 2016, 08:18:13 pm
You maybe onto something. I wonder if the meter extrapolates the value of zero offset based on history of prior zero measurements. If it uses a high-degree extrapolation coupled perhaps with some bug in the implementation, it can lead to undesirable results. Maybe when one uses triggered measurements, the autozero algorithm changes, so say for 0.1sec timing autozero is done with every measurement.

Perhaps somehow related to this, I noticed an interesting behavior when the temperature of the meter quickly changes (it was brought from outside into the lab). There are abrupt periodic changes in the readings every 3.2 sec or so. This is even though the autozero measurements are done every 0.2 sec. I am not sure what it is doing, perhaps applying some correction from its temperature sensor? Notice the offset is rather large, about 10 microV with autozero on. The offset still drifts quickly and the meter tries to correct this drift with abrupt changes. Eventually the voltage drifts back to zero when the meter warms up on a 20 min time scale.
(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=274802)
Doing Fourier transform on a long data set (when temperature is stable) reveals a few little discrete peaks, but they don't contribute much to the RMS noise, mostly there is a broad peak around 0.015 Hz, which is consistent with peak in the Allan variance at half the period, around 30 sec.
(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=274804)
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 01, 2016, 02:01:44 pm
Here is the Allan variance comparison of the four leading DMM models. Its nice to be able to find two meters of each model on TiN list. The performance is quite reproducible for each model, except for long term behavior, which depends on the length of the data set and the temperature stability during the run.

Its nice to see that 34465A performs almost as well as the 3458A while nearly 10 times cheaper. On the other hand, Keithley meters don't look so good in this comparison to HP/Agilent/Keysight. The 2002 model also has some trouble with averaging for longer times slower than 1/sqrt(time), but not as pronounced as DMM7510.

(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=274929)
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 01, 2016, 10:13:04 pm
I took DMM7510 10v range data with autozero off for comparison. It looks like autozero does not actually remove any noise on time scale shorter than 20 sec for continuous measurements. But it does help if the measurements are triggered at 0.1 sec intervals. I think this points to a serious firmware problem.

(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=274988)
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 02, 2016, 12:23:41 am
I think this points to a serious firmware problem.

The even bigger question is, how to get Keithley's attention?  So far they have been pretty much ignoring bugs I send them.
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on December 02, 2016, 03:44:27 am
I would consider getting your list of issues together and then post them on the Keithley forum. The questions/concerns are usually handled by a Dale C.

Post a link back to EEVblog, if it is possible, to show the issues you are describing. They may be willing to discuss what you are seeing and having it posted on their forum makes it more visible to the company.
Title: Re: DMM Noise comparison testing project
Post by: HighVoltage on December 02, 2016, 07:39:19 am
I have issues with Keithley DMM7510, 2450 and 2460 SMU and it took forever to even get a response. At the end I was told that with a new FW update, these issues would be solved. Who knows when that will happen.

To compile all new Keithley problems, I have opened a new thread:
https://www.eevblog.com/forum/testgear/keithley-dmm7510-smu-2450-2460-problems/ (https://www.eevblog.com/forum/testgear/keithley-dmm7510-smu-2450-2460-problems/)

May be we can help Keithley in fixing these problems.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 02, 2016, 09:19:17 am
The relatively high noise of the DMM7510 in the 2 s to 30 s range is likely due to a problem in the software. Having nearly the same noise without AZ active in the range shows that for some reason AZ is not able to suppress the 1/f type of noise. At 10 PLC and short times the AZ mode is also higher in noise than expected: one would expect a factor of 1.4 (about what is seen at 1 PLC), but at 10 PLC this looks even more. This suggests they are trying a kind of extrapolation and not averaging for the zero measurement. Heavy averaging would have caused the extra low frequency noise, but at least with the advantage of lower noise at short time scale. The data without AZ don't look so bad that extrapolation would do any good (except maybe under fast changing temperature).

It is not a really serious problem, but it is kind of a shame if a poor firmware degrades the possible performance. The good thing is that this problem should be relatively easy to fix, once they are willing to do so.

The second point the data show is that there is quite some 1/f type noise coming from the ADC itself (not the input amplifier) - this indicate there might also be a potential for an HW update (e.g. better OP in the integrator). So other DMMs might had the same weakness in the software (the data for the 2002 somewhat suggest that), but only the high 1/f noise from the ADC make the weakness so obvious.

The glitches / steps during the measurement with high temperature change rate could be due to automatic internal gain calibrations. It is expected that on changing temperature the will be extra cycles of measuring the internal ref. (e.g. 7 V) to compensate for gain drift. These could cause some minor upset for the AZ measurements. Overall it does not look that bad given the hard conditions. Though there might be similar adjustments under normal conditions as well - only less frequent (and smaller if made the right way).
Title: Re: DMM Noise comparison testing project
Post by: bingo600 on December 02, 2016, 01:27:28 pm
@maxwell3e10

Any chance you could share some info (scripts , data , formats) for using that gfx package ?

I just built it on my linux machine, but would like some "jump starting"

/Bingo
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 02, 2016, 02:16:52 pm
Its a good idea to post on TEK/Keithley forum, do you mean here? https://forum.tek.com/viewforum.php?f=363
Seems like it would be in their interest to fix it, as it could make DMM7510 an all-around great meter that can maybe compete with HP3458.

I was surprised that autozero off noise is not actually that bad on 1-20 sec timescale, so its not like they need to work hard to cancel it.

I am attaching the Genplot script for calculating Allan variance. It can be a bit slow for >10^5 points because I didn't bother making the step size variable.
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 02, 2016, 02:34:58 pm
Its a good idea to post on TEK/Keithley forum, do you mean here? https://forum.tek.com/viewforum.php?f=363

Done,    :-+

https://forum.tek.com/viewtopic.php?f=363&t=139083#p281815
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 02, 2016, 10:49:06 pm
Here is a comparison of autozero on and off for 10V range and 1V range.
On 1V range, autozero functions better in removing the drift, which is primarily caused by input amplifier.

It is interesting to note that at say 20 sec time scale, the autozero fractional Allan variance is better on 1V scale, about 0.015 ppm, than on 10V scale, about 0.03ppm. Here is one hypothesis: maybe they set a certain limit (about 0.03 ppm=10^(-7.5)), below which no autozero adjustments are made. In this way on 1V scale, having larger input amplifier noise forces autozero adjustments, while on 10V scale, there are no autozero adjustments until the voltage drifts enough.

(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=275189)
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 03, 2016, 11:51:50 am
i want to try to understand allan deviation for my K2015, but i think i got it all wrong, or a K2015 ADC is too noisy?
the data is in the zip. it is last years data (3600 samples over 2100 seconds)
col A = time
col B = AVEDEV calculated
col J = data in nV (after zero)
col K = raw data

the plot is AVEDEV() vs time, which i am guessing is the opencalc equiv version of allan deviation (10v NPLC20 AZ=on)

can anyone familiar take a look at the equation inside the xls and provide a hint?

edit : the NPLC 10 version is in the "1158" zip and as seen in pic 2.gif. (there is some disturbance after 100th second). but overall, it shares trend but in a quirky way lol

in a nutshell is the AVEDEV() equation the correct method?
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 03, 2016, 12:25:50 pm
The key for Allan deviation is to take difference between successive points. So, first point of the Allan deviation plot is standard deviation of the difference between neighboring points. For next point you average 2 neighboring points together and calculate standard deviation of the difference of the pairs, and so on.
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 03, 2016, 12:39:27 pm
lotsa cartoon question marks going off above my head.

so say at the 20th sample, the allan deviation = STDEV of samples number 19 to 21? only 3 samples?
this appears to be the VAR AVEDEV function in opencalc :
https://wiki.openoffice.org/wiki/Documentation/How_Tos/Calc:_VAR_function

in my case example =
VAR AVEDEV(S19; S20; S21)

like that?
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 03, 2016, 12:44:10 pm
No, 20th point involves averaging data in groups of 21 points, taking difference between successive groups, and calculating standard deviation of that.
Title: Re: DMM Noise comparison testing project
Post by: bingo600 on December 03, 2016, 12:47:01 pm
Had a look @Genplot , looks fairly complex.
But also somewhat like gnuplot.

Tried an example from the net, but it complained about missing device, not being able to open the Xdriver  and other stuff.
And when it "coredumped" on overriding these errors , i decided to stick w. gnuplot.


/Bingo
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 03, 2016, 03:23:55 pm
No, 20th point involves averaging data in groups of 21 points, taking difference between successive groups, and calculating standard deviation of that.

hmmm ok, i replenished some sugar to make the brain work (or not?). i assume this time my diagram is correct? so the number of differences is (n-1)? and the result being plotted is a progression of the increasing number of differences being included WRT time?

so (rho)^2 = sum [ ((S1 - S2)^2 ) / (n -1) ] ? assuming S1 and S2 are inside n number of samples, but i stumbled on an online pdf which says the divider is  =2* (n-1), which makes (rho)^2 = sum [ ((S1 - S2)^2 ) / (2n -2) ] , the correct version is the later yes? (is there a simple way to know why the additional 2?)

http://www.measurement.sk/PAPERS/Siraya.pdf (http://www.measurement.sk/PAPERS/Siraya.pdf)

**update
if i am understanding allan variance right, which in open calc can be expressed as =(DEVSQ(D1:D2)/(2*n-2))^0.5 ... with 30 samples in the xls file, column k = original data, J = difference, I = AVRA. again, i would appreciate if anyone could tell me if this is the correct method.
however on the flip side, i dont understand why the plot should go lower with AZ=on, shouldnt the overall noise be more or less be a constant over time?
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 03, 2016, 10:37:50 pm
I don't know how to calculate Allan variance in Excel, but with a little googling I found this stand-alone program http://www.alamath.com/alavar/ (http://www.alamath.com/alavar/)
It just needs one column of uniformly sampled data in txt format.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 04, 2016, 06:16:40 am
Results from a K2010, in cal, Keithley 4-term shorting block. 

Range 2 on a k2010 is 10v, FYI.

I've been poking around here and found that Dr.Diesel data for the Keithley 2010 DMM look promising. The rms noise on 10V, 10PCL is only 0.5 muV and the Allan variance looks good. But the data were only recorded at 5 sec intervals. Could you take more data at faster polling rate and maybe also lower voltage ranges?
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 04, 2016, 01:07:05 pm
Could you take more data at faster polling rate and maybe also lower voltage ranges?

You bet!  I got a full house today, but will run the full gambit in the next day or two.
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 04, 2016, 06:42:50 pm
Could you take more data at faster polling rate and maybe also lower voltage ranges?

You bet!  I got a full house today, but will run the full gambit in the next day or two.

NPLC 10, 5, 1, 0.1 at ranges 10, 1, 100mV, 1 sec polling:

ftp://xdevs.com/k2010/

Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 04, 2016, 08:38:58 pm
i am still obnoxiously trying to understand the equation behind the Allan variance, but still, the neurons dont work ...
but using the program indicated by maxwell
this is the plot (from year 2015 log no 1251). how should i "look" at this to understand my DMM? the Y scale should be 100nV. esp the "knee" ?
(im glad i have kept the huge folder, and have documented every log file)

**edit/updated**
pic 3 = 20NPLC, AZ = on, 10v sampling interval approx 1.2 ~ 1.3s (running from RS232) log no 1251 (dec 22nd) modded with new damage
pic 4 = 10NPLC, AZ = on, 10v sampling interval approx 0.8 ~ 0.9s (running from RS232) log no 1158 (dec 22nd) modded with new damage
pic 5 = 10NPLC, AZ = on, 10v sampling interval approx 1.0s (running from RS232) modded w/o damage, log no 0125 (nov 12th)
pic 6 = 10NPLC, AZ = on, 1v sampling interval approx 0.67s (running from RS232) modded w/o damage, log no 1208 (nov 03rd)
pic 7 = 8 NPLC, AZ = on, 1v sampling interval approx 0.5s (running from RS232) modded with new damage. 2nd jan 2016 (only 200 samples)
as i try to recall what i done to the DMM, and the 2nd accidental damage (on about 12dec?).


should the error limiters be flicker FM  or PM? these are all FM.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 05, 2016, 04:32:34 am
You bet!  I got a full house today, but will run the full gambit in the next day or two.
NPLC 10, 5, 1, 0.1 at ranges 10, 1, 100mV, 1 sec polling:
ftp://xdevs.com/k2010/ (http://ftp://xdevs.com/k2010/)

Thanks. It seems to have somewhat similar behavior, faster polling does not lead to less noise on a given time scale. Overall, the performance seems to be slightly worse than DMM7510.  I wonder if all of Keithley multimeters have this peculiar feature where the noise does not average as 1/sqrt(time).
(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=275800)
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 05, 2016, 04:45:43 am
how should i "look" at this to understand my DMM?
should the error limiters be flicker FM  or PM? these are all FM.

I am not an expert on all the options, Allan variance originates in the analysis of clock stability, so things like phase modulation are not relevant here. Just look at ADEV, it should start as low as possible and go down as 1/sqrt(time). If you have white, uncorrelated noise, if N points are averaged, the uncertainty goes as 1/sqrt(N).
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 05, 2016, 12:05:49 pm
hmmm this is interesting, borrowing tin's log of 10v ref using 3458a
this file "10v_3458_nplc200_mm_01527_clean_reduced.psv"

produces this allan variance :P. now maybe this is a good tool to use on vref?

** i had tried some new logging format during 2016, but i did not do it extensively, see the 1v log (pic 6 vs pic7 in post #394). i used a diff format. the NPLC i use jumps in "2s" instead of "10s". im not sure if this point to some kind of "logic" problem, but the 2 log of 1v, have drastic difference NPLC 10 vs NPLC 8? maybe somebody else can try. NPLC 2/4/8/16, vs 1/5/10/15?

there seem to be no mention of what FM/PM error means, except here http://www.wriley.com/The%20Evolution%20of%20Frequency%20Stability%20Analysis%20Software.pdf. (http://www.wriley.com/The%20Evolution%20of%20Frequency%20Stability%20Analysis%20Software.pdf.)
which i assume, maybe FM = freq something ? PM = power something? and the corresponding white noise and flicker noise plot. and this is interesting as 99% of my plots are all high in flicker noise.

**update : i found a log which i think corresponds to the "standard" allan variance character slope. log no 1548 30th nov 2015.
100mV range, 3600 samples @ 1 hz, 10NPLC AZ = on, PPM range recorded is 1.49. this is before the short circuit accident.
but the 10v range does not perform the same. log no 0410
10V range, 3600 samples @ 1 hz, 10NPLC AZ = on, PPM range recorded is 0.05. this is before the short circuit accident.

**update : i needed a way to compare, and so i borrowed Dr Diesel's latest 2010 data from xdev ftp --> the NPLC 10 --> 0.1v and 10v
i converted all to nV scale so there is no decimal points to consider on the Y axis, hmmm not enough samples to reach 1000 (i think needs about 2048 samples)

as kleinstein pointed out before, the K2015 is at the limits of its "anti noise" mod. now what would happen if the 2010 is modded?
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 05, 2016, 04:08:55 pm

i converted all to nV scale so there is no decimal points to consider on the Y axis, hmmm not enough samples to reach 1000 (i think needs about 2048 samples)

as kleinstein pointed out before, the K2015 is at the limits of its "anti noise" mod. now what would happen if the 2010 is modded?

I'm happy to do longer runs.

I've not looked in detail, but I'm more than willing to mod my 2010.  (I need more DMMs, too much stuff to log)   :scared:
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 05, 2016, 05:26:45 pm
OK here are results for a K2182A.
Alan
Alan, can you share the raw data taken with K2182? Or take some new files for a few ranges, longer is better.
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 06, 2016, 01:06:21 am
Overall, the performance seems to be slightly worse than DMM7510.

Today's brief trend of my 731B agrees with that statement.

Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 06, 2016, 02:25:33 am

i converted all to nV scale so there is no decimal points to consider on the Y axis, hmmm not enough samples to reach 1000 (i think needs about 2048 samples)

as kleinstein pointed out before, the K2015 is at the limits of its "anti noise" mod. now what would happen if the 2010 is modded?

I'm happy to do longer runs.

I've not looked in detail, but I'm more than willing to mod my 2010.  (I need more DMMs, too much stuff to log)   :scared:

1) change bypass caps next to important opamps. 100nF --> 10uF 50v. i used TDK x7r for this or something with very very high ripple character. 1210 sitting upright on 1206 pads. see pic
2) add additional DC reservoir to sections of the DMM, ie : ohms section has its own 100uF rails buffer, etc. i used some OSCON for this or any high ripple char.
3) gnd trace beefing, to bypass the 0.2 to 0.4ohm PCB trace resistance. essentially is = create new star grounding. the PCB ground seem to focus on a testpoint as center.
4) zero buffer have the most noise influence in my case, the entire section is overhauled. LTC1050 -> LTC2057, and the power float buffer all BJT is swapped from SOT23 to TO92. this section in my case heats up and creates alot of noise previously.
5) input impedance test, when bad, the impedance never exceed 11Gohm. when good, it is beyond 50G, this is when i have least noise.
6) front/rear switch, it is quite a huge problem with every touch creates a different offset as it is very old. so i did away with the switch totally. input is direct wired to the input protection section.
7) blocking of air movement / improving of air movement. this 1 is finicky. have pros and cons.

im not sure how to quantify if i did add 0.5digit of accuracy to this old K2015, i have nothing more accurate than this to measure. but noise wise i think it is seems no longer a 6.5digit. i think alex nikitin did the opamp mod too, he might have characterized his DMM with calibrated numbers?
and of cos the K2000 schema https://xdevs.com/fix/kei2000/ (https://xdevs.com/fix/kei2000/) this is from the original BBShot 38, there are some discrepencies, so always check before committing changes.
i posted some updates of schema here https://www.eevblog.com/forum/repair/repaired-keithley-2000/, (https://www.eevblog.com/forum/repair/repaired-keithley-2000/,) they are in kicad format iirc

option 8 ) if you did mod a bypass from front switch, then this could be interesting
https://www.eevblog.com/forum/projects/diy-low-thermal-emf-switchscanner-for-comparisons-of-voltage-and-resistor-stand/ (https://www.eevblog.com/forum/projects/diy-low-thermal-emf-switchscanner-for-comparisons-of-voltage-and-resistor-stand/)
add a new auto/manual switcher?

option 9 ) PCB top mod see pic here https://www.eevblog.com/forum/beginners/o-qn-on-funny-nplc-multislopenoise/msg808835/#msg808835 (https://www.eevblog.com/forum/beginners/o-qn-on-funny-nplc-multislopenoise/msg808835/#msg808835) <-- these are the i'm bored mods, they dont seem to be very effective capacitor additions

**update @ dr diesel
i remember now, after re-reading this post https://www.eevblog.com/forum/beginners/o-qn-on-funny-nplc-multislopenoise/msg831474/#msg831474 (https://www.eevblog.com/forum/beginners/o-qn-on-funny-nplc-multislopenoise/msg831474/#msg831474)
back then, i found some that NPLC setting creates a clock noise which varies with NPLC, can be "seen" in the final noise. and in that experiment, by using a base NPLC that is not 10, seem to create a less jittery noise. this seems to coincide with a later test which i used NPLC 8.
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 06, 2016, 11:31:21 am
@ maxwell and dr diesel

i have a suggestion to look at the noise using different sets of NPLC multipliers, with my existing old data, i manage to find a LIKELY trend using the allan dev program. see pics.
x NPLC times y REPeating average (not moving average). the NPLC setting are as per the pic name. eg : 5 x 5 = 5NPLC x 5 repeated_average (non overlapping samples).

notice the deliberate plateaus/flat-line? and that is missing somewhat in NPLC2 and NPLC4?

so again this ties back to my assumption, the NPLC timing, zero crossing of the multislope (NE5534 section?) creates some kind of noise which is leaked into the AD path or somewhat. then this effect is somewhat spoken about passively in K2700 manual which states that there is least noise not when NPLC is highest, but between 2 and 9, strange? in this case, NPLC 2? NPLC 3? the knee also looks diff on diff voltage ranges, it is like an amplification of offset error? but i dont know for sure.

maybe more experts who know this kind of deviation well can give better analysis of this data (y scale is nV or mV for the 100v case)
and maybe it needs more samples to look at esp between 2 to 9 NPLC for machines outside my home to be sure this plateau happens all the time?
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 06, 2016, 01:52:39 pm
For the Alan deviation analysis there is no need to also look at averaged data. This in already included for the longer times (data are averaged before taking the difference). So there is really no need for those extra curves.

There is a certain dependence of noise on the integration time - usually the very short times are not that good, as more time is lost to switching, maybe the final run down and digital resolution could be limited. At very long integration time there will be flicker noise coming through as the AZ cycle is to slow. So there is an optimum length. Depending on the instrument this could be at 1 PLC, 10 PLC or even much longer (e.g. with the Solartron 1081 best length could be in the minutes). Usually the noise from a single reading at a higher NPLC is lower noise than a single faster reading (with same time in between). But the average of several faster readings could get better at some point. Some instrument do internal averaging already to get longer times.

The plateau seen in the Alan variance curves for some of the Keithley instruments at times in the 1 second range is something odd. Normally one would not expect nothing interesting for a DMM using classical auto zero mode (measure zero, measure signal and output difference). This chopper like operation should take care of most of the flicker noise, especially with a shored input. Anything else than a curve going down like the square root is odd. Only at the very low (long) end there might be something from before the AZ switch (e.g. the input protection, or the input buffer at the K2000 and similar).

One thing that could cause a different curve would a kind of averaging / interpolation used for the zero reading. As a simple example this would be using the zero reading before and after the input reading instead of only the one before (or after) - this would reduce the higher frequency noise (due to averaging), but can also increase the flicker noise from an intermediate frequency range. Averaging / digital filtering of the zero readings shifts the balance between higher and lower frequency noise. In the Alan noise plot this might cause such a plateau be reducing the noise for short times a little, but adding noise for the longer times. It is a little like giving away the advantage one could have from averaging several short AZ readings instead of one very long one, as the AZ can no longer reduce flicker noise with too much averaging. Seeing the plateau for the Keithley Instruments suggests they use a kind of averaging / filtering for AZ - with the DMM7510 they seem to have overdone it, cause quite some extra noise.
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 06, 2016, 02:48:27 pm
i have many questions about a noise allan variance plot :D

http://www.phidgets.com/docs/Allan_Deviation_Primer (http://www.phidgets.com/docs/Allan_Deviation_Primer)
http://electronics.stackexchange.com/questions/101045/reading-noise-from-allan-variance-plot-for-mems-sensor-per-ieee-std-952-1997 (http://electronics.stackexchange.com/questions/101045/reading-noise-from-allan-variance-plot-for-mems-sensor-per-ieee-std-952-1997)
quite alot of time-nut based pdf info in google

(http://www.phidgets.com/wiki/images/thumb/9/92/Spatials_1042_allandev_use.png/550px-Spatials_1042_allandev_use.png)
Quote
Point A - This y-axis value is the standard deviation of noise for any one single measurement point.
Point B - Averaging over the time spans along the decreasing slope corrects noise which oscillates quickly.
Point C - Eventually, you average enough that the fast-oscillating noise is mostly corrected for. This minimum has both an X and Y value of interest.
Point D - Noise which oscillates over longer time frames begins to influence bigger groups of averaged data.

aside from the plateau problem, this article suggest that allan plot can be used to determine the best amount of integration time needed to reach the lowest noise uncertainty (point C). and since every DMM and location noise is random, which suggest that our sampling times should be adjusted based on this? especially for long term drift negation? which could maximise long term logging accuracy? ie best SnR?

reference to my post #402, in 10NPLC x 10 mode, the integration time is approx more than 200-300 seconds ... hmmm ? sounds logical?
** if NPLC = counter AC noise cycle, point (c) = counter DMM base noise cycle?
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 06, 2016, 04:59:58 pm
With a working AZ mode, the noise curve should go down even for long times even beyond the 300 seconds. There is not need to choose an integration time near the minimum of the curve - one can always do later averaging on the data. Most modern DMMs get the longer (e.g. > 100 PLC) integration times from averaging anyway.
The use of faster sampling is more question of data rate and memory / file size - not a big problem anymore. So even with longer time logging one can use quite a fast sampling and do filtering / averaging as needed later. Also there often is no choice of time scale - it is set by the experiment.

Also keep in mind that with real, non zero readings, there will be additional noise from the reference. This is not captured in the thread so far - but it can be quite important at a slower time scale. Most refs. show quite some flicker noise, so the curve including the reference will go up after some time. So for comparison one could include the noise of typical refs (e.g. LM399 and LTZ1000). Looking at the zero point noise in the 10 V range is a little odd point to test, as for a real signal near zero one would often use a smaller range.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 06, 2016, 05:37:13 pm
Looking at the zero point noise in the 10 V range is a little odd point to test, as for a real signal near zero one would often use a smaller range.

This is generally true, but we are talking about 7.5-8.5 digit meters, where the whole point is to resolve a small fractional signal. Otherwise for small signals near zero one can always just use a pre-amplifier. For 10V range, 10^(-7.5)=0.03 ppm=300 uV, which is exactly where DMM7510 is starting to behave funny. So one can say it just barely satisfies its specs of giving a result to 7.5 digits. Actually it has rms noise specifications in the datasheet and the measurements that have been posted here are right on the edge, some are results are OK but some are slightly worse than the datasheet specs.
Title: Re: DMM Noise comparison testing project
Post by: VintageNut on December 06, 2016, 06:49:14 pm
Looking at the zero point noise in the 10 V range is a little odd point to test, as for a real signal near zero one would often use a smaller range.

This is generally true, but we are talking about 7.5-8.5 digit meters, where the whole point is to resolve a small fractional signal. Otherwise for small signals near zero one can always just use a pre-amplifier. For 10V range, 10^(-7.5)=0.03 ppm=300 uV, which is exactly where DMM7510 is starting to behave funny. So one can say it just barely satisfies its specs of giving a result to 7.5 digits. Actually it has rms noise specifications in the datasheet and the measurements that have been posted here are right on the edge, some are results are OK but some are slightly worse than the datasheet specs.


I think you mean to say 300nV.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 06, 2016, 07:09:46 pm
Using the 10 V range near zero is a little misleading, as one has to expect a higher noise if used at something like 5 V or 10 V. This may not be so much with the DMM7510 but I would expect quite some extra noise for the 34465 or Keithley 2010 with it's LM399 reference. Measuring near zero just excludes most of the reference noise - especially the 1/f part. This is one of the 3 main noise sources - in the low frequency or longer time range very well possibly the dominating one of one is not near zero. In the Alan variance plot this would give a slope of sqrt(time) up from somewhere around 1 s or so, scaled with the faction of the full scale.
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 06, 2016, 10:37:00 pm
With a working AZ mode, the noise curve should go down even for long times even beyond the 300 seconds. There is not need to choose an integration time near the minimum of the curve - one can always do later averaging on the data. Most modern DMMs get the longer (e.g. > 100 PLC) integration times from averaging anyway.
The use of faster sampling is more question of data rate and memory / file size - not a big problem anymore. So even with longer time logging one can use quite a fast sampling and do filtering / averaging as needed later. Also there often is no choice of time scale - it is set by the experiment.

Also keep in mind that with real, non zero readings, there will be additional noise from the reference. This is not captured in the thread so far - but it can be quite important at a slower time scale. Most refs. show quite some flicker noise, so the curve including the reference will go up after some time. So for comparison one could include the noise of typical refs (e.g. LM399 and LTZ1000). Looking at the zero point noise in the 10 V range is a little odd point to test, as for a real signal near zero one would often use a smaller range.

based on your info, i am starting to understand more about integration time and noise. i went to find the longest log i have, and TADA ! well at least i know that is not how to use "point (c)"
but i did find an alternative curve which may fit a point (c) in an alternate way.
by changing the confidence level from 1 sigma to 3 sigma and using flicker FM boundary. the range where noise is included or precluded can be seen, and there is a low position where a "point (c)" could be found on top of the upper bound tips. by longer integration, it captures more and more LF noise which is what is going on as the boundary expands at the tail (esp for noisy DMM).

plot 2015Nov02_2357_21DD.gif is 0.1v, 1NPLC (sigma = 3). 30k samples
plot 2015Nov01.gif is 10v 10 NPLC (sigma = 3), 20k samples
plot 2015Nov01b.gif is 10v 10 NPLC (sigma = 2), 20k samples
for ease , we assume all samples to be taken at 1sample per second.

these are plots i think way before any mods, so the DMM is quite noisy. in the 3rd pic using sigma = 2, it seems by using an even longer integration beyond 1000seconds, the 100nV resolution can become "statistically" useful. if i use sigma = 3, between 1000-2000s of integration barely makes 100nV of some use (which is more than total effective NPLC of over 10,000. i guess this is why this DMM was sent to the dumpster?). in the 100mV scale, it only needs 32seconds to make 100nV useful (sigma = 3, which is effective total NPLC of only 32). so if i am using a noisy DMM like this in 100mV for long term logging, i will assume it be best to integrate to 32seconds to obtain usable (and repeatable) data down to 100nV in order to exclude the most amount of noise.

would my intention of using allan variation in this way be applicable? it makes sense i would think?
so my guess for 3458a to resolve 10nV, a suitable allan plot can be taken to find the optimal integration time too?
it will also be interesting to turn on all the noisy appliances in the house and do an allan plot vs 1 that has nothing on.

this link talks about a diff allan variation program, but it has more details about the different noise types and the integration slope leading to lowest noise
http://www.stable32.com/paper2ht.htm (http://www.stable32.com/paper2ht.htm) which gave me the idea of the lowest point thingy

**edit, but looking at Tin's 7v log "7v_3458_nplc200_tin_goodA3.csv". we see that the noise is now an increasing slope. by using allans variance, we can see that in order to resolve 1uV, we should sample below 16seconds. does this make metrological sense?
same in the case of the 10k resistor, "time_10k_dmm_3458_nplc100_tin.csv", to resolve to 0.01ohm, we need to sample within 64s, in the case of the resistor, there is a point (c) @ 2~4s.
Title: Re: DMM Noise comparison testing project
Post by: Andreas on December 07, 2016, 05:39:49 am

**edit, but looking at Tin's 7v log "7v_3458_nplc200_tin_goodA3.csv". we see that the noise is now an increasing slope. by using allans variance, we can see that in order to resolve 1uV, we should sample below 16seconds. does this make metrological sense?


Hello,

I guess there is something wrong with the measurement setup (or the alan deviation calculation)
I know that Frank has usually below 200nV standard deviation when measuring a LTZ1000 with his HP3458A at 100NPLC and AZERO on (>=4 seconds)

see also here: (where the plot starts at 130 nV.)
https://www.eevblog.com/forum/projects/project-kx-diy-calibrator-reference-sourcemeter/msg592170/#msg592170 (https://www.eevblog.com/forum/projects/project-kx-diy-calibrator-reference-sourcemeter/msg592170/#msg592170)

And yes: it makes no sense with a 3458A to average more than around 10 measurements.
(the X-scale is in measurements so a 1 corresponds to 5 seconds with triggered measurement).

Your LTZ/3458A plot begins with 400-500nV which is far too high.

with best regards

Andreas




Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 07, 2016, 05:54:45 am
i dont know why its high, im too new to understand it esp measureing of VREFs. but what do you think of application of allan variation to measurement noise? this isnt something applied to volt metrology widely, only popular in time metrology. with my limited knowledge it do seem like it can be useful, a systematic way to determine limit of sampling to what resolution? since the estimated/statistical limit of where the noise stops can be presented/plotted. or in another way of looking at it is the plot of boundary of certainty vs uncertainty
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 07, 2016, 08:16:52 am
Before calculating the Allan variance its useful to look at the time trace of the data. If the trace looks flat and just has  uniform noise, the Allan variance will look good, go down as 1/sqrt(time). If there is any drift in the trace or any spikes, level shifts, etc, the Allan variance will not look good, either flat or going up in time. One can choose to remove spikes or fit out the drift, depending on the purpose of the analysis.

Regarding testing with finite voltage, it would be good to come up with a standard setup that is not too specialized, so many people can use it. Perhaps use a big low-pass filter, say 1 MOhm and a large capacitor, to remove some short-term drift in whatever reference one has. Does anyone know if electrolytic capacitors would cause too much drift in this filter application?
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on December 07, 2016, 10:23:35 am

**edit, but looking at Tin's 7v log "7v_3458_nplc200_tin_goodA3.csv". we see that the noise is now an increasing slope. by using allans variance, we can see that in order to resolve 1uV, we should sample below 16seconds. does this make metrological sense?


Hello,

I guess there is something wrong with the measurement setup (or the alan deviation calculation)
I know that Frank has usually below 200nV standard deviation when measuring a LTZ1000 with his HP3458A at 100NPLC and AZERO on (>=4 seconds)


And yes: it makes no sense with a 3458A to average more than around 10 measurements.
(the X-scale is in measurements so a 1 corresponds to 5 seconds with triggered measurement).

Your LTZ/3458A plot begins with 400-500nV which is far too high.

with best regards

Andreas


By using the LTZ design of Andreas, I  measure about 0,047ppm noise, or about 330nV, see here:
This includes medium term fluctuations (hours time scale), short term (10min) noise may be around 200nV.

(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=276266;image)

A high precision VDC measurement should be made over about two minutes averaging time, that's a recommendation from NIST / PTB, I think.
Therefore , averaging over 25 samples of NPLC 100 is fully sufficient.
By using built in statistics, you will get mean and STD values; here I achieve between 100nV..500nV  noise for 7.15V or 10V, typically around 200nV.
Longer averaging may only make the STD value more stable, but that's not useful.
Also, one might already measure drift effect, instead of noise.

Instead, such long termed measurements with equidistant measurements, analysed by the Allan Distribution, reveals the different stability effects, as you can already identify in the diagram.
That is the initial drift of the 3458A for the first 2h (0.5°C change => ~0.2 ppm drift), then the short term noise of < 0.05ppm, and medium term fluctuations, over 10minutes.

Frank
Title: Re: DMM Noise comparison testing project
Post by: TiN on December 07, 2016, 01:47:35 pm
Quote
7v_3458_nplc200_tin_goodA3.csv

That's very very old data, just to check A3 stability back there.

Suggest to use recent 7V LTZ test. Attached log over 10hours with HP,pair of 2001s, pair of 2002's. Ambient temp within 1c overall. Should have more accurate result.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 07, 2016, 04:33:35 pm
The changed shape of the variance curve when measuring an external reference come from the extra noise from both the external ref to be measured and the DMM internal ref. This extra noise is relatively high compared to the other meter internal noise (at least for the longer times).
This noise can also depend on the environmental conditions as some of this can be temperature effects. Not all of the refs of the same type are the same with respect to noise.

A relatively easy to reproduce finite ref voltage might be a pack of NiCd cells (e.g. 6 to 8 cells to get 7.4 to 9.8 V. They are supposed to be very low in noise, if at a stable temperature and not moved around. It might need a certain treatment to get a really stable state, like charge fully, discharge by 10-20% over a day or so (load with a suitable resistor) and then let them sit for a few days. The voltage will not be absolutely the same and one might have to check for drift, but chances are good to get a quite stable voltage for a few hours.

A resistor and cap for filtering is tricky. This can work for higher frequency noise (e.g. higher than 0.1 Hz) but it can not work for longer times. The electrolytic cap is also likely as sensitive (or worse) to environmental changes as a battery. So one would need similar care and still only has a limited capacity and frequency range. For the reference noise, I would be more interested in the 1-100 mHz range - just where a capacitor is not very practical any more.

The 2010 meter is a little special in the way AZ is done. The AZ mode does not include the input buffer, as the is chopper stabilized. The plateau if the curve for the 10 V range suggest there is some kind of averaging used in the AZ mode of many Keithley instruments - not just the DMM7510. For the 100 mV range it is not visible any more because the input amplifier noise dominates.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 07, 2016, 07:01:26 pm
A relatively easy to reproduce finite ref voltage might be a pack of NiCd cells (e.g. 6 to 8 cells to get 7.4 to 9.8 V.

NiCd? Mercury cells are known to be stable, and I still have a few of them, but they are impossible to get now.
Title: Re: DMM Noise comparison testing project
Post by: Andreas on December 07, 2016, 07:48:34 pm

Instead, such long termed measurements with equidistant measurements, analysed by the Allan Distribution, reveals the different stability effects, as you can already identify in the diagram.

Frank
Hello Frank,

Do you have the Allan diagram for this measurement, or can you provide the raw data?

With best regards

Andreas
Title: Re: DMM Noise comparison testing project
Post by: Andreas on December 07, 2016, 08:19:47 pm
Suggest to use recent 7V LTZ test.

Hello Illya,

thats much better.
now it starts below 200nV standard deviation.

The time scale seems to be unstable.
The time stamps have 6-10 seconds difference between the steps.
I think for allan deviation you should use equal time stamps.

with best regards

Andreas
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on December 07, 2016, 10:36:55 pm

Instead, such long termed measurements with equidistant measurements, analysed by the Allan Distribution, reveals the different stability effects, as you can already identify in the diagram.

Frank
Hello Frank,

Do you have the Allan diagram for this measurement, or can you provide the raw data?

With best regards

Andreas

Yep. Latter one. Dammit. xlsx not allowed. xls too big. therefore csv data. Sorry.No csv format, therefore txt. Rename it, please.
Frank
Title: Re: DMM Noise comparison testing project
Post by: TiN on December 08, 2016, 03:32:08 pm
Quote
The time scale seems to be unstable.
The time stamps have 6-10 seconds difference between the steps.
I think for allan deviation you should use equal time stamps.

First I was puzzled by this comment, as code just takes samples as fast as they arrive, talking to each meter in sequence, but then things got cleared out, as there is ACAL correction function, to trigger ACAL DCV (which takes 2 minutes, at while code waits) every 0.2c of temperature change. Sorry for that.
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 08, 2016, 03:49:31 pm
does timing inconsistency add to flicker noise? or its a math thing? (the comparison @ 1024 mark)
what else could be possible to add to Tin's incremental flicker noise?  :-//
i was hoping to plot in opencalc the way andreas presented his plot, but i couldnt understand the equation well :/
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 08, 2016, 05:06:07 pm
The uneven time data should not add extra noise. it is more like smearing out the time axis a little. As the curve usually is not that step (usually  sqrt(1/tau) to sqrt(tau)) this does not introduce a large error.

The ACAL run from time to time might add some extra error though, as this also causes small jumps in the curve. In a certain way this is part of the instrument noise - just not fixed, but under user control.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 08, 2016, 06:47:20 pm
Based on this information http://www.basytec.de/Literatur/temperature/DE_2002.htm (http://www.basytec.de/Literatur/temperature/DE_2002.htm)
it looks like NiCd batteries would have a sweet spot somewhere on the discharge curve. But Pb batteries should also work, they have small temperature dependence and one can get them in much higher capacity and thermal mass, which should  help.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 08, 2016, 08:02:03 pm
Here is a comparison of the finite voltage measurements. Here Keithley 2002 perform pretty well, they start at higher noise, but then average down to maybe even slightly better performance than HP3458. I also tried to look at differences between 3 simultaneous meters in TiN data, but there is no improvement, so I think the meters have the dominant noise contribution.

(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=276602)
Title: Re: DMM Noise comparison testing project
Post by: Andreas on December 08, 2016, 10:49:42 pm
Yep. Latter one. Dammit. xlsx not allowed. xls too big. therefore csv data. Sorry.No csv format, therefore txt. Rename it, please.
Frank

Hello Frank,

.txt is perfect (as the plotter program of Ulrich Bangert needs .txt).

here the diagram.
There are some glitches in the .txt with 0 V and -273 deg C which I have removed.
Also the drift of the first 2 hours is removed. So the diagram is the last 7 hours.

First: diagram over time.
2nd: histogram showing a near perfect gaussian distribution
3rd: Allan deviation starting at 136 nV standard deviation for short time stability.
(near the theoretical limit of 100nV of the instrument alone).
Above around 10 averaged measurements stability is determined by drift.
X-Axis shows number of measurements (4-5 seconds each for 100 NPLC).

So for me the main usage of the Allan diagram in volt-nut mode is to determine
a useful integration time (averaged measurements) for lowest noise.

with best regards

Andreas
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 09, 2016, 02:06:26 am
would my assumption be correct that this integration time is around 25s ? base on the the first slight dip at tau =5?
then what about the huge dip going on at tau =700, do you know what to make of that? this is all so new  :-/O
Title: Re: DMM Noise comparison testing project
Post by: TiN on December 09, 2016, 04:17:05 am
Got data for last test (https://xdevs.com/str_prepost/) from fairy module before shipping to the voltnut. 8 hours with stable ambient w/o ACALs, then drop temperature/ACAL :)
Two meters this time only, 3458 (black line) and 2002 (purple). Keithley gets some credit, as after ~5C ambient temperature change reading does not change much. Meters are sampling different KX LTZ modules.
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on December 09, 2016, 09:56:16 am
would my assumption be correct that this integration time is around 25s ? base on the the first slight dip at tau =5?
then what about the huge dip going on at tau =700, do you know what to make of that? this is all so new  :-/O

The sampling spacing is about 4sec, as NPLC 100 in our 50Hz grid equals 2sec measurement plus 2s AZ time.

Therefore, about 20s averaging gives best noise figure for the 3458A.
That characteristic can be observed in many other setups also, like NPLC 10, or so.

That artefact at tau=700 will be related to that initial drift on the first 2h, when the 3458A inside the room had at first to stabilize.

I'd expect that if you skip the first two hours, you'd see a smooth curve.

Anyhow, for these long time constants, the Allan Deviation gets more and more sensitive to disturbances and drifts. Or in other words, these high tau values are based on too few data points.
For a more stable graph, it would be necessary to measure over a much longer period of time, let's say about 10 times longer at least as the tau value to be observed.

Frank
Title: Re: DMM Noise comparison testing project
Post by: Andreas on December 10, 2016, 11:37:08 am
That artefact at tau=700 will be related to that initial drift on the first 2h, when the 3458A inside the room had at first to stabilize.

Hello Frank,

not in this case, as already mentioned above I have removed the first 2 hours from the diagram.
I think more the 700 tau artefact is something generated by the unusual stable environment conditions in your lab.
That is something that you cannot generally expect from a setup.
I never regard the Allan deviation above the first minimum.

So with the first 2 hours we have the following picture:
(again removed the two outliers with 0 V).

1. slighgly drift over time
2. distribution shows a inclined distribution due to the drift
3. allan deviation again starts at 0.136uV going up to higher levels due to drift.
    (the artefact at 700 tau remains).

with best regards

Andreas
Title: Re: DMM Noise comparison testing project
Post by: branadic on December 10, 2016, 07:43:47 pm
I was told by someone that Plotter and Alavar seem to show different results in Allan Variance. Andreas, have you performed a conformance test?

http://www.ulrich-bangert.de/Plotter.zip (http://www.ulrich-bangert.de/Plotter.zip)
http://www.alamath.com/alavar/ (http://www.alamath.com/alavar/)
Title: Re: DMM Noise comparison testing project
Post by: Andreas on December 10, 2016, 09:51:39 pm
Hello,

I was told by someone that Plotter and Alavar seem to show different results in Allan Variance.

Source?
Significance?

Andreas, have you performed a conformance test?

Why should I?
Do you make conformance tests with every standard tool  that you use?

With best regards

Andreas
Title: Re: DMM Noise comparison testing project
Post by: TiN on December 12, 2016, 04:08:50 am
More data for volt-nut tinkering: 3458A + A10 preamp (https://xdevs.com/datashort/ulna_short2_em_100k_3458_nplc100_tin.csv), with copper wire short at input. Gain = 100K (hp3458 data column already multiplied, reading in nanovolts). NPLC 10, fixed correction offset -4.5nV. Peak-peak noise ~0.4nV.

K2001 column - unprocessed raw VDC readings at 200mV range.

(https://xdevs.com/doc/EM_Electronics/A10/a10_100k.png)

As one can see from data, there is no need for 3458A/2002 to get most of A10 (purple dots - K2001 samples, green dots - 3458).
Now the difficult question, how to have any DC signal to be AC coupled to preamp, so this kind of numbers are not compromised.  :scared:
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 12, 2016, 05:09:21 pm
As the noise of the A10 preamp is so low, it must have a rather low input impedance and likely also quite some current noise. So it only works with a low impedance source (e.g. < 10 Ohms) - in this case AC coupling is really difficult a lower frequencies. So even with large capacitors like a few 1000 µF  the frequency range would be limited to a few 10 Hz and up. How far one might go down could be seem from the current noise, which could be seen if the A10 is used with a resistor (e.g. 1 K, low thermal EMF) instead of the dead short.

If the DC voltage to compensate for it rather small (e.g. a few mV - so still to much to use a high gain), there is an option to use an external DC servo loop - there was a thread a few weeks ago in the design section using such a scheme, though less extreme and still with AC coupling.

With so much gain of the A10 it is not a surprise to have mainly noise from the input stage and thus no need for a high resolution DMM any more.
Title: Re: DMM Noise comparison testing project
Post by: TiN on December 13, 2016, 04:30:44 am
Here we go, 1.2 KOhm WW Ohmite 41 (https://www.digikey.com/product-detail/en/ohmite/41F1K2E/41F1K2E-ND/823174) resistor on preamp input, gain change to 10K.

(https://xdevs.com/doc/EM_Electronics/A10/a10_10k_1k2r.png) (https://xdevs.com/em_1k2_10k/)

Noise still very low, ~15nV/pk-pk, if my math is right.
Perhaps I should move this discussion into separate thread?
Title: Re: DMM Noise comparison testing project
Post by: Pipelie on December 13, 2016, 06:43:22 am
I tested my HP34420 couple day ago, attach the RAW data, for now just tested Channel 1.
 
replace the ZIP file
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 13, 2016, 11:29:23 am
hmmm i think the csv format saved some special characters. due to conversion from chinese character?
Title: Re: DMM Noise comparison testing project
Post by: Alex Nikitin on December 13, 2016, 12:10:20 pm
Here we go, 1.2 KOhm WW Ohmite 41 (https://www.digikey.com/product-detail/en/ohmite/41F1K2E/41F1K2E-ND/823174) resistor on preamp input, gain change to 10K.

Noise still very low, ~15nV/pk-pk, if my math is right.
Perhaps I should move this discussion into separate thread?

What is the effective bandwidth in this case?

Cheers

Alex
Title: Re: DMM Noise comparison testing project
Post by: Pipelie on December 13, 2016, 01:46:53 pm
hmmm i think the csv format saved some special characters. due to conversion from chinese character?
i run EZGPIB in XPMODE(English version ) to record data.
it probably happen when i open the CSV file by excel  in win7(chinese version) to change the row name "HP34420A_1" to "HP34420A" and save it.

when I open the CSV file with excel, and than click close, will pop-up a small window ask save the change or not? So,something did change. :scared:

Title: Re: DMM Noise comparison testing project
Post by: TiN on December 13, 2016, 05:14:33 pm
Welcome to EEVBlog, Pipelie, thanks for 34420 data. I'll add it into comparison. I think it's time to make 2016 summary with all recent datalogs :)
So readers have CSV data files pending, feel free to upload them. I'd say deadline by December 25, to make it in finals :)

Alex Nikitin
Previous log was NPLC 10.
This one NPLC1 (https://xdevs.com/em_1k2_10k_nplc1/).
Noise about same, but here you can see also temperature induced drift (AC was turned on in room, A10 preamp in the styrofoam box though).
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 13, 2016, 07:39:00 pm
anybody else with keithley want to try a base NPLC of 2 / 3 / 4 and its effects on the noise plateau (in allan variance plot?). ie : NPLC4 x 25 repeating ave to get nominal 100NPLC?
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 13, 2016, 08:58:24 pm
anybody else with keithley want to try a base NPLC of 2 / 3 / 4 and its effects on the noise plateau (in allan variance plot?). ie : NPLC4 x 25 repeating ave to get nominal 100NPLC?
Doing extra averaging (e.g. 25 times 4 PLC to get a simulated 100 PLC) does not help for the Alan variance plots. The exactly same data would be in the curve with the single readings (4 PLC) - it is just a different program to do the average, and you get some extra in between point if you use the data directly.

The Keithley 2015 seems so show the same strange (Keithley typical ?) plateau. So if it supports modes like 2,3,4,5 PLC you are free to take the data (a little longer than the old curves). At least the 10 V data should be rather similar to the stock 2000 / 2015.
Title: Re: DMM Noise comparison testing project
Post by: Pipelie on December 14, 2016, 03:27:53 am
Thanks, TiN
just finish the test,attach the HP and Agilent 3458A data.
Title: Re: DMM Noise comparison testing project
Post by: Andreas on December 14, 2016, 05:47:00 am
anybody else with keithley want to try a base NPLC of 2 / 3 / 4 and its effects on the noise plateau (in allan variance plot?). ie : NPLC4 x 25 repeating ave to get nominal 100NPLC?
Doing extra averaging (e.g. 25 times 4 PLC to get a simulated 100 PLC) does not help for the Alan variance plots. The exactly same data would be in the curve with the single readings (4 PLC) - it is just a different program to do the average, and you get some extra in between point if you use the data directly.

The Keithley 2015 seems so show the same strange (Keithley typical ?) plateau. So if it supports modes like 2,3,4,5 PLC you are free to take the data (a little longer than the old curves). At least the 10 V data should be rather similar to the stock 2000 / 2015.

Hello,

mhm,
perhaps the "error" is much simpler.

Has anybody tried to analyze the resolution of the data being output?
Assume they are using single precision floating point arithmethic on the DMMs with 24 Bit resolution mantissa....
In this case it makes a difference if you calculate the averaging on DMM or on PC (with double precision).

When I have a look at Blackdogs HP34461A noise data in 10V-range then suddenly at 10mV the resolution seems to change ...

with best regards

Andreas

Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 14, 2016, 07:10:47 am
Interesting looking data... Could it have something to do with writing ascii data with certain number of digits, so one digit is lost for  V>10mv?

The digital resolution of DMM7510 is shown here https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/msg1081650/#msg1081650 (https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/msg1081650/#msg1081650)
It is about 0.0014 ppm (I zoomed in, but the histogram looks gaussian on larger scale).

I noted that comparison of 10V and 1V noise suggests a certain threshold behavior at around 0.03ppm where the AZ starts to work: https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/msg1083353/#msg1083353 (https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/msg1083353/#msg1083353)
One possibility is that the zero value is calculated with lower digital precision. So, on 10V scale, the AZ adjustments are below digital resolution of zero measurements and no correction is being made. On 1V scale larger amplifier noise causes more bit noise in the zero value and digital steps are  averaged out better due to dither. It would be at about 26 bits. From the timing, it looks like zero measurements take about the same time as real measurements (same PLC) so in principle there is no reason for it to have lower resolution, unless, again, it is a software bug.
Title: Re: DMM Noise comparison testing project
Post by: Andreas on December 14, 2016, 07:56:31 am

The digital resolution of DMM7510 is shown here https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/msg1081650/#msg1081650 (https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/msg1081650/#msg1081650)
It is about 0.0014 ppm (I zoomed in, but the histogram looks gaussian on larger scale).


Hello,

I do not remember if it was a zero measurement or a 10V offseted measurement. (which is more likely).

So what happens with your resolution if the values are slightly above 10V?

With best regards

Andreas
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on December 14, 2016, 07:30:32 pm
Has anybody tried to analyze the resolution of the data being output?
Assume they are using single precision floating point arithmethic on the DMMs with 24 Bit resolution mantissa....
In this case it makes a difference if you calculate the averaging on DMM or on PC (with double precision).

When I have a look at Blackdogs HP34461A noise data in 10V-range then suddenly at 10mV the resolution seems to change ...

with best regards

Andreas

from the K7510 plot, it would seem the resolution if at 1 NPLC would be 166.67nV (i counted 150nV over 9stops)?. in my case (K2015, see pic) it is about 500nV. about 3x difference. i think i tried to understand this "problem" before in the K2015 noob mod thread, but i didnt understand the noise vs plateau problem. my thinking of the plateau problem currently is due to the way the NPLC timing noise is a fixed frequency interference to the speed of sampling, but then again this is where i do not know how to continue to decipher. i think i saw lymex did said something about allan variance noise in his 38hot.bbs thread, maybe he has some input on this subject.
in the alavar plot it is hard to tell, so i m not sure what to make of it?
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 14, 2016, 08:09:00 pm
I don't think the noise plateau for the Keithleys is due to limited resolution. If this would be a problem one would see it in the direct plots, but the histogram plots are really spread out. My best guess so far is that the software somehow is not using the zero readings directly, even at 10 PLC. The first gues would be that they use a kind of averaging for the zero readings and maybe even some extrapolation. This could explain the kind of extra low frequency noise even with AZ active. However somehow they missed out the advantage of this: At 10 PLC and short time (0.5 s) the noise with AZ active is still about twice that of running without AZ. This is the same ratio one would expect with simple difference calculation (average of 2 readings compared to difference of 2 readings). Averaging over longer time would have got less noise (e.g. 1.5 times compared to non AZ mode). So maybe a not so clever Version of extrapolation is used.

The extra noise is just in an time / frequency range that if often used to do things like manual polarity switching. It is just the range where the HP meters are at there best. With even the 34465 beating the DMM7510 or 2002.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 15, 2016, 09:28:14 am
I agree that simple digital resolution in the zero measurements would introduce some anomalies in the histogram. I had tried looking for various spikes in the histogram of the differences, but didn't find anything there. On the other hand, it is striking that the Allan variance with AZ starts to go down just when the noise without autozero exceeds about 0.03 ppm, on both 1V and 10v scale. So there appears to be  a threshold behavior, but with some additional processing.
What if they use some version of "Filter window" as described in their manual. If Autozero values are close to each other, they are averaged together, if they deviate by more than a threshold, the average is discarded. This can perhaps explain that when using triggered measurements it works better, if the trigger resets the autozero average.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 16, 2016, 08:10:41 pm
Digital resolution: I hooked up both DMM7510 and 34465 to an old lead battery that gives about 10.24 V. It seems reasonably stable. Here is the resolution that the meters write to USB on 10V scale with no relative offset:

DMM7510: 10.24113281872
34465A:    10.2408757   (ignore the offset, the meter hasn't warmed up yet)

For 34465A the resolution is 0.1 uV, which is just adequate since the noise is 0.4uV on 10PLC 10V scale.

I am going to leave them record the battery for a while, see what the noise looks like.
Title: Re: DMM Noise comparison testing project
Post by: dvdput on December 16, 2016, 08:38:30 pm
Hi, long time lurker here. I thought it was time I added some small contribution.

Attached are 3 files of 10.000 readings from a Fluke 8846A. (10.000 readings is the max I can automatically store on a USB stick).
0001 is at 10V, 0002 is at 1V and 0003 is at 100mV. All 3 files were measured with 10NPLC, no digital or analog filter.

I hope that it is useful, let me know if other readings should be added.

Cheers, David
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 19, 2016, 07:10:19 am
Here is the comparison of DMM7510 and 34465A for finite input. I used a 10.24 V 7Ah (almost dead) lead battery from a UPS supply and a 3.13 V (primary, moderately used) Li CR123A battery from a wireless alarm sensor. For lead battery, I removed linear self-discharge trend. For Li battery, just found a quiet temperature spot.
(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=279017)
As might be expected, at finite voltage 34465A does not perform as well, probably due to limitation of the voltage reference. It would be best to compare 34470A to DMM7510 in this case.

@dvdput: Thanks for posting the data! Looking at the file on 10V scale the digital resolution is 3 uV. This is much worse than 34465A. If there is no way to change this setting it points to a clear superiority of 34465A at a smaller list price. It would be nice to add some of this information to the DMM comparison table, so people can decide which meter to buy with  information that is often not stated on the datasheets.
Title: Re: DMM Noise comparison testing project
Post by: Pipelie on December 22, 2016, 06:31:31 am
Here is the test result of Channel 2, it's better than channel 1. :)
Shorting Block: LEMO FFA 1S ,BUT NOT manufacture by LEMO.
Title: Re: DMM Noise comparison testing project
Post by: branadic on December 22, 2016, 12:57:34 pm
Hello,

I was told by someone that Plotter and Alavar seem to show different results in Allan Variance.

Source?
Significance?

Andreas, have you performed a conformance test?

Why should I?
Do you make conformance tests with every standard tool  that you use?

With best regards

Andreas

Hello Andreas,

I was told the results differ by 10e-1 between Plotter and Avar, while Avar seems to deliver the same results as Stable32. I haven't checked myself so far, but there are test data available to prove the results you get are okay. I'm sure you know this website: http://www.wriley.com/paper1ht.htm (http://www.wriley.com/paper1ht.htm)
and the linked Handbook of Frequency Stability Analysis: http://tf.nist.gov/timefreq/general/pdf/2220.pdf (http://tf.nist.gov/timefreq/general/pdf/2220.pdf)?
You can find a set of test data on this website to check if the results are matching what you expect or not:

The classic set of nine 3-digit numbers from Annex 8.E of NBS Monograph 140: http://www.wriley.com/nbs.dat (http://www.wriley.com/nbs.dat)
A test suite of 1000 pseudo-random frequency data points: http://www.wriley.com/tst_suit.dat (http://www.wriley.com/tst_suit.dat)

Furthermore, the handbook describes the different plot methodes to analyse the behaviour of your DUT.
Title: Re: DMM Noise comparison testing project
Post by: Jorn on February 14, 2017, 04:38:12 pm
For greater confidence in Allan Variance measurements I decided to perform some experiments whose results I will share with you below.

All tests are carried out in Python with the package allantools found at https://github.com/aewallin/allantools/ (https://github.com/aewallin/allantools/)

Overlapping Allan Deviation is chosen so that the results can be compared with other measurements in this thread.

First test is carried out with the 9-point test set from http://www.ieee-uffc.org/frequency-control/learning-riley.asp (http://www.ieee-uffc.org/frequency-control/learning-riley.asp) (ieee-uffc)
The 9-point test set is normalised by subtracting the mean from each sample. The calculated result for tau=1 and tau=2 is identical to the values listed in table II(ieee-uffc). Here follows the code:
 
(http://www.sanggaard.com/br/9_point_set.PNG)

The algorithm for a 1000 point pseudo random integer sequence from section "Test Data" in (ieee-uffc) was implemented and executed. The results for tau=1, tau=10 and and tau=100 are identical to the values listed in table III(ieee-uffc). Here follows the code:

(http://www.sanggaard.com/br/1k_point_set.PNG)

Confidence in the allantools python library, and its use, is hereby present.

Moving on to the data file from Dr. Frank: Ltz5_tc_9.txt (find it earlier in this thread and remember to remove "zero" samples)

(http://www.sanggaard.com/br/dr_frank_data.PNG)

As can be seen from the plot it is almost identical to Andreas plot from reply #429. Only difference is that Andreas uses tau0=1 as time unit and thus you have to know the sample spacing in order to interpret the graph. I prefer to use rate=0.25 corresponding to tau0=4 seconds (2s acquire (100 NPLC) + 2s auto zero) between samples.

However confidence in the tool (afair DF6JB Plotter) that Andreas uses for allan deviation calculation and graphing is present. 

@brandic: hope you agree, no factor 10 error here :-)

Allan deviation plots of my own reference follows in part II

-Jorn
Title: Re: DMM Noise comparison testing project
Post by: Jorn on February 14, 2017, 04:40:15 pm
Now continuing with measurements on my own reference. A ltz1000 reference with vishay VSMP resistors (once available from Digikey, in single pieces and custom values) and a LTC1150/LT1010 buffer. It has been running 24/7 for almost 2 years now.

A 2-year old 34470A is used to measure the output of the voltage reference. To minimize temperature variations the 34470A was placed in a cooling chamber (actually a cheap wine cooler) at 18 degC  which is able to hold the temperature inside the dmm within one third degree. (Within 24 hours the temperature varied from 20.28 to 20.59 degC, perfect!).

(http://www.sanggaard.com/br/chamber.JPG)

The reference and the cooling chamber was placed in a 15m2 room where the radiator was set to 22 deg. This ensures relative stable temperature between 21 and 23 degC during the hole day (outdoor temperature was between -6 and 2 degrees). The reference has a TC of 0.05 ppm/degC (meassured in the range from -1 to 25 degC). Expected voltage variations from temperature is now limited to

LTZ1000 reference < 0.1 ppm 
34470A dmm < 0.3 ppm

After 6 hours to stabilize a 20 hour dataset (18000 samples) was collected and the overlapping allan deviation was calculated. Result is shown here:

(http://www.sanggaard.com/br/ltz1000_ref_20_hours.PNG)

Conclusion:
Best stability is achieved with five 100 NPLC measuremens (= 20 sec average) unless you have time to wait an hour or more. 

However beware that the uncertainties for high tau values is very high. Look what happens when we extend the period to 87 hours of measurements:

(http://www.sanggaard.com/br/ltz1000_ref_87_hours.PNG)

The first 20 hour, for some reason, was remarkably stable.

Attached is the raw data file if you want to play with Overlapping Allan Deviation plots yourself ;)

-Jorn

 
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on February 14, 2017, 11:12:03 pm
Its interesting to note that under these (admittedly more controlled than typical) conditions, the performance of 34470A meter is on par with HP3458 and K2002 meters in being able to maintain better than 2x10^(-7) V  stability for 1000 sec.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on February 15, 2017, 05:33:33 pm
Comparing the stability curves at 0 voltage and with an voltage close to full scale, it is obvious that that with many of the meters the reference noise sets the limit for the full scale measurements. The references in the 34470 / 3458 and Ke2002 are rather similar (LTZ1000 based) - so not a surprise.

The measurements are also a combination of the internal and external reference of similar quality. So a lot of noise could be due to the external reference too. Not all of the Ltz chips are equally good.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on February 15, 2017, 06:22:04 pm
Has anyone tried to measure directly the difference in voltage between two LTZ1000 references? This would be a good way to check their intrinsic noise and stability without the effects of all the signal conditioning circuits present in the DMMs
Title: Re: DMM Noise comparison testing project
Post by: enut11 on February 16, 2017, 10:15:05 am
Here is an XLS file of my HP3456A with input shorted, 10NPLC, 10v range.

After a short time the readings settled down to 0.00000v and stayed there??

Cannot believe that there is no noise??
enut11
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on February 16, 2017, 04:42:36 pm
AFAIK the old 3456 has a display oriented ADC - so the output steps directly corresponds to ADC steps. Also compared to the resolution the noise is relatively low. So it can happen, that quantization is hiding the noise, just it often happens with 3.5 digit DMMs.
Title: Re: DMM Noise comparison testing project
Post by: Andreas on February 16, 2017, 07:49:35 pm
Cannot believe that there is no noise??

Hello,

look harder: the sign is toggling. (+/- 0.00000 V)
so there is definitely noise.
Only the output resolution is too low.

with best regards

Andreas
Title: Re: DMM Noise comparison testing project
Post by: enut11 on February 16, 2017, 07:57:26 pm
Repeated test on HP3456A with 1 NPLC. This time I recorded some noise.

The unit is operation on 240vAC and I changed the crystal to 4.875MHz

BTW, to attach file here I had to reduced size and save the spreadsheet as XLS  with reduced functionality.

The original spreadsheet from @IanJ and modified by @Bud:
https://www.eevblog.com/forum/metrology/3458a-logging-via-excel-macro/ (https://www.eevblog.com/forum/metrology/3458a-logging-via-excel-macro/)
the HP3456A version is at Reply #55
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on March 06, 2017, 10:34:47 pm
The autozero problem with Keithley DMM7510 meter is still not resolved. I wrote a little script to force autozero measurements and it works better than default settings, although still worse than Keysight 34465A.
(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=297150)
I am attaching the script (change the extension from .txt to .tsp). If anyone has a stable voltage reference and a DMM7510, I am curious how it will perform at finite voltages with the custom zero algorithm.
Title: Re: DMM Noise comparison testing project
Post by: cncjerry on March 19, 2017, 06:59:01 am
I have two 3456a meters that will run for hours and hours with the inputs shorted without flipping the last digit or sign.   I ran one for 10,000 NPLC 100 samples once at 9.99999V displayed and recorded without changing.  The same reference on my 3457a using the HIREs register wanders all over the place but it has the extra digit of resolution.  I don't think this says anything about the 3456a or the reference other than within its range it is pretty stable but you can't compare the stability of a 6.5 meter to a 7.5 or higher.

Lately one of my 3456a meters seems to be drifting higher so I'll have to get under that issue.  I recently purchased a bunch of LM399s thinking I would make a parallel reference for it as another member did but again, within 6.5 digits how good does the reference need t be?

I love my meters! 
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on March 19, 2017, 09:24:53 am
With the input shorted, there is usually not much noise from the reference (at least it is avoidable). The shorted test is more testing the input amplifier (in lower ranges like 200 mV or 2 V) and the ADC circuit itself.

The 3456 seems to have rather low noise, but a coarse quantization. This makes is hard to see the noise. One could get more meaningful results with a shorter integration time, so that random noise is not swamped by quantization. A fully stable result is just not saying very much, it gives only an upper limit for the noise. Having an external reference and than measure is a test for the two references involved.
Title: Re: DMM Noise comparison testing project
Post by: blackdog on April 14, 2017, 06:49:04 pm
Hi,

I need some help please...  :)

I want to start controling my Agilent 3458A with a measuring computer.
I Installed EZGPIB en loaded the "EZGPIB script for HP 3458A ver.1.01" from de website of Illya.

The software is running afther i changed the gpib_address to 11 for my 3458A

I espected it would change range and NPLC, before i run the script i put the 3458A in 10V DC Mode and 100 NPLC.
Afther starting the script it started measuring, stil on the 10V DC range and it swicht to a low NPLC value.
And now 15 minutes later nothing is changed?

Did i do something wrong?

Kind regards,
Blackdog



Title: Re: DMM Noise comparison testing project
Post by: pelule on April 14, 2017, 07:24:53 pm
Hi
is the "END ALWAYS" command in the script. This is needed for the 3458A to respond.

/PeLuLe
Title: Re: DMM Noise comparison testing project
Post by: blackdog on April 14, 2017, 07:34:34 pm
Hi pelule,

It has just switch range, maybe i'm to impatient.  :)

Kind regarts,
Blackdog
Title: Re: DMM Noise comparison testing project
Post by: ManateeMafia on April 14, 2017, 08:08:24 pm
blackdog,

I believe the delay is intentional. I can't remember if there was an ACAL ALL in the script but it may have been there in case it was performed.
Title: Re: DMM Noise comparison testing project
Post by: Echo88 on April 23, 2017, 04:08:56 pm
Hi,
im trying to get the python-script "pars_noise_sd.py" which TiN wrote to work, but with the downloaded Python Interpreter 3.6 its just shows me the error:

Python 3.6.1 (v3.6.1:69c0db5, Mar 21 2017, 18:41:36) [MSC v.1900 64 bit (AMD64)] on win32
Type "copyright", "credits" or "license()" for more information.
>>>
========== RESTART: C:\MyMeasurements\HP34420A_1\parse_noise_sd.py ==========
| Multimeter    | Range      | NPLC   |          Counts   |    Sq.sum   |  Average   |    SD      |    SD,uV   |
Traceback (most recent call last):
  File "C:\MyMeasurements\HP34420A_1\parse_noise_sd.py", line 15, in <module>
    o.write ("|Multimeter|Range|NPLC|Counts|Sq.sum|Average|SD|SD,uV|\r\n")
TypeError: a bytes-like object is required, not 'str'

Then it produces an empty output.txt-file.
I use the HP34420A-example from the xdevs-DMM-Noise-website to log my Keysight 34465A-DMM and the produced .csv-files all look good to me.

Maybe someone can take a look at the problem? I want to contribute to the DMM-Noise-Database with the mentioned 34465A and also with my VXI-based HP E1410A 6.5Digit-DMM.

Attached is a produced example file. The file-ending .xls needs to be changed back to .csv (forum-upload-restrictions  :palm: ).
Title: Re: DMM Noise comparison testing project
Post by: fluxamp on April 24, 2017, 09:08:36 am
Hi,
im trying to get the python-script "pars_noise_sd.py" which TiN wrote to work, but with the downloaded Python Interpreter 3.6 its just shows me the error:

Python 3.6.1 (v3.6.1:69c0db5, Mar 21 2017, 18:41:36) [MSC v.1900 64 bit (AMD64)] on win32
Type "copyright", "credits" or "license()" for more information.
>>>
========== RESTART: C:\MyMeasurements\HP34420A_1\parse_noise_sd.py ==========
| Multimeter    | Range      | NPLC   |          Counts   |    Sq.sum   |  Average   |    SD      |    SD,uV   |
Traceback (most recent call last):
  File "C:\MyMeasurements\HP34420A_1\parse_noise_sd.py", line 15, in <module>
    o.write ("|Multimeter|Range|NPLC|Counts|Sq.sum|Average|SD|SD,uV|\r\n")
TypeError: a bytes-like object is required, not 'str'

Sounds like the code was written for Python 2.7. Try using that one or bug TiN to fix it  ;D
Title: Re: DMM Noise comparison testing project
Post by: Echo88 on April 24, 2017, 05:37:16 pm
Nope, Python 2.7 also doesnt work, but at least produces "|Multimeter|Range|NPLC|Counts|Sq.sum|Average|SD|SD,uV|" in the output.txt-file.
Error Message:

Traceback (most recent call last):
  File "C:\MyMeasurements\HP34420A_1\parse_noise_sd.py", line 28, in <module>
    sum += float(row[setname[0]])
KeyError: 'HP34420A'

Guess ill bug TiN.
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 25, 2017, 04:15:05 am
Don't use _ in the name of the insturment or filename. Underscore used as separator for filename/data parsing.

After rename your file into HP34420A_DCVOLT10_NPLC100.csv and correcting first line to date,HP34420A script work fine:

Code: [Select]
c:\__\code\py_parsesd>parse_sd.py
| Multimeter            | Range         | NPLC  |    Counts     |    Sq.sum     |  Average      |    RMS        |    RMS,uV     |
| HP34420A              | 10            | 100   |       74      | 0.00000000    | 1.051549E-07  | 1.698011E-07  |    0.17       |

Surely you can easily modify script to process different separator symbol, if you want keep underscores.
Title: Re: DMM Noise comparison testing project
Post by: Echo88 on April 25, 2017, 08:48:35 am
Thank you! I will upload the DMM-noise-results of both my multimeters when theyre done.
Title: Re: DMM Noise comparison testing project
Post by: fonograph on October 05, 2017, 12:39:39 am
Here is the comparison of DMM7510 and 34465A for finite input. I used a 10.24 V 7Ah (almost dead) lead battery from a UPS supply and a 3.13 V (primary, moderately used) Li CR123A battery from a wireless alarm sensor. For lead battery, I removed linear self-discharge trend. For Li battery, just found a quiet temperature spot.
(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=279017)
As might be expected, at finite voltage 34465A does not perform as well, probably due to limitation of the voltage reference. It would be best to compare 34470A to DMM7510 in this case.

@dvdput: Thanks for posting the data! Looking at the file on 10V scale the digital resolution is 3 uV. This is much worse than 34465A. If there is no way to change this setting it points to a clear superiority of 34465A at a smaller list price. It would be nice to add some of this information to the DMM comparison table, so people can decide which meter to buy with  information that is often not stated on the datasheets.

Does that mean that the Keithley 7510 problem where its inferior to keysight 34465 when doing 10 NLPC measurements with auto zero only happens when its shorted,but when its actualy measuring real voltage then its superior?

I mean,at the start of this thread there was this idea that to test the multimeter noise,the standard procedure was to short the inputs,then it was found that 7510 shows weird behaviour where the noise doesnt drop with higher NLPC like expected,now your graph for measuring real voltage,real electronic device shows that it works better than Keysight?

Does this mean its not a problem with normal use? Becose normaly people measure various devices and not the meter itself with inputs shorted.I think it doesnt matter how the noise measures with input shorted,only thing that matters is how it performs in normal usage.

I was considering buying it, is this real problem?

Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on October 05, 2017, 12:57:17 am
I was considering buying it, is this real problem?

Yes, at a minimum the 7510 has a *somewhat* flawed AutoZero implementation.

Title: Re: DMM Noise comparison testing project
Post by: fonograph on October 05, 2017, 01:40:31 am
Is it software or hardware problem? Didnt Keithley fix it with new firmware patch or something?

Doesnt that graph I quoted show the problem only exist with shorted inputs?
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on October 05, 2017, 04:14:22 pm
The unexpected extra low frequency (e.g. 0.1 Hz range) noise of the DMM7510 and some other Keithly meters seems to be a software problem, as it can be lowered a little with different triggering mode. So it does not seem to be a HW problem (e.g. temperature fluctuations). The funny thing is that also other Keithly meters like the K2002 seem to show a similar effect, though less obvious.
The Keysight meters show that there is no need for the extra bump in the noise spectrum / Alan deviation curve.

My suspicion is they use the average of several zero readings (over something like 10s) in stead of direct subtraction for the AZ mode. It might seem to be a clever way to reduce noise - but it does not work well, because it would let more 1/f noise through - so they trade in noise from the 100 Hz range to higher noise from the 0.1 Hz range. The AZ mode not only suppresses drift but also low frequency noise, just like in a chopper amplifier. The noise form the non AZ range suggests that the HW could do better, even if we take into account that continuous integration (like used in the HP34401) favors the non AZ mode a little.

Another possible reason could be a slow working numerical compensation of temperature effects. If they measure internal temperature every 10 s (or so, but more often if in triggered mode) and do some corrections based on this, it could have a similar effect.

When measuring a not so small voltage (e.g. more than 50% of FS), the noise of the references makes the excess noise less visible, but it is still there, though less obvious. The bump at about 15 seconds it still there for the 10 V input. The reference noise can be both from the signal measured and the DMM internal reference. It looks like the LTFLU reference in the DMM7510 is really good for a not heated reference. The very long times seem to be dominated from the source, thus making the LM399 in the 34465 look similar in the curves below.

The bump in the noise curve does not look that large, however the extra noise is just at the time (1-30s) scale where low noise is most wanted. For precision measurements this is about the time scale used for manual switching or external polarity reversal. So it is a kind of embarrassing at 10 s aaveraging and 3 V the DMM7510 is not better than the cheaper 34465 and for a short even a factor 5 higher in noise.

There where a few SW updates, but AFAIK they where addressing mainly software crashes of the GUI and not the measurement itself.
Title: Re: DMM Noise comparison testing project
Post by: HighVoltage on October 05, 2017, 06:39:32 pm
Is it software or hardware problem? Didnt Keithley fix it with new firmware patch or something?

Doesnt that graph I quoted show the problem only exist with shorted inputs?

As others, I have pointed this problem out to Keithley directly without any real valuable response to this particular issue.
All other issues that I had got addressed in the many FW updates that followed.
This leads me to believe, it might be hardware related and can not be fixed by software.
 
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on October 05, 2017, 07:05:12 pm
This leads me to believe, it might be hardware related and can not be fixed by software.

I doubt the AZ issue is HW related.  The software issues were fixed (They still haven't fixed the web interface issues, at least it wasn't noted in the changelog) fairly quick because once IDed and reproducible that stuff is usually easy.  The AZ issue on the other hand would require the *right* guy at Keithley to research and study what is going on.  The difficulty here might also be in the fix, it would alter the behavior of the instrument and might be an issue for some customers, requiring re-certification or production line changes.

I suspect we will never get any traction on this issue.   :(
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on October 05, 2017, 10:36:49 pm
This plot shows that with 10 V input one can remove the noise bump by using a custom trigger script on DMM7510, at the expense of higher short-term noise:
https://www.eevblog.com/forum/testgear/keithley-dmm7510-smu-2450-2460-problems/msg1194829/#msg1194829 (https://www.eevblog.com/forum/testgear/keithley-dmm7510-smu-2450-2460-problems/msg1194829/#msg1194829)

I was going to do a more fair comparison of Keysight 34470A with the DMM7510 at finite voltages because 34465A is limited by poorer voltage reference.
Also, I am wondering if the 1/f noise without AZ is better in Keysight meters, so maybe Keithley has to work harder to suppress it.

In terms of practical impact, the 1/f noise in DMM7510 is embarrassing if one has to show Allan deviation plots or even time domain plots for a low-noise DUT. When someone asks why does your DUT has 1/f noise, try to convince them its actually the meter.
Title: Re: DMM Noise comparison testing project
Post by: fonograph on October 06, 2017, 01:40:54 am
Indeed at 0V it shows Keysight is better,at 3.13V its match,then at 30 second+ the keysight pulls ahead,but at 10V the Keithley is better,both short and long term!

Just look at the graph! The keithley in black is under the red keysight curve! So at 10V keithley is better and this autozero problem doesnt make it inferior like when measuring 0V,whitch is short.

My point is,as a person that want best dmm to measure 10V,I should not be put off by the poor 0V noise of 7510 since at 10V its better than keysight,or I am wrong?
Title: Re: DMM Noise comparison testing project
Post by: VintageNut on October 06, 2017, 03:37:56 am
Anecdotally, I have used my DMM7510 to measure one of my Fluke 731Bs in an environment where the temperature fluctuates p-p 10 degrees F or more. The long-term measured standard deviation of the 10V output of the 731B is around 1/4 ppm.

In the long-term graph, you can see the rolling hills of the temperature in my house.

I consider the DMM7510 to be stable, repeatable and very low noise measuring my 10V Fluke 731B. I do not need any better performance.

Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on October 06, 2017, 04:57:57 am
My point is,as a person that want best dmm to measure 10V,I should not be put off by the poor 0V noise of 7510 since at 10V its better than keysight,or I am wrong?

If your application is specifically to measure 10V and if you are comparing DMM7510 to 34465A, which is about 1/3 of the price, then indeed DMM7510 is better.

I recently got a 34470A, so I will run at some point a direct comparison DMM7510 to 34470A. A few other people here can also do it at 10 V. Would be good to throw in a 3458A as well.
Title: Re: DMM Noise comparison testing project
Post by: fonograph on October 06, 2017, 05:12:23 am
My point is,as a person that want best dmm to measure 10V,I should not be put off by the poor 0V noise of 7510 since at 10V its better than keysight,or I am wrong?

If your application is specifically to measure 10V and if you are comparing DMM7510 to 34465A, which is about 1/3 of the price, then indeed DMM7510 is better.

I recently got a 34470A, so I will run at some point a direct comparison DMM7510 to 34470A. A few other people here can also do it at 10 V. Would be good to through in a 3458A as well.

That would be great! I am currently deciding between 34470A and 7510,any test comparing the two directly would be very appreciated.I would also like other measurements tested,not just DCV,also ACV and DCI,ACI,resistance 4 wire and capacitance
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on October 06, 2017, 08:38:25 am
This leads me to believe, it might be hardware related and can not be fixed by software.

I doubt the AZ issue is HW related.  The software issues were fixed (They still haven't fixed the web interface issues, at least it wasn't noted in the changelog) fairly quick because once IDed and reproducible that stuff is usually easy.  The AZ issue on the other hand would require the *right* guy at Keithley to research and study what is going on.  The difficulty here might also be in the fix, it would alter the behavior of the instrument and might be an issue for some customers, requiring re-certification or production line changes.

I suspect we will never get any traction on this issue.   :(

Fixing the AZ issue should also be relatively easy, as the weak point is relatively well localized. However it will take a different guy than the user interface part and this might be old code they have to touched for decades (the K2002 seems to have a similar issue, though less obvious). I don't see why there should be an important change in overall behavior. If they are really afraid of this, they might even add an optional choice of AZ mode (so not just AZ off / on), since there are a few possible good choices depending on the situation:
1) the old Keithley mode with averaging for compatibility (not much other advantage)
2) using the zero before and after the signal with half weight - should be the obvious solution
3) using the zero reading before the signal only - to get less latency for reading
4) use less time on zero correction  - useful for relatively noisy signals.
The slightly different behavior when changing the AZ mode might cause some changes and this can include a few negative ones
Title: Re: DMM Noise comparison testing project
Post by: HighVoltage on October 06, 2017, 10:31:30 am

That would be great! I am currently deciding between 34470A and 7510,any test comparing the two directly would be very appreciated.I would also like other measurements tested,not just DCV,also ACV and DCI,ACI,resistance 4 wire and capacitance
I have both instruments and like them a lot.

Here is an interesting startup comparison between the 34470A and 7510
Actually I have one 7510 and two 34470A hooked up to a good and reliable warmed up 10V source.
Then turned all three instruments on at the same time.

The 7510 has a very interesting warmup graph and is much faster at reliable numbers than the 34470A.
Here are some comparison graphs.
Essentially the Keithley 7510 has reached reliable values after 3 min and the Keysight 34470A at 30 min
 

Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on October 06, 2017, 02:45:04 pm
The 7510 has a very interesting warmup graph
Yes, I remember noticing the steps in the voltage when the temperature is changing quickly even when its reading zero. I am not sure if its an ideal behavior, but they probably do a more aggressive temperature correction than Keysight.

Can you leave the instruments recording 10 V for a few hours at 10 PLC and post the data?
Title: Re: DMM Noise comparison testing project
Post by: fonograph on October 06, 2017, 05:03:55 pm
omg yes! I love you HighVoltage! Thats the kind of information I need,I am real jealous that you have 2x 34470 and 7510,any kind of comparsions and performance observations would be highly welcome.

The fact that it hits operational temperature in 1/10 time is significant.But what about ACAL? Both 7510 and 34470 have automatic calibration that compensates for temperature,or is it not important when it comes start up time required for stabilization?

How long does the 7510 ACAL last anyway,34470 is around  15 seconds if I remember correctly.I have read that 7510 fan is loud and 34470 is quiet,is that true?
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on October 07, 2017, 02:02:21 pm
How long does the 7510 ACAL last anyway,34470 is around  15 seconds if I remember correctly.I have read that 7510 fan is loud and 34470 is quiet,is that true?

Should probably move further discussion to one of the 7510 threads, or a new one, but:

7510 ACAL takes 7min 4sec.

I've not been utilizing the temp based ACAL scheduling option of the 7510 because I haven't tested/verified it, maybe a project for the near future. 
Title: Re: DMM Noise comparison testing project
Post by: HighVoltage on October 07, 2017, 10:07:01 pm
Can you leave the instruments recording 10 V for a few hours at 10 PLC and post the data?

Here is a first test of my 7510 at a stable 10V input with 10PLC setting and AZ ON.
I have the instrument running over night and will post a full buffer file tomorrow.


Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on October 08, 2017, 12:10:22 am
This looks good, similar to other measurements. The long-term stability is quite good.
What would be most interesting is to take 7510 and 34470 data at the same time to compare them directly.
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on October 08, 2017, 12:18:48 am
This looks good, similar to other measurements. The long-term stability is quite good.
What would be most interesting is to take 7510 and 34470 data at the same time to compare them directly.

I wonder what improvement could be gained by proper screw type banana jacks, similar/same as the 3458A...
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on October 08, 2017, 08:48:50 am
The very low frequency noise that might come from thermal EMF and similar is not only coming from the terminals. There a quite a few internal points (e.g. relays, the front / back terminal switch, PTCs for protection, temperature gradients at chips/fets). So I won't expect a great improvement from just different plugs.
For really low level signals the special meters like the 34420 have the better input amplifier and you don't need a high end ADC and reference at the nV level anymore, as other errors are usually larger.

With an external source there are also variations from the source. Even a good 10 V reference (except JJA) is usually less stable than the thermal EMF limit. One of the older curves comparing the 34465 and 7510 showed this when measuring both simultaneous - the very low frequency parts was from the source as both showed the same variations.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on October 14, 2017, 04:00:44 pm
Here is my test of the Keithley DMM7510 and Keysight 34470A directly against each other with a 9.6V battery input. So the noise bump in the Allan variance at 20 sec in DMM7510 is still quite pronounced.

(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=360667)

The 34470A meter seems to have extra noise on the 100-500 sec time scale. This can be compared with tests by Jorn, https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/msg1136604/#msg1136604 (https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/msg1136604/#msg1136604), where there is no rise in the noise and the Allan variance stays below 0.2 uV. Perhaps it is due to better ambient temperature stability.
Title: Re: DMM Noise comparison testing project
Post by: branadic on October 22, 2017, 09:09:42 pm
Question: What noise would one expect, if DMM measures its own voltage reference in 10V range?

I'm currently observing the reference voltage on my Prema 5017 by itself and I'm the opinion that the noise is rather high. Attached is a picture directly after powering the unit up with capturing data with 0.5Hz repetition rate. I will go one measuring and will then measure the reference voltage with 3458A for comparison. Maybe there is some room for improvement within the circuit by changing some opamps by lower noise types?

-branadic-
Title: Re: DMM Noise comparison testing project
Post by: Cerebus on October 22, 2017, 10:36:00 pm
Question: What noise would one expect, if DMM measures its own voltage reference in 10V range?

That's a bit of a "how long is a piece of string?" question.

It's going to depend heavily on the ADC architecture in use.

In something like an HP 3458 or 34401 where the reference voltage is going to be applied simultaneously down the 'measurement' and 'charge balance' routes then it's going to have correlated noise that will, to some extent, either cancel or reinforce itself. Whereas if it's a classic double slope integrator then the reference voltage will be applied serially in time and there will be no cancellation. Both types will, of course, band limit the noise to 1/2t where t is the aperture time.

And so on for other ADC architectures.

I think you can only come up with an expectation after an, at least moderately, rigorous trip over a detailed block diagram of the meter in question with some good guesstimates to hand of the noise characteristics of each stage in the block diagram.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on October 23, 2017, 01:20:30 pm
Here is a bit more data on direct comparison of DMM7510 and 34470A. In my lab there is often a pronounced temperature oscillation of a few tenths of a degree with a period of 1000 sec. One can see nice Fourier peaks in the temperature and the voltage. For these tests the meters are placed on a lab bench with plenty of space around each one, while the battery is well thermally insulated. Under these conditions, Keysight 34470A has about a factor of 2 higher sensitivity to temperature changes compared to Keithley DMM7510. That is the origin of the peak in the Allan deviation around 500 sec which drops down at 1000 sec because the temperature changes are fairly periodic.
(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=363179)
(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=363185)
(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=363183)
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on October 23, 2017, 03:11:26 pm
When measuring it's own reference the ADC will see some of the reference noise, but not all. What exactly depends on the ADC type. Especially the very low frequency part is well suppressed. There may be a significant contribution (could very well be amplification)  from some higher frequencies (where the modulation in CB ADCs happens). Of cause the amplifier part is still there.

AFAIK the Prema meters use an AZ OP at the input. This could be a significant contribution to the noise in the lower voltage ranges, but it usually is not for the 10 V (or similar) range. Here changing the OP might be possible  (e.g. LTC1050/ICL7650 to LTC1052/ICL7652). However with AZ OPs it is usually a compromise between bias current and voltage noise. The very lower noise AZ OPs usually have to much bias and maybe to much current noise too.

The Prema meters use an special ADC chip - so nothing to improve there. There might be a small chance to improve reference filtering (to reduce the higher frequency noise part). At least a few meters (e.g. Keithley 2001 AFAIK) seem to have skipped on this rather simple option. However I am not sure on how much that contribution is - it may not be that much. Looking in detail at the noise source could be interesting, but would be more likely worth a separate thread - if it leads to significant results they would be interesting in this thread too.
Title: Re: DMM Noise comparison testing project
Post by: branadic on October 23, 2017, 04:53:33 pm
When measuring it's own reference the ADC will see some of the reference noise, but not all. What exactly depends on the ADC type. Especially the very low frequency part is well suppressed. There may be a significant contribution (could very well be amplification)  from some higher frequencies (where the modulation in CB ADCs happens). Of cause the amplifier part is still there.

AFAIK the Prema meters use an AZ OP at the input. This could be a significant contribution to the noise in the lower voltage ranges, but it usually is not for the 10 V (or similar) range. Here changing the OP might be possible  (e.g. LTC1050/ICL7650 to LTC1052/ICL7652). However with AZ OPs it is usually a compromise between bias current and voltage noise. The very lower noise AZ OPs usually have to much bias and maybe to much current noise too.

The Prema meters use an special ADC chip - so nothing to improve there. There might be a small chance to improve reference filtering (to reduce the higher frequency noise part). At least a few meters (e.g. Keithley 2001 AFAIK) seem to have skipped on this rather simple option. However I am not sure on how much that contribution is - it may not be that much. Looking in detail at the noise source could be interesting, but would be more likely worth a separate thread - if it leads to significant results they would be interesting in this thread too.

Thanks, but don't you think that those ~30µVpp in 10V range are a bit much? I would have expected something significant smaller.

-branadic-
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on October 23, 2017, 05:40:48 pm
30 µV_pp are too much for a 0.5 Hz update rate. There is a slight chance that measuring the internal reference also gives a path for RF noise to enter the system. So the fist test would be the simple readings on the shorted input. The second test would than be reading a independent stable voltage (e.g. 9 V block).  Ideally reading the own reference should give a lower noise than an external stable voltage, down to the level of the shorted input, but usually a little more.
Title: Re: DMM Noise comparison testing project
Post by: branadic on October 23, 2017, 05:48:12 pm
I will start a new thread on this topic.

-branadic-
Title: Re: DMM Noise comparison testing project
Post by: Andreas on October 23, 2017, 07:09:27 pm
Question: What noise would one expect, if DMM measures its own voltage reference in 10V range?

I'm currently observing the reference voltage on my Prema 5017 by itself and I'm the opinion that the noise is rather high.

Hello,

if I look at the datasheet of the ADC the noise is explainable for me:

https://www.ohh.de/5610.htm (https://www.ohh.de/5610.htm)

2 seconds integration time correspond to N1=30 and N2 = 10 thus around 23.6 bits.
Input range is +/-30 V so 60V / 23.6 bits gives 4.7uV.

If I assume that the 3 sigma has to be multiplied (and not divided)
we get around 15uVp / 30uVpp noise alone from the ADC.

So I fear that the analog path with 2uVpp estimated maximum noise is not the mayor source of the noise.

with best regards

Andreas






Title: Re: DMM Noise comparison testing project
Post by: fonograph on October 28, 2017, 09:06:24 pm
Here is a bit more data on direct comparison of DMM7510 and 34470A. In my lab there is often a pronounced temperature oscillation of a few tenths of a degree with a period of 1000 sec. One can see nice Fourier peaks in the temperature and the voltage. For these tests the meters are placed on a lab bench with plenty of space around each one, while the battery is well thermally insulated. Under these conditions, Keysight 34470A has about a factor of 2 higher sensitivity to temperature changes compared to Keithley DMM7510. That is the origin of the peak in the Allan deviation around 500 sec which drops down at 1000 sec because the temperature changes are fairly periodic.
(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=363179)
(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=363185)
(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=363183)

could you please please please do 34465,34470 and 7510  all at once? You did 7510 vs 34465 with various voltage ranges and then 34470 vs 7510 at 10V only.If you could do all three with variety of voltages at same time that would be awesome.

If you could also test them side by side cold start on warmed up reference to see how they stabilize with respect to time.
Title: Re: DMM Noise comparison testing project
Post by: martinr33 on December 03, 2017, 11:45:24 pm
I put the files on the Xdevs FTP site under K2010martin

Here are the 10V results:
10V 10NPLC   STDEV 500nV average -600nV
10V  1NPLC        STDEV 830nV average -680nV

As with the other K2010 here, and another unit I have, the SD is quite low at 500nV.

I included the zero voltage because I find it surprisingly low for a unit this old. I don't see any evidence of calibration.
S/N 0743311
Rev: A09 A02


60Hz 110VAC ambient 70 degrees F
Keithley low thermal short applied
Been warming up for weeks
Absolute readings - not relative (unit has good zero if it is allowed to sit)
Unit came from Japan. Display is tired.
No work done on meter yet. May need caps, fan and so on.


SCRIPTING NOTES - the script is also in the xdevs directory.
K2010TEST is the script. Works OK, except some readings are too slow. Needs timeout increased to 90 seconds.
See notes at beginning of program.

Most important thing is removing the EGR COMP config, as the 2010 does not support it.
Title: Re: DMM Noise comparison testing project
Post by: martinr33 on December 04, 2017, 03:07:09 am
Here's the distribution of readings from my 10V NPLC 1 session on the Keithley 2010.

The readings are quantized in steps of 560nV.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 04, 2017, 08:43:53 am
Here is the Allan variance of Martin's Keithley 2010 for 10V range 1 plc data - it has exactly the same bump as  DMM7510! This is the clearest evidence yet that the Autozero problem is deep inside their algorithm and applies to all meters, not just DMM7510. No wonder they have trouble fixing the problem.

(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=376354)
Title: Re: DMM Noise comparison testing project
Post by: saturnin on December 04, 2017, 11:27:56 am
I think mentioned autozero effects can be clearly seen during warmup phase of Keithley's multimeters. They all exhibit the same saw-like warmup characteristic as autozero mechanism corrects large thermal drifts which are present just after startup.

See attached plots of warmup phase of my K2010 and K2001 multimeters (no filters used, sample rate 0.5 Hz) + data from HighVoltage's measurement from the previous page (first two plots): https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/msg1317367/#msg1317367 (https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/msg1317367/#msg1317367)

Btw. K2010 stabilizes fairly quickly compared to K2001. Even then K2001 exhibits the worst noise performance from the 2000 series - it is basically useless as 7-1/2 multimeter without heavy filtering.
Title: Re: DMM Noise comparison testing project
Post by: dr.diesel on December 04, 2017, 02:01:05 pm
Here is the Allan variance of Martin's Keithley 2010 for 10V range 1 plc data - it has exactly the same bump as  DMM7510! This is the clearest evidence yet that the Autozero problem is deep inside their algorithm and applies to all meters, not just DMM7510. No wonder they have trouble fixing the problem.

The k2002 is probably in the same boat.  Lots of data sets in over at TiN's site, but probably best to let him choose the right one to include in the comparison.
Title: Re: DMM Noise comparison testing project
Post by: TiN on December 04, 2017, 02:21:24 pm
Let me know what conditions are needed, I can capture fresh log, as I have both meters currently idle.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 04, 2017, 03:33:25 pm
The saw-tooth behavior during warm-up was also observed in DMM7510, https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/msg1081865/#msg1081865 (https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/msg1081865/#msg1081865)

Its a good question if this periodic relatively slow temperature compensation is the source of the AZ problem. I believe the evidence points against it. In particular, there are no spikes in the Fourier transform of the signal, as one would expect for a periodic correction. The most likely explanation for AZ bump is that the zero value for autozero correction is calculated as a running average over a long time. Forcing the triggering of the meter can eliminate the bump, probably because it resets the running zero average.

The data for K2002 meter are analyzed in https://www.eevblog.com/forum/testgear/keithley-dmm7510-smu-2450-2460-problems/msg1083291/#msg1083291 (https://www.eevblog.com/forum/testgear/keithley-dmm7510-smu-2450-2460-problems/msg1083291/#msg1083291)
It shows similar behavior, but K2002 short-term noise is higher, so the bump is not as pronounced.
 

Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 04, 2017, 04:43:55 pm
The saw tooth like curve on warmup is likely due to internal corrections done with something like temperature measurements every 70 seconds or the like. At least it looks like those corrections are done quite good. It might be worth to compare the warm up with a 10 V signal and with a short, as there are both effects on the scale factor / reference and offset drift. I would expect main an effect on the scale factor - at least with AZ mode active.

These corrections (especially those effecting the offset, and if not implemented well) could also lead to some extra noise in the same frequency range as the extra noise peak. So there is a chance that a not so good implementation if those temperature corrections is causing the problem. This might be hard to fix and might meed HW modifications, e.g. to get better temperature readings - though with a reasonable stable ADC/amplifier the demands on the internal temperature reading should not be that high. Also triggering can change things more points to a problem due to the AZ procedure and not temperature corrections.

The 2001 meter is different from most other meters, as it uses a separate short time reference (zener-diode on the ADC board) for the ADC and long time reference (LM399). So there somehow needs to be a regular extra measurement of the long time reference (LM399) - this could be as frequent as after every reading. There are other options, like switching between the AZ and 7 V reading - thus requiring some averaging for the AZ readings.

This procedure can lead to rather good stability (similar effect as a frequent acal 72 on the 3458) but also more lost time and thus higher noise. Also the data rate might be lower than expected from the PLC setting. AFAIK the 2001 is rather high noise, but good stability / linearity.
Chances are also that the noise contribution from the reference has a different spectrum than just a LM399 - if well done it could be better, as the extra short time reference could be used for a digital filtering of the LM399 reference to reduce the noise to the level of the possibly lower noise short time reference.
Title: Re: DMM Noise comparison testing project
Post by: Andreas on December 04, 2017, 06:09:40 pm
Hello,

same behaviour here with a K2000 on a 7V reference.
Saw tooth up to 10uVpp (except when warmup drift is too large).

Warmup shown for the first 3 minutes with 10 NPLC (~0.6 seconds / measurement).
X-Axis: number of measurement.

with best regards

Andreas

Title: Re: DMM Noise comparison testing project
Post by: saturnin on December 04, 2017, 06:57:57 pm
Some time ago, I debugged the ADC in K2001 (at first I thought it was faulty - too noisy). When I connected test leads to a node on the ADC board, there was often an immediate shift in readings - a few tens of ppm. Of course, this is not so surprising since conditions in the ADC circuitry were changed by attached test leads. What surprised me was K2001 reaction - with test leads still connected it returned to the initial reading very slowly and reluctantly. IIRC, the return to the initial value consisted of several discrete steps (it was not definitely smooth).

I suspect AZ calibrates zero/gain of the ADC and averages these calibration values over a given time period. Therefore several measurement cycles are needed to adapt to a new state of the ADC circuitry. Using averaged zero/gain calibration values rather than actual ones might lead to excess of noise in K2001 ADC. (AZ might not be able to seamlessly compensate the drift since it looks too much to the past due to the averaged values.)

The 2001 meter is different from most other meters, as it uses a short time time reference (zener-diode on the ADC board) for the ADC and long time reference (LM399). So there somehow needs to be a regular extra measurement of the long time reference (LM399) - this could be as frequent as after every reading. There are other options, like switching between the AZ and 7 V reading - thus requiring some averaging for the AZ readings as I observed.

Kleinstein, I would correct you at this point. K2010 model uses an auxiliary reference too (its nominal value is 6.4V, see attached photo). This reference is used for definition of CB currents and the constant current source depends on it too. The master reference (LM399) is used to calibrate the whole multimeter.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 04, 2017, 07:46:42 pm
Some time ago, I debugged the ADC in K2001 (at first I thought it was faulty - too noisy). When I connected test leads to a node on the ADC board, there was often an immediate shift in readings - a few tens of ppm. Of course, this is not so surprising since conditions in the ADC circuitry were changed by attached test leads. What surprised me was K2001 reaction - with test leads still connected it returned to the initial reading very slowly and reluctantly. IIRC, the return to the initial value consisted of several discrete steps (it was not definitely smooth).

I suspect AZ calibrates zero/gain of the ADC and averages these calibration values over a given time period. Therefore several measurement cycles are needed to adapt to a new state of the ADC circuitry. Using averaged zero/gain calibration values rather than actual ones might lead to excess of noise in K2001 ADC. (AZ might not be able to seamlessly compensate the drift since it looks too much to the past due to the averaged values.)
...
Using some averaging for the gain calibration is OK, as this can reduce the noise, especially ADC noise and higher frequency noise of the long term reference. Averaging determines the cross over from the long term reference to the short therm reference at the ADC.  However averaging for the zero reading used for the offset compensation (AZ) is not such a good idea: it reduces the higher frequency noise, but on the back side it adds low frequency noise, that is higher due to 1/f noise. Ideally the AZ readings can suppress much of the low frequency noise just like a chopper amplifier. However this does not work well anymore when the zero readings are averaged. This seems to be a problem with quite a few of the Keithley meters.

Title: Re: DMM Noise comparison testing project
Post by: Mickle T. on December 04, 2017, 08:07:08 pm
The master reference (LM399) is used to calibrate the whole multimeter.
No. The master reference is used to calibrate the ADC FS on a periodic basis. K2100 does the same thing via the same DG408 MUX.
Title: Re: DMM Noise comparison testing project
Post by: saturnin on December 04, 2017, 09:19:11 pm
Kleinstein,

thank you for explanation. That's probably right - AZ gain calibration is not likely culprit in this case: there is significant noise even with 0V input signal in K2001.

The master reference (LM399) is used to calibrate the whole multimeter.
No. The master reference is used to calibrate the ADC FS on a periodic basis. K2100 does the same thing via the same DG408 MUX.

Well, I maybe used a little bit vague formulation, but my point was to mention there is the auxiliary reference (6.4V) in K2010 too. On the other hand, there is very stable master reference (LM399) that serves as a reference point for the whole multimetr (i.e. all functions depend on it - ok, except frequency). That's obvious the ADC is used to compare reference value with measured ones... 
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 04, 2017, 11:01:28 pm
Given the fact that K2010 and DMM7510 have very similar noise, I wonder if the analog part is almost the same, only a faster processor for the DMM7510. Does anyone have both meters to open?
Title: Re: DMM Noise comparison testing project
Post by: martinr33 on December 05, 2017, 05:55:15 am
There's a good 7510 teardown video on https://www.youtube.com/watch?v=uvgJ2zAxgAY (https://www.youtube.com/watch?v=uvgJ2zAxgAY)

The DAC seems to be living inside an Actel ProASIC3. The version here has 250,000 gates - enough for an ARM core. The previous DAC was eventually placed in an ASIC, but the new one looks like it adds capability. On top of that - two PowerPC processors. Quite a lot of processing.

I don't think that the K2K units had a processor in the gate array. Too early for that - best capability in that device would be a simple state machine. Not enough to do any averaging.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 05, 2017, 12:09:49 pm
The K2010 and DMM7510 have similar performance. So they might share some of the electronics. However the 7510 seems to use the better reference (LTFLU) compared to LM399. On first sight it is mainly the graphics display with the DMM7510. Not shure for what reason they need that much processing power, maybe the OS for the graphical system.

From the teardown pictures so far, it looks like the new ADC uses a fast ADC chip for the ADC internal feedback. The newer HP meters seem to use a very similar method, at least they use similar parts. Likely it is much like an improved 34401, with an ADC to get the residual charge on the fly. This would need quite some processing for the ADC already and thus the more powerful FPGA. Something like the AZ mode or adjustment measurements would be already low data rate and could thus very well be in the ground referenced part.

p.s.:
I looked at the picture from 2010 and the DMM7510: there are very different designs. The 2010 is more like an improved 2001 - the 7510 looks much more modern. So not much in common at all.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 05, 2017, 07:04:02 pm
On the 1V and 100 mV scale the noise for DMM7510 is about a factor of 2 lower than for K2010 (and also better than for HP3458A). So the amplifier in DMM7510 must be better. But the 10 V range has exactly the same noise as K2010, so I guess ADC performance hasn't changed even if the processor is faster.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 05, 2017, 09:11:51 pm
The ADC in the DMM7510 is not just using a larger / faster FPGA. From what it looks like, the 7510, like the Keysight3446x/70 is using extra ADCs and likely a more continuous mode like in the old 34401. So integrate with feedback (using fast ADC Chip in the new meters) and measure the residual charge with an ADC. The ADC in the 2010 very much looks like the typical older Keithley ADCs (e.g. 2000,2001). So the more classical way with integrate and separate rundown phase. In contrast to the high noise 2001 they seem to have found a good way to use the secondary reference to get low noise even with just a LM399 as the main reference.

So the 2010 and 7510 do not have very much in common and the very similar noise level is more like coincidence, maybe due to the same target noise during design. I would consider the 7510 a modern replacement for the 2010. The 2010 looks rather similar to the 2182 nV meter for the ADC (and reference) part. The rather similar noise peak suggests that they use the same AZ algorithm.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 06, 2017, 04:57:39 am
It's interesting that the intrinsic noise of the ADC (on 10V scale at 1 to 10 PLC speed) is virtually the same on all meters (HP3458A, 34465/34470, DMM7510, K2010, K2002), within roughly 50%. I don't think its just a design target. Certainly if someone had come up with a way to significantly beat 3458A noise, they would have run with it. There must be a pretty hard hardware limit.

Its not obviously a limit coming from analog input. A 10 nV/Hz amplifier would give at 10 PLC a noise of 2.5ppb, more than a factor of 10 less than typical meter noise. Its not obviously the voltage reference noise, if the signal is near zero volt. Its not obviously timing jitter in an integrating ADC, 100 psec jitter would give 0.6ppb noise. What are other possible fundamental sources of noise?
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 06, 2017, 04:49:59 pm
There are quite a few contributions to the noise of those integrating ADCs. As typical with an optimized design it is not one big noise source, but several of similar size. A few obvious ones are:
 
1) The resistors at the input of the integrator. For the 3458 this are 40 K for the input and about the same for the reference currents. So effectively 80 K and thus about 36 nV/Sqrt(Hz). Other DMMs often use larger resistors.
2) noise voltage of the integrator OPs relative to the input signal.  Due to the low frequency (e.g. 25 Hz range or lower) there can be quite some 1/f noise from JFET OPs. A BJT based OP like the OPA177 will add some current noise too.
3) Higher frequency noise of the integrator and following comparator (if used). The comparator might need to be rather fast and thus the effective bandwidth can be rather high and thus quite a noise contribution. Some modern ADCs use and extra ADC chip instead. This might be an advantage due to an effective lower BW. Not sure on how much of the given opportunities they actually use. This would be especially true if an ADC is used in combination with a separate rundown phase ( I don't know such a design).
4) The charge zero phase at the start of conversion might add some noise for the starting point too - this part might be overlooked in some designs. Again continuous versions with ADC might not use a zero Phase.
5) Charge injection from the switches for the reference might also add some noise, especially with fast switching.
6) Clock or control circuit jitter. For a low noise it needs signal jitter well below 1 ns. It is not so much the full time, but with a rather fast reference switching frequency, a single conversion can have several 10000 switching events. So clock jitter adds up. Frequent switching is attractive to keep other noise (and INL) contributions small.
7) The balance of the positive and negative references adds some noise (e.g. the OP and the resistors used for this)
8) Power supply noise and similar signals coupled in might be a factor too
9) for the critical low frequency part (e.g. 1-100 mHz range) thermal stability can be a factor too - this often is what makes the Alan variance curve go up after some point.
10) Higher frequency noise from the reference (e.g. modulation frequency band) can enter.  Though filtering is easy I have not seen it with most DMMs. 
11) A non perfect sync to the line frequency can contribute

There are other contributions too, some can be hard to find and specific to some ADCs.
For the AZ mode the second measurement also adds to the noise - it is hard to avoid for the longer time scales.

The typical noise level of a LTZ1000 reference also sets a noise level, that might lead to a common design target. There is not that much advantage of having an ADC that is much lower noise than the reference. Similar there are not many signal sources (e.g. calibration sources) that have a much lower voltage noise.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 10, 2017, 08:20:58 pm
I just got a used Agilent 34420 nanovoltmeter, seems to work fine. On 1mV and 10mV ranges the input noise is 5nV/sqrt(Hz), so about a factor of 2 better than chopper amplifiers. The Allan variance looks good too, crosses 1 nV at about 10-20 sec.
I wanted to compare the performance to the Keithley 2182A. TiN, I saw you use one recently, could you take some shorted input noise data, primarily on 10mV and 100 mV scales.
Title: Re: DMM Noise comparison testing project
Post by: TiN on December 11, 2017, 01:05:03 pm
Ok, will do, however one I have now is plain 2182, non-A. And it's non-proofed one, might be sub-par performance, as it was after repair.
It's currently used together with other meters to log my proto FX references, but I do plan to compare it's noise performance versus K2002, K2002-1801(A10) and K182M I have.
I'll be recalibrating it as well, it's currently +3.5 ppm off on 10DCV.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on December 11, 2017, 03:04:04 pm
Thanks. The specifications that they list for 2182 and 2182A are identical as far as noise is concerned.

Keithley specifies the noise performance in the most asinine way possible, though, as peak-to-peak noise for a time=10x response time, where "Response time = time required for reading to be settled within noise levels from a stepped input". Neither of these is a well-defined quantity.

There were some earlier reports here by alanambrose (#332)  of the K2182A performance that show very anomalous behavior of rms noise vs. PLC. So I am curious to look at the raw data.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 11, 2017, 05:09:03 pm
From the pictures the K2182 ADC looks very much like the K2100. So it might be interesting to not just look at RMS noise vs. PLC, but also look at the Allan variance curve. I would be surprised not to find that extra noise in the 10-50 seconds range. Those old data from Alanambrose look a little odd.

Independent from the meter used, for less than 1 PLC it might be interesting to separate true noise from 50/100 Hz coupled in. Just looking at the RMS values can be misleading if it is dominated by a 50/100 Hz contribution, that can also vary between units.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on July 09, 2018, 08:28:48 am
I made a new summary plot showing the noise for a bunch of DMMs with shorted inputs. I picked 100 PLC integration time since it gives a good estimate of the uncertainty after a few seconds of data taking. The voltage rms noise is plotted vs. voltage range. This allows one to distinguish the noise of the front end vs. the noise of the ADC.

Part of my motivation was to see where HP3457A would fall on the plot. The 10 V range in it is added using a voltage divider to 3V range https://www.eevblog.com/forum/metrology/extra-10v-dc-range-on-hp3457a/msg1521082/#msg1521082 (https://www.eevblog.com/forum/metrology/extra-10v-dc-range-on-hp3457a/msg1521082/#msg1521082).

EDIT: Added a couple more meters and fixed some errors in the spreadsheet
Some conclusions:
Best modern low-noise DMM: 34461A
Best nanovoltmeter: 34420A
Best low-cost used low noise DMM: 3457A

(https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/?action=dlattach;attach=472706;image)

Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on July 10, 2018, 12:14:23 am
I fixed a couple of errors in the plot in the previous post, going back to the raw data when possible.
Title: Re: DMM Noise comparison testing project
Post by: serg-el on July 12, 2018, 09:33:00 am
Хмм.

У меня получились другие данные.

I got other data.

Edit: added data
WTF!!!

Edit2: ManateeMafia HP3458A пересчитано
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on July 12, 2018, 05:27:17 pm
Проверьте что вы вычисляити стандартное отклонение а не среднее, у Тина есть ошибки в таблице
Title: Re: DMM Noise comparison testing project
Post by: serg-el on July 12, 2018, 05:39:58 pm
В каких данных ошибка?
Я пока не нашёл.
Вычислял stddev (rms).
СТАНДОТКЛОН в русской версии exel.

Edit: нашел.
Новые данные выше.
Title: Re: DMM Noise comparison testing project
Post by: TiN on July 12, 2018, 06:04:07 pm
EEVBlog fixed unicode support for forum? Wowski :)

I had two versions of Excel file, with older peak-peak values and then later with RMS Stddev.
Also there was issue of double division by range on some test.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on July 12, 2018, 09:27:28 pm
Old neutrons 34461A, pilelie 34420A - analyze original data, summary table shows rms, not stddev.
barnacle2k Solartron -shows integration time in seconds, not nplc

Title: Re: DMM Noise comparison testing project
Post by: serg-el on July 12, 2018, 09:56:33 pm
https://xdevs.com/datashort/Pipelie/
Вычислял сам.

https://xdevs.com/datashort/OldNeurons/
Вычислял сам.


barnacle2k Solartron это, да. Неправильно. Но график не сильно изменится, если пересчитать 3,2 сек. в plc. Будет равно 160 PLC. Если 50 Гц.
Или 192 PLC если 60 Гц.

RMS это и есть stdev ;)

Edit: OldNeurons_RAW_25_344641A вычислено заново.
Edit: ManateeMafia_HP3458A__ID111 вычислено заново.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on July 12, 2018, 10:11:07 pm
нет, Stddev=sqrt(rms^2-ave^2)
Title: Re: DMM Noise comparison testing project
Post by: serg-el on July 12, 2018, 10:19:25 pm
Physical scientists often use the term "root mean square" as a synonym for standard deviation when it can be assumed the input signal has zero mean, i.e., referring to the square root of the mean squared deviation of a signal from a given baseline or fit.[5][6] This is useful for electrical engineers in calculating the "AC only" RMS of a signal. Standard deviation being the root mean square of a signal's variation about the mean, rather than about 0, the DC component is removed (i.e. RMS(signal) = Stdev(signal) if the mean signal is 0).

https://en.m.wikipedia.org/wiki/Root_mean_square
Title: Re: DMM Noise comparison testing project
Post by: dl1640 on July 19, 2018, 10:05:01 am
checked my 6.5 digit DMM today.
with copper short on hi to lo.

setting:
dcv 200mV range, AZON, 25PLC (500ms, 50Hz line), 25 is the largest settable number.
sampling interval 1100ms, single trigger on each and every 1.3s with totally 3600 data.

STDEV for the last 1800 data around 0.102uV, the display resolution is only 0.1uV, not bad.

 :popcorn:
Title: Re: DMM Noise comparison testing project
Post by: knightzdw on December 23, 2018, 09:49:15 am
What meter is used in this case if you don't mind to share?
Title: Re: DMM Noise comparison testing project
Post by: MiDi on May 29, 2019, 03:49:30 pm
Is there ootb script/tool for 3458A and Solartron 7081 for Linux/RPI awailable?
Or at least sourcecode, so that it is easy to derive script?
Title: Re: DMM Noise comparison testing project
Post by: MiDi on June 04, 2019, 03:30:55 pm
Is there ootb script/tool for 3458A and Solartron 7081 for Linux/RPI awailable?
Or at least sourcecode, so that it is easy to derive script?

Seems I have to start from scratch or did I miss something in this long thread or elsewhere?

If there is enough interest, I would get some motivation to make a universal python script to adapt different DMMs easy.
Target is primary linux-gpib and perhaps COM-Port.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on August 31, 2019, 05:10:21 am
This thread has been dormant for a while, but it contains a lot of useful information. In particular, it had been noted here that the shorted input noise is quite small for DMM7510 on low DC voltage ranges, much smaller than for 34461-70 Keysight meters. It turns out a lot of the noise for Keysight meters is due to air flow over the input stage.
https://www.eevblog.com/forum/metrology/turning-fan-off-to-reduce-dmm-voltage-noise/ (https://www.eevblog.com/forum/metrology/turning-fan-off-to-reduce-dmm-voltage-noise/)
This effect was first pointed out by OldNeurons earlier in this thread. https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/msg665603/#msg665603 (https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/msg665603/#msg665603)
With proper air current shield or turning the fan off the noise can be reduced quite a bit. Here is a comparison of Allan deviation for DMM7510, DMM6500 and Keysight 34461 with air cover. One can see that for short averaging times DMM7510 is still the best. But because it does not average well, at longer times 34461 can do just as well.
[attachimg=1]
Title: Re: DMM Noise comparison testing project
Post by: iMo on August 31, 2019, 01:41:29 pm
34401A shorted inputs.
Stddev 42.1nV.
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on September 01, 2019, 12:22:27 am
this pdf cpem-2016-keysight.pdf was mentioned in another thread about noise analysis
of interest is my incomplete understanding about the use of allan variance in finding a certain range of sampling which gives the best SNR
at some point in the 3458A plot, the SNR seem to get smaller

eg : for 10v, the best sampling is 10-20 samples? eye popping 150dB SNR
(150 SNR ~ 26 bits. 26bits @ 10v = 0.15uV per step. the best set of data I have is 0.6uV/24bits for similar range but needs 100x more averaging)
on most plots here in this thread contributed by users, it does not seem like 100NPLC is more noisy on 3458A than 10 NPLC
maybe theirs (on paper) is a different way of measuring?

on K2015, my previous messy data seem to suggest the best capture block is around 8NPLC. weird? but looking into the K2015 pdf, it also seem to suggest similar. with that, back then i then started to play in blocks of 2/4/8 binary increment NPLC blocks with interesting results.

in the other thread about the maths use, I used to think about the use of kurtosis. but after seeing allanvariance, i am imagining some kind of algorithm where there is a real time allanvariance calculation which adjusts NPLC as time progresses to get the most optimum sampling over time. or maybe the user specify a SNR and the software auto determines averaging and NPLC rate for fastest capture possible.
currently all of our captures are fixed NPLC.averaging, but noise and ambient intrusions are variables.

i found 2-3 xls online which has simple allan variance calculations. i tried to do something similar for noise but i could not get the allan variance to work. im sure my math is wrong somewhere  :-DD

lets hope keysight doesnt do this first before one of us does and names it "true-nplc" :-DD
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on September 01, 2019, 08:29:08 am
It is quite normal that there is an optimal integration time to get the best SNR. This because there can be source of 1/f noise in the ADC. In auto zero mode, from some point on it is more effective to use shorter conversions and averaging than one (actually 2 for the AZ mode) long conversions.  The like many modern DMMs the 3458 uses this, and the normal 100 PLC setting is actually the average of 10 readings at 10 PLC. AFAIK there is a way to force it to do linger integration at a piece, but this gives more noise.
The lowest noise point may be even at shorter integrations, but INL may be better at 10 PLC than 1 PLC.
For my ADC design I get best block size at 1 PLC and the DMM7510  seems to be best more around 2 or 3 PLC. It is a balance between 1/f noise and limited resolution / error in reading the final charge.

There is no real need to do some complicates read time calculations to choose the best setting. Close to the optimum it does not make a big difference which setting is used and the best settings are fixed for a given instruments. So just using averaging from a certain point on (e.g. 10 PLC for the 3458) is a good enough solution.  Things get more interesting with those meters that include an extra analog low pass filter before the ADC (e.g. DA1281, Keithley 2182) - there using shorter conversions allows a faster settling analog filter. The filter helps reducing the noise bandwidth seen for the input signal - this does not help much with a short in the 10 V range, but it can help (get the same noise level in half the time) if the signal source itself is noisy or in the low ranges where the amplifier noise is more important than ADC noise.
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on September 01, 2019, 09:04:53 am
Using APER 1 instead of NPLC 50 gives a single conversion,  what you can directly observe in OHM mode, probably valid in DCV mode also.
Title: Re: DMM Noise comparison testing project
Post by: MiDi on December 29, 2019, 11:01:50 pm
Made some measurements with 3458A on 10V and 100PLC.
It seems - at least for this unit - that 100 or even 1000 samples are not enough for "trustworthy" results of StdDev.
For a rolling SD over 100 samples we get values from 74nV to 126nV (+-26%), for 1000 there are 93nV to 113nV (-7% +13%) with overall SD of 100nV for 12184 samples.
At least for me this is surprising, because theorie claims that 100 samples should give "trustworthy" results for SD  :-//


[attach=1]


For comparison with Dr. Franks 3458A (100 samples):

[attach=2]


Edit: added Dataset
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on December 30, 2019, 08:41:42 am
Obviously you have some misconception about statistical methods.

StD as such is only an estimate for the stability of the quantity to be measured, and it's therefore not useful at all to assign itself an uncertainty value.
Usually it's  completely sufficient to take 10 .. 16 samples to get a good estimate for the quantity to be measured, and also that implies that the StD is sufficiently 'stable'.

Taking more samples to 'improve' the StD is counter productive, as you will get instabilities of higher order into your measurements, e.g. mid- and long term drifts.

I refer to a FLUKE seminar about measurement uncertainty, where this is explained nicely. (will link it here, as soon as I find it again)
I also do not understand, which theory you mean, which gives an idea about the 'trustworthiness'  of the StD.. sounds very strange to me.

As you cite my measurements, I just want to refer to the Allan Deviation method, where you get a good picture of instabilities or noise over different timescales.

This method might be, what you are really looking for, and I've done that also on my 3458A.
Here's an example of the combined stabilities of an LTZ1000 and the 3458A.

The 2nd diagram is a similar method, which shows the noise / instability of the 3458A zero reading at different time scales, about 16 samples each point, which is fully sufficient to reconstruct the datasheet.

Frank

For example
Reference, FLUKE: Applying Measurement Uncertainty to Digital Multimeter and Clamp Meter Calibration
http://download.flukecal.com/pub/literature/webinar-uncertainty-presentation-Dec%202011.pdf (http://download.flukecal.com/pub/literature/webinar-uncertainty-presentation-Dec%202011.pdf)



Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 30, 2019, 09:05:46 am
If the noise is just white noise, relatively short sets of readings give good estimates for the standard deviation. However if there is some extra 1/f or popcorn noise or drift or a other superimposed signal the RMS calculation can fluctuate and different lengths may show different values. In this case the Allan deviation plot may be more helpful than just the standard deviation. A single number is just not sufficient to characterize complex noise.

So I would interpret the fluctuations seen in the stD calculated over 100 samples each as an indication that there is not just white noise.
Title: Re: DMM Noise comparison testing project
Post by: MiDi on December 30, 2019, 09:31:52 am
We want to compare the ACRMS/SD of shorts for different DMMs at given PLC and range.
What would be a good method to do this?
For me it seems that this method gives large spread and for that reason even comparing meter to itself seems not appropriate.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 30, 2019, 10:14:45 am
There are a few difficulties with just using the RMS value for the short. One is that the RMS value fluctuates and may also depend on the length of the interval used. So one should use at least the same number of readings.
There is another complication with some meters: the readings done in a short sequence may not be fully independent, as something like the zero reading in AZ mode may be averaged / filtered over a longer time. The worst example is an unnoticed running average filter or settling from sigma delta converters.
With more than just simple white noise it would take more than just 1 number, more like the Allan deviation curve - though difficult to compare between more meters. Reducing it to one number the StD may still not be that bad. The other common choice to give noise is the peak to peak value, but this naturally fluctuates quite a bit and may give to much weight to a few points (especially popcorn noise events).
For the noise I see mainly 3 contributions:
1. simple white noise that is easy to to measure and describe with the StD.
2. slow variations and drift, like thermal effects that may depend on environment.
3. popcorn type noise with more of less sudden jumps that may appear rather infrequent - so a fast test naturally can not capture this correct and it would take really long time to get a reliable picture.


Title: Re: DMM Noise comparison testing project
Post by: maat on December 30, 2019, 11:17:24 am
At least for me this is surprising, because theorie claims that 100 samples should give "trustworthy" results for SD  :-//

I believe you are referring to the sigma of the normal distribution, which goes with 1/sqrt(n). This is only true for truly random events, that have a white noise floor. Most quantities one measures are well above the noise floor and far away from that pesky 1/f part and therefore tend to be more Gaussian in shape, hence a bit of averaging helps. As soon as you hit that 1/f part in the noise spectrum, no averaging will help you there and the standard deviation no longer scales with  1/sqrt(n).

To sum it up, you can always use the RMS value + the bandwidth to compare results. A better picture can be seen using a noise spectral density plot or in this case the Allan Deviation as it a measure for the deviation of successive samples.
Title: Re: DMM Noise comparison testing project
Post by: Dr. Frank on December 30, 2019, 12:26:42 pm
We want to compare the ACRMS/SD of shorts for different DMMs at given PLC and range.
What would be a good method to do this?
For me it seems that this method gives large spread and for that reason even comparing meter to itself seems not appropriate.

Who is 'WE'? Plural Majestic?  :-//

RMS noise and StD share basically the same formula, so under some precautions, like observation of the different noise sources, the StD gives a good estimate for the noise figures, as I have demonstrated with my diagram for apertures ranging from 1.4µs to NPLC of 1000.
I can't observe, that there is a large spread, compared to the hp specification, and also within the whole graph.
Please also take notice, that such measurements are always plotted on a logarithmic scale, so small variations do not play a role.

And again, for noise measurements the Allan Deviation is the appropriate, broadly accepted, and maybe more 'exact' method of choice.
This is mostly used in time measurements, like stability of oscillators, but can as well be applied to any other stability / noise measurements.

The freely available programs PLOTTER by Ulrich Bangert, or STABLE32 both have all necessary tools on board.

http://www.ulrich-bangert.de/html/downloads.html (http://www.ulrich-bangert.de/html/downloads.html)
https://ieee-uffc.org/frequency-control/frequency-control-software/stable32/ (https://ieee-uffc.org/frequency-control/frequency-control-software/stable32/)

John Miles TimeLab also contains Allan Deviation, together with acquisition software for many T.I. and frequency counters, but unfortunately not for voltage instruments. But maybe there you can find further information about stability / noise measurements.

http://www.ke5fx.com/timelab/readme.htm (http://www.ke5fx.com/timelab/readme.htm)

Therefore you have to write your acquisition program for your 3458A on your own.
Frank
Title: Re: DMM Noise comparison testing project
Post by: MiDi on December 30, 2019, 05:32:34 pm
...
Usually it's  completely sufficient to take 10 .. 16 samples to get a good estimate for the quantity to be measured, and also that implies that the StD is sufficiently 'stable'.

Taking more samples to 'improve' the StD is counter productive, as you will get instabilities of higher order into your measurements, e.g. mid- and long term drifts.
...
As you cite my measurements, I just want to refer to the Allan Deviation method, where you get a good picture of instabilities or noise over different timescales.
...

If the noise is just white noise, relatively short sets of readings give good estimates for the standard deviation. However if there is some extra 1/f or popcorn noise or drift or a other superimposed signal the RMS calculation can fluctuate and different lengths may show different values. In this case the Allan deviation plot may be more helpful than just the standard deviation. A single number is just not sufficient to characterize complex noise.

So I would interpret the fluctuations seen in the stD calculated over 100 samples each as an indication that there is not just white noise.

...
RMS noise and StD share basically the same formula, so under some precautions, like observation of the different noise sources, the StD gives a good estimate for the noise figures, as I have demonstrated with my diagram for apertures ranging from 1.4µs to NPLC of 1000.
I can't observe, that there is a large spread, compared to the hp specification, and also within the whole graph.
Please also take notice, that such measurements are always plotted on a logarithmic scale, so small variations do not play a role.
...

For comparison, the dataset was filled with pure white noise (16154 samples, SD 100nV, mean 1.53µV - same as original Data).
With several runs with different white noise sets I get (limited represantative):

rolling SD(10)rolling SD(100)rolling SD(1000)SD(16154)
multiple runs white noise~+-50...100%~+-20...30%~+-5...10%100nV <+-1%
original dataset-72% +80%-26% +26%-7% +13%100nV

An Example with white noise is attached.

The spreading of rolling ACRMS/SD over white noise for short sets with 10 samples are in the range of ~0...200nV.
In the context of comparison I would not call that good estimates for given ACRMS/SD of 100nV over all samples.
If this is my misconception of statistical methods for this purpose: I can suffer, so slap me hard on the head :horse:

In contradiction for large sets the ACRMS/SD may be dominated by other noise sources, as you already stated.
I am wondering if it would be appropriate to use rolling ACRMS/SD with short sets on a large dataset and take e.g. the Mean of all rolling ACRMS/SD?
Intention is to have a high-pass filter to get rid of probably dominant LF Noise Sources (Drift, TC, popcorn-noise?) whilst maintaining good approximation of the remaining mostly white noise part.
Clearly there is not one number to deal with "complex" noise, but if it is possible to separate appropriate into a couple of numbers for different noise types and other influences, this would have value.


The shorted DMM seems to have mostly white noise, but you are right, for deeper insight the Allan deviation would be helpful.

We want to compare the ACRMS/SD of shorts for different DMMs at given PLC and range.

Who is 'WE'? Plural Majestic?  :-//

'WE' meant in the sense the participants in "DMM Noise comparison testing project"
I am pretty shure you got the point  ;)
Title: Re: DMM Noise comparison testing project
Post by: MiDi on December 31, 2019, 12:04:01 am
Trying to answer the remaining question:
...
I also do not understand, which theory you mean, which gives an idea about the 'trustworthiness'  of the StD.. sounds very strange to me.
...
Reference, FLUKE: Applying Measurement Uncertainty to Digital Multimeter and Clamp Meter Calibration
http://download.flukecal.com/pub/literature/webinar-uncertainty-presentation-Dec%202011.pdf (http://download.flukecal.com/pub/literature/webinar-uncertainty-presentation-Dec%202011.pdf)

What I meant is the transition from student t to standard distribution for higher count of given values (degrees of freedom).
In the linked Fluke document on p. 54 the adjustment factors are plotted for different degrees of freedom.
For a coverage factor of 1 to 3 (Sigma) with 100 degrees of freedom the adjustment factors are not significant (<<10% deviation).
From this I derived the misconception that 100 values would be sufficient to get ACRMS values with sufficient confidence ("trustworthy") for comparison - seems I am not the only one: this is the point of my discussion.

PS: I had that figure only in mind, but good to have the confirmation from the Fluke document p. 54.

Thank you all for the valuable suggestions & links.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on December 31, 2019, 10:37:59 pm
In contradiction for large sets the ACRMS/SD may be dominated by other noise sources, as you already stated.
I am wondering if it would be appropriate to use rolling ACRMS/SD with short sets on a large dataset and take e.g. the Mean of all rolling ACRMS/SD?
Intention is to have a high-pass filter to get rid of probably dominant LF Noise Sources (Drift, TC, popcorn-noise?) whilst maintaining good approximation of the remaining mostly white noise part.
Clearly there is not one number to deal with "complex" noise, but if it is possible to separate appropriate into a couple of numbers for different noise types and other influences, this would have value.

The shorted DMM seems to have mostly white noise, but you are right, for deeper insight the Allan deviation would be helpful.

Using the average over the SD calculated over shorter subsets is kind of doing some high pass filtering, taking out very slow processes like drift and some 1/f noise. So this may be appropriate. However it should not help with the general limitation of all noise estimators. It just takes quite a lot of samples to get a low uncertainty for the noise estimate. So 100 samples is well good enough to need to worry about the limited number of degrees of freedom and thus the correction factor.  However the SD calculated from 100 samples can still show quite some noise, even with the ideal white noise data.  So for a normal measurement 100 samples are OK to calculate the uncertainty - usually one does not really are if an measurement is +-1.0 % or +- 1.2 %. It is not uncommon that the uncertainty is not known very well.  However when noise is the main interest 10 or 12 may be a significant difference.

In this sense the Fluke Webinar contains a flaw: they use just 6 readings to calculate the statistical part of the error as +-25.5 mA. However these +-25.5 mA have a large uncertainty - it could as well be 15 mA or 50 mA with quite some probability. So rounding to 30 would probably be appropriate. With so much uncertainty in the error, there is little sense in calculating the exact correction factor from the limited degrees of freedom. :-//
6 readings may be OK to get the value, but they are not at all good to get a good estimate of the statistical error.

With 100 readings resulting in +-25% (I assume this are the extremes) scattering, this may be just the lower limit to get a useful noise estimate. More would definitely be better, though it should only improve like the square root. At least for the shorter PLC settings 1000 readings are possible - with longer integration this gets slow and more sensitive to drift.
Title: Re: DMM Noise comparison testing project
Post by: 3roomlab on January 01, 2020, 06:18:14 am
TTEST stats function in opencalc
hmmm fascinating
i tried this in 1 of my old data
TTEST(x;y;2;2) = 0.13497 (n=70, NPLC10 10v, 1.5s interval per sample)
TTEST(x;y;2;2) = 0.2917 (n=25 .... )

samples from near the top, and samples from near the middle in a span of 3600 samples.
Title: Re: DMM Noise comparison testing project
Post by: branadic on February 03, 2020, 06:53:24 am
AD774x series are capacitance to digital converters (CDC) based on sigma delta ADCs, thus you want to express noise in terms of the input parameter, which is capacity here.

-branadic-
Title: Re: DMM Noise comparison testing project
Post by: jchw4 on March 23, 2020, 10:53:15 am
My 34401A. I bought it used, history is unknown.

Code: [Select]
*IDN?
HEWLETT-PACKARD,34401A,0,7-5-2
cal:count?
+42
cal:str?
"15 FEB 1996 26.2C"
(Why 26.2C? Who knows?)


Script:
Code: [Select]
*RST
*CLS
CONFIGURE:VOLTAGE:DC 10V,MIN
VOLTAGE:DC:NPLC 1
SENSE:DETECTOR:BANDWIDTH MAX
SENSe:ZERO:AUTO ON
INPUT:IMPEDANCE:AUTO ON
TRIGGER:SOURCE IMMEDIATE
SAMPLE:COUNT 50
Then
Code: [Select]
READ? in a loop.

I repeated the same script for NPLC 10 and 100.

Horizontal axis is minutes from logging start.

34401A User Manual has this table:
Code: [Select]
Integration time Resolution
1 NPLC           0.000003 x Full-Scale
10 NPLC          0.000001 x Full-Scale
100 NPLC         0.0000003 x Full-Scale

It seems that the noise is below the stated resolution, which is definitely good!
I wonder why the meter has negative offset for 1NPLC, positive offset for 10NPLC and no offset at all for 100NPLC.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on March 23, 2020, 12:41:25 pm
Chances are the zero adjustment was done with 100 PLC - so no offset there is no surprise.
Than having some offset with 10 PLC is a surprise indeed, as the 100 PLC more is supposed to be the average over 10 of the 10 PLC readings.
The PLC can be a little different, with more effect from amplifier settling / switching transients.
There could also be different zero constants with the faster modes not adjusted as careful / recent.
The temperature vales should be the internal temperature during the last calibration way back. The absolute value may not be very accurate.
Title: Re: DMM Noise comparison testing project
Post by: jchw4 on April 05, 2020, 08:40:50 pm
This is Mooshimeter (https://www.eevblog.com/forum/crowd-funded-projects/mooshimeter-wireless-smartphone-multimetre/ (https://www.eevblog.com/forum/crowd-funded-projects/mooshimeter-wireless-smartphone-multimetre/), https://moosh.im/ (https://moosh.im/)).

I bought one of the last stock from DigiKey half a year ago. Now it's all gone everywhere. Time to do some noise measurements  ;)

I don't have proper short for it, so I used Keithley 8640 plugged in as  "AUX + VOLT" ~ Input, "VOLTS + CURRENT" ~ Sense (if it makes any sense, but you can imagine the meter oriented vertically with sockets on the bottom, and 4-wire short oriented vertically).

I also did not check the temperature, but hopefully it was well isolated wrapped in a bubble wrap and put into a drawer.

Configuration:
- "VOLTAGE DC 60V" range for main input (available ranges 60V and 600V).
- "AUXILIARY VOLTAGE DC 1.2V"  for the second input (available ranges 1.2V, 300mv, 100mv).

"RPS" =~ "Records per Second" to an SD card.

Q(0.9) = 90% Quantile of the StdDev over the graph.

Horizontal axis is minutes. Averaging is per-minute, so each graph is 30 points.

It looks it's decent 5.5 digit meter on main input (I would ignore 6.5 possible with <2 RPS) and 6.1 digit on AUX input!
(with up to 6.5 and 7.1 digit possible with 1 - 0.5 RPS on each channel).

WDYT?

Title: Re: DMM Noise comparison testing project
Post by: MegaVolt on July 01, 2020, 10:17:34 pm
Once I saw just such a picture for the coolest 3458a multimeter and wanted to repeat it.

[attach=4]

Here are the results:

Keithley DMM7510 noise:

Just a little more words and details here: https://www.eevblog.com/forum/testgear/all-about-keithley-dmm7510-bugs-and-features-recipes-advice-notes/msg3115140/#msg3115140 (https://www.eevblog.com/forum/testgear/all-about-keithley-dmm7510-bugs-and-features-recipes-advice-notes/msg3115140/#msg3115140)

Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on March 18, 2021, 09:39:34 am
Does a 1 PLC reading with the 6500 really take 50 ms. Nomally I would expect just a little over 40 ms, e.g. some 42 ms.
The vertical scale seems to be in volts (not ppm) - still the noise for the 100 PLC mode looks quite high, because of the keithley typical hump at some 20 seconds.  It is odd that they have still not fixed this - this seems to go back quite a bit, likely a left over from the brown 19x series.
The 1 PLC mode with averaging seems so be slightly better than 100 PLC directly, though not much.
Title: Re: DMM Noise comparison testing project
Post by: guenthert on March 18, 2021, 05:11:34 pm
Agilent 34410A noise

10VDC, 100NPLC, Auto-Zero, Fluke 4W short.
(https://ampnuts.com/wp-content/uploads/2021/03/34410A_raw.png)
[..]
     This is an awfully long thread and I'm sure it has been explained before, but perhaps for readers as lazy as me, it might be worth to restate (every 10 pages or so ;-} how this measurement was made.  Variations in measurement less than 0.1 ppm on a 6.5 digit meter are worth expanding on, methinks.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on March 18, 2021, 06:06:16 pm
Most modern higher resolution DMMs (that is newer than the early 1980s) usually have higher internal numerical resolution and use a numeric scale factor for the calibration.
So 1 LSB step of the ADC no longer corresponds to 1 display step. The PC interface often give data with the full internal resulution (e.g. more digits than actually valid from the internals).

The display resolution is choosen depending on the noise and accuracy (linearity and zero stability), but there is no simple universal rule what to choose. Especially for the longer integration time the internal resolution and noise limit can be quite a bit better than the display resolution.
The HP34410 is quite a bit lower noise than the predecessor 34401, but still sold as a 6.5 digit meter - in part because the reference and accuracy are limiting, not so much the noise. The noise also depends on the integration time. 100 PLC is usually something like the average of 10 conversins at 10 PC and thus some factor 3.2 lower noise than 10 PLC (except for many Keithly meters that get the averaging /auto zero wrong).
Modern meters often reach there nominal 6 digits with 1 PLC while some old meter needed 100 PLC and maybe even longer.

The relatively common LM399 referene is usually considered not good for more than 6.5 digits and there are thus only few meters with more digits, even though the noise can be quite a bit lower than the early 6 digit meters or comparable to 7 digit meters. The main difference between the 6 digit KS34465 and 7 digit KS34470 is the bettter reference in the 34470.
Purely from the ADC noise the 34410 is lower noise than even some old 8 digit meters (e.g. Solartron7081 and Keithly 2002 for some cases). The noise test with a short is not everything.
Title: Re: DMM Noise comparison testing project
Post by: bsw_m on March 28, 2021, 11:06:28 pm
V7-54/2 6.5 DMM developed in MNIPI
20V range, 2.56s integration time.
Sorry, cannot calculate Allan variance for this dmm.  :)
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on March 29, 2021, 06:39:10 am
V7-54/2 6.5 DMM developed in MNIPI
20V range, 2.56s integration time.
Sorry, cannot calculate Allan variance for this dmm.  :)
The data somehow have insuficient resolution. There is still some variation, but just +0 and -0.  So one would need to change the data format. One may have to use shorter integration to get useful data, that are no longer limited by ouput quantization.
So far one can only conclude that the peak to peak noise seems to be less than 10 µV and thus internal RMS noise less than some 2 µV. This is relatively good for a 6.5 digit meter with a 20 V range.
Title: Re: DMM Noise comparison testing project
Post by: bsw_m on April 09, 2021, 07:35:12 pm
V7-54/2
2 volts range, 2.56s integration time. About 34 hours log:
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on April 09, 2021, 07:39:07 pm
V7-54/2
1 volts range, 2.56s integration time. About 34 hours log:

For me the data just show zero - so no use full information at all. There seems to be the same problem with insufficient number of digits in the data to measure the noise.
Title: Re: DMM Noise comparison testing project
Post by: bsw_m on April 09, 2021, 07:43:52 pm
57 data lines with +0.000001 from 47982 lines.
About resolution: this is maximum resolution for ADC in this metter.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on April 09, 2021, 08:37:09 pm
Even with a few 1 µV reading one can not tell very much from the data. One can give an upper bound for the peak to peak noise of about 2 µV and thus some 330 nV for the RMS noise.
One might get slightly more noise and thus a better chance to see something with shorter integration.
Title: Re: DMM Noise comparison testing project
Post by: bsw_m on April 10, 2021, 06:10:25 am
shorter integration.
Shorter integration time for this type ADC = less resolution.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on April 10, 2021, 08:00:11 am
With a limited number of digits at the output, the simple normal distribution picture for noise no longer works.  Describing the noise would need more than just the std. deviation. One could take the quatization effect seprate and try to estimate the noise in the transition before the quantization. It is a little more tricky, but still possible. It is a little more like the methods used for low resolution ADCs (e.g. 8 bits) where it is more common to have the quantization dominating the noise. The added difficulty here is that the DMM is relatively slow and drift may be an issue.

One gets essentially 2 possible readings at a given input voltage level and the result is the percentage of readings showing the higher value for something like a few 100 readings.
One can than apply a small constant voltage (one the order of a few 100 nV) and than observe how the result (percentage of higher readings) changes. This way one kind of checks the distribution function at a few different offsets. To get an idea of the steepness of the step one would ideally like some 2-3 points between 20 % and 80%.

Limiting the resolution only to those digits that are really stable adds a bit quatization noise. This is usually OK to do with the display for manual reading, but for the computer it is nice to have the raw data without the extra rounding noise. 12 digits are overdoing it a bit, but 1-2 extra digits at the computer interface are good practice. The PC can still decide to save fewer digits in case memory is low.  For a modern 6 digit DMM i don't think that the ADC's LSB steps are directly linked to the display steps (e.g. like in the old ICL7106 based DMMs). So there should be a slightly higher internal resolution to apply a numerical scale factor without extra rounding errors.
Title: Re: DMM Noise comparison testing project
Post by: TiN on April 21, 2021, 06:12:38 am
Little fun test with nanovoltmeters:

(https://xdevs.com/doc/HP_Agilent_Keysight/34420A/btest/nvms_compare_zero_short_1.png) (https://xdevs.com/doc/HP_Agilent_Keysight/34420A/btest/nvms_compare_zero_short.png)

Settings for each instrument:

Keysight 34420A

Fixed ranges 10mV, 1mV (and 100mV,1V,10V present in RAW data but not plotted).
Meter warmed up (weeks of runtime).
Channel 1 used, NPLC 50, MAX 7.5 digit resolution
Original Keysight 34420A shorting plug used as zero source

Keithley 2182A

Fixed range 10mV.
Meter warmed up (weeks of runtime).
Channel 1 used, NPLC 5, MAX 7.5 digit resolution
Autozero and front-end autozero enabed. ACAL was not performed during whole log duration.
Second original Keysight 34420A shorting plug used as zero source.

Keithley 1801 (digitized and powered by Keithley 2002)

Fixed range 20 uV, later switched to 200uV towards the end of the plot.
Keithley 1801 amplifier was placed in thermal chamber and cycled from +18 to +30°C.
NPLC 20, 8.5 digit mode, rear terminals used. Digital filter 10.
Analog amplifier filter set to SLOW (50uF) at the beginning of the log, later switched to FAST.
Bare copper wire short mounted right at the amplifier input M3 rods.
No warmup, turned on minutes before datalog started.

RAW data in CSV-ish format (semicolon separated) (https://xdevs.com/datashort/732bx_tempco2_nvzeros_fflab_3458abc_apr2021.dsv).
Title: Re: DMM Noise comparison testing project
Post by: bsw_m on April 23, 2021, 03:34:47 pm
24 hour data for 0.2V range
Multimeter: V7-54/2
Setting: sample per 2.56s (6.5 digit mode)
Environment: total uncontrolled (about 7 Celsius temperature different, dirty line voltage and other antimetrology things. Now this DMM used in metal processing workshop with heavy machine tools, like a milling machine weighing 60 tons, and welding machines )
 
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on April 23, 2021, 04:19:25 pm
The noise data for the V7-54/2 look about normal for a 6 digit meter. Not especially good, but not bad either. At least not Keithley typical extra hump in the 10-100 s range. The reading rate is rather slow, but the amplifier noise looks about normal for an input amplifier. As expected the 0.2 V range is more limied by the amplifier and not the ADC's quantization.
Title: Re: DMM Noise comparison testing project
Post by: bsw_m on April 23, 2021, 04:23:34 pm
0.2 V range is more limied by the amplifier and not the ADC's quantization.
You right!
Some interesting fact for this input amplifier. Please note to input bias current.
Amplifier is little bit noisy, but have very low input bias current (~0.07pA).
Title: Re: DMM Noise comparison testing project
Post by: MegaVolt on April 24, 2021, 12:16:22 pm
Amplifier is little bit noisy, but have very low input bias current (~0.07pA).
Is there a schematics or other details?  What transistor is at the input?  How are the protection circuits made?
Title: Re: DMM Noise comparison testing project
Post by: bsw_m on April 24, 2021, 11:21:33 pm
Amplifier is little bit noisy, but have very low input bias current (~0.07pA).
  What transistor is at the input?  How are the protection circuits made?

As an input differential pair, a custom hybrid transistor assembly with full custom transitors die (developed and produced in MNIPI) US006 is used, containing 2 differential jfet pairs.
The absolute maximum input current for it is no more than 3pA
Dual jfet 2PS104 are used as protective diodes with low leakage.
some time ago I uploaded a photo of the schematic diagram to the cloud storage to share it on Russian-language forums: https://disk.yandex.ru/i/SuMbouTaVEutcA
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on April 25, 2021, 10:00:51 am
The circuit looks strange for modern times - still using a photoresistor chopper, at least allready with LEDs and no neons. less than 1 pA bias suggests that there is some adjustment/compensation of the current of some kind (should be possible through the LDR chopper).
Title: Re: DMM Noise comparison testing project
Post by: bsw_m on April 25, 2021, 05:42:00 pm
You defeated me. :o
Oops  :) Have you measured the input bias current? ::)

Keysight B2985A noise.

2pA range, 100NPLC, input closed with dust cap.

V7-49
Uncontrolled environment.
Filter on.
2pA range, input closed by cap.
About 13hours data collection.

Due raw data file is too large to attach. I'm upload this to cloud disk: https://disk.yandex.ru/d/QeBi84xEmjFU2A
Title: Re: DMM Noise comparison testing project
Post by: bsw_m on April 25, 2021, 05:58:19 pm
The circuit looks strange for modern times - still using a photoresistor chopper, at least allready with LEDs and no neons. less than 1 pA bias suggests that there is some adjustment/compensation of the current of some kind (should be possible through the LDR chopper).
This DMM start development in late 80, and production start in about 1991-1992 year.
photoresistor chopper - developed in MNIPI for low termal EMF, low noise and some other things. Named OR46
Compensation for bias current not used/present, this can be seen in the schematic diagram.

Hmm.... may be I need start topic for this DMM?   ???
Title: Re: DMM Noise comparison testing project
Post by: dietert1 on December 14, 2021, 06:52:18 am
Another noise test of a Keithley 2182A nanovoltmeter:
 
K2182A settings:
:SYST:AZER? => "1"
:SYST:FAZ? => "1"
:SYST:LSYN? => "1"
CH1, 10 mV range
1 PLC
240V AC setting with 220 V synthetic mains supply (DDS generator + power amplifier + transformer)
Meter is inside cardbox
Internal input short (solder bridge)

Logging every 5 seconds. On average 25 samples + int temperature reading take 4.256 secs per point.
Since the K2182A will be used with a low thermal mux, both analog and digital filters are off.

Result:
Clean 3 hour log with 1.4 nV rms standard deviation over 2160 points!
bottom up noise = average of standard deviation of 25 samples per point / 5
top down noise = standard deviation of point to point differences / sqrt(2)

Regards, Dieter

Edit: A step from 220 => 210 V AC resulted in a zero shift of about 23 nV. Half of that happened within minutes, the other half took 1.5 hours. Probably isolated power supply first and then mains transformer heat-up. In total about 5 nV for each % of mains voltage deviation. My synthetic mains setup is good for about 0.1 %. A second K2182A exhibits the same problem.
Title: Re: DMM Noise comparison testing project
Post by: _pv on May 23, 2022, 03:53:12 pm
without autozero

data: https://github.com/pavel212/noise
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on May 23, 2022, 04:30:05 pm
The curves for the 3458 and 2182 DMMs show quite some dips at 20 ms and 40 ms integration. This suggests that there is quite some residual hum in the signal, and not just noise.
Title: Re: DMM Noise comparison testing project
Post by: _pv on May 23, 2022, 05:26:46 pm
The curves for the 3458 and 2182 DMMs show quite some dips at 20 ms and 40 ms integration. This suggests that there is quite some residual hum in the signal, and not just noise.
inputs are just directly shortened with 0 Ohm, what else could i do.
all the questions to voltmeter manufacturers why PSRR is that bad, so it is visible with shorted inputs when aperture time is not an integer number of PLC.
Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on May 23, 2022, 05:37:15 pm
Thanks for this great summary plot and welcome to the message board!
What does NMV stand for?
Title: Re: DMM Noise comparison testing project
Post by: _pv on May 23, 2022, 05:42:41 pm
NMV stands for a typo in NVM:
https://github.com/jaromir-sukuba/nvm/tree/main/measurement_data
Title: Re: DMM Noise comparison testing project
Post by: MegaVolt on May 23, 2022, 05:53:45 pm
The curves for the 3458 and 2182 DMMs show quite some dips at 20 ms and 40 ms integration. This suggests that there is quite some residual hum in the signal, and not just noise.
Keithley 7510 shows the same behavior.

https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/msg3115162/#msg3115162 (https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/msg3115162/#msg3115162)
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on May 23, 2022, 06:19:30 pm
The curves for the 3458 and 2182 DMMs show quite some dips at 20 ms and 40 ms integration. This suggests that there is quite some residual hum in the signal, and not just noise.
inputs are just directly shortened with 0 Ohm, what else could i do.
all the questions to voltmeter manufacturers why PSRR is that bad, so it is visible with shorted inputs when aperture time is not an integer number of PLC.
The amplitude goes down at 20 ms, but not much at 10 ms integration. So the background is more 50 Hz hum and not 100 Hz. I would suspect magnetic coupling, either from the DMM internal transformer or other transformers or similar sources of a magnetic field. External fields could be shielded with some steel or just reduced with more distange, or a less susceptible position. For the 3458 the connection at the guard terminal can also make a different. Chances are it should be connected to COM for the noise test.
Title: Re: DMM Noise comparison testing project
Post by: _pv on May 23, 2022, 10:37:49 pm
The amplitude goes down at 20 ms, but not much at 10 ms integration.I would suspect magnetic coupling
yes, for poor PSRR rectified 100Hz should be present, but
for magnetic coupling in order to induce some microvolt * 10ms on a some few cm^2 loops require magnetic fields more than earth field, which i'm pretty sure i do not have in the lab where some of these noise plots were measured.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on May 24, 2022, 07:28:59 am
Looking at the numbers an external magnetic field is unlikely. 1 cm² area and 1 µV hum would need some 33 µT, which is unlikely, though still within permitted safety limit of 100 µT. More typical fields in the lab should be less than 1 µT. The 3458 circuit is physical quite large and may have a larger effective area, but hardly that large, unless they made a big misstake (e.g. have some magnetic material inside the area to amplify the effect / concentrate the field).

There is still the meter internal stray field from the transformer. This can be more a problem with 50 Hz than 60 Hz as the magnetization would usually run higher. With transformers primary designed for 60 Hz operation this can become a problem, especially with more audible hum at 50 Hz.


For the 3458 the question is, if the guard is connected to low and maybe also to ground. This can effect capacitive coupling.
Title: Re: DMM Noise comparison testing project
Post by: _pv on May 24, 2022, 11:48:16 am
For 3458A it was just a "floating" shortened input without guard connected to LO button.
And if it is not PSRR, then it is awful CMRR, as it is still 0 Ohm shortened input, and you could not inject much onto a 0 Ohm through capacitive coupling differentially.
And for common mode there is also no tesla coil or similar stuff around with huge electric fields, especially at 50Hz.

Keithley do not have guard terminal at all, just a diff input, and behave the same.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on May 24, 2022, 01:00:51 pm
The protection for the voltage input has some resistance (10 K for the 3458) in series. So the actual amplifier does not see a dead short but these 10 K. The 3458 has a switch to connect the guard to lo for a reason. The protection in the 2182 should be rather low resistance, so I would not expect capacitive coupling to be an issue.

The visible about 1 µV of 50 Hz hum is also not very much. In most cases the extra suppression from integration over 1 or 10 PLC would deal with this. The extra CMRR from integration over mains periods is in the 60 dB range and better (depending on how good the mains frequency is). It is only with the shorter integration time that it really matters. They have the gurad terminal and a switch to connect to low if wanted to improve on the CMRR.
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on June 14, 2022, 01:37:50 pm
Do these look right? i.e. is the K2182A much better than the 34420A re noise?

Alan

Title: Re: DMM Noise comparison testing project
Post by: maxwell3e10 on June 14, 2022, 02:38:15 pm
The problem with K2182A is that it doesn't integrate well for longer times. The 0.01V scale noise never really goes below 1 ppm=10nV. In contrast, 34420 noise improves as 1/sqrt(t) as it should, and crosses 1 nV at a time of a few seconds.
Title: Re: DMM Noise comparison testing project
Post by: dietert1 on June 14, 2022, 03:25:54 pm
Above you will find how i obtained 1.4 nVrms for 5 second integration time with the K2182A. I used it's built in data buffer and averaged 40 samples. That was without any mods. So I'd guess the two intruments aren't so much different. Rather it is very easy at that level to introduce thermal EMF, e.g. in the front panel connector.
In the thread about multiplexers for monitoring voltage references i posted some results with the K2182A. They show how to make the instrument work stable to 1 nV over a week or so with the help of a relay multiplexer.

Regards, Dieter
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on June 14, 2022, 04:23:29 pm
The data for the 2182 look suspeciously good at 1 PLC and not that good for longer integration. There may be some hidden digital filtering or maybe not using simple AZ mode.
The Keithley 2182 gets extra complication from having separate auto zero settings for the ADC and input amplifier and some extra analog filtering. So it really depends on the settings and in some cases there is extra settling time. The NPLC setting alone can be misleading, even without extra digital filtering. The case with input chopping, but no AZ mode for the ADC is also a bit misleading, allowing good performance over a short time, but some 1/f noise and drift over the long run.
Working well at 1 PLC and not so good with longer integration is a problem with many Keithley meters - not just the 2182. My suspision is some hidden digital filtering that improves on the 1PLC noise at the costs of extra noise at 100 PLC.
The ADC in the K2182 has a potential for good noise, possibly approaching the K2002 and K2010 noise performance, as these are not that much different. In parts they seem to compromise INL for noise.

For shorter integration the 34420 is limited by the ADC: it is the same ADC as in the 34401 and for less than 10 PLC (and maybe even at 10 PLC) limited by quantization noise. It is kind of a very good input amplifier, but a relatively noisy ADC, especially at 1 PLC, but also the 10 PLC ADC performance is not great.
Title: Re: DMM Noise comparison testing project
Post by: bsw_m on June 14, 2022, 06:52:32 pm
10hours noise & stability of 33years old V2-38 nanovoltmeter:
10uV range no filter no dumping. Plotted raw data.
Title: Re: DMM Noise comparison testing project
Post by: dietert1 on June 14, 2022, 09:11:12 pm
What is the data rate? Do you know how to calculate the standard deviation?

Regards, Dieter
Title: Re: DMM Noise comparison testing project
Post by: bsw_m on June 14, 2022, 09:27:36 pm
What is the data rate?
Data rate is 3sps.
Do you know how to calculate the standard deviation?
Stdev=1.2nV

Regards, Alexey
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on June 15, 2022, 08:23:42 am
>>> The data for the 2182 look suspeciously good at 1 PLC and not that good for longer integration. There may be some hidden digital filtering or maybe not using simple AZ mode.

The noise specs below do seem to suggest that the marketing folks have picked only the NPLC=1 case to demonstrate noise results with no filter.

I'll check my code and maybe run again - it certainly looks like it always selects AZ mode.

>>>
he ADC in the K2182 has a potential for good noise, possibly approaching the K2002 and K2010 noise performance, as these are not that much different. In parts they seem to compromise INL for noise.

For shorter integration the 34420 is limited by the ADC: it is the same ADC as in the 34401 and for less than 10 PLC (and maybe even at 10 PLC) limited by quantization noise. It is kind of a very good input amplifier, but a relatively noisy ADC, especially at 1 PLC, but also the 10 PLC ADC performance is not great.
<<<

Ah, interesting insights.

Alan
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on June 15, 2022, 01:03:01 pm
The noise specs aready include the relatively high noise for the slower cases. So it is not only the 1 PLC case and some of the more disappointing case are included. Some of the numbers look odd, like only about a factor of 2 (or even less for the 100 mV / 1 V range) improvement (instead of square root of 10) for the step from 1 PLC to 10 PLC. One the other hand the step from 18 PLC  to 50 PLC helps more than is should in the 1 V range.  Chances are the 600 nV for 18 PLC in the 1 V range is wrong as channel 2 got better specs in this case.

The measured noise for the 10 V range and 1 PLC is close to the specs - so the ADC really seems to be that good.


Giving the settling time to a varying noise level is a bit strange. The settling may also depend on the range, as it looks like the lower ranges include some analog filtering. Chances are the 10 V range settles faster than others.

There are seprate specs for the reading speed and these indicate that the DMM is spending quite some extra time: e.g.  15 readings per second for 1 PLC (50Hz) instead of some 24/s as expected for a simple 2 conversions AZ cycle. There is something else going on, like additional zero readings or reference readings for the scale factor like in the K19x).  For actual use the reading rate can be the more important parameter than the actual integration time.
Title: Re: DMM Noise comparison testing project
Post by: _pv on June 15, 2022, 02:41:31 pm
10hours noise & stability of 33years old V2-38 nanovoltmeter:
10uV range no filter no dumping. Plotted raw data.
could you please share raw data as well?
Title: Re: DMM Noise comparison testing project
Post by: bsw_m on June 15, 2022, 07:03:50 pm
could you please share raw data as well?
No problem!
Measurements were made on the range of 10 μV
First column is time in unixtime format. Second column - data from nanovoltmeter.
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on June 16, 2022, 11:05:24 am
Ah, two conversations going at once :)

Re Kleinstein's thoughts:

>>>  So it is not only the 1 PLC case and some of the more disappointing case are included.

As the only no-filter specs were 1 nplc, those were the only ones I used for comparison with my no-filter tests. I agree that the specs are confusing - maybe innocently, they're using some 'real world' examples. And I don't pretend to fully understand the noise specs because of the '2D' combination of nplc & filter data points. There's probably some rationale there but I don't quite see what it is. Is the response time really 'the time you realistically need to wait for the results to settle' rather than an input variable and should therefore really be one of the rightmost columns?

For the 34420A (below) I noted the official specs on the original graph for the 1mV range of 16 and 1.4 ppm at 1 & 200  nplc - although right now (the actual tests were done some time ago), I can't see where I got those from. However, I've also added the 100 nplc official specs on the graph (also below). All said, I'm thinking my K2182A & 34420A results roughly match the official specs and so my analysis is good. Any thoughts on that?

Alan

p.s. I still need to double check the two 2182A auto zero settings ('Front Autozero' and 'Autozero') I used in the test.
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on June 16, 2022, 12:03:44 pm
The digital filter is simple averaging. So one has to multiply the PLC setting and fitler setting to get the total integration time. Many meters automatic convert PLC settings larger than 10 to real intgration of some 10 PLC and than use averaging as digital filtering.
Title: Re: DMM Noise comparison testing project
Post by: _pv on June 16, 2022, 02:04:40 pm
Measurements were made on the range of 10 μV
Just updated the plot,
and "noise" here is StDev over 10 consecutive measurements at given averaging time
Title: Re: DMM Noise comparison testing project
Post by: alanambrose on June 16, 2022, 03:06:29 pm
>>> The digital filter is simple averaging. So one has to multiply the PLC setting and fitler setting to get the total integration time. Many meters automatic convert PLC settings larger than 10 to real intgration of some 10 PLC and than use averaging as digital filtering.

OK understand, that makes perfect sense.

Alan
Title: Re: DMM Noise comparison testing project
Post by: n_haku on October 13, 2022, 12:53:41 pm
Mine data from ad7461a. Though cal expired approx half year ago, it should not affect in adc zero noise measue. Data are srtaight, w/o any math, after well warmed, (>2h), rear input shorted with bare copper wire, every run 30 min lenght.
If matters, I can collect data for longer periods, when dmm not used.

PS: as there seems no dedicated thread for equipment's ROMs, I'll also attach dumps for tr6861, r6144, r6551. I checked function work before read.
Title: Re: DMM Noise comparison testing project
Post by: MegaVolt on October 13, 2022, 12:57:47 pm
Mine data from ad7461a.
What is the y-axis dimension?
Title: Re: DMM Noise comparison testing project
Post by: n_haku on October 13, 2022, 01:38:58 pm
What is the y-axis dimension?
Since no math applied, its in lsb of range, ie 10uV for 10V, 1uV for 1V, 0.1uV for 100mV, and cause max readings are 1e6, it become ppm of range.
Title: Re: DMM Noise comparison testing project
Post by: zrq on January 22, 2023, 01:58:07 pm
Reviving this thread with some data taken from a Keithley 2001M with front input shorted.
It's noise is very disappointing:
1. almost a order of magnitude higher than modern 7.5 digits and some 6.5 digits DMMs
2. can hardly be averaged down at 100s scale (very significant 1/f)
3. 200 mV range is particularly noisy, not really providing higher resolution than the 2 V range in long averaging time.
I'd like to sell the meter and try to get something else (oh no, I don't want to be a voltnut and spend x5 the money for a DMM7510).

Here shows the allan deviation of various different settings, unit in Volt RMS and in ppm range for easier comparison.
The raw data is attached in the compressed files in the next post, first column is time in unix timestamp and second the voltage. A few traces have (low-resolution) room temperature recorded in a separated file. The BATT ones are measuring a 9V battery, not included in the allan deviation plot.

BTW, does anyone know if it's possible to completely disable the screen to save VFD life? The screen off command kept the VFD on with a fixed screen disabled message, increasing the sampling rate at 1PLC from 19.7Hz to 22.2Hz, completely useless.

Edit: added a few traces in the volt scale plot.
Title: Re: DMM Noise comparison testing project
Post by: zrq on January 22, 2023, 02:08:03 pm
Selected raw data for Keithley 2001M, a few long and high speed recordings cannot be uploaded due to attachment size limit.
Title: Re: DMM Noise comparison testing project
Post by: bsw_m on January 28, 2023, 03:56:44 am
Noise and stability the R3003 microvoltmeter - part of R3003 voltage comparator.
Microvoltmeter in 10uV range. The output digitized by DMM 100PLC speed.

First column in file - time in UNIX time format. Second column - digitized result which is given to the used range of the microvoltmeter. No more mathematics was used.
Title: Re: DMM Noise comparison testing project
Post by: iMo on January 28, 2023, 01:05:27 pm
Years back I did with my 34401A at 100mV/100NPLC/AZON (https://www.eevblog.com/forum/metrology/dmm-adc-noise-comparison-testing-project/msg2656110/#msg2656110) with 42nV stddev/rms.
I want to repeat the measurement at .1V/1V/10V - what NPLC should I use? 10 or 100?
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on January 28, 2023, 01:40:42 pm
There is somewhat limited need to have a run at 100 PLC, as this would averaging 10 PLC data internally. So a long enough rund at 10 PLC could be used as well. The Allan deviation plot should take care of the averaging already and the curves should overlap to a large part.
1 PLC may be interesting, but for the 34401 this has quite some noise from quantization. Still possibly a point for the 100 mV range as less 1/f noise is involved.
Title: Re: DMM Noise comparison testing project
Post by: iMo on January 28, 2023, 01:44:40 pm
Ok, I will do die langen Runden with 10PLC (fast 6 digits)..
Title: Re: DMM Noise comparison testing project
Post by: zrq on January 28, 2023, 02:01:20 pm
Recently, I observed another surprising behavior of the Keithley 2001M. When the option slot is empty, whether it's covered or not can have a significant effect on the zero point.
My meter comes with neither option card nor the slot cover, so I simply filled the port with some aluminum foil. The observation began with noticing a sudden jump in a long recording of 20V range, followed by another jump back close to the original value later in few thousands of seconds. Initially I believe it's a jump in temperature or something else, but a similar jump happened again when recording for 200V range and this time I'm sure everything is stable. Later, I noticed another similar jump when I was working on the GPIB cable and torn off the filling aluminum foil accidentally, and the value quickly restored after I put another piece of foil filling the option port!
For now, my best explanation of the observation is the internal temperature distribution can be slightly changed by the airflow. The aluminum foil can get loose and move a bit. So far, after I cover the option port with tape and foil more carefully, I haven't seen such jumps ever again.
Title: Re: DMM Noise comparison testing project
Post by: iMo on January 28, 2023, 05:29:16 pm
Here is a 34401A measurement at 10PLC, 100mV range, AzOn, not fully warmed-up, raw data and put into Plotter app. Is this Overlapping Allan Dev the measure we are interested in? Hopefully my settings are ok..
Edit: nope, wrong tau0, fixed..

PS: at 4.04sec tau (100PLC) it shows 38nV which fits my 42nV@100PLC stddev measurement above..
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on January 28, 2023, 06:04:59 pm
The Allan deviation is a useful form to show the result, as one can also see how good one could get with averaging. Still not everyone is familier with this format.
The simple standard deviation for a fixed window (the lenght 100 or 1000 points is debateable) is easier to understand. So one should give that number too.

The x axis should be in seconds. Normally 10 PLC should be close to 2.5 or 3 readings per second - so the data indicate 50 Hz mains frequency. I think the plot is wrong and need the sampling time and not the samplig rate entered as tau0, as the curve should start at some 0.4 seconds and not 2.5 seconds.
Not fully warmed up adds the drift, that could well be the reason for the upward terend after some 2000 units. So especially the low ranges should be well warmed up.
Title: Re: DMM Noise comparison testing project
Post by: iMo on January 28, 2023, 06:15:19 pm
The Allan deviation is a useful form to show the result, as one can also see how good one could get with averaging..
Thus my above measurement says I can go for 5minutes with averaging at that range.
I messed with TimeLab a lot when playing with OCXOs, a pity the Plotter app cannot read csv files, I had to replace commas and rename the file..
Title: Re: DMM Noise comparison testing project
Post by: Kleinstein on January 28, 2023, 09:38:25 pm
The Allan deviation curve again going up is likely due to the drift, not the intrinsic noise. With a a more stable temperature the drift should get smaller and thus even longer averaging may work. There will finally be a limit from temperature fluctuations or background signals (e.g. hum, EMI).  The noise level is already not bad, considering that much of the noise is due to the resistor string (8*13K) used for the protection and the balancing resistor in the zero link.
Title: Re: DMM Noise comparison testing project
Post by: iMo on January 29, 2023, 07:45:13 am
Ok, after warming up my 34401A here are - the 100mV and 10V MADEVs at 10NPLC and AZON over night runs and 1V measurement made over the day.
Needs some analysis on this method and results..

PS:
a) removed the Plotter outputs
b) added 10PLC 100mV, 1V and 10V MADEV in TimeLab

Note: The 1V range has been sampled during the day with more temperature drift around, will be repeated over night sometime..