Keithley 2015 THD with FFT and Harmonic graphs

[2bluesc]

Hey all,

After getting my Keithley 2015 THD for some small amplifier projects I was shocked that nobody had put together some tools to automate the beast.  The DMM is simple to get THD or THD+N numbers on the display, but that never tells the whole pictures.  After some digging around I managed to extract the first FFT plot (make a WAG at the bin bandwidth, manual doesn't say) and plot some graphs.  I haven't seen anyone share FFT spectrum plots from the device, so I'm hear to share!

The first screenshot (read title on plot) is with the internal source generator generating a 1kHz sine wave at 1Vrms.  The internal generator isn't that amazing, and as others have pointed out: A sound card on a PC can probably do better if you can eliminate the noise of the PC.  The 2015's gen spec is "-64dB THD+N with harmonics 2-5" which calculates out to 0.063%.  It measures 0.02% THD+N, which should include all harmonics and be more pessimistic.  Seems well within spec.

The second screenshot is my FIIO D03K optical to analog DAC generating the same 1kHz sine wave with the volume at -3.0 dB according to the software mixer in Linux.  The D03K DAC is rated for "Total harmonic distortion: <0.008%" and the Keithley measures it at 0.003% on the THD+N setting (assuming they measure and calculate the same).  Impressive for both the DAC and the 2015.  The spec sheet for the 2015 lists the THD+N residual distortion at 0.056% from 20-20kHz, so this is well within that spec (at least at 1kHz and 0.5Vrms) as well.  I'm not sure if I'm reading the spec sheet right in this department, what is actually described in the Keithley 2015 spec sheet for "Residual distortion"?

In short it works as expected and I'm assuming that the Keithley 2015 meter is reading well beyond what my ears can hear (audiophoolery aside).

That said I have a few comments:

• The Keithley 2015 SCPI command reference describes the :FFTransform:BINS command, but it doesn't discuss the bandwidth of each bin.  From my own empirical measurements, bin[1] measures from 61-121Hz and bin[291] measures from 19915-19983Hz.  That means the first bin is 60 Hz wide and the last bin is 68 Hz wide.  Does anyone have ideas on how this actually works?  Is it really not documented anywhere?  My graphs are plotting bins 1-500 which is approximately 0-34.2kHz.  The plots place the data at the center of each bin and that's why 1kHz doesn't line up with the grid lines.  I don't think I can do much better without a finer grain FFT.  I assume this is the limit of the Keithley 2015.  Also, if bin[500] = 34.2kHz, it's unfortunate that I can't define a small bin width to zoom in on certain frequencies instead of measuring out to 1023 * 60 = 61.3kHz which seems only useful for catching higher harmonics at higher frequencies.  The docs for the Keithley 2015-P (note the P for peak) seems to have definable bin width or ambiguous documentation, neither would surprise me.
• A Keithley 2015 quick reference guide (doc #2015-903-01 Rev. A, Dec 2001) mentions a :DISTortion:BNoIse SCPI command and the user manual (Doc #2015-900-01 Rev. F, Aug 2003) doesn't even mention the command.  The ref guide describes it as "Background noise is the residual voltage after the input signal’s fundamental and harmonics are removed." for frequencies greater then 61 Hz. Are there any more forgotten commands?  Hopefully one to reisze bins
• This is my first time playing with a SCPI over UART, but it seems after I send the "*RST" command the first letter of almost any command I send next is dropped.  Not sure if this is my RS232-USB converter (seems unlikely) or a firmware bug.
• My device responds to *IDN? command with "KEITHLEY INSTRUMENTS INC.,MODEL 2015,1051478,B15  /A02" for those interested.

Next steps, clean-up the horrendous hacky code and try go make it easy to spit out graphs for a handful of common tasks:

• Automated FFT spectrum plot with harmonics. First attempt is done as attached
• Sweep frequencies using internal generator and measure the THD+N at a number of points and plot.  I fear the internal source may not be good enough for devices I want to test.
• Sweep frequencies using the internal generator to build a frequency response plot.  Would be handy to overlay multiple tests to do channel mapping
• Measure noise floor.  I don't know how to do this on the Keithley 2015, any ideas?

[1audio]

My 2015 can measure as low as .001% on a really clean sinewave. I'm not sure how much I trust that since its also on the verge of .000% occasionally which is nonsense. Still if you have some code I'm all ears. Are you using serial or GPIB to talk to it?

I have looked around for app to do this and there are few. I can send you code from one effort by another guy for a traditional analyzer (Boonton 1120) that has addressed a lot of the issues of getting useful measurements but doesn't know how to talk to the Keithley. It was written in visual basic so Windows oriented. Let me know if you are interested. It does have routines for THD vs. level and Level vs. frequency. It uses a VB link to Excel for output.

Measuring SNR would be a several stage process. I believe the 2015 has some filters coded into it. (Necessary for the cell phone biz, which is what paid for them). You would need to establish a reference level and then "zero" the input (watch for source Z issues) and then measure the level with the filter for meaningful info.

[1audio]

One more thing- displaying discrete harmonics as a bar graph seems easier to grasp. The instruments that can do that graphically all seem to use bar graphs.

[2bluesc]

Yeah, I need to fix the harmonic graph. If I just output a bar graph I'll be upside down. So I need to work on it a bit more. Everything needs more work though.

[Ash]

Nice work, this is one of the items on my list as well. Albeit, quite a ways down the list..   

I'd be interested in the code for sure.. would you publish it on GitHub, that way others can contribute easily.   

Thanks
Ash.

[2bluesc]

I'd be interested in the code for sure.. would you publish it on GitHub, that way others can contribute easily.   

I'm going to host it on a Github repo after it's more organized.  So far it's a hacked mess to see if the hardware works.  Check it out at this gist.

[Ash]

Hi 2bluesc,

I'm not sure if you have seen it, but a bit of googling and I found a document from Keithley on AC signal analysis that seems to have data on the bin.

https://www.testequity.com/documents/pdf/keithley/2015-2015-P-2016-rg.pdf

On page 16 - I believe that this is #2015-903-01 Rev. A, Dec 2001:

Frequency bins

In order to get maximum frequency resolution from the FFT calculation, the frequency spectrum
must be separated into 20Hz bins. The example frequency spectrum in Figure 2, shows
the 51 frequencies that can be analyzed for a spectrum from 1kHz to 2kHz.
The following command separates the frequency spectrum into 20Hz bins:

Code: [Select]

:SENS:DIST:FREQ 20 ' Set distortion frequency to 20Hz.

Have you tried this?

This all seems to be designed for the "P" options.. I know mine is a straight 2015 THD, not a "P" variant. I have B17 A02 firmware I believe, so when I get a chance (weekend?) I'll fire it up and see if the commands run for me.

Cheers,
Ash.

[2bluesc]

On page 16 - I believe that this is #2015-903-01 Rev. A, Dec 2001:

Frequency bins

In order to get maximum frequency resolution from the FFT calculation, the frequency spectrum
must be separated into 20Hz bins. The example frequency spectrum in Figure 2, shows
the 51 frequencies that can be analyzed for a spectrum from 1kHz to 2kHz.
The following command separates the frequency spectrum into 20Hz bins:

Code: [Select]

:SENS:DIST:FREQ 20 ' Set distortion frequency to 20Hz.

Have you tried this?

This all seems to be designed for the "P" options.. I know mine is a straight 2015 THD, not a "P" variant. I have B17 A02 firmware I believe, so when I get a chance (weekend?) I'll fire it up and see if the commands run for me.

Hi Ash,

I did try that and the way it's described seems very confusing, because that document disagrees with the User's Manual definition for the SENSe:DISTortion:FREQuency command.  The command on my meter forces the meter to use the given frequency for the reference magnitude of the FFT, and as a result the rest of the FFT is garbage.  The description sounds like something I want for the smaller bins, but the semantics of the command name and the user manual doc match what it actually appears to do. I suspect it's either a typo, or as you said, only available on the "P" variants.

I'd love to hear what your tests show, the code I have posted thus far can easily be hacked to run the test quickly.  I bet the FFT plot with turn to garbage.  Give it a shot! 

- Kyle

[1audio]

Docs on this stuff always seems to be everywhere and nowhere. There is a Keithley support forum where you may get better answers: https://forum.tek.com/viewforum.php?f=64  and here: https://forum.tek.com/viewforum.php?f=67 Other users have trouble getting good answers from Keithley judging from reading through that forum.

What would be great is 2015-p firmware if anyone has a way to get it. The distortion analysis supposedly is only available on the -p version. keithley says its upgradable (by them for a fee).

[2bluesc]

Docs on this stuff always seems to be everywhere and nowhere. There is a Keithley support forum where you may get better answers: https://forum.tek.com/viewforum.php?f=64  and here: https://forum.tek.com/viewforum.php?f=67 Other users have trouble getting good answers from Keithley judging from reading through that forum.

Interesting.  Didn't even think to check out a Keithley forum, the 2015 forum looks very quiet, but I think I'll post there when I get a little further along and the code is more presentable.  Thanks for sharing

What would be great is 2015-p firmware if anyone has a way to get it. The distortion analysis supposedly is only available on the -p version. keithley says its upgradable (by them for a fee).

This would be an awesome hack.  The distortion analysis is in the 2015, the 2015-P is supposed to add "peak analysis" which appears to be just an easy way to iterate through peak harmonics programmatically, but I haven't studied enough.  I assume the extra ':PEAK" SCPI commands are of particular use for automated factory testing setups and may not provide much more information then downloading the FFT bin output directly.  I to stumbled upon the post that you mentioned where the 2015 could be upgraded to a 2015-P model.  The 2015-P options sound like they are nothing more then software, and may not provide much value, but if the FFT bin size is configurable on the 2015-P, that alone may be worth checking out.   

[G0HZU]

After getting my Keithley 2015 THD for some small amplifier projects I was shocked that nobody had put together some tools to automate the beast.

I bought mine a few years ago and created some automated apps for it within a few days of it arriving

https://www.eevblog.com/forum/testgear/keithley-2015thd-initial-tests/





All the apps are fairly crude but they work well. I did the THD UI first, followed by a fairly decent 'Toneohm' app where the pitch of the audio from the PC speakers depends on the resistance of the device being measured. It worked quite well as the GPIB interface is quite quick.

I also did a quick and dirty logger program to measure PSU stability. Not exactly modern or pretty but it works.

I haven't seen anyone share FFT spectrum plots from the device, so I'm hear to share!

Thanks for this. I missed the FFT plot command so I may have a play with this at some point   How quickly can it create and refresh the spectrum plots using this command?

[2bluesc]

Thanks for this. I missed the FFT plot command so I may have a play with this at some point   How quickly can it create and refresh the spectrum plots using this command?

I stumbled on your app, but saw that it was Windows based and realized that wouldn't work for me on Linux.    Did you ever release it to the public?

As for the spectrum plots, I'm using the RS232 interface, and the data moves quite slow at 19.2kb/s which seems to be the highest speed (unless a new firmware improves this or there are undocumented features).  I need to explore changing the ':FORMat:DATA` command to transfer the numbers as binary IEE754 floating point which should happen several times faster (think ~14 bytes as ASCII vs 8 bytes for a double).  It takes maybe 5 seconds to just receive the FFT data over serial.  I think the actual conversion time for the internal DSP is the considerably faster, and should be the same as you experience with your app.

[2bluesc]

After I get done exploring with my THD tests, I'm curious if I can make something like your DMM app.  I'd like to see if it's possible to write a driver for sigrok and pulseview and if the sigrok UI tools like pulseview are useable to justify the effort vs a standalone app that suits my needs.

[2bluesc]

Played around a bit more with the FFT binning.  It appears the `DIST:FREQ` command does modify the width of the bins on my 2015 as described for the 2015-P.

If I set the 'DIST:FREQ'  (apparently bin width in special cases) to 20 Hz and read all 1023 samples I get the attached plot.  The original plots were with the frequency set to auto acquire and only reading the first 500 samples (at 60Hz bin width). The THD and THD+N numbers appear to be garbage, and this led me to believe it wasn't working earlier as it sets the 0 magnitude reference to whatever noise it reads at 20 Hz.  After some normalization of the FFT plot values I get the attached graph with 20 Hz bandwidth per bin.  I assume that I can easily sum the harmonics and derive my own THD and THD+N values with higher resolution for lower frequencies (there's no data past 20kHz for harmonic calculations).  I will need to test the 20Hz vs automatic 60 Hz bin width and see if they agree for test values of 1kHz.

Seems odd that Keithley wouldn't calculate intelligent THD, THD+N, SINAD values after adding a new SCPI bin width command that doesn't overlap the DIST:FREQ command.

The Harmonics graph is a mess still, please ignore.

[1audio]

I'm almost done with a VB app for the Keithley that I'll be sharing. If you have the code for the harmonics it would be helpful. That's the next challenge. I'm using GPIB and its pretty quick. Supposedly it can make a lot of measurements very quickly if the internal processor is used to do the sequencing.

One limitation is the internal source. I can't find a schematic to come up with ideas on improving it. I'm sure its the 12 bit DAC but its not a simple DAC upgrade if there's only 12 bits to drive it.

[dvb]

Hi guys! Any progress in this matter? I bought a 2015 few months ago and I'm still shocked by the lack of apps for this instruments...

Take care!

@GOHZU - I've tried to PM you but no luck, seems your PM service is disabled...

[frankmhowell]

G0HZU has incoming blocked/disabled everywhere...including his YouTube channel.

[frankmhowell]

Any chance of sharing this?

Frank

[emartine]

I will purchase this meter and upload an app to github, so anyone can use it..
Im already working on it.
This is my github page if you wanna help:
https://github.com/andmarti1424

[1audio]

Feel free to use whatever you can from this: https://github.com/1audio/Keithley-Windows-10  Its mostly working. Integrating the harmonics analysis with the rest of the package would make it very useful. Adding control for an external oscillator (the internal source is not very good) would enhance its utility.

[emartine]

Thanks! Will check it out.

[emartine]

I have been working on my app lately. In case anyone is interested, you can find it here:
https://github.com/andmarti1424/free_keithley

Any help is always welcome!
Thanks.

[dvb]

Hi, thanks for sharing!

Now, can you write a few words about hardware setup? What kind of cable, interface, settings... ?

Best regards!

[emartine]

I dont know what you mean but ask whatever you need.

[dvb]

"Is the instrument linked to the computer via serial interface?" sort of thing...

Thanks

[emartine]

RS232 port.
I use an RS232 to USB cable.

[dvb]

... and yet another stupid question before trying to download the required software: is this software suite Windows or Linux? Say it is Windows, please!

Thanks

[emartine]

I use it on Linux. But it should work on Windows as well if you download the requirements..
python 3.10+
matplotlib
python-pyserial
tkinter

DIdnt try it myself though cause windows is sh#t.
(I use it at work)

[dvb]

Unfortunately I don't have the time to fiddle with installation under Win10 right now but it's very good you wrote these apps! A more compact Windows version (like an executable ) will have a bigger success in the future than a Linux one, just my opinion...

Best regards, take care!

Later edit: I did figure out how to setup all requirements sooner than I thought but I receive the following (same) error in command prompt (same from IDLE Python utility) when I try to launch the modules

"    File "C:\Users\Dorin\AppData\Local\Programs\Python\Python311\free_keithley-main\thd.py", line 28, in <module>
    import pandas as pd
ModuleNotFoundError: No module named 'pandas' "

[dvb]

Are these Keithley 2015 RS232 settings OK?
- BAUD: 19.2k
- FLOW: NONE
- TX TERM: CR

[dvb]

I have installed "pandas" and "serial" as a result of errors I received but now I have:

" File "C:\Users\Dorin\AppData\Local\Programs\Python\Python311\free_keithley-main\thd.py", line 38, in __init__
    self.ser = serial.Serial()
AttributeError: module 'serial' has no attribute 'Serial' "

The settings of serial port are to be edited in module?
I have 3 COM ports, the last one called "ATEN USB to Serial Bridge (COM5)" in Device Manager, used by Keithley - communication tested OK with Putty at both 9600 and 19200 baud.
How does the module know which one to use?

Thanks!

[zrq]

Are you sure you have the correct serial package installed? It appears to require https://pypi.org/project/pyserial/ . There can be python packages that have a same name.

[dvb]

I think so, I have just checked and...
" C:\Users\Dorin\AppData\Local\Programs\Python\Python311>pip install pyserial
Requirement already satisfied: pyserial in c:\users\dorin\appdata\local\programs\python\python311\lib\site-packages (3.5) "

I can only imagine that not being yet tested for Windows (as Andres/emartine said) a lot of little things are still to be sorted out (as I was affraid of)

[emartine]

Feel free to use whatever you can from this: https://github.com/1audio/Keithley-Windows-10  Its mostly working. Integrating the harmonics analysis with the rest of the package would make it very useful. Adding control for an external oscillator (the internal source is not very good) would enhance its utility.

Hello. I made some progress. You can take a look at it: https://github.com/andmarti1424/free_keithley
The thing is I cannot find anything regarding FFT on your code. As im having trouble to interpret the bins after I issue:
':DIST:FFT:BINS? 1,1023'
It is also very slow over RS232..
Thanks for your help.

[dvb]

An alternative to Keithley's internal generator can be a relatively cheap Focusrite 2i2 (2nd gen) set to 0.5Vrms headphone output, for which Keithley reads "000.001 THD" (10 harmonics).
For 0.2Vrms line output directly from soundcard Keithley reads "000.000 THD" while the soundcard's ADC reads 0.0006% (via Waveforms software from Digilent, but other programs give the same results)

My conclusion here is that Keithley 2015 shouldn't be disregarded so easily, still has its use!

[1audio]

emartine  RE the code I shared on Github- It did not have any FFT stuff. We weren't clear if it was even supported on the non-p version. The student who crafted that code for me (from the original from the web) has since gone on to real work. I sort of know what it does and directed what I wanted it to do.

I'll download your code to see what you have. We never put effort into RS232 since I have GPIB all over here.

[emartine]

Hello there. I managed to have some progress based on this info:
https://www.eevblog.com/forum/testgear/continuing-the-keithley-2015-2015p-saga/

I still want to compare the FFT that my program generate with the one that my scope do.
I do still want to know if the bin width of 20hz is the onlly way to set it..

Some more comments:
yes, FFT works on 2015 model (not only the p one)

I could make FFT little quicker changing baudrate in the rs232 communication to 19200.
Changing format data from ascii to binary would make it quicker as well but the only format allowed for data over rs232 is ascii. Cannot change it to binary as you would do with GPIB.

[emartine]

I think so, I have just checked and...
" C:\Users\Dorin\AppData\Local\Programs\Python\Python311>pip install pyserial
Requirement already satisfied: pyserial in c:\users\dorin\appdata\local\programs\python\python311\lib\site-packages (3.5) "

I can only imagine that not being yet tested for Windows (as Andres/emartine said) a lot of little things are still to be sorted out (as I was affraid of)

I am afraid is not the case. See here:
https://pythonhosted.org/pyserial/shortintro.html#opening-serial-ports
it opens the serial port just as my app:
ser = serial.Serial('/dev/ttyUSB0')  # open serial port
There must be something wrong with the pyserial installation or version.