Raspberry Pi2/3 logging platform for Voltnuts

[plesa]

Lot of members here needs to log data for various instruments.
And because there is no commonly accepted platform I would like to start collecting inputs for preparation image for RPi2/3 for data-logging over GPIB/LXI and USB.
Steps will be update on TiN website as well.
https://xdevs.com/guide/ni_gpib_rpi/
Soo will be there also RPi image which you will needs to restore on SD card.

Please add in this thread what you would like to log and what instrument.
Some of you have Prologix adapter which we can probably support with small modifications as well.
For logging environment is used BME280 ( temperature. humidity, pressure) sensors are pretty cheap $5 and reasonably accurate.

On RPi is running Apache as webserver and ProFTPd as FTP to access logs, of course SSH with screen 
Webpage on RPI contains live view of logged data with D3, from instrument and also data from BME280.

[VK5RC]

Hi Plesa,
For my vote its is all HP-Ag-Ks GPIB equipment with either  Prologix or HP 82357B. The later has some problems with clones abounding everywhere.
NI also in the running.
Thanks

[TiN]

plesa

Apache, noooo... How about nginx. I can help with setup.
I suggest to set deadline date for inputs , so after you could focus on making all features for version 0.1.
If you want I can provide mercurial repository for sources/build files, etc off my server (no size limits).

I'd be happy with next feature set:

* Latest Pi3 kernel 4.x.x + linux-gpib (Have both Pi1 and Pi3 here)
* Python 2.7 as code platform
* Support for NI GPIB-USB-HS (I can test this)
* Support for Agilent GPIB pods and their clones  (can test with clone)
* Support for popular adapter like Prologix
* Support HP 34401A/3446xA
* Support HP 3458A (can test this)
* Support Keithley 2000
* Support Keithley 2001/2002 (can test this with both 2001 and 2002)
* Support BME280 for environment monitoring using I2C
* Function to upload CSV-data to remote FTP
* SSH via dhcp-network

Supporting all GPIB equipment would be many years of work, so I'd leave that out. If somebody need support specific piece of gear, they can dig thru instruments manual and write own python code to support logging required data.
For example I have Keithley 2510 TEC SMU, and use same app to log TEC power, temperature and current together with DMM samples, but I can't expect everyone to write support for it, just because I need it After few trial and errors it's not that hard for DIY.

[TiN]

If it's python, I can help to write support for Keithley 2001, 2002, 2400, 2510, 182, HP 3458, Wavetek 4920/4920M.

[pmcouto]

Hi Plesa,

Thanks for your efforts.

I would like to have support for data logging over LAN for Keithley DMM7510, Tek DMM4050/Fluke 8846A and Keysight 3446xA/34470A.

[2N3055]

Plesa,
thanks for sharing...

For the moment I have Rigol DM3068 and RPi2..  It would be over Ethernet.
I would like to help with that.

P.S. Where did you guys get BME280 from?

[pmcouto]

BME280

http://www.ebay.com/itm/272040804944?_trksid=p2060353.m2749.l2649&ssPageName=STRK%3AMEBIDX%3AIT

[acbern]

Great idea overall!! If this is written in Python, would it not also run (or could it be written in siuch a way) that it runs on a PC?

[TiN]

That's possible too, I used such way before with PyVISA , but quickly dropped the idea as having separate box, without tie to bulky PC is well worth those 35$ for Pi.

[HighVoltage]

Right now I am using the Prologix and RF Scientific logging software on my 3458A and other Agilent gear.
But I am very much interested in other options, especially RP.

[ManateeMafia]

I have been working on a small side project with the BME280. It takes the code we are using from Adafruit one step further by making it a network service.

Instead of calling it directly through the i2c interface, a server runs in the background and a client connects to it and gets the data. I have been using the server for some months now acting as a Fluke 1620A emulator. I have the real thing but it doesn't work very well and drops data intermittently.
I just wrote a client module that can be imported into a python app. It only requires a couple lines of code. The server and client can also reside on the same RPi if needed. My plan is to have a RPi run 24/7 feeding data to my Windows program monitoring 10V references and I won't have to move it around when I collect data for xDevs on a second RPi.

The code will be posted in a few days as I am waiting for a small case to show up that will also have a TFT display. I will be writing up an article in case anyone is interested in making one for their home lab. Plesa can also add it to the img file.

[ManateeMafia]

Plesa,

I have attached a couple of shell scripts I used to setup my RPi on wheezy. If you find any of it useful you can add it to your project. The rpi_gpib_installer.sh works well but it only lets you select either the Agilent or NI interfaces. It might not be difficult to change for a universal install.

[wraper]

Keysight 34461A, Rigol DM3068 over LAN.

[plesa]

Thanks for all inputs. Extra Kudos for  TiN and ManateeMafia
Based on voting majority needs support 3458A, so lets start with this instrument.
It is going to use latest Raspbian with Pixel, this is answer to TiN question related to kernel ( 4.4.26) and Python 2.7.9

GPIB interface:
NI GPIB-USB-HS - TiN, Plesa
Agilent 82357B ( official)  - we needs volunteer for testing
Agilent 82357B ( clone)  - I have dead clone only
Prologix GPIB-USB v6.0  - we needs volunteer for testing
Agilent E5810A  - Plesa

LAN:
support for LAN is made by
https://github.com/python-ivi/python-vxi11
http://alexforencich.com/wiki/en/python-vxi11/start
Alex Forencich ( member here)  - author of python-vxi11 and also USBTMC

Instruments (Support means script for dataloging)
In first phase only 3458A,K2001,K2002
Future phases  3441xA/34401A/3446xA

Enviroment:
2x BME280 connected to I2C - Python dataloging with Adafruit code to log file (csv) and ploting data on webpage on RPI (similar look like Fluke 1620A display  - 2nd page of datasheet)
http://download.flukecal.com/pub/literature/3397500_6200_ENG_B_W.PDF
2 sensors as minimum
BME280 sensors I used are these
https://www.sparkfun.com/products/13676
Others posted above do not allow to set I2C address, there are similar on Ebay for $5/pcs.

Data upload:
Function to upload CSV-data to remote FTP. I will prefer to make data available on RPI FTP instead of active upload.
Who needs this except TiN?

SSH access is default.
Apache2/NGINX - any preference except TiN?

Now we needs to discuss how to process data. I checked options like KST ( stability ) and ended like TiN with D3.js. There is possibility to plot graphs by D3 on server side to reduce processing time on webpage, but I needs to investigate further. Dataplot of 10MB takes 20-30s.
Currently I can imagine one page for data from 3458A ( timestamp, temperature, humidity,pressure) second page for environment log and third page as universal for generic instruments ( timestamp, value).
Any suggestions how to visualize data?

[mimmus78]

It whould be nice to have a web interface to setup measurement experiment/project.

Inviato dal mio Nexus 6P utilizzando Tapatalk

[mimmus78]

I don't know how D3 works, but I think it will be useful to have a file format that explains how to plot data and few "macro" to add things like stddev, convergence, ppm deviation between two measurements etc. If there is something like this, you can plot chart with one script.

Inviato dal mio Nexus 6P utilizzando Tapatalk

[lwatts666]

The guys at sigrok.org have done a lot of work on unified cross platform drivers for various instruments and put it all under the GPL. You may be able to leverage some of their work. If nothing else, there is a lot info there.

[t2kv]

Keysight 34461A over either LAN or USB, please.

[enut11]

@plesa

I have an HP3456A and Agilent HPIB to USB interface on the way. Also have RP3.
enut11

[guenthert]

Hmmh, I'm generally in favor of strict separation of hard- and software, otherwise there will be unnecessary duplication of effort and fragmentation of community and knowledge.

If you suggest Raspberry Pi, I suppose you're ok with using Linux.  When the task is to access the GPIB using Linux, then the obvious choice would be to use the linux-gpib library (http://linux-gpib.sourceforge.net/), no?  Well, that's what I'm using at least (with an old PCI GPIB interface -- I also have a USB GPIB interface, but that doesn't seem to work well with multiple devices or older HPIB gear).

I would like to see more support for GPIB devices and perhaps on the high level ("presentation layer" if you will), like the web interface you suggest.

[Nuno_pt]

Morning all,

I also have an 3456 on the way and a Agilent 82357B clone, 2xBME280 on the way, all to join the K2000 and the 3457.

They are all connected via GPIB cables.

I've 2xRPi2.

So for me would be great in the 3456/7 could be add to the list.

[mimmus78]

If I remember K2001 and K2002 have 3458A GPIB compatibility mode ... so supporting 3458A means also K2001 and K2002.
Anyone used this compatibility mode up to now on Keithely? How it works?

Anyway I think we must think at this as at least 3 software layer for just capturing the data:

• TOP LAYER: gather data and store on CSV or some file based database
• MIDDLE LAYER: implements instrument interface
• LOW LEVEL LAYER: write GPIB commands to the physical interface (for supporting specific hardware - Prologix, 82357B, GPIB ENET, etc)

in this way we can implement how many LOW layer or instrument we wants without changing (too much) the other TOP layers.

Than I imagine a simple web interface made by two main modules:

• interface for set "logging" tasks (this module speaks with TOP LAYER and configure the instrument for doing measurements), this interface show also the real time measured data
• interface and module to elaborate the stored data gathered by TOP LAYER and to present them in the most appropriate way (charts, tables, etc) 

[klaus11]

K2001 does not play with 3458A

[bingo600]

I have Raspi1 , and Raspi3
I would prefer Apache (sorry TIN)


Agilent 82357B ( clone)  - I have one , working excellent , and a Beiming
Agilent E5810A  - I have one , but not used it yet

Edit:
Have ordered : 2x BME280

/Bingo

[lukier]

Agilent E5810A  - I have one , but not used it yet

Care for a mini teardown? I was thinking about GPIB-LAN bridges recently, because I only have one USB-GPIB adapter (also a 82357B clone) and it's not as convenient as having access to all the instruments from the network. So I've came up with the idea to implement a linux-gpib to VXI bridge to emulate E5810B (could do that with a RPi and this clone USB adapter perhaps), but I need to do more research on that.

While researching this I was looking at existing GPIB-LAN gateways, Keysight, ICS and also I've analyzed E5810B firmware a bit and it seems very clever as it uses TI's AM335X and the PRUSS cores to do the GPIB. I never saw the insides of this gateway so I don't know if PRUSS is bitbanging some GPIB interface chip (NAT9914 and the likes) or probably GPIB transceivers directly, which would be quite cool and fast. The kernel modules, especially the one responsible for talking to the PRUSS and GPIB is tagged with the GPL linker symbol, but I didn't find sources anywhere