Author Topic: Clone 85033E VNA cal kit measured against PICO cal kit using LibreVNA  (Read 8614 times)

0 Members and 1 Guest are viewing this topic.

Offline joeqsmith

  • Super Contributor
  • ***
  • Posts: 11601
  • Country: us
Re: Clone 85033E VNA cal kit measured against PICO cal kit using LibreVNA
« Reply #25 on: October 13, 2022, 08:51:22 pm »
Quote
I doubt supporting your VNA would be a major problem if it were well documented.
No, but it would restrict future development of the protocol. I am still extending it when I add new features (e.g. the most recent functionality of combining multiple devices into a single multi-port VNA). It is not so much about the documentation (that could probably be done fairly quickly and to be honest you could also just grab the communications layer from my software and build the rest yourself), but what happens if I make an update to the protocol that breaks your software? That wouldn't be a good user experience either.

The firmware for the low cost VNAs isn't stagnant.   I had worked with Dislord, or at least they tolerated my input and as a result, I added more features to my software so support their efforts.   Lucky for me, they have continued to maintain backward compatibility.   The bigger problem early on was finding any firmware that stable enough to use.  I have not seen too many problems with Dislords firmware for the LiteVNA. 

Quote
I am not sure how fast or how much data we are talking about.
We are talking about 640kB/s of raw payload for the highest sweep rate. That is without any protocol overhead. Maximum theoretical throughput over USB fullspeed is about 1MB/s. Seems easily doable but from my experience it actually doesn't leave a lot of room.

That's not a lot for a typical modern PC and shouldn't pose any problems.     

Quote
I have seen people posing about how unstable your software is and there is no way I would want that wedged between my software and the VNA.
Well, the software certainly crashed at some point in the development. But which software doesn't? If you are that concerned about stability I would like it much more if you would run it yourself and report possible problems instead of repeating what other people said about it in earlier versions. I am absolutely not claiming that it is without bugs (again, what software is?) but personally I have not witnessed a crash during normal operation for quite some time.

Running any tests would require I obtain one.   Good to hear that you're personally not seeing any problems.  Again, I am not really concerned about the your project but I have been asked about supporting it with my software.

But even if the LibreVNA-GUI where perfectly bug free, I wouldn't recommend it to you as an intermittent layer. It looks to me as if you are building a GUI for different devices as well and the SCPI API is really intended for automating measurements and not for realtime data extraction.

My software does indeed support a few additional peripherals beyond the VNA itself including a transfer relay and some stepper motors.   The steppers are used for a delay line experiment I ran and also a two axis antenna rotor to test my pork and bean cans waveguide with.   :-DD 

I consider my software a long term science project that went off the tracks years ago.   There is no long term plans for it.  If I want to run a new experiment,  I just add the code to do it.   That's been going on for about 20 years now and it shows.  I doubt there is more than a handfull of users and I certainly do not promote it or recommend it to anyone. 

Offline jankae

  • Newbie
  • Posts: 9
  • Country: de
Re: Clone 85033E VNA cal kit measured against PICO cal kit using LibreVNA
« Reply #26 on: October 13, 2022, 09:26:17 pm »
Quote
That's not a lot for a typical modern PC and shouldn't pose any problems.
The PC isn't the bottleneck, the USB (fullspeed) interface is. But it is possible, it just requires a careful protocol without too much overhead.

Quote
Again, I am not really concerned about the your project but I have been asked about supporting it with my software.
Sorry, I think I have gotten the wrong idea earlier. I had the impression that you were complaining about my project and the lack of documentation, so I wanted to provide my point of view. I think I get it now and I very much understand that you are not particularly interested in integrating support for the LibreVNA just because some people asked for it.

Quote
My software does indeed support a few additional peripherals beyond the VNA itself including a transfer relay and some stepper motors.
[...]
I consider my software a long term science project that went off the tracks years ago.
It certainly looks impressive :) I am trying to keep my project on the tracks (i.e. not deviating too far from what a typical VNA does) and am rather aiming for easy integration with other measurement equipment through user scripts (thats why there is the SCPI API). But even though it is an open-source project, feature requests always outweigh contributions from users ;) I am sure you get the same sometimes :D

Anyway, best of luck with your project and sorry about the misunderstanding earlier.
 

Offline joeqsmith

  • Super Contributor
  • ***
  • Posts: 11601
  • Country: us
Re: Clone 85033E VNA cal kit measured against PICO cal kit using LibreVNA
« Reply #27 on: October 13, 2022, 10:20:52 pm »
The PC isn't the bottleneck, the USB (fullspeed) interface is. But it is possible, it just requires a careful protocol without too much overhead.

Maybe you will want to consider a bus you can grow with rather than having to work against it's limitations.   

Quote
Again, I am not really concerned about the your project but I have been asked about supporting it with my software.
Sorry, I think I have gotten the wrong idea earlier. I had the impression that you were complaining about my project and the lack of documentation, so I wanted to provide my point of view. I think I get it now and I very much understand that you are not particularly interested in integrating support for the LibreVNA just because some people asked for it.

I had considered getting your VNA early on but the higher cost took it out of the no brainer category.  The lower frequency was too limited and then there was the software.   We did follow its progress for some time but I really have not been paying attention in the past year.   Basically since the last time someone had asked me about supporting it.   I had seen a sort of review (ham) but I didn't get anything out of it but did see a few comments posted about needing added cooling and temperature drift.  Again, I don't have one and just go off of what I read.   

Quote
My software does indeed support a few additional peripherals beyond the VNA itself including a transfer relay and some stepper motors.
[...]
I consider my software a long term science project that went off the tracks years ago.
It certainly looks impressive :) I am trying to keep my project on the tracks (i.e. not deviating too far from what a typical VNA does) and am rather aiming for easy integration with other measurement equipment through user scripts (thats why there is the SCPI API). But even though it is an open-source project, feature requests always outweigh contributions from users ;) I am sure you get the same sometimes :D

Anyway, best of luck with your project and sorry about the misunderstanding earlier.

No problem.   

I don't get too many requests for features.  I expect you have it far worse as you are supplying hardware and software to paying customers.  I have no paying customers and don't except donations.   There's an upside to that!  :-DD   

I'll check out your multi-VNA project.  Someone had posted about using a couple of the low cost VNAs, a couple of T's and cables to make a full two port measurement rather than using a transfer relay.   My understanding was your VNA is a 2-port analyzer and I am guessing you are attempting to use them to go beyond two ports.   Maybe provide a link if you have it in a public place. 

Offline joeqsmith

  • Super Contributor
  • ***
  • Posts: 11601
  • Country: us
Re: Clone 85033E VNA cal kit measured against PICO cal kit using LibreVNA
« Reply #28 on: October 18, 2022, 05:44:36 pm »
I read through some of the threads posted on your groups.io including the LibreVNA 2.0 Hardware Concept.    I

Quote
Lower frequency range. I know that higher frequencies sound more impressive but I still think that 6 GHz is sort of the limit for reasonable priced components and FR4.

Depending how low you could get things to work, it certainly would make it more attractive.   With the low cost VNAs I have looked at, that very first NanoVNA I tested out performs the others. 

Quote
Hi, Jan,
Another thing that might worth investigation is the possibility of some extra SW and HW modifications to add compatibility with the NanoVNA v.2 (SAA-2) serial communication protocol commands set (not so easy to do, might need integrating an extra STM32 mCU with separate USB communication port)
If possible to implement, it would extend the compatibility of the LibreVNA with 3-rd party software tools that had been developed for the NanoVNA v.2, LiteVNA, etc .

I doubt supporting what you have would be a major effort rather than trying to fit with what is there.  It appears your hardware will be much more capable anyway so I see no reason why you would consider constraining it.   

Eye Diagram for TDR
Quote
Hi Jan,
Can an Eye Diagram be added to the TDR function?
Aaron
I've been playing around with this a bit and plan to demo it soon running with the LiteVNA.  I had asked Keysight about providing a license for my vintage PNA to remove the frequency range restriction.  Both the LiteVNA and my PNA could work at 9GHz and may be fun to compare the two.   The Lite's performance is what you would expect for a $120 VNA.  You mention post processing the data to get the eye diagrams but I have not found any packages that would do this.  Keysight used to offer a program I guess.  They still allow you to download but no longer appear to provide licenses for it.   My software is written in LabView which is no speed demon. My plan is to work with the data live.  As you suggest, some of the math for this does slow things down a bit. 

Good luck with your 2.x design.   

***
Link to where I posted about my efforts to support eye diagrams.  At the time, I had not yet tried to run it with a VNA so it's a bit dated compared to what I pan to demo. 
https://www.eevblog.com/forum/rf-microwave/nanovna-custom-software/msg4460926/#msg4460926
« Last Edit: October 18, 2022, 05:51:05 pm by joeqsmith »
 

Offline davethomaspilot

  • Contributor
  • Posts: 33
  • Country: us
Re: Clone 85033E VNA cal kit measured against PICO cal kit using LibreVNA
« Reply #29 on: October 21, 2022, 12:28:37 am »
I searched for Taobao calibration kits and found several with widely varying prices.

Is there a way I can buy what you tested?  URL?

Thanks!

 

Offline Mechatrommer

  • Super Contributor
  • ***
  • Posts: 11518
  • Country: my
  • reassessing directives...
Re: Clone 85033E VNA cal kit measured against PICO cal kit using LibreVNA
« Reply #30 on: October 21, 2022, 11:13:07 am »
@TopQuark. i plotted S11 from characterized data file of the 2 given Cal Kit Open Standard by TopQuark, the 3rd is mine.

attachment 1: PicoTech cal kit, i'm guessing measured with their more expensive PicoVNA device and Cal Kit. (provided in PICO cal kit.zip)
attachment 2: Clone 85033E cal kit, i'm guessing measured with LibreVNA calibrated with PicoTech Cal Kit. (provided in 85033E cal kit.zip)
attachment 3: my pcb based open standard measured with NanoVNA V2.2 calibrated with Kirkby Microwave Cal Kit (iirc, measured 2 years ago)

can you explain why the LibreVNA is ringy past 3-4GHz? your cable setup looks good. iirc there's discussion somewhere, this ringy thing is due to VNA's internal circuitry/pcb traces impedance mismatch. or maybe is it from Clone 85033E cal kit? i doubt it. whats the LibreVNA's software called? can anybody download and test it freely even without the VNA? i assume the SW can support characterized cal kit data as you've demonstrated. otoh iirc the last time i checked my NanoVNA and LiteVNA provided cal kit (Open and Short dust caps) they are almost 0ps delay, and the Load are quite acceptable. except the fixed rotating SMA male center pin on the Short and Load.
« Last Edit: October 21, 2022, 11:18:06 am by Mechatrommer »
Nature: Evolution and the Illusion of Randomness (Stephen L. Talbott): Its now indisputable that... organisms “expertise” contextualizes its genome, and its nonsense to say that these powers are under the control of the genome being contextualized - Barbara McClintock
 

Offline TopQuarkTopic starter

  • Frequent Contributor
  • **
  • Posts: 297
  • Country: hk
Re: Clone 85033E VNA cal kit measured against PICO cal kit using LibreVNA
« Reply #31 on: October 22, 2022, 08:51:09 am »
I searched for Taobao calibration kits and found several with widely varying prices.

Is there a way I can buy what you tested?  URL?

Thanks!

https://item.taobao.com/item.htm?id=568795988394
I have 2 of these kits now, I think they are fine for what they cost, but of course my testing of the kit is not very through nor with very good equipment. Buy at your own risk.

@TopQuark. i plotted S11 from characterized data file of the 2 given Cal Kit Open Standard by TopQuark, the 3rd is mine.

attachment 1: PicoTech cal kit, i'm guessing measured with their more expensive PicoVNA device and Cal Kit. (provided in PICO cal kit.zip)
attachment 2: Clone 85033E cal kit, i'm guessing measured with LibreVNA calibrated with PicoTech Cal Kit. (provided in 85033E cal kit.zip)
attachment 3: my pcb based open standard measured with NanoVNA V2.2 calibrated with Kirkby Microwave Cal Kit (iirc, measured 2 years ago)

can you explain why the LibreVNA is ringy past 3-4GHz? your cable setup looks good. iirc there's discussion somewhere, this ringy thing is due to VNA's internal circuitry/pcb traces impedance mismatch. or maybe is it from Clone 85033E cal kit? i doubt it. whats the LibreVNA's software called? can anybody download and test it freely even without the VNA? i assume the SW can support characterized cal kit data as you've demonstrated. otoh iirc the last time i checked my NanoVNA and LiteVNA provided cal kit (Open and Short dust caps) they are almost 0ps delay, and the Load are quite acceptable. except the fixed rotating SMA male center pin on the Short and Load.

Thanks for the analysys, I don't really have an explanation as to why the data trace is wavey, what you suggest sounds plausible. The software for the LibreVNA is freely available on github under the same name, iirc some of the functionality like viewing traces can be used without the device itself. The SW does support characterized cal kit data, which is what I used to calibrate the VNA against the pico cal kit.

Quote
Interesting, please let me know if you run into any issues :) I'd love to read what you think about the LibreVNA when the review is finished.

TBH besides the lack of time, the thing holding me back from reviewing the LibreVNA is the software crashing. I think the whole package is great for the price, it is very hard to find anything that is as capable at the price (or a few times more for that matter) . I want to give it a glowing review and good publicity but I can't when the software crashes from time to time.

I don't really want to just complain about the issue and hope someone fixes it, but I want to contribute to fixing the issue instead. I have on order an USB protocol analyser, sniffed the traffic with Wireshark and I have looked into the code for the software. I haven't sunk much time into the issue yet (working 2 jobs at the moment), and the intermittent crashes sometimes take hours to occur, means it is something that will take some time to debug. But it is something I am doing.
 

Offline jankae

  • Newbie
  • Posts: 9
  • Country: de
Re: Clone 85033E VNA cal kit measured against PICO cal kit using LibreVNA
« Reply #32 on: October 22, 2022, 07:00:39 pm »
Quote
the thing holding me back from reviewing the LibreVNA is the software crashing
Sorry to hear that. It has been a while since someone mentioned irregular crashes. The thing is that I have never been able to reproduce any. I have let my software run for days (on Win10 and Ubuntu) and it didn't crash. I would really really like to fix that but I simply have no idea where to start looking. It is very much a "works on my machine" issue...

It sounds like you are prepared to spend some time with it and also have some experience. What would probably help me the most is this:
- Install the Qt IDE (QtCreator with Qt 5.15.2 and MinGW 8.1.0 64bit compiler)
- Clone the repository (preferably the latest on master but that is experimental and would mean you have to update the device firmware as well. Using 1.4.0 is probably also fine)
- Install the libusb-1.0 dependency (download libusb header and library files, place in compiler search path)
- Compile the software in QtCreator, start it in debug mode and wait for it to crash. Maybe you'll see something obvious right away but in any case I would love a screenshot of the debugger after the crash (should point to the offending line and contain variables and the call stack).

I am fairly sure that it will be a relatively easy fix once the cause of the crash has been determined. If you want to try this but run into any issues setting up the toolchain, please get in touch through j.kaeberich@gmx.de
 
The following users thanked this post: davethomaspilot

Offline nctnico

  • Super Contributor
  • ***
  • Posts: 26682
  • Country: nl
    • NCT Developments
Re: Clone 85033E VNA cal kit measured against PICO cal kit using LibreVNA
« Reply #33 on: October 24, 2022, 01:42:27 pm »
I have seen intermittant USB communication causing problems but these can be very machine dependant. Perhaps it is an idea to inject USB errors and see how the software deals / recovers from that?
There are small lies, big lies and then there is what is on the screen of your oscilloscope.
 

Offline joeqsmith

  • Super Contributor
  • ***
  • Posts: 11601
  • Country: us
Re: Clone 85033E VNA cal kit measured against PICO cal kit using LibreVNA
« Reply #34 on: November 26, 2022, 09:50:59 pm »
"IMO, it was a shame they didn't start with the protocol used with the V2Plus4.   They could have had the software basically for free as there's a few open sourced projects supporting it.  I'm guessing there was a reason for having a unique interface. "

   Just to clarify, the LibreVNA uses a well-documented industry standard SCPI command set, so it's really the V2Plus4 that has a unique register-based interface.

That's news to me. Anything I saw documented was talking to their supplied software using their command set not direct like we are discussing. 

***
I checked their Github account and this still seems to be the case.   Maybe you didn't understand.  If there is documentation on how to control it directly with SCPI or other, post a link and I'll have a look. 

We agree about the need to run their software and no documented way to talk directly with the LibreVNA.   It may not be that big of a deal but the time I would need to invest into evaluating it makes it less attractive.   As long as their software is open sourced, as suggested it could be reverse engineered.  I would have overlooked the cost and lack of a documented interface had the unit been able to do something beyond what I can achieve today.

jankae did end up documenting the direct interface with their LibreVNA.   I looked into how it worked and it seems pretty straight forward.   They did warn about it continuing to evolve with the project but I don't see that being much of a problem.  I suspect it would be similar to Dislord's development of the firmware for the LiteVNA. 

Offline Joel_Dunsmore

  • Regular Contributor
  • *
  • Posts: 168
  • Country: us
Re: Clone 85033E VNA cal kit measured against PICO cal kit using LibreVNA
« Reply #35 on: December 11, 2022, 09:15:18 pm »
@TopQuark. i plotted S11 from characterized data file of the 2 given Cal Kit Open Standard by TopQuark, the 3rd is mine.

attachment 2: Clone 85033E cal kit, i'm guessing measured with LibreVNA calibrated with PicoTech Cal Kit. (provided in 85033E cal kit.zip)

can you explain why the LibreVNA is ringy past 3-4GHz? your cable setup looks good. iirc there's discussion somewhere, this ringy thing is due to VNA's internal circuitry/pcb traces impedance mismatch. or maybe is it from Clone 85033E cal kit? i doubt it. whats the LibreVNA's software called? can anybody download and test it freely even without the VNA? i assume the SW can support characterized cal kit data as you've demonstrated. otoh iirc the last time i checked my NanoVNA and LiteVNA provided cal kit (Open and Short dust caps) they are almost 0ps delay, and the Load are quite acceptable. except the fixed rotating SMA male center pin on the Short and Load.
The ripple has the rate of about 125 MHz which suggests a reflection length of something like 1 meter.  So likely the calibration kit wasn't great, and the cable connection at the VNA was not great or the VNA source match raw changed over time, causing a mismatch ripple between the high reflection and the poor match back at the other end of the cable.  Ripples like that have to come from long things.
 
The following users thanked this post: TheSteve

Offline joeqsmith

  • Super Contributor
  • ***
  • Posts: 11601
  • Country: us
Re: Clone 85033E VNA cal kit measured against PICO cal kit using LibreVNA
« Reply #36 on: December 12, 2022, 12:10:04 pm »
... or the VNA source match raw changed over time, causing a mismatch ripple between the high reflection and the poor match back at the other end of the cable.  ....

I've seen several photos of people using large heatsinks and fans to attempt to cool the LibreVNA.   There have also been several posts about the drift.    There was some additional posts here as well.   Maybe users cal them cold and the ripple is a result of it drifting while it warms up.  Odd is people in the group.io  don't seem to care.  There was a recent change to the hardware and it still behaves like this. 

https://www.eevblog.com/forum/testgear/sub-$1000-vna-for-antenna-matching/msg4546259/#msg4546259

Offline Mechatrommer

  • Super Contributor
  • ***
  • Posts: 11518
  • Country: my
  • reassessing directives...
Re: Clone 85033E VNA cal kit measured against PICO cal kit using LibreVNA
« Reply #37 on: December 12, 2022, 01:11:52 pm »
China coax and cal kit that comes free with litevna dont exhibit those ripple that bad on cheapy litevna, i have to dig some of my super crap no brand for video coax to get that kind of ripple.. my diy pcb cal kit stuff with impedance way off from 50 ohm and physical length about 10mm also dont produce such ripple. OP didnt seem to use super crap coax setip during testing either.. i'll try to simulate when i get home..
Nature: Evolution and the Illusion of Randomness (Stephen L. Talbott): Its now indisputable that... organisms “expertise” contextualizes its genome, and its nonsense to say that these powers are under the control of the genome being contextualized - Barbara McClintock
 


Share me

Digg  Facebook  SlashDot  Delicious  Technorati  Twitter  Google  Yahoo
Smf