Author Topic: OpenIRV. ISC0901B0 (Autoliv NV3, FLIR E4/5/6/8) based opensource thermal camera  (Read 111778 times)

0 Members and 1 Guest are viewing this topic.

Offline NVTech

  • Newbie
  • Posts: 9
  • Country: gb
Does anyone know if the following STEP files are available, I've had a look in the GitHub repository and can't locate them?

Magnets holding ring
Shutter mount spacer
Updated motor mount

 

Offline OC

  • Newbie
  • Posts: 3
  • Country: gb
I believe that the software files for the application running on the MicroBlaze are also missing from the GitHub page. I cannot find a built file of the application either.

I am close to having a fully built M-board so this is a bit of a showstopper.
 

Offline LesioQ

  • Regular Contributor
  • *
  • Posts: 66
  • Country: pl
  • Every king should be naked.
Try getting to VGN by e-mail. There's quite a bunch of us who put money on finishing the prototype cameras based on his commitment and declarations.  :-BROKE
Fingers crossed !
 

Offline LesioQ

  • Regular Contributor
  • *
  • Posts: 66
  • Country: pl
  • Every king should be naked.
Does anyone know where this project got stuck ?
Are we bricked ?
 
The following users thanked this post: ddrl46

Offline OC

  • Newbie
  • Posts: 3
  • Country: gb
Hi all,

Just posting in case people have a stash of parts that have been out of stock for a while.

I am missing the following ICs to complete my M-board. If anyone has them and is willing to sell them, so that this project can be rejuvenated!

TPS61041DBVR
TPS7A4901DGNR
TPS7A9001DSKR
TPS62821DLCR

Or know of any drop in replacements!
« Last Edit: March 06, 2023, 07:58:57 pm by OC »
 
The following users thanked this post: ddrl46

Offline dmendesf

  • Frequent Contributor
  • **
  • Posts: 318
  • Country: br
TPS61041DBVR - 4k pieces at Mouser
TPS7A4901DGNR - digikey has similar part BD00FA1WEFJ-E2
TPS7A9001DSKR - Texas has 6k pieces
TPS62821DLCR - digikey has 11 pieces

Finish it and show it to us :)
 

Offline dmendesf

  • Frequent Contributor
  • **
  • Posts: 318
  • Country: br
Hello!

Have added datasheets for LCD and focus motor: https://github.com/OVGN/OpenIRV/tree/master/docs/BOM/BOM_v1.1.0
You can easily find both. Note that there are a lot of manufacturers that make same 6mm geared DC motors.
Use provided motor datasheet as a reference. The key parameters are diameter (6mm), gear ration (~1:26), shaft geometry and voltage (nominal 3.0V).
[/quotwe

Hello!

Have added datasheets for LCD and focus motor: https://github.com/OVGN/OpenIRV/tree/master/docs/BOM/BOM_v1.1.0
You can easily find both. Note that there are a lot of manufacturers that make same 6mm geared DC motors.
Use provided motor datasheet as a reference. The key parameters are diameter (6mm), gear ration (~1:26), shaft geometry and voltage (nominal 3.0V).

Hi VGN, hope everything is ok. Chippagedon is less serious now. Will you publish the spice , only the binaries or have something else in mind?
Daniel
 

Offline ArsenioDev

  • Regular Contributor
  • *
  • Posts: 236
  • Country: us
    • DiscountMissiles: my portfolio and landing page
Really hoping this hasn't died :(

I'm in the process of getting captures of several other microbolometers and sourcing currently manufactured ASi units to allow for custom builds without requiring the donation of an entire NV3, ironically not that hard to get em, bigger headache will be the lenses.
 

Online Fraser

  • Super Contributor
  • ***
  • Posts: 13151
  • Country: gb
VGN was last logged into this forum back In December 2022. I fear that this project has stalled until he has the time to revisit it.
This is why I do not financially invest heavily in a project that is still being developed. Many such projects fall by the wayside when the developers circumstances or motivations change. I am equally guilty of such but tend not to publish my projects so it is no problem.

I was interested in what was achieved by VGN and it is so close to being a complete project, but close is not enough when it comes to creating a useable project such as this. With the advent of cheaper imaging cores and complete cameras coming out of Asia, such projects can become redundant or non competitive before they are ever finished. The trials of being a product developer.

Fraser
« Last Edit: July 06, 2023, 07:55:55 pm by Fraser »
If I have helped you please consider a donation : https://gofund.me/c86b0a2c
 
The following users thanked this post: ddrl46, ArsenioDev

Offline ArsenioDev

  • Regular Contributor
  • *
  • Posts: 236
  • Country: us
    • DiscountMissiles: my portfolio and landing page
True, My NV2 at least will get me rollin along with my matched set of VGA cores I have the ICDs on. In any case, what the baseline we got here will be a useful future reference.
 

Offline horstmannhid

  • Contributor
  • Posts: 14
  • Country: de
I think some of us have got a complete set of the boards. And we also have got the manufacturing data of the boards.

I tried to load the existing software into vivado with the OIRVBOOT.tcl file but I have some problems running the RTL analysis. But I think that's only some sort of creating a new project and load the existing files.

The main problem may be the missing microblaze software. Does anyone have got a completly assembled board and running some code on it?
A working display only showing the thermal image would be great in a first step. Would be so sad if nothing further happens with this project.
I have a lot of experience programming microcontrollers in C but I have not much knowledge with FPGA's.
Main problem are the costs of all the components. Otherwise I will just try it.
 

Offline ArsenioDev

  • Regular Contributor
  • *
  • Posts: 236
  • Country: us
    • DiscountMissiles: my portfolio and landing page
Now that I've obtained the FPA and have some FPGAs on order, I'm working with some coworkers to re-do this from the baselines that exist here and take it on our own path as it appears VGN has gone dark.
 
The following users thanked this post: ddrl46, tek2232

Offline horstmannhid

  • Contributor
  • Posts: 14
  • Country: de
Now that I've obtained the FPA and have some FPGAs on order, I'm working with some coworkers to re-do this from the baselines that exist here and take it on our own path as it appears VGN has gone dark.

That sounds awesome.

I now ordered a development board (Arty S7-50) with exactly the same FPGA. In the first step I will try to build a simple camera with the MLX90640 and a TFT-Display. If I make any progress with that I'll continue assembling the boards from VGN.

A nice tutorial suitable to our project can be found here:
https://community.element14.com/technologies/fpga-group/b/blog/posts/arty-s7-50-vga-thermal-imaging-camera
 

Offline Mach

  • Newbie
  • Posts: 1
  • Country: si
Hello guys,

i know this is not the core business here, but, by any chance - anyone tried to dissasemble the original Audi night vision control unit, and extract firmware?

Im trying to retrofit it into a non-compatible car - Q7 system to a Q5. Everything works, only the image transfer does not occur (but it throws out an error after transmission attempt - also calibration not possible after tool is found).

one of two likely applies:
1) Virtual cockpit cluster does not have HW or SW on it (unlikely, as it has all adaptations, codings possible, HMI parameters are identical,...)
2) NV Control unit, against vehicle gateway or cluster requires a handshake (chassis ID/VIN; VIN mask - this was the case on the non-encrypted modules) -> More believable, as there are many NV control units for different audis, and even for other in the VAG concern: vw's, Bentleys, Porsche,....

i do have the original firmware, but its encrypted (likely AES, no compression). There is a chance, that on the board in the chipset the decrypted data could be downloaded. For a known fact, flashing procedure on car opens protocols for decryption and checksum actions.

if anyone can help, let me know.
Sorry for asking non-topic related question, but im running out of ideas :)

regards, M
 

Offline railrun

  • Regular Contributor
  • *
  • Posts: 113
 

Offline horstmannhid

  • Contributor
  • Posts: 14
  • Country: de
Made some progress with the development board and just the small MLX90640 sensor. But it’s a long way to go. And it’s really complicated programming FPGA’s and dealing with the Xilinx software. Maybe I‘ll start to interface the camera with an adapter board in a first step.
 

Offline daedolon

  • Newbie
  • Posts: 2
  • Country: au
horstmannhid, you should probably know about these two projects. I feel like they've done a lot of the work for you.

https://github.com/randomplum/autoliv_nv3_uvc
This one uses a Gowin FPGA and an FX2 to convert the sensor's output to a USB webcam. He hasn't done calibration yet, and there's no shutter control, but otherwise it works. He used the high level python-based Amaranth HDL to program the FPGA so it should be easier to work with. Obviously it would be easier to use the same FPGA he's used, but you can also more easily port it to other FPGAs: https://amaranth-lang.org/docs/amaranth/latest/platform.html

https://github.com/festlv/isc0901b0-breakout
This is the project the USB webcam converter is based on. This one's "just" a breakout board that supplies power. It does have unidirectional shutter control. However in his board VGN used a H-bridge driver to give bidirectional shutter control (which also gave him a driver for the focus motor, as it's a dual H-bridge driver). The shutter I have definitely needs bidirectional control to return fully to the open position, but it's somewhat damaged so I'm not certain this applies to undamaged shutters.
 

Offline horstmannhid

  • Contributor
  • Posts: 14
  • Country: de
Hi daedolon,

thanks for your answer. I didn't know about the first project. Maybe it's also helpful.

I knew about the second link. I just wanted to order the breakout board. Just refitted the connector to a one that is possible to order at Digikey. But I think it doesn't make sense to assemble all that because it's also not cheap. I have got no final plan yet. I think I will assemble the original boards from Vaagn as I already have got them and try to get it running with the existing code. I will share the Digikey part lists here.

I succesfully opened the Vivado project in Vivado 2020.2 and ported it to the actual version 2023.2. Don't know yet if it all works with the new version but I created two pdf's of the last block design from this project.
The microblaze has to initialize at least the BRAM's for the color palettes and of course the VDMA. What I don't understand right know is how the color palettes (axis_palette_lut) should look like. But I think that's a thing that I'll find out. A lot of example code how to initialize the IP's can be found here: https://github.com/Xilinx/embeddedsw.github.io/blob/master/axivdma/examples/vdma_api.c
My own test with the small MLX90640 also had a VDMA and works with two frame buffers. But its only a small test project which has got no final stage and is very slow because a lot is running on the microblaze. So nothing to really share  :)

And of course the microblaze has to create an OSD (on screen display) image with 0xFFFF for every tft pixel (320x240) to just show the thermal image. When you want to show a menu it is possible to show it as an overlay. That's how the "lcd_ctrl.v" is designed.

That's so far what I found out. Hopefully I'll get it running.
 
The following users thanked this post: daedolon

Offline horstmannhid

  • Contributor
  • Posts: 14
  • Country: de
https://github.com/festlv/isc0901b0-breakout
This is the project the USB webcam converter is based on. This one's "just" a breakout board that supplies power. It does have unidirectional shutter control. However in his board VGN used a H-bridge driver to give bidirectional shutter control (which also gave him a driver for the focus motor, as it's a dual H-bridge driver). The shutter I have definitely needs bidirectional control to return fully to the open position, but it's somewhat damaged so I'm not certain this applies to undamaged shutters.

Sorry forgot to say. Your shutter is damaged. I have got an unused NV3 camera and the shutter is returning itself with a spring.
 
The following users thanked this post: daedolon

Offline horstmannhid

  • Contributor
  • Posts: 14
  • Country: de
We have to use Vivado 2020.2. The Hyperram module isn't supported by the newer versions of Vivado but that doesn't matter.

Here are the BOM's for the parts at digikey. I chose some replacement parts which are available to order. Almost everything is in stock. I will not assemble everything of the P-Board because it's expensive and not needed in the first step.

OpenIRV_P-Board https://www.digikey.de/de/mylists/list/Y2DV4BHYMK

OpenIRV_M-Board https://www.digikey.de/de/mylists/list/E8V9XF2ZES

OpenIRV_F-Board https://www.digikey.de/de/mylists/list/4EW9TYYM5X

OpenIRV_D-Board https://www.digikey.de/de/mylists/list/U7877XPDF7

OpenIRV_B-Board https://www.digikey.de/de/mylists/list/49EETGAR8X
 
The following users thanked this post: daedolon

Offline daedolon

  • Newbie
  • Posts: 2
  • Country: au
Thanks for all that. I'm a software guy by trade, plenty of firmware experience, but none with FPGAs. I'm hoping to find the time to stick my head into these HDLs and see what I can do with them.

Thanks for the tip on the shutter too, that's what I suspected. I'll see if I can hook a return spring on it externally.
 

Offline horstmannhid

  • Contributor
  • Posts: 14
  • Country: de
The hardware in Vivado is finished and should hopefully work. I already synthesized it and created a bitstream in Vivado and exported everything to Vitis. In Vitis it's "only" some C code writing for initializing everything.

Takes some time for me to build everything. There are still some components missing. Cables etc. I will post an additional BOM with all additional parts needed.
 
The following users thanked this post: ArsenioDev


Offline isuzulake

  • Contributor
  • Posts: 14
  • Country: cn
TKS,It's very cool. I wish you sucessful for it.  :-+
I like it.
 

Offline sslupsky

  • Contributor
  • Posts: 11
  • Country: ca
Wonder if it would be worthwhile to consider porting the FPGA to an open source platform such as LiteX?
https://github.com/enjoy-digital/litex
 


Share me

Digg  Facebook  SlashDot  Delicious  Technorati  Twitter  Google  Yahoo
Smf