Looking for Image Signal processor that supports >10MP CMOS image sensor..

[sangar]

Hello All,

I am trying to get an ISP which support >=10MP CMOS image sensor for my Monochrome camera...I have looked at On Semiconductor's ISP, unfortunately, they support up to 2MP...If anyone has come across the ISP with >10MP support, please suggest...

Thanks,
Sangar

[frozenfrogz]

Lattice acquired Silicon Image about ten years ago. SI had ISP ICs like the camerIC-18

[NiHaoMike]

What framerate are you going for? A FPGA might be the way to go if the sensor is so unusual that common SoCs are not compatible.

[sangar]

Hi,

frozenfrogz, thanks...I will look at SI...

What framerate are you going for?

Thanks...Our CMOS image sensor Frame per second is 60 fps...

Regards,
Sangar

[sangar]

Hi frozenfrogz,

I am not getting anything in the lattice semiconductor website by typing "Camera IC-18" but there is Helion IONOS IP, provided by Lattice, which supports up to 12MP sensors...If you don't mind, could you share the link of datasheet (or) product manual of "Camera IC-18"...


Thanks,
Sangar

[frozenfrogz]

Sorry, I think I did not express myself correctly. The SI CamerIC is EOL, but I my guess is, that Lattice should have some products that might fit your need, since they acquired SI and all of their IP.

http://www.latticesemi.com/Solutions/Solutions/SolutionsDetails02/VideoManagement

I was just pointing you "in that direction", so you can contact them with your specific design criteria.

[NiHaoMike]

Thanks...Our CMOS image sensor Frame per second is 60 fps...

10MP+ and 60FPS at the same time or just one at a time? Keep in mind that 4K is 8MP and a 4K 60FPS camera is already getting into the high end as far as consumer cameras are concerned.

[sangar]

Hi,

10MP+ and 60FPS at the same time or just one at a time?

I don't understand your question...Are you asking that 60 frames will be sending to the ISP at the same time (or) one by one , which means 1/60 = One frame/16ms...I am not sure but I think that the later one is our case...


Thanks,
Sangar

[ebastler]

10MP+ and 60FPS at the same time or just one at a time?

I don't understand your question...Are you asking that 60 frames will be sending to the ISP at the same time (or) one by one , which means 1/60 = One frame/16ms...I am not sure but I think that the later one is our case...

I think NiHaoMike was asking whether your camera is meant to support different modes -- a "full resolution" mode with 10 MP but slower frame rate, and a "fast mode" with 60 FPS but limited resolution. Or do you actually intend to capture 10 MP images at 60 FPS, which would be quite a challenge?

[Berni]

The Jetson AGX Xavier can handle a lot of pixels being thrown at it, not only being able to take them in, but also process them and compress into a video format.

But you will need the image sent over multiple MIPI CSI camera buses to get it in as a single 4 lane MIPI bus will not handle the ridiculously high bandwidth of 13MP 24bit at 60fps (about 19 Gbit/s)

But doing 13MP at lower framerates is easy.

[sangar]

Hi,

Thanks...

I think NiHaoMike was asking whether your camera is meant to support different modes -- a "full resolution" mode with 10 MP but slower frame rate, and a "fast mode" with 60 FPS but limited resolution. Or do you actually intend to capture 10 MP images at 60 FPS, which would be quite a challenge?

My image sensor's max resolution is 3840 (H) × 2160 (V) which is 8.3 MP and it says that 60 fps at the max resolution. I don't see anything like the "fast mode" with low resolution in the specification...
 
Should my ISP be capable to receive all 60fps without missing?... I mean that I should have an ISP which supports >=60fps at 3840 x 2160 - equals to 4K.

Please correct me if I am wrong...

[NiHaoMike]

So you have an image sensor that is fairly high spec, but is such that common smartphone SoCs cannot directly interface with it? If there's no SoC/ASIC to interface with it, a FPGA is pretty much the only answer. Are you planning to record the video locally or send it to some remote system in real time?

[sangar]

Hi NiHaoMike,

Thanks. Though the Soc we are using has ISP, its performance is very poor. That is why we had to go with an external ISP. Have you seen any FPGA based ISP that well suits for our requirements?... If yes, please share with me. It will be a starting point...



Thanks,
Sangar

[NiHaoMike]

Then you probably want a faster SoC. Without knowing the system requirements, it's hard to recommend one but handling 4K60 encoding in real time is not that exotic. (More than that is, however.)

A FPGA is just a "digital breadboard on a chip", it's up to software to program it to do what you want. Modern ones have hard DSP blocks that allow them to be competitive with dedicated DSPs. (If you can also make good use of the programmable logic, that is - there's a reason why dedicated DSPs are still being made.)


I still think a faster SoC is the way to go. One possible exception is if you're going for extremely low latency (e.g. a microscope that outputs HDMI), something FPGAs excel at.

[sangar]

Hi,

Thanks...

any FPGA based ISP that well suits for our requirements?

Maybe, I did not express myself correctly for the above...

I was asking for an IP for ISP from vendor like silicon image, which can put in FPGA...

Thanks,
Sangar