Electronics > Open Source Hardware

Open source IR motion tracking - what would be the proprer image sensor

(1/3) > >>

Tomek:
Hi Guys.

[this is my first post by the way]

Introduction (probably just skip it)
I'm thinking about replicating a device called Track IR (http://www.naturalpoint.com/trackir/). Basically it's a game controller that consists of "special" camera and a clip for your headphones that has 3 IR leds. This allows to track your head movements which are replicated in a first person perspective games. Its particularly useful in simulation or racing games like MS Flight Simulator or Formula 1. Its really cool stuff.
There are some open source alternatives like FreeTrack http://www.free-track.net/english/,  but they are based on regular web cameras (or WiiMote) which introduce notable delay (piping full image through USB and processing it on PC) this in turn introduce motion sickness and vomiting ;).
Track IR has 1080p@120FPS image sensor and (most probably) FPGA that processes the image inside the device and sends only processed data down to PC (x & y cordinates of image of ir leds).

I have some experiance with web cam solution. I could buy original TrackIR, but I thought it would be much more fun to build proper one by my self :D.
Open source version might have more versatile application than just head tracking. Ha! It could track any thing.

Here comes technical stuff
I got stuck on very first step in my research - the image sensor.

All i know, is that this project requires camera with following characteristics:

High Resolution - high precision of movement reproduction
High FPS - allows smoothing of movement without introducing significant delay
Low Color depth - 1bit per color would be great if controlling of threshold was possible.
RAW output - ease of processing
up to $15 per piece - its meant to be Open Source ;)
 
Of course when it comes to image sensors bandwidth is main limiting factor. thus I would like to trade color depth for HiRes and HiFPS.
The problem is  that most cameras that i can find on digikey (or any where else) allow for trade of  HiRes vs HiFPS. The "best" case scenario is that camera ic has some codec build-in to compress output.

so my question is: Is there any Image sensor that meets those requirements? Where I should look for it besides usual suspects?

thanks

Legit-Design:
CastAR from http://technicalillusions.com/ is doing sub millimeter, "0.07mm tracking", with really cheap cellphone camera modules, I think they quoted in the range of 1-3$ price for a single camera module. They are doing it now with really small fpga, which is also doing other things, but they are going towards metalized gate array, which is a custom chip. I think they have patented (or will patent) the sub millimeter tracking with optical tricks, will that prevent it to be used in open source thing?

http://technicalillusions.com/?incsub_wiki=tracking
The fpga will process camera information. No need for high bandwidth tracking information, since it only sends the location in all degrees.

The way Jeri explained the leds in one of the videos is that they are just modulating them. One tracking pad on the table has 5 leds, four leds each corner, one led will tell the camera which is the corner to start from.

Tomek:
Thanks Legit-Design
I totally forgot about CastAR. if they did that, it means its doable.  That's definitely a place to look for some answers.
BUT ( :) ) When I was talking about bandwidth limitation I meant throughput between camera and FPGA.(sorry, that probably wasn't clear). It's the limitation of how fast camera can push out data and what data it pushes.
I steel think that proper camera is the secret ingredient. I doesn't mean that it has to be something special. Its just a matter of feature set. I can choose from thousands  of image sensors, but without access to all data sheets to dig into minutia of particular devices capabilities I won't be able to achieve good quality tracking.
Its like Oculus Rift guys not sharing info about screens they are researching, or part numbers removed from components in oscilloscope in one of Daves videos.
I think proper part is the key here.

Any way, CastAR is definitely a great trail to follow. Thanks again :-+

hagster:
I worked on a project that did this about 15 years ago using some basic logic chips. We had an analogue bw camera and ran a threshold detector on the output. Using a fast timer we measured the time between the sync and the first bright spot. Worked pretty well but we could only track on it led. Also the led had to be the brightest thing in the scene. Should be easy with modern hardware.

Legit-Design:
Like Jeri told on one of the CastAR interviews they are also using motion prediction with their technology. Since humans move in a more natural way, any movement will start to slow down before it will stop, so they actually know where subjects head is going to land before it actually lands there, same thing when movement starts.

Navigation

[0] Message Index

[#] Next page