Forum

Multiple kinects into one texture

Hi All

I am about to make an installation using 3 kinects to cover a larger area. Is the any experience in merging the depth maps from the kinects and ideally using all 3 kinects as one, both in regards to the depth map but being able to track skeletons across all 3 kinects so one person can move seamless from one kinect to the next.

Currently I am thinking that it must somehow be possible to do some sort of conversion from distances from the sensor to distances from plane of kinects.

any ideas would be appreciated.

sunep

seamless walking seems quite a challenge
but, sure it’s possible to sort out, just need to know layout.

vvvvery interesting thread. +1 for any suggestions.

A few pointers:

With overlapping Kinects you have to deal with interference. Here are two interesting articles on how to overcome these problems by using a small vibrating motor:

http://research.microsoft.com/pubs/171706/shake’n’Sense.pdf

http://www.cs.unc.edu/~fuchs/kinect_VR_2012.pdf

Being able to track across the whole range would mean to calibrate the cameras accordingly. You could have a look at some of the projector calibration scenarios - e.g. using a checker board etc.

Heres an article about that with multiple kinects:
http://www.graphics.tu-bs.de/media/publications/multikinectsMocap.pdf

I think it should be possible to achieve this also without doing your own tracking, by comparing joint positions and knowing the cameras position / angle.

I think this is interesting too, if you wanna make a joint effort at a multi kinect module i would gladly help.