Aligning RGB and Depth Kinect2


#21

hei @rogalag , thank you for the patch.

i have a question how to get a result like evan? i already combine it with rgb but the result always have a red color in front of the rgb.

[solved it using color channel remap]

thank you


#22

I try to align the HD RGB stream on a mesh I created with Mesh(DX11 Pointcloud).
The mesh is based on a preprocessed version of the depth channel.

So I guess I basicly need the exact opposite of the FilterAllToRGB shader @antokhio posted earlier.
Like FilterRGBtoAll. Is this somewhere hidden inside “kinect toolbox” or did I oversee something?

fyi: I am trying to marry Kinect2 with SuperPhysical, DOF and maybe SSAO. I try to get a visual representation that is as close to reality as possible - to start messing with mesh and texture from this point.

I will add the patch (based on older version of SuperPhysical), to show the problem only (I guess it will show alot red)
It was living in 03 SuperPhysical - SCENE folder which I did not copy into packs. Any additional TFX have been added right to this folder (in a bad manner).

SuperKinect_test.zip (15.2 KB)

One addition: It seems as if the RGB and depth stream are not perfectly in sync. The timestamps differ for sure, depending on your hardware - and even cable - there can also be dropped frames. You can try to work against this with Framedelay (DX11 Texture 2D) by vux.


#23

Here Meier you can rip it off here

kinect PC.zip (1.7 KB)

it’s a little bit more extended version, i use to send kinect over network.
right now it writes world tex to rgb and kinect rgb to alpha
you can remove world and keep only projected rgb there…