I try to align the HD RGB stream on a mesh I created with Mesh(DX11 Pointcloud).
The mesh is based on a preprocessed version of the depth channel.
So I guess I basicly need the exact opposite of the FilterAllToRGB shader @antokhio posted earlier.
Like FilterRGBtoAll. Is this somewhere hidden inside "kinect toolbox" or did I oversee something?
fyi: I am trying to marry Kinect2 with SuperPhysical, DOF and maybe SSAO. I try to get a visual representation that is as close to reality as possible - to start messing with mesh and texture from this point.
I will add the patch (based on older version of SuperPhysical), to show the problem only (I guess it will show alot red)
It was living in 03 SuperPhysical - SCENE folder which I did not copy into packs. Any additional TFX have been added right to this folder (in a bad manner).
SuperKinect_test.zip (15.2 KB)
One addition: It seems as if the RGB and depth stream are not perfectly in sync. The timestamps differ for sure, depending on your hardware - and even cable - there can also be dropped frames. You can try to work against this with Framedelay (DX11 Texture 2D) by vux.