How to tackle the problem: "Sampling" kinect data in 3D space?

vvvv beta question
2

this VL.Devices.Kinect2 or AsRaw dx11 texture