Pointcloud pack kinect output questions

vvvv beta question
#1

patcher here with question about kinect2 in cool pointcloud pack:

  • is it possible to map the depth texture to the generated mesh ?
  • how is it possible to shade the generated mesh other that with the visualizer nodes ? tried phongpoint but no workey

regards

#2

if i may add a question:
why is the rgb texture going on the mesh so low res. theoretically it could be much higher because the rgb is 1920x1080. my guess it has smth. to do with the DepthRGB correction texture that is lower? is there a way around?

#3

Hi,
are you looking for a mesh generated from depth image and shaded as Phong or Gouraud?
First displace the points of a grid with World(Kinect2) using geometry shader, then you need to apply another geometry shader to generate new normals for the displaced geometry. Finally, send the geometry to your favorite shader.

#4

Hi id144,

  • is FaceNormals a node that is available for download somewhere ?
  • is the geometry displace available somewhere ?
  • what are the values inside the texture displace (dx11) ?

thank you

#5

Hi @id144,
can you please write down the nodes you were using, the screenshot is so little I can’t read it. This would help me a lot, thx.

#6

Here is the patch
KinectNormals.zip (836.4 KB)

FaceNormals (DX11.GeomFX) comes from DX11 pack by @vux
There are also two shaders which I wrote - TextureDisplace (DX11.GeomFX) which streams out vertices displaced by values sampled from the world texture and Normals (DX11.Effect) which renders the normals of the vertices.

#7

Another approach is to generate normals from the Z position from the world texture. This allows you to have smoother normals. Correct me if I’m wrong, but geometry shader only allows you to calculate flat normals as it can not access neighboring polygons while pixel shader can access neighboring pixels easily.

KinectNormals.7z (2.3 MB)