VL.Devices.Nuitrack

Minor update: previously hidden Overview help patch is now visible under Learn/Explanations in the Help Browser.

thanks for your work. having proper depth cam support should prove handy in the future!

I tested the realsense today, it works quite well so far. What is the Min Z/Max Z unit? mm or something?

next would be to have a long-term test (to make sure it is viable for installations) and a 3d test, if the pointcloud can be used to reconstruct the world similar how the late kinect2 did.
for that I would need a way to use your gamma advances in beta.
would it work to simply update some of the nugets and dlls?

@velcrome glad to hear it is working for you. Min and Max Z are in mm (at least for a Kinect2).

Regarding stability I believe @Elias had it running for days with no major issues.

As for the pointcloud, the current solution is far from production ready specially regarding performance. A GPU (Xenko/Stride) approach will be the way to go when that finally lands in VL. In the meantime some improvements could be made but don’t get your expectations too high. (Kinect2 is performing significantly better already if that helps).

As far as beta goes I have no knowledge on what is needed to get this playing along with it but I suspect it involves .netcore and other lower level plattform bits which are beyond the library implementation itself.

I should find time soon to update the VL integration layer of beta to incooperate the latest VL bits. Just updating the packages won’t work because of bigger changes brought by new roslyn backend.

But in theory once we have VL back in its newest form in beta, and beta having DX11 it should be possible to upload the pointcloud to the GPU in a more performant way - I think the basic infrastructure should already be there.

Hi

VL.Devices.Nuitrack works here fine with vvvv_gamma_2019.2.0-0321
but not with the actual vvvv_gamma_2020.1.0-0032

Greets

Argh, thanks for reporting. Pushed a new version (>= 0.1.21) which should be compatible with 2020.1

thx, but still not working in vvvv_gamma_2020.1.0-0040
pointcloud ok but RGB, skeleton and so on - off

Hm homeoffice is not helping now ;) Device is in the office, will report back once I have it.

Ok I also had no color image, also not in their official application. Turned out it was a config issue, see https://community.nuitrack.com/t/no-rgb-feed-unity-astra-pro/1197

@TremensS latest nuget now includes face landmark detection via Instances node.

2 Likes

Awesome news! :)