[Edit: title of post changed from “Intel RealSense SDK port” to “NUItrack port” based on obsolescence of features pointed by @motzi below]
For an upcoming project, we are urgently looking for a port of the Intel RealSense SDK to vvvv/VL.
We are working on a couple of installations involving body & face tracking, and while good ol’ Kinects would surely do the job, the tiny size of Intel’s would help a lot on the integration side of things; and this would also be a good opportunity to have a more conveniently available and supported hardware/software combo for 3D tracking (until Microsoft Azure shows up and changes the game, possibly?).
I did not have the time/opportunity to dive into VL just yet, so maybe this is not that big of a mountain importing/wrapping the SDK .dll, but we’d rather delegate that to people more fluent on this workflow so we can focus on the other tasks involved.
I have seen threads and posts with first attempts at it, mostly focused on the depth image, but we need the higher level functions as well, especially the face tracking and body tracking.
I’ve found (unfortunately outdated) links from @microdee pointing to a “simplified pipeline” draft, so maybe this has even grown into something since then?
I even found this contribution on GitHub (straight from Japan!) that claims RGB, Depth, hand/face tracking, speech recog, etc. but I can’t have it to work (I’ve shot an email to the dev)
and I’ve seen users like @Aurel already suggested a community joint force to make this proper port a couple of times.
So let’s do it?
We are willing to fund this (in part or in whole, depending on the price tag), and would release this back to the community, as this should make a lot of us’ lives easier.
Of course anyone willing to jump in and participate in the effort is always welcome!
This is pretty urgent as the project is about to get confirmed in the very next days, and production will have to get on solid tracks (including work-in-progress reports) almost right away.
Event is scheduled end of June, but functional prototypes must be delivered to the client in 2 to 3 weeks tops (May 27th); so while we can work on the content and other tasks in the meantime, we’d need the RealSense side of things within 2 weeks for proper integration…
In case we can’t make it in time with Real Sense, we’ll fallback to Kinects.
Up for it? Hit me up!
Already done it? Hit me up!
Want to hit me up? Hit me up!
Sidenote: another route would be to approach it NUItrack style, like @schlonzo and @robotanton have been playing with here, which would have the advantage to be sensor agnostic and maybe reduce the hassle of hardware-dependent efforts.
(btw any performance/feature thoughts or experience as to Nuitrack VS Intel’s SDK?)
And finally here are a bunch of Intel resources for your reading pleasure:
Dev documentation portal
official .NET wrapper
Face and head tracking using the Intel RealSense SDK
Face Tracking tutorial