Forum

Cake23 | WebSocket Hub for Kinect v2 and MIDI controllers


#1

One Sentence: Whats happening in your workshop?
I will present a server-client solution to connect multiple Kinect v2 sensors and MIDI controllers over WebSockets with some web based visualization examples.

What 3 tags describe your workshop?
C#, Kinect SDK 2.0, WebSockets, JavaScript

In which of the three categories does your workshop fall: beginner, intermediate, advanced
Beginner to intermediate level will be sufficient to follow, but there are plenty challenges for advanced users too.

How long will your workshop be?
(Standard formats are 3h or 2x 3h, but other formats may be possible)
Just going through the source code is totally possible in one hour. I did that at Chaos Cologne 2015. Include setting up the development environment, and add another hour. The rest is open-ended creativeness and depends on the participants.

Who is the target audience of your workshop?
People interested in art installations with skeletal tracking and networking. Since the rendering happens in a web page, this is also interesting for JavaScript developers and WebGL shadertoy aficionados.

What knowledge do you presume your participants have?
Basic coding skills in C# are of advantage, but not necessary. Advanced users will be challenged to integrate other sensor types or interfaces to vvvv. The visualization that i bring with me is implemented in VanillaJS. Apart from the SignalR2 library to receive the tracking data, no further externals are used.

What will attendees of your workshop learn?
You will get an introduction to the Kinect SDK 2.0 and the content of the skeletal tracking data object. I will briefly explain how to setup a client-server solution in C# with OWIN Self-Hosting, a little bit of Razor templating, and the SignalR2 WebSocket abstraction layer.
The JavaScript client is basically an advanced shadertoy and maybe a bit too much to go into detail in this workshop. But perhaps we end up hacking glsl shader code.

What technical requirements does your workshop have (apart from internet and a projector)?
The Kinect SDK 2.0 for the Kinect v2 requires Windows 8.1 or 10 and a USB3.0 port. The project is built with Visual Studio. Hosting a http server requires administrator rights. Also don’t forget to bring your Korg NanoKONTROL2 as I have prepared a mapping for the knobs and slider values to shader uniforms.

Who would be the two hosts?
So far, I’m alone.

How would the hosts qualify for the topic? (Describe and add links to portfolio website, github, vimeo,… accounts)
The project sources are hosted here: https://github.com/Flexi23/Cake23
I’ve got a youtube channel too: https://www.youtube.com/user/Fnexxi/videos


#2

Dear Admin, since I’m new to the forum, I can only post two links but I also wanted to add these two:

Here are my recent WebGL experiments: http://www.cake23.de/?C=M;O=D
This is also related: https://twitter.com/Flexi23/status/599582620675153921