I just started to work on a personal mixed reality project using Hololens.
It’s a long term project,but I would like to prototype things fast to have a first idea…
For the moment, the only compatible engine with Hololens is Unity.
But I would like to find how to use my favorite multi-purpose toolkit in a way or another…
Here are the options:
The Hololens is a standalone computer, but it can use the computational power of a desktop PC with a GPU, communicating in Wifi, using Microsoft Holographic Remoting (a library available as a NuGet package)
This library could be a good candidate for the brand new VL Library Import feature?
A cool scenario would be: Hololens send the sensors data through wifi, VL display theses data into VVVV, VVVV calculates the texture using DX11, VL send the texture to Hololens.
Another option: Using Unity as the authoring and compiling tool, and VL for the logic parts.
As VL can show the C# code, and Unity uses C#…
I guess the goal of that “Decompiled IL Code” window is for this kind of scenario, isn’t it?
I’m not at all into code, and I suspect it can’t be as simple as a copy/paste…
Another option: using Unity and VVVV/VL remotely (using ZeroMQ or OSC?).
For sure the most realistic option.
Problem in that case is synchronization between apps.
For example, calculating the transformations of an object using VVVV, sending the position data to Unity, and sending the texture from Unity to Hololens (via Holographic Remoting).
The mainloops not being synced could lead to artifacts like stutter…
Not an option for now, but a question for the future:
To be able to run on Hololens, an app should be an UWP app.
Could the VL standalone app be UWP compatible at some point?
I will investigate more about these hypothetical workflows, I just wanted your expertise about what’s easy, what’s possible with a huge amount of work, what’s totally impossible, and what’s would be possible in the future.