Punting this out there before the weekend properly takes hold
ONNX_Dev.7z (3.9 MB)
What is ONNX?
ONNX stand for open Neural Network eXchange. its basically means you can save a standard machine learning model from one of the many machine learning frame works like PyTorch, Tensorflow, CNTK etc, and run them in your program
With VLML ONNX you can run models with NVIDIA Cuda-based GPU acceleration for high performance. Included in this package is an example of how to work with images at to apply style transfer. It uses VL.OpenCV to achieve this, but it could use other kinds of data input.
In general this is a very efficient way of inferring (evaluating) machine learning models, probably faster than running an equivalent model from within any particular framework.
It isn’t possible to retrain an ONNX model. For this you can use VLML and convert the model into an ONNX model.
Requirements
- recent version of vvvv Gamma
- recent version of OpenCV
-
Nvidia GPU (GTX 7xx and upwards)
with up-to-date drivers for CUDA. - VLML installed
There are planety of models you can try out here though I’m don’t know if they will all necessarily work with this WIP. If you have any questions about them this or VLML.
Got more to say on VLML but I’ll save that for the other thread
H