Many Crashes later...
Using the TensorflowSharp library and Alpha x64 (its a 64 bit library).
It should be possible to import models to use but I'm a while away from that.
A visual programming language and a machine learning library should be a good fit, what, with the the visible overview of the graph, but a vl library is going to need some thoughtful design choices, There are quite a lot of ways to muck things up at the moment and I haven't tried anything fancy.
The documentation for the C# wrapper is a little lacking, there are still some bugs and seemingly redundant nodes. Oh and there's a pretty big memory leak somewhere, its a pretty barebones c# port of the c library; no stablizers.
Like the mainline python, chages happen quite frequently, and do break things.