Hi @otr789, what you are looking for I think is called “feature detection” and would allow you to “recognize” a set of features in an original image within a second image. This exists in OpenCV but has not been implemented in VL.OpenCV as far as I recall.
I can’t imagine bringing the functionality in to be a huge undertaking but I have no time to get into it right now. If you are adventurous you are welcome to look under the hood at how some other nodes are implemented and have a go at adding this yourself.
I can assist you in the process to a degree but am quite busy with work so mileage may vary.
Another option would be to use (invisible) aruco or similar markers with an IR reflective material and to use an IR camera, this would make the markers invisible to the user but available to the CV system.
Adding my two (VL) cents here : Lobe claim their app will be able to do object detection “soon” (scroll down to Project Templates here). I guess it’ll work a easily as what they have right now for image classification : give a set of image, label them, wait for the model to train, and run. When this is released, I could update the VL.Lobe nuget to support this feature. I believe this should be usable in beta as a VL plugin.
It also seems you can train your own Recognition model in RunwayML. I’ve never tried this feature so far but I believe you would then be able to use your train model as a normal one in vvvv (either remotely or locally). I can try to give it a spin in the next days. Also, I’ve never tried the VL.RunwayML nuget in beta, so cannot confirm it’ll work for you :)
Back again! I’ve had some success with training own recognitions models, RunwayML looks very promising but not being able to run models locally on a Windows PC is a dealbreaker for now.
@sebescudie: Thank you for the great Lobe.ai contribution :) If object detection was ready and being able to use a model without having the app ifself open, this would 100% be the perfect fit. Very easy to train and use.
I’m a bit stuck right now, also with limited non-cuda hardware.
My next step would be learning about custom HAARCascade (doesn’t feel so overkill right now anymore) files.
If anybode else has another idea I’d greatly appreciate it!