👨 Face Landmark Detection
Now we have already "Find Faces" with eyes recognition, but what about like a 3D mesh of the face like TensorFlow again their "Face Landmark Detection ?) Would that be useful in Vuo, don't know ;) Would we want to create some AR Masks with Vuo ? ;)
Can I create some feature requests for those ? Or have I missed some that already exist ?
A general question about those from my limited understanding about the topic, does for example those TensorFlow models come like pre-trained algorithms ? Or do you have to train them yourself ? Or is training them yourself a possibility also if you wanted to ? I see on the Apple CoreML page you can load trained models but also create some with CreateML ?
Regarding Apple Models or libraries like Tensor's Models, I guess it's again kinda the question about Vulkan/OpenGL or Metal ? If a Windows version is still in the pipelines, the Vuo Team would have to implement CoreML for Mac users, and add some workload to implement different techniques for other platforms, so open source multi platform tools require less effort ?
Of course, some Apple tools are really optimised for Apple products, so I guess as Jean Marie seem to say, it's about testing out performances and possibilities and finding the right balance ? How for example does Apple's new Skeletal Tracking performs VS TensorFlow's one ?
I've stumbled across some what seem to be very efficient technologies, like the Banuba ones which of course come with a paid license, maybe those are the technologies used by Zoom for background removal (thought Snapchat would use it too, but I see they acquired another startup in this domain for their technology).
I say this because sometimes the open source and free libraries seem less performant, and I guess it's up to the team to find those that work best, but those from Tensor seem to work pretty great !?
Of course I'd love to be able to implement such libraries and models myself into Vuo, but I can barely create some stateless nodes using the given API functions, I can't even create stateful nodes or custom functions ;)
I remember Martinus asked some questions about implementing stuff, can't wait to see what he's coming up with ;)
And also there is a feature request about a tutorial to implement libraries. Can't wait ;)
However, with embed and controls activated, with mouse support, I can play / pause, but not change volume, or access settings.
Guess that is some rendering engine limitations that could be updated ?
I also tried some higher resolutions, but got glitches, maybe because of my old hardware (which I could not replicate), but setting node resolution to 1920*1080 I get extreme low FPS, Vuo editor becoming slow etc.
Is it because the node needs to reload every time ? How would we be able to avoid that ?