Bodysoulspirit's picture

@Bodysoulspirit

I made a donation to Vuo.
Bodysoulspirit's picture
Bodysoulspirit commented on tarakhanal's Composition, “My very first composition

Welcome to Vuo ;)

Bodysoulspirit's picture

Not a VDMX user, but because the analog node was added in the latest Vuo version, it might be this : Vuo x VDMX: Update to latest framework ?

Bodysoulspirit's picture
Bodysoulspirit commented on Motus Lumina's Composition, “Data Glitch

Nice job ;)

Bodysoulspirit's picture
Bodysoulspirit commented on keithlang's Feature Request, “CoreML integration

Cool topic, thank you for opening it Keith !

I see on Tensor's Hand Face Detection Model page they write multiple hand tracking is coming.

Jumping on the train with my limited understanding of all this :) Have some questions, maybe someone can answer me some.

There are some blob tracking feature requests already and this topic is about hand tracking, but are there yet some requests that I could have missed regarding

  1. 🏞 Image segmentation for people / background removal for example ?
    Using non-depth cameras like the Kinect, for example to extract the person only from its background from a webcam (would something like TensorFlow's BodySegmentation be better for this, or TensorFlow's Sementic Segmentation ?)

  2. 💀 Also, some skeletal tracking without Kinect (for example TensorFlow Pose Estimation ?).

  3. 👨 Face Landmark Detection
    Now we have already "Find Faces" with eyes recognition, but what about like a 3D mesh of the face like TensorFlow again their "Face Landmark Detection ?) Would that be useful in Vuo, don't know ;) Would we want to create some AR Masks with Vuo ? ;)

  4. Can I create some feature requests for those ? Or have I missed some that already exist ?

  5. A general question about those from my limited understanding about the topic, does for example those TensorFlow models come like pre-trained algorithms ? Or do you have to train them yourself ? Or is training them yourself a possibility also if you wanted to ? I see on the Apple CoreML page you can load trained models but also create some with CreateML ?

  6. Regarding Apple Models or libraries like Tensor's Models, I guess it's again kinda the question about Vulkan/OpenGL or Metal ? If a Windows version is still in the pipelines, the Vuo Team would have to implement CoreML for Mac users, and add some workload to implement different techniques for other platforms, so open source multi platform tools require less effort ?
    Of course, some Apple tools are really optimised for Apple products, so I guess as Jean Marie seem to say, it's about testing out performances and possibilities and finding the right balance ? How for example does Apple's new Skeletal Tracking performs VS TensorFlow's one ?
    I've stumbled across some what seem to be very efficient technologies, like the Banuba ones which of course come with a paid license, maybe those are the technologies used by Zoom for background removal (thought Snapchat would use it too, but I see they acquired another startup in this domain for their technology).
    I say this because sometimes the open source and free libraries seem less performant, and I guess it's up to the team to find those that work best, but those from Tensor seem to work pretty great !?

Of course I'd love to be able to implement such libraries and models myself into Vuo, but I can barely create some stateless nodes using the given API functions, I can't even create stateful nodes or custom functions ;)
I remember Martinus asked some questions about implementing stuff, can't wait to see what he's coming up with ;)
And also there is a feature request about a tutorial to implement libraries. Can't wait ;)

Bodysoulspirit's picture
Bodysoulspirit commented on dee's Discussion, “Streaming Video from You tube

Yup, happens for me too.
Plays 1 or 3 seconds from the video, then the video area goes black. Bug ?

2 things,

• either add a mouse support node and click on the video, that reactives the video or
• use /embed ? For example with autoplay and hidden controls it works quite well

See joined comps

However, with embed and controls activated, with mouse support, I can play / pause, but not change volume, or access settings.
Guess that is some rendering engine limitations that could be updated ?

I also tried some higher resolutions, but got glitches, maybe because of my old hardware (which I could not replicate), but setting node resolution to 1920*1080 I get extreme low FPS, Vuo editor becoming slow etc.
Is it because the node needs to reload every time ? How would we be able to avoid that ?

Pages