jstrecker's picture

Jaymie (@jstrecker)


  • Vuo Founder
  • Team Vuo
jstrecker's picture

When the Vuo 2.0 beta is released, I think you'll be able to download and install it just like a regular Vuo version. We'll make another mailing list / blog post when it's ready. I hope you'll try it since we'd especially like to hear from people like you who have not used similar apps before. During beta testing, we mainly just want folks to use Vuo like they normally would and see if they run into any problems or anything confusing.

jstrecker's picture
@jstrecker commented on @Scratchpole's Discussion, “Have you seen OpenPose?

Thanks for the tip. We looked into OpenPose in OpenCV to see if it would be compatible with Vuo. Although the OpenPose model dataset is still noncommercial, there's an alternative dataset with a license that should work for us. They say that macOS support is coming sometime in 2019. With macOS support, we could consider OpenCV for the built-in skeletal tracking feature request.

jstrecker's picture
@jstrecker commented on @root's Feature Request, “Node set for skeletal tracking with Kinect

We recently surveyed a bunch of skeletal tracking libraries. Of the 27 we looked at, 3 are viable candidates to include in Vuo:

  • BodySkeletonTracker
    • head and arms only (no torso or legs)
    • depth camera required in practice, based on our brief testing
  • Skeltrack
    • head and arms only (no torso or legs)
    • depth camera required
  • PoseEstimation-CoreML
    • better tracking than the other two, based on our brief testing
    • uses regular camera, not depth camera
    • requires macOS 10.13+, not Windows/Linux-compatible

The other 24 libraries we considered wouldn't currently work with Vuo for one reason or another: Windows only, proprietary or non-commercial license, incompatible programming language, etc.

So we will likely choose one of the above libraries, unless something better comes along by the time we implement this feature request.

All of the above libraries input an image rather than interfacing directly with a Kinect or other camera. PoseEstimation-CoreML uses a regular video camera. Skeltrack requires a depth camera. BodySkeletonTracker says that the depth camera is optional, but we weren't able to get it to track without one.

Now that we have a better idea of the libraries we might use, I've bumped this feature request's complexity rating down a notch, meaning we will be more likely to choose it compared to a more complex feature with a similar number of votes.

jstrecker's picture

Chris, I discussed your suggestion with the team. While I totally understand not wanting to spend money on something that's going to be free soon, it would take us some time and possibly even a new release to unlock the trial version. We think it would be better to focus on getting the 2.0 beta release out instead.

jstrecker's picture

The problems that we've seen generally occur for certain combinations of GPU hardware and macOS version. That probably means they're bugs in Apple's driver code.

When two closely related GPUs use the same driver, such as the Intel Iris 640 and 650, it's likely that a problem seen for one GPU will also show up for the other.

However, sometimes more distantly related GPUs share the same driver, and not all manifest the same problems. For example, we think that the AMD Radeon Pro 555X uses a driver called AMDRadeonX4000GLDriver — which is also used by the AMD Radeon R9 M370X, the AMD FirePro D500, and the AMD Radeon 7970. The FirePro D500 and Radeon 7970 both have known issues. Yet my coworker is using a Radeon R9 M370X on macOS 10.14 and Vuo's graphics all work fine for him.

So that's why we always say, if you're thinking of buying some hardware, it's best if you can test Vuo on the system configuration before buying.