A node that interfaces with voice recognition tools (such as Siri on Sierra)

Component: 

Notes from Team Vuo

Vuo Pro: 

No — available with both Vuo and Vuo Pro licenses

Complexity: 

●○○○ — Up to a few days of work

Potential: 

●○○ — Appeals to current community

This node would input a set of available commands and listen for commands to be spoken.

It would not interface with Siri (see discussion below).

Comments

We checked out the Apple

jstrecker's picture
Submitted by
Feature status:
Waiting for review by Team Vuo
»
Waiting for more information from reporter

We checked out the Apple framework that interfaces with Siri, SiriKit.

The documentation describes a limitation that I want to make sure you're aware of, which is that SiriKit can only be used for certain specified topics: VoIP calling, Messaging, Payments, Photo, Workouts, Ride booking, Restaurant reservations (Maps only), CarPlay (automotive vendors only).

And, just to let you know, the process for integrating SiriKit with a composition / exported app, as described in the documentation, would be onerous. Unlike a typical framework that is just dropped in when compiling/linking the composition, this one requires significant changes to the compiling/linking process. So this would not be a simple 1-dot-complexity feature request. (An alternative voice recognition technology, OS X Dictation, probably would be 1-dot.)

So, what do you think? Could you maybe describe what you hope to do with this node?

Hey @Jaymie,

alexmitchellmus's picture
Submitted by

Hey Jaymie (@jstrecker),

Thanks for checking Siri out. Sounds like there would be little point integrating Siri into Vuo if OS X Dictation is easier. Does OS X Dictation use any Siri backend services? Or is it a competing technology? Would Siri eventually take over from Dictation?

I will change the request title to simply be Voice Command Node and leave the implementation up to Team Vuo. There could even be a better solution which is cross-platform out there anyway.

It really depends on what you

jstrecker's picture
Submitted by

It really depends on what you want the commands to do.

Siri can handle commands for the topics I listed above.

Dictation, which was added in OS X 10.8, can handle commands to the system or specific applications, such as "Undo that", "Get new mail", "What time is it?" As the name suggests, it can also convert speech to text.

Or if those don't cover the uses you had in mind, possibly there are other options available besides Apple's.

Aha, there's another built-in

jstrecker's picture
Submitted by

Aha, there's another built-in Apple API for voice commands: Speech Recognition. Speech Recognition would work better for commands than Dictation because it listens for a specified set of commands. (Not susceptible to silly dictation mistakes like "turn right" -> "tern write".)

I'll update this feature request and open it for voting.

For Dictation, I've created a separate feature request: https://vuo.org/node/1551

Feature status

When we (Team Vuo) plan each release, we try to implement as many of the community's top-voted feature requests as we have time for. Vote your favorite features to the top! (How do Vuo feature requests work?)

  • Submitted to vuo.org
  • Reviewed by Team Vuo
  • Open for community voting
  • Chosen to be implemented
  • Released