robokit

An electron app for transforming a device (i.e. Mac, Raspberry Pi, etc.) into a voice-driven robot.

Note: This a work in progress.

Medium article about robokit

see also: https://github.com/wwlib/robocommander

Demo Video - YouTube

Config

• duplicate data/config-example.json and rename it config.json
• add your Azure subscription key
• add your LUIS credentials
• (optional) upload docs/luis-robokit.json to LUIS to configure a new NLU app

Building

yarn
yarn rebuild (see below)
yarn start
...
yarn restart

Dependencies

OSX

brew install sox

compiling snowboy for electron

snowboy needs to be recompiled for electron using

yarn rebuild

This is equivalent to electron-rebuild -f -w snowboy See: dolanmiu/MMM-awesome-alexa#91

UI

Say

• Hey Robo, what time is it?
• Hey Robo, tell me a joke.
• Hey Robo, who is your favorite robot?

Notes

RoboKit uses:

• Snowboy (https://www.npmjs.com/package/snowboy) for hotword detection.
• Pixi.js (https://www.npmjs.com/package/pixi.js) for screen animation
• Azure ASR (STT), Azure TTS https://azure.microsoft.com/en-us/services/cognitive-services/
• LUIS NLU https://www.luis.ai/

License

MIT