Building Arduino robots is pretty cool, but being able to program a robot in Javascript is even better. However, what is even more awesome is the ability to control a robot with Kinect gestures. This presentation provides attendees with a brief introduction to the awesome world of NodeJs, Johnny-Five and Socket.io. The session will deliver an overview of a Kinect gesture detection library and how to connect it to a node-bot.
9. @joel__lord
#NEPHP
Why
• Worked with Nodebots for a while now
• Wanted to explore other possibilities of NodeJs
• Because controlling a robot with a Kinect is pretty cool
@joel__lord
10. @joel__lord
#NEPHP
Why
• Worked with Nodebots for a while now
• Wanted to explore other possibilities of NodeJs
• Because controlling a robot with a Kinect is pretty cool
• But mostly… for fame !
@joel__lord
13. @joel__lord
#NEPHP
Goals
• Needed a way to use events to tell the robot to perform an action
• Gestures seemed the best way to achieve this
@joel__lord
19. @joel__lord
#NEPHP
Johnny-Five
• Uses Javascript to control an Arduino (or other boards) via Standard Firmata
• Also works with a bunch of platforms like Tessel, Raspberry Pi, Particle
• Uses a standard API for all the platforms
@joel__lord
20. @joel__lord
#NEPHP
Johnny-Five’s Hello World
var five = require("johnny-five");
var board = new five.Board();
board.on("ready", function() {
// Create a standard `led`
// component instance
var led = new five.Led(13);
// "blink" the led in 500ms
// on-off phase periods
led.blink(500);
});
@joel__lord
34. @joel__lord
#NEPHP
Gestures 101 - Needs
• A skeleton with an event when it changes
• Know the position of the « COM »
• Have a « base unit »
@joel__lord
37. @joel__lord
#NEPHP
Gestures 101 –Introducing kinect-gestures
• Gesture detection using a base class
• Tracks the skeleton for an initial condition
• Checks every 100ms to see if the condition is still met
@joel__lord
38. @joel__lord
#NEPHP
Gestures 101 –Introducing kinect-gestures
• Gesture detection using a base class
• Tracks the skeleton for an initial condition
• Checks every 100ms to see if the condition is still met
• If the final condition is met, trigger an event
@joel__lord
39. @joel__lord
#NEPHP
Gestures 101 –Introducing kinect-gestures
• Gesture detection using a base class
• Tracks the skeleton for an initial condition
• Checks every 100ms to see if the condition is still met
• If the final condition is met, trigger an event
• Other classes are used to define the actual gestures
@joel__lord
43. DOCUMENT CONFIDENTIEL, TOUT DROIT RÉSERVÉ
PRESENTED BY
The End !
Questions ?
JOEL LORD
August 5th 2016
TWITTER: @JOEL__LORD
GITHUB: HTTP://GITHUB.COM/JOELLORD
Notes de l'éditeur
Thank you to NEPHP for giving me my first talking opp a few years ago
(Daycamp 4 Dev plug)