Controlling gadgets with amazon Alexa - June 2018
•Télécharger en tant que PPTX, PDF•
1 j'aime•143 vues
A detailed walk-through of how to write Skills for Amazon Alexa to control gadgets in your house using the Raspberry Pi.
Recommandé
Recommandé
Contenu connexe
Tendances
Tendances (17)
Similaire à Controlling gadgets with amazon Alexa - June 2018
Similaire à Controlling gadgets with amazon Alexa - June 2018 (20)
Plus de Peter Gallagher
Plus de Peter Gallagher (20)
Dernier
Dernier (20)
Controlling gadgets with amazon Alexa - June 2018
- 1. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Beginning to Automate your home with Amazon Alexa PETE GALLAGHER PJGCREATIONS.CO.UK 21/06/2018
- 2. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 About Me Pete Gallagher @pete_codes / @PJGCreations www.PJGCreations.co.uk Pete@PJGCreations.co.uk • IT Consultant • Decades of Desktop, Web & Embedded Software experience • Gadget Addict
- 3. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 What we’re going to be doing… A description of the basic elements Amazon Echo and Alexa An introduction to the software elements Building a Basic Alexa Skill Amazon IoT Smart Home Skills Amazon Rekognition Q&A
- 4. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 The Parts
- 5. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Amazon Echo
- 6. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Amazon Echo “Amazon Echo is a hands-free speaker you control with your voice. Echo connects to the Alexa Voice Service to play music, answer questions, make calls, send and receive messages, provide information, news, sports scores, weather and more. All you have to do is ask”
- 7. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Invocation, Intents and Utterances Voice First Design Connects to AWS Lambda Alexa Skills
- 8. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Skill Name Doesn’t have to be unique Name used for the Store Invocation Used to launch Must be at least two words – Unless you are a recognised brand name Doesn’t have to be unique Choose something Memorable, easy and relevant Can be different to the skill name Can’t use Alexa Reserved Words or infringe copyright Building a Basic Alexa Skill
- 9. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Intents Used to access sections of the Skill Acts as a separation between distinct operations Must be unique to the Skill Naming is only for reference and convention Utterances Per Intent Set out how the user will invoke the Intents Multiple different permutations of how to invoke. Contain Slots – Options fed back to lambda. Building a Basic Alexa Skill
- 10. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Download here: http://bit.ly/AlexaSmartHome2018Instruction s Instructions
- 11. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Let’s Build a Skill… Building a Basic Alexa Skill
- 12. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Serverless Computing Endpoint for Alexa Skills Process and return responses using ASK SDK Can be written in Node, Python, C#, Java, GO Can call out to other services to compute response AWS Lambda
- 13. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Enables Developers to integrate Alexa into their products SDK’s & API’s for Windows, Linux, Mac OS, Raspberry Pi https://github.com/alexa/avs-device-sdk/ https://github.com/alexa/avs-device-sdk/wiki/Raspberry-Pi-Quick-Start- Guide-with-Script Hardware Development Kits from Synaptics, Intel, Amlogic Alexa Voice Service
- 14. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Let’s add a Lambda… AWS Lambda
- 15. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 “Managed Cloud Platform” Allows billions of devices to securely communicate through a centralised location. Devices referred to as “Things” Works even while offline using “Device Shadow” AWS IoT Core
- 16. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 R E S O U R C E S F I E L D IoT and Amazon IoT Core I O T C O R E Device Gateway Message Broker AWS Lambda S3 Storage Queue Notification Service
- 17. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Let’s add a “Thing”… AWS IoT Core
- 18. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Raspberry Pi 3B+ Manufacturer: Raspberry Pi Foundation Processor: Quad Core Broadcom BCM2837 ARM Cortex A53 @ 1.4GHz + 1GB RAM Connectivity: 4x USB, Gigabit Lan, Wifi, Bluetooth LE I/O: 40 GPIO Pins – SPI, UART, I2C, PWM Sensors etc: None Cost: £35 (+ SD Card + PSU + Peripherals)
- 19. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 4 Channel Relay Can switch anything from 3v up to 240v Powered by 5v directly from Pi Controlled via simple logic direct from Pi Mains Relay
- 20. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Mains Relay
- 21. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Code in JavaScript (Node), Python, Node Red etc Node for this example Add Node Packages for AWS (IoT Core, S3 etc), Camera, GPIO Raspberry Pi Code
- 22. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Let’s create some code… Raspberry Pi
- 23. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Simpler Skill System No need to Invoke via a skill name Requires user to link their account to discover Smart Things Building an Alexa Smart Home Skill
- 24. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Let’s Build a Smart Home Skill… Building an Alexa Smart Home Skill
- 25. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Image and Video Recognition Understands Image and Video contents. Understands Expressions and Emotions Can recognise faces when compared to a set of known images. AWS Rekognition
- 26. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Cloud Storage Fast and Cheap Central repository between Pi and Lambda AWS S3
- 27. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Who’s at the door? Adding Rekognition to our Skill
- 28. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Cheese! Taking Photos with the Raspberry Pi Camera
- 29. Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018Beginning to Automate your Home with Amazon Alexa – Pete Gallagher – PJG Creations - 2018 Questions? All done
Notes de l'éditeur
- https://developer.amazon.com/alexa-skills-kit http://bit.ly/AlexaSmartHome2018Instructions
- https://developer.amazon.com/alexa-skills-kit
- https://aws.amazon.com/console/ https://s3.amazonaws.com/webappvui/skillcode/v2/index.html
- https://aws.amazon.com/iot-core/
- https://aws.amazon.com/iot-core/ https://docs.aws.amazon.com/iot/latest/developerguide/iot-policies.html Policy: iot:* Lambda Code: let AWS = require("aws-sdk"); const config = {}; config.IOT_BROKER_ENDPOINT = "a3lr4pxoc781d9.iot.eu-west-1.amazonaws.com"; // also called the REST API endpoint config.IOT_BROKER_REGION = "eu-west-1"; // eu-west-1 corresponds to the Ireland Region. Use us-east-1 for the N. Virginia region config.IOT_THING_NAME = "pi-home-control"; let deviceResolved = ""; let stateResolved = ""; return new Promise(resolve => { updateShadow(deviceResolved, stateResolved, (status) => { let speechOutput = ""; if (status) { speechOutput = status; } else { speechOutput = "Couldn't control the gadget"; } handlerInput.attributesManager.setSessionAttributes(sessionAttributes); resolve(handlerInput.responseBuilder.speak(speechOutput).getResponse()); }); }); function updateShadow(device, desiredState, callback) { // update AWS IOT thing shadow var AWS = require("aws-sdk"); AWS.config.region = config.IOT_BROKER_REGION; //Prepare the parameters of the update call var paramsUpdate = { thingName: config.IOT_THING_NAME, payload: JSON.stringify({ state: { reported: { device: device, // {"Lamp"} state: desiredState // {"Off"} } } }) }; var iotData = new AWS.IotData({ endpoint: config.IOT_BROKER_ENDPOINT }); iotData.updateThingShadow(paramsUpdate, function(err, data) { if (err) { console.log(err); callback("not ok"); } else { console.log( "updated thing shadow " + config.IOT_THING_NAME + " to state " + paramsUpdate.payload ); callback("ok, the " + device + " is " + desiredState); } }); } Add IAM Policies: IOT Full Access Cloudwatch Full Access
- BCM = System on a Chip
- Create Directory Create certs directory Npm init Create index.js Npm install aws-sdk Npm install rpi-gpio var AWS = require("aws-sdk"); var awsIot = require('aws-iot-device-sdk');
- https://login.amazon.com/ Authorization URI: https://www.amazon.com/ap/oa Access Token URI: https://api.amazon.com/auth/o2/token Scope: profile https://alexa.amazon.co.uk/spa/index.html?#cards
- let AWS = require("aws-sdk"); let s3 = new AWS.S3({ apiVersion: "2006-03-01" }); let rekognition = new AWS.Rekognition(); var myBucket = "pjgrekogstore2"; var myKey = "demo.jpg"; return new Promise(resolve => { analysePhoto((status) => { let speechOutput = ""; if (status) { speechOutput = status; } else { speechOutput = "Couldn't check the door"; } handlerInput.attributesManager.setSessionAttributes(sessionAttributes); resolve(handlerInput.responseBuilder.speak(speechOutput).getResponse()); }); }); function analysePhoto(callback) { //for text file //fs.readFile('demo.txt', function (err, data) { //for Video file //fs.readFile('demo.avi', function (err, data) { //for image file let say = ""; rekognition.config.loadFromPath("./config.json"); var params = { Attributes: ["ALL"], Image: { S3Object: { Bucket: myBucket, Name: myKey } } }; try { rekognition.detectFaces(params, function(err, data) { if (err) { console.log(err, err.stack); // an error occurred say = "An error occurred"; } else { console.log(JSON.stringify(data, null, "\t")); // successful response console.log("Getting Face Details"); let gender = data.FaceDetails[0].Gender.Value; let lowAge = data.FaceDetails[0].AgeRange.Low; let highAge = data.FaceDetails[0].AgeRange.High; let mainEmotion = data.FaceDetails[0].Emotions[0].Type; say = "A " + gender + " between " + lowAge + " and " + highAge + " years old, who is " + mainEmotion + " is at the door"; console.log(say); } callback(say); }); } catch (ex) { console.log(ex); say = "An error occurred"; } }; Config.json: { "accessKeyId": "", "secretAccessKey": "", "region": "eu-west-1" }
- Npm install node-raspistill var Raspistill = require('node-raspistill').Raspistill; AWS.config.loadFromPath("./config.json"); var s3 = new AWS.S3(); var myBucket = "pjgrekogstore3"; var myKey = "demo.jpg"; var photoPath = "./photos/image.jpg"; gpio.on('change', function(channel, value) { takePhoto(); console.log('Channel ' + channel + ' value is now ' + value); }); gpio.setup(3, gpio.DIR_IN, gpio.EDGE_RISING); function takePhoto() { const piStillCamera = new Raspistill({ fileName: photoPath, verticalFlip: true, width: 800, height: 600 }); piStillCamera.takePhoto('image') .then((photo) => { console.log('took first photo', photo); analysePhoto(); }) .catch((error) => { console.error('something bad happened', error); }); }; function analysePhoto() { fs.readFile(photoPath, function(err, data) { if (err) { throw err; } params = { Bucket: myBucket, Key: myKey, Body: data }; try { s3.deleteObject(myKey); } catch (ex) { console.log(ex); } s3.putObject(params, function(err, data) { if (err) { console.log(err); } else { console.log("Successfully uploaded data to myBucket/myKey"); var params = { Attributes: ["ALL"], Image: { S3Object: { Bucket: myBucket, Name: myKey } } }; } }); }); };