Alexa Skill Development Workshop slides

1. Bienvenidos y a crear sus cuentas!
developer.amazon.com / aws.amazon.com
Wifi: La Nave – INNOVACION18
@wifi @memodoring @germanviscuso

2. •10:00 Introducción
•11:00 Tareas (ejercicios guiados)
•13:30 Almuerzo
•14:30 Más Tareas (más ejercicos guiados)
•16:00 Hacking libre
Agenda

8. Source: MindMeld
2005 2010 2015 2020
0B
100B
200B
300B
World Wide Searches Per Month
Keyword
Searches
Voice
Searches
Massive shift in voice has
already begun:
• In 2014, voice search traffic was
negligible. Today it exceeds 10%
of all search traffic.
• Today, over 50B voice searches per
month.
• By 2020, over 200B searches per
month will be done with voice.

9. 1970 1980 1990 2000 2010 2020
HUMAN ACCURACY
50% 55%
60% 62%
70%
95%
ASR accuracy has dramatically increased in the last 4-5 years.
This inflection point has created sustained momentum in consumer adoption of
voice technology
Source: MindMeld
A S R A C C U R A C Y

10. Comprised of two important frameworks that enable brands to connect to customers
Lives In The Cloud
Automated Speech
Recognition (ASR)
Natural Language
Understanding (NLU)
Always Learning
ALEX A
V O ICE
SERV ICE
Unparalleled Distribution:
AVS allows your content
to be everywhere
Alexa’s Framework

11. Comprised of two important frameworks that enable brands to connect to customers
ALEX A
V O ICE
SERV ICE
Unparalleled Distribution:
AVS allows your content
to be everywhere
Lives In The Cloud
Automated Speech
Recognition (ASR)
Natural Language
Understanding (NLU)
Always Learning
ALEX A
SKILLS
KIT
Create Great Content:
ASK is how you connect
to your consumer
Alexa’s Framework

13. 2 0 1 5 2 0 1 8
A L E X A H A S M A N Y S K I L L S
5 0 , 0 0 0 +
S k i l l s

15. Demo

16. Tarea 1: Identificar el objetivo de la skill
1. Formar equipos
2. Elegir un escenario de recomendación de algo
Juntar 3-5 datos del usaurio y tener una respuesta relevante. Ex:
busca mascotas, planificador de viajes…
5 Min

17. Voice User Interface Programming Logic
+

18. Voice User Interface Programming Logic
+
developer.amazon.com aws.amazon.com

19. Request
Audio
Response
Your Service
Text to Speech
Machine Learning
Natural Language
Understanding
Speech Recognition
Visual
A L E X A S K I L L S K I T

20. N A T U R A L L A N G U A G E U N D E R S T A N D I N G
• One / Won
• Two / Too / To
• Four / For / Fore
• Eight / Ate
• Tea / Tee

21. Automatic Speech Recognition
foʊr maɪlz
4 Miles
For Miles
Form Isles
For My Isles

22. Automatic Speech Recognition
Asia
Hacia
Has sí a
Haz y ya

23. N O M B R E D E A P E R T U R A
Alexa, abre busca camisetas.
Alexa, pide a busca camisetas una camiseta.
Alexa, pide una camiseta a busca camisetas.
Alexa, dile a busca camisetas que busque una roja.

24. Tarea 2: Escribe el Camino Feliz
1. Escribe un guión
2. Leelo en voz alta a tus compañeros de equipo
Asegurate que todas las interacciones comienzan con el usuario
Debe ser sencillo de decir, y fácil e interesante de escuchar
10 Min

25. E N U N C I A D O S
Alexa, abre busca camisetas.
Alexa, pide a busca camisetas una camiseta.
Alexa, pide una camiseta desde busca camisetas.
Alexa, dile a busca camisetas que quiero una camiseta.

26. Alexa,
activación
Palabra de Activación

27. Alexa, abre busca camisetas
activación nombre de aperturalanzamiento
Frases de Lanzamiento

28. comienza
lanza
corre
resume
pregunta
dile
Alexa, abre busca camisetas
activación nombre de aperturalanzamiento
Frases de Lanzamiento

29. Alexa, pide a busca camisetas una camiseta
activación nombre de aperturalanzamiento enunciado
Enunciados

30. Alexa, pide a busca camisetas una camiseta
activación nombre de aperturalanzamiento enunciado
Enunciados
una camiseta roja
una grande y barata
una marca puma

31. Tarea 3: Enunciados
1. Piensa en que otras formas el usuario puede
pedir una recomendación
2. Piensa en sinónimos, verbos alternativos y
diferentes tiempos verbales
15 Min

32. Intenciones
AMAZON.HelpIntent
Alexa, pide a busca camisetas ayuda
activación nombre de aperturalanzamiento enunciado

33. Intenciones
AMAZON.CancelIntent
Alexa, pide a busca camisetas cancelar
activación nombre de aperturalanzamiento enunciado

34. Intenciones
RecommendationIntent
Alexa, pide a busca camisetas una camiseta
activación nombre de aperturalanzamiento enunciado

35. Intenciones
RecommendationIntent
una camiseta roja
una grande y barata
una marca puma

36. Tarea 4: Intenciones
1. ¿Qué otras cosas puede decir el usuario?
2. Mapea los enunciados a tus intents
15 Min

37. S L O T S
Alexa, abre busca camisetas.
Alexa, pide a busca camisetas una roja.
Alexa, pide una roja a busca camisetas.
Alexa, dile a busca camisetas que quiero una roja.

38. Intenciones
RecommendationIntent
color: roja
una camiseta roja

39. Intenciones
RecommendationIntent
Slots:
{
name: color
value: roja
}
una camiseta {color}

40. {talla}
diminuta
pequeña
mediana
grande
Dame una de talla , precio {precio}
barata
intermedia
cata
{marca}
puma
adidas
Slots
y marca{color}
roja
verde
negra
blanca

41. Tarea 5: Slots & Tipos
1. Identifica patrones
2. Reemplaza palabras de la misma familia con
slots
15 Min

42. Request
Audio
Response
Your Service
Text to Speech
Machine Learning
Natural Language
Understanding
Speech Recognition
Visual
A L E X A S K I L L S K I T

43. Wake word
detection
Beam forming
Visual
Your Service
Text to Speech
Machine Learning
Natural Language
Understanding
Speech Recognition
Request
Response
A L E X A S K I L L S K I T : S I G N A L P R O C E S S I N G

44. Your Service
Text to Speech
Machine Learning
Natural Language
Understanding
Speech Recognition
Response
Visual
Utterances
Intents
A L E X A S K I L L S K I T : U T T E R A N C E S & I N T E N T S

45. Your Service
Text to Speech
Machine Learning
Natural Language
Understanding
Speech Recognition
Response
Visual
Audio
Intents
A L E X A S K I L L S K I T : R E Q U E S T A N D R E S P O N S E

46. Your Service
Text to Speech
SSML, streaming audio
Machine Learning
Natural Language
Understanding
Speech Recognition
Response
Visual
Audio
Intents
A L E X A S K I L L S K I T : O U T P U T

47. Tarea 6: Create la VUI en el Constructor de Skills
1. Agregar tu RecommendationIntent
2. Agreegar tus enunciados
3. Agregar tus slots
15 Min

48. S I N G L E S H O T I N V O C A T I O N

49. S I N G L E S H O T I N V O C A T I O N

50. M U L T I - T U R N D I A L O G S

51. U S E M U L T I - T U R N D I A L O G S

52. Task 7: Activar Administración de Diálogo
1. Haz click en los botones necesarios
2. Agrega los Prompts
3. Agrega Enunciados & Slots
20 Min

53. • alexa.design/guide
A L E X A V O I C E
D E S I G N G U I D E

54. Alexa, open {INVOCATION_NAME}
Alexa, tell {INVOCATION_NAME} to {COMMAND}
Alexa, {INVOCATION_NAME}
C H O O S E Y O U R I N V O C A T I O N N A M E C A R E F U L L Y

55. London
Where would you
like to go?
London, tonight at 6 pmVS
Where would you
like to go?
When? Ok, done!
H A N D L E U N D E R / O V E R A N S W E R I N G

56. the
1 breath
TEST
So your final order is:
1 large pizza, correct?
So I will now recap what you ordered: You
ordered 1 large pizza. Please say yes if you
want to confirm this order, or say no to
change it. You can also add our world
famous cheesy mozzarella sticks for 2
pounds or a milkshake for 1 pound. Thank
you for choosing Uber Pizza. Check out our
Facebook page at uberpizza.co.uk/fb.
Leave a like!
B E B R I E F

57. I confirm.
So your final order is:
1 small pizza, correct?
Actually, make it large.VS
So your final order is:
1 small pizza, correct?
H A N D L E C O R R E C T I O N S F R O M T H E U S E R

58. Would you like
some cheese or
peperoni pizza?
We have cheese or
peperoni. Which
one would you like?
Yes…? Peperoni!
P R E S E N T D E F I N I T I V E C H O I C E S

59. Avoid odd phrasing
Make it clear when a response is needed
Don’t assume the user knows what to do
Clearly present options
Keep it brief; provide variety
Avoid too many choices
Obtain information one piece at a time
And don’t forget to speak naturally
1
2
3
4
5
6
7
8
alexa.design/guide
A D O P T V O I C E D E S I G N B E S T P R A C T I C E S

60. © 2018, Amazon Alexa, All rights reserved.
quiero talla grande quiero tamaño L quiero una holgada
Muchas maneras de decir lo mismo

61. Sinónimos
{size} id Synonyms
tiny xs little
small s little, petite
medium m medium size, average
large l huge, gigantic

62. {energy} id Synonyms
high high high energy, energetic, play fetch, go hiking, hike, run, play frisbee,
that I can run with
medium med plays tug of war, tug of war, fun to play with, for my apartment
low low lazy, to watch amazon video with, to cuddle with
Complex Synonyms

63. "slots": {
"size": {
"value": "huge",
"resolutions": {
"resolutionsPerAuthority": [ {
"status": {
"code": "ER_SUCCESS_MATCH”},
"values": [{
"value": {
"name": "large"
}
}],
…
{size}
tiny
small
medium
large
What Happens Upon A Match?

64. {energy} ID Synonyms
high high high energy, energetic, play fetch, go hiking, that I can run
with
medium med plays tug of war, fun to play with, for my apartment
low low lazy, to cuddle, to watch amazon video with
API Requirements

65. Synonyms
{size} id Synonyms
tiny xs little
small s little, petite
medium m medium size, average
large l huge, gigantic

66. "slots": {
"size": {
"value": "little",
"resolutions": {
"resolutionsPerAuthority": [ {
"status": {
"code": "ER_SUCCESS_MATCH"},
"values": [{
"value": {
"name": "tiny"
},
"value": {
"name": "small"
}}] …
{size}
tiny
small
medium
large
Entity Resolution - Multiple

67. © 2018, Amazon Alexa, All rights reserved.
{pet} Synonyms
dog puppy, pooch
mythical_creatures dragon, unicorn, chimera
Slot Validation

68. "slots": {
"pet": {
"value": "dragon",
"resolutions": {
"resolutionsPerAuthority": [ {
"status": {
"code": "ER_SUCCESS_MATCH"},
"values": [{
"value": {
"name": "mythical_creatures"
}
}]
…
{pet} Synonyms
dog puppy, …
mythical_creatures dragon, unicorn, …
What If The User Says Dragon?

69. Tarea 7: Sinonimos – Resolución de Entidades
1. Hacer click en botones requeridos
2. Agregar Prompts
3. Agregar Enunciados & Slots
20 Min

70. Tenemos la VUI, Construyamos el Back-End!

71. Your Service
Text to Speech
Machine Learning
Natural Language
Understanding
Speech Recognition
Response
Visual
Audio
Intents
A L E X A S K I L L S K I T : R E Q U E S T A N D R E S P O N S E

72. Task 8: Generar Código y Probar
1. Copy your Interaction Model from the Code Editor into
alexa.design/codegenerator and generate code
2. Create a lambda function using that code
3. Iterate on the design / content / code
30 Min

73. Task 8: Personalizar el Código
1. Persistencia
30 Min

74. Task 9: Personalizar el Código
1. Hacer una llamada HTTPs
30 Min

75. Skill Management API – ASK CLI
•Command Line Interface
• Includes AWS CLI
• Requires Node.JS 6.0
• alexa.design/cli

76. twitch.tv/amazonalexa

77. ¡Por favor complete esta encuesta ahora!

78. ¡Gracias!
@memodoring @germanviscuso