SlideShare une entreprise Scribd logo
1  sur  37
Télécharger pour lire hors ligne
30.01.2017
how to implement chatbots for
alexa and fb messenger
About me
Co-Founder and CTO
Voice and chat user interfaces in combination with
AI to boost productivity at the workplace.
botconnect.io
Senior Analyst in Residence
Observing the technology industry and its impact on business and
society to deliver insight and foresight.
crisp-research.com
how does it work?
• tools/apis/sdks
• orchestration
• data transmission
chatbots
• text (aka chat)
• voice (aka digital assistants)
• medium.com: 10 Differences Between
Voice and Text Conversations
Speech Text
Automatic
Speech
Recognition
Text Intention
Natural
Language
Understanding
Intention Request
Intention
Handling
Request Text
Intention
Handling
wit.ai
wit.ai
app
alexa ask
app
app
alexa ask
Text Speech
Speech
Synthesis
alexa ask
alexa stackfb/wit stack
VUI
TUI
CUI
+
concepts
• intents
• slots, values
• session attributes (context)
• cards
• ssml
tools
• amazon skills kit
• amazon voice service
• amazon lambda (serverless computing)
alexa enabled
device avs/ask
1
Speech
input
4
Speech
output
aws lambda
2 Request
3 Respones
Speech recognition
Voice -> Text
Natural language understanding
Unstructured text ->
structured data (intents,
slots, slot values, session
attributes)
Speech synthesis
Text -> Voice
Intent handler
„emits“ (speech, cards)
wake word engine
audio i/o
audio streaming
LaunchRequest
LaunchRequest
Response
output text
context
IntentRequest
context
IntentRequest
intent
slots
response
output text
context
SSML
LaunchRequest
goto NewExercise
Intent: NewExercise
store result in context
coming soon: lex
• voice & text
• for every device
why should I buy something like a raw
echo dot for 300 bucks?
+
IMDB bot - fb messenger
https://www.omdbapi.com
IMDB bot - fb page
fb messenger api
fb messenger api
wit.ai
app on heroku
to expose app in internet you can use ngrok alternatively
concepts
• entities (incl. intents)
• actions
• context
messenger wit.ai apiappmessenger api
1
message
2
message
app.post(‚/webhook‘,(req,res))
wit.runActions(message)
send
runActions
api
webhook
send API
4
msg, actiontext
3
https://developers.facebook.com/docs/messenger-platform/webhook-reference/message
callback - incoming message1
https://wit.ai/docs/http/20160526#post--converse-link
Renamed into „send“ action
2
3
*
Wit converse api
*
text to fb
text from fb
https://github.com/hunkim/Wit-Facebook/blob/master/index.js
2 getting & handling the message
runActions
• Wit is instantiated with actions,
including ‚send’
• extracts entities from text
• calls actions to create values for
entities
• finally sends text with ‚send‘ action
Handling the message (actions)
https://developers.facebook.com/docs/messenger-platform/send-api-reference
fb send api4
thank you
moritz.strube@mac.com
@mostwi

Contenu connexe

Tendances

Creating applications that can see, hear, speak or understand using microso...
Creating applications that can see, hear, speak or understand   using microso...Creating applications that can see, hear, speak or understand   using microso...
Creating applications that can see, hear, speak or understand using microso...
Radu Vunvulea
 

Tendances (19)

Alfresco DevCon 2019 - DBP on EKS
Alfresco DevCon 2019 - DBP on EKSAlfresco DevCon 2019 - DBP on EKS
Alfresco DevCon 2019 - DBP on EKS
 
AWS Office Hours: Dev and Test
AWS Office Hours: Dev and TestAWS Office Hours: Dev and Test
AWS Office Hours: Dev and Test
 
Hybrid integration and the power of Azure services (Jon Fancey at CONNECT17)
Hybrid integration and the power of Azure services (Jon Fancey at CONNECT17)Hybrid integration and the power of Azure services (Jon Fancey at CONNECT17)
Hybrid integration and the power of Azure services (Jon Fancey at CONNECT17)
 
Azure Serverless Computing with Azure Functions
Azure Serverless Computing with Azure FunctionsAzure Serverless Computing with Azure Functions
Azure Serverless Computing with Azure Functions
 
EF6 and DDD
EF6 and DDDEF6 and DDD
EF6 and DDD
 
IoT and Serverless - AWS - Serverless Summit - Madhusudan Shekar
IoT and Serverless - AWS - Serverless Summit - Madhusudan ShekarIoT and Serverless - AWS - Serverless Summit - Madhusudan Shekar
IoT and Serverless - AWS - Serverless Summit - Madhusudan Shekar
 
Azure Meetup: Novità CosmosDB modalità Serverless e Cognitive Services
Azure Meetup: Novità CosmosDB modalità Serverless e Cognitive ServicesAzure Meetup: Novità CosmosDB modalità Serverless e Cognitive Services
Azure Meetup: Novità CosmosDB modalità Serverless e Cognitive Services
 
Understanding Azure Batch Service - Niloshima - CCDays
Understanding Azure Batch Service - Niloshima - CCDays Understanding Azure Batch Service - Niloshima - CCDays
Understanding Azure Batch Service - Niloshima - CCDays
 
Entity Framework and Domain Driven Design
Entity Framework and Domain Driven DesignEntity Framework and Domain Driven Design
Entity Framework and Domain Driven Design
 
From Zero to Hero Keynote - AWS Startup Day Johannesburg.pdf
From Zero to Hero Keynote - AWS Startup Day Johannesburg.pdfFrom Zero to Hero Keynote - AWS Startup Day Johannesburg.pdf
From Zero to Hero Keynote - AWS Startup Day Johannesburg.pdf
 
O365Con19 - Sharepoint with (Artificial) Intelligence - Adis Jugo
O365Con19 - Sharepoint with (Artificial) Intelligence - Adis JugoO365Con19 - Sharepoint with (Artificial) Intelligence - Adis Jugo
O365Con19 - Sharepoint with (Artificial) Intelligence - Adis Jugo
 
Creating applications that can see, hear, speak or understand using microso...
Creating applications that can see, hear, speak or understand   using microso...Creating applications that can see, hear, speak or understand   using microso...
Creating applications that can see, hear, speak or understand using microso...
 
Azure App Services Azure Bootcamp
Azure App Services Azure Bootcamp Azure App Services Azure Bootcamp
Azure App Services Azure Bootcamp
 
Hybrid connectivity through Logic Apps (Glenn Colpaert - webinar)
Hybrid connectivity through Logic Apps (Glenn Colpaert - webinar)Hybrid connectivity through Logic Apps (Glenn Colpaert - webinar)
Hybrid connectivity through Logic Apps (Glenn Colpaert - webinar)
 
Windows Azure Overview
Windows Azure OverviewWindows Azure Overview
Windows Azure Overview
 
Serverless .NET on AWS
Serverless .NET on AWS Serverless .NET on AWS
Serverless .NET on AWS
 
Dukungan IBM Untuk Pengembang Lokal
Dukungan IBM Untuk Pengembang LokalDukungan IBM Untuk Pengembang Lokal
Dukungan IBM Untuk Pengembang Lokal
 
20160629 Habitat Introduction: Austin DevOps/Mesos User Group
20160629 Habitat Introduction: Austin DevOps/Mesos User Group 20160629 Habitat Introduction: Austin DevOps/Mesos User Group
20160629 Habitat Introduction: Austin DevOps/Mesos User Group
 
Logic Apps and Azure Functions
Logic Apps and Azure FunctionsLogic Apps and Azure Functions
Logic Apps and Azure Functions
 

En vedette

ServerlessPresentation
ServerlessPresentationServerlessPresentation
ServerlessPresentation
Rohit Kumar
 

En vedette (20)

Serverless computing and Function-as-a-Service (FaaS)
Serverless computing and Function-as-a-Service (FaaS)Serverless computing and Function-as-a-Service (FaaS)
Serverless computing and Function-as-a-Service (FaaS)
 
Voice enable all the things with Alexa
Voice enable all the things with AlexaVoice enable all the things with Alexa
Voice enable all the things with Alexa
 
JustGiving – Serverless Data Pipelines, API, Messaging and Stream Processing
JustGiving – Serverless Data Pipelines,  API, Messaging and Stream ProcessingJustGiving – Serverless Data Pipelines,  API, Messaging and Stream Processing
JustGiving – Serverless Data Pipelines, API, Messaging and Stream Processing
 
Amazon Alexa - Introduction & Custom Skills
Amazon Alexa - Introduction & Custom SkillsAmazon Alexa - Introduction & Custom Skills
Amazon Alexa - Introduction & Custom Skills
 
Serverless
ServerlessServerless
Serverless
 
Serverless - Lunch&Learn CleverToday - Mars 2017
Serverless - Lunch&Learn CleverToday - Mars 2017Serverless - Lunch&Learn CleverToday - Mars 2017
Serverless - Lunch&Learn CleverToday - Mars 2017
 
AWS re:Invent 2016: JustGiving: Serverless Data Pipelines, Event-Driven ETL, ...
AWS re:Invent 2016: JustGiving: Serverless Data Pipelines, Event-Driven ETL, ...AWS re:Invent 2016: JustGiving: Serverless Data Pipelines, Event-Driven ETL, ...
AWS re:Invent 2016: JustGiving: Serverless Data Pipelines, Event-Driven ETL, ...
 
PLACING THE BIO-ECONOMY IN THE CONTEXT OF THE CIRCULAR ECONOMY
PLACING THE BIO-ECONOMY IN THE CONTEXT OF THE CIRCULAR ECONOMY PLACING THE BIO-ECONOMY IN THE CONTEXT OF THE CIRCULAR ECONOMY
PLACING THE BIO-ECONOMY IN THE CONTEXT OF THE CIRCULAR ECONOMY
 
AWS Lambda in Practice
AWS Lambda in Practice  AWS Lambda in Practice
AWS Lambda in Practice
 
Serverless and the Way Forward
Serverless and the Way ForwardServerless and the Way Forward
Serverless and the Way Forward
 
Voice Interfaces Usergroup Berlin - 05-10-2016 : Kay Lerch on Morse-Coder skill
Voice Interfaces Usergroup Berlin - 05-10-2016 : Kay Lerch on Morse-Coder skillVoice Interfaces Usergroup Berlin - 05-10-2016 : Kay Lerch on Morse-Coder skill
Voice Interfaces Usergroup Berlin - 05-10-2016 : Kay Lerch on Morse-Coder skill
 
Speech Recognition, Text to Speech, and Voice Interfaces
Speech Recognition, Text to Speech, and Voice InterfacesSpeech Recognition, Text to Speech, and Voice Interfaces
Speech Recognition, Text to Speech, and Voice Interfaces
 
How to Succeed With Rewarded Video Ads
How to Succeed With Rewarded Video AdsHow to Succeed With Rewarded Video Ads
How to Succeed With Rewarded Video Ads
 
Mobile Gaming Monetization Trends in 2016
Mobile Gaming Monetization Trends in 2016Mobile Gaming Monetization Trends in 2016
Mobile Gaming Monetization Trends in 2016
 
KiwiPyCon 2014 talk - Understanding human language with Python
KiwiPyCon 2014 talk - Understanding human language with PythonKiwiPyCon 2014 talk - Understanding human language with Python
KiwiPyCon 2014 talk - Understanding human language with Python
 
Designing a Conversational Intelligent Bot which can cook
Designing a Conversational Intelligent Bot which can cookDesigning a Conversational Intelligent Bot which can cook
Designing a Conversational Intelligent Bot which can cook
 
ServerlessPresentation
ServerlessPresentationServerlessPresentation
ServerlessPresentation
 
ICS2208 lecture4
ICS2208 lecture4ICS2208 lecture4
ICS2208 lecture4
 
Openstack taskflow 簡介
Openstack taskflow 簡介Openstack taskflow 簡介
Openstack taskflow 簡介
 
Combining OpenWhisk (serverless), Open API (swagger) and API Connect to build...
Combining OpenWhisk (serverless), Open API (swagger) and API Connect to build...Combining OpenWhisk (serverless), Open API (swagger) and API Connect to build...
Combining OpenWhisk (serverless), Open API (swagger) and API Connect to build...
 

Similaire à How to implement chatbots for Alexa and Facebook Messenger

Similaire à How to implement chatbots for Alexa and Facebook Messenger (20)

SharePoint Saturday Belgium 2019 Unite your modern workplace with microsofst...
SharePoint Saturday Belgium 2019  Unite your modern workplace with microsofst...SharePoint Saturday Belgium 2019  Unite your modern workplace with microsofst...
SharePoint Saturday Belgium 2019 Unite your modern workplace with microsofst...
 
Solvion Trendwerkstatt - Microsoft Azure + Bots
Solvion Trendwerkstatt - Microsoft Azure + BotsSolvion Trendwerkstatt - Microsoft Azure + Bots
Solvion Trendwerkstatt - Microsoft Azure + Bots
 
AI and Python: Developing a Conversational Interface using Python
AI and Python: Developing a Conversational Interface using PythonAI and Python: Developing a Conversational Interface using Python
AI and Python: Developing a Conversational Interface using Python
 
Microsoft ignite 2019 highlights
Microsoft ignite 2019 highlightsMicrosoft ignite 2019 highlights
Microsoft ignite 2019 highlights
 
SharePoint Saturday Helsinki 2019 - Unite your Modern Workplace with Microsof...
SharePoint Saturday Helsinki 2019 - Unite your Modern Workplace with Microsof...SharePoint Saturday Helsinki 2019 - Unite your Modern Workplace with Microsof...
SharePoint Saturday Helsinki 2019 - Unite your Modern Workplace with Microsof...
 
SharePoint Saturday Warsaw - Conversational AI applications in Microsoft Teams
SharePoint Saturday Warsaw - Conversational AI applications in Microsoft TeamsSharePoint Saturday Warsaw - Conversational AI applications in Microsoft Teams
SharePoint Saturday Warsaw - Conversational AI applications in Microsoft Teams
 
Enterprise Content Sharing Bots & AI
Enterprise Content Sharing Bots & AIEnterprise Content Sharing Bots & AI
Enterprise Content Sharing Bots & AI
 
SharePoint Saturday Belgium 2018 A 21st century lunch bell
SharePoint Saturday Belgium 2018 A 21st century lunch bellSharePoint Saturday Belgium 2018 A 21st century lunch bell
SharePoint Saturday Belgium 2018 A 21st century lunch bell
 
Revolutionize the way you work with AI and ChatGPT..gslides (2).pdf
Revolutionize the way you work with AI and ChatGPT..gslides (2).pdfRevolutionize the way you work with AI and ChatGPT..gslides (2).pdf
Revolutionize the way you work with AI and ChatGPT..gslides (2).pdf
 
Da 0 all'AI conversazionale usando Microsoft Azure
Da 0 all'AI conversazionale usando Microsoft AzureDa 0 all'AI conversazionale usando Microsoft Azure
Da 0 all'AI conversazionale usando Microsoft Azure
 
Building intelligentchatbots
Building intelligentchatbotsBuilding intelligentchatbots
Building intelligentchatbots
 
AWS Artificial Intelligence Day - Toronto
AWS Artificial Intelligence Day - TorontoAWS Artificial Intelligence Day - Toronto
AWS Artificial Intelligence Day - Toronto
 
Amazon Web Services - Strategy and Current Offering
Amazon Web Services - Strategy and Current OfferingAmazon Web Services - Strategy and Current Offering
Amazon Web Services - Strategy and Current Offering
 
Conversations as a Platform
Conversations as a PlatformConversations as a Platform
Conversations as a Platform
 
Use O365 and Azure Cognitive Services for intelligent search
Use O365 and Azure Cognitive Services for intelligent searchUse O365 and Azure Cognitive Services for intelligent search
Use O365 and Azure Cognitive Services for intelligent search
 
BDA306 An Introduction to Amazon Lex, your Service for Building Voice and Tex...
BDA306 An Introduction to Amazon Lex, your Service for Building Voice and Tex...BDA306 An Introduction to Amazon Lex, your Service for Building Voice and Tex...
BDA306 An Introduction to Amazon Lex, your Service for Building Voice and Tex...
 
Azure Logic Apps & AI - Building Integration & AI Solutions
Azure Logic Apps & AI - Building Integration & AI SolutionsAzure Logic Apps & AI - Building Integration & AI Solutions
Azure Logic Apps & AI - Building Integration & AI Solutions
 
Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics
Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics
Dynamics 365 Saturday Melbourne - AI & Bots with Dynamics
 
Tech talk - Microsoft A.I.
Tech talk - Microsoft A.I.Tech talk - Microsoft A.I.
Tech talk - Microsoft A.I.
 
OUGN 2018 - Chatbot and the need to integrate
OUGN 2018 - Chatbot and the need to integrateOUGN 2018 - Chatbot and the need to integrate
OUGN 2018 - Chatbot and the need to integrate
 

Dernier

Jax, FL Admin Community Group 05.14.2024 Combined Deck
Jax, FL Admin Community Group 05.14.2024 Combined DeckJax, FL Admin Community Group 05.14.2024 Combined Deck
Jax, FL Admin Community Group 05.14.2024 Combined Deck
Marc Lester
 

Dernier (20)

Jax, FL Admin Community Group 05.14.2024 Combined Deck
Jax, FL Admin Community Group 05.14.2024 Combined DeckJax, FL Admin Community Group 05.14.2024 Combined Deck
Jax, FL Admin Community Group 05.14.2024 Combined Deck
 
What need to be mastered as AI-Powered Java Developers
What need to be mastered as AI-Powered Java DevelopersWhat need to be mastered as AI-Powered Java Developers
What need to be mastered as AI-Powered Java Developers
 
Top Mobile App Development Companies 2024
Top Mobile App Development Companies 2024Top Mobile App Development Companies 2024
Top Mobile App Development Companies 2024
 
KLARNA - Language Models and Knowledge Graphs: A Systems Approach
KLARNA -  Language Models and Knowledge Graphs: A Systems ApproachKLARNA -  Language Models and Knowledge Graphs: A Systems Approach
KLARNA - Language Models and Knowledge Graphs: A Systems Approach
 
The Strategic Impact of Buying vs Building in Test Automation
The Strategic Impact of Buying vs Building in Test AutomationThe Strategic Impact of Buying vs Building in Test Automation
The Strategic Impact of Buying vs Building in Test Automation
 
architecting-ai-in-the-enterprise-apis-and-applications.pdf
architecting-ai-in-the-enterprise-apis-and-applications.pdfarchitecting-ai-in-the-enterprise-apis-and-applications.pdf
architecting-ai-in-the-enterprise-apis-and-applications.pdf
 
GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates
GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product UpdatesGraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates
GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates
 
A Deep Dive into Secure Product Development Frameworks.pdf
A Deep Dive into Secure Product Development Frameworks.pdfA Deep Dive into Secure Product Development Frameworks.pdf
A Deep Dive into Secure Product Development Frameworks.pdf
 
Microsoft 365 Copilot; An AI tool changing the world of work _PDF.pdf
Microsoft 365 Copilot; An AI tool changing the world of work _PDF.pdfMicrosoft 365 Copilot; An AI tool changing the world of work _PDF.pdf
Microsoft 365 Copilot; An AI tool changing the world of work _PDF.pdf
 
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdfThe Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
 
Community is Just as Important as Code by Andrea Goulet
Community is Just as Important as Code by Andrea GouletCommunity is Just as Important as Code by Andrea Goulet
Community is Just as Important as Code by Andrea Goulet
 
The Impact of PLM Software on Fashion Production
The Impact of PLM Software on Fashion ProductionThe Impact of PLM Software on Fashion Production
The Impact of PLM Software on Fashion Production
 
Odoo vs Shopify: Why Odoo is Best for Ecommerce Website Builder in 2024
Odoo vs Shopify: Why Odoo is Best for Ecommerce Website Builder in 2024Odoo vs Shopify: Why Odoo is Best for Ecommerce Website Builder in 2024
Odoo vs Shopify: Why Odoo is Best for Ecommerce Website Builder in 2024
 
OpenChain Webinar: AboutCode and Beyond - End-to-End SCA
OpenChain Webinar: AboutCode and Beyond - End-to-End SCAOpenChain Webinar: AboutCode and Beyond - End-to-End SCA
OpenChain Webinar: AboutCode and Beyond - End-to-End SCA
 
A Guideline to Zendesk to Re:amaze Data Migration
A Guideline to Zendesk to Re:amaze Data MigrationA Guideline to Zendesk to Re:amaze Data Migration
A Guideline to Zendesk to Re:amaze Data Migration
 
Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024
Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024
Wired_2.0_CREATE YOUR ULTIMATE LEARNING ENVIRONMENT_JCON_16052024
 
Sourcing Success - How to Find a Clothing Manufacturer
Sourcing Success - How to Find a Clothing ManufacturerSourcing Success - How to Find a Clothing Manufacturer
Sourcing Success - How to Find a Clothing Manufacturer
 
IT Software Development Resume, Vaibhav jha 2024
IT Software Development Resume, Vaibhav jha 2024IT Software Development Resume, Vaibhav jha 2024
IT Software Development Resume, Vaibhav jha 2024
 
COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...
COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...
COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...
 
Optimizing Operations by Aligning Resources with Strategic Objectives Using O...
Optimizing Operations by Aligning Resources with Strategic Objectives Using O...Optimizing Operations by Aligning Resources with Strategic Objectives Using O...
Optimizing Operations by Aligning Resources with Strategic Objectives Using O...
 

How to implement chatbots for Alexa and Facebook Messenger