SlideShare a Scribd company logo
1 of 49
Are bots just a hype?
Once-in-a-decade opportunity
• High demand from companies of all sizes
• Opportunity for more natural experiences
• Users spending more time on messaging apps
• Simpler deployment/update model than apps
• App ecosystem overly crowded
• Everybody wants to automate something
Your bot code
Entity
Extraction
Speech
Vision/Face
Natural
Language
Translation
+ Microsoft Cognitive Services
Search
Emotion
Knowledge
API
…
Message input <> output
State Management
Bot Connector Service
Conversation Canvas/Channels
……
…
Other services, APIs,
Databases, Azure Machine
Learning, Azure Search,
etc…
Bot Builder SDK
Web Chat
Direct Line…
Email
Facebook
GroupMe
Kik
Skype
Slack
Telegram
Twilio (SMS)
An x-ray of a typical bot
Bot Builder SDK
Your code goes here
Register your bot
Connect to channels
Test
Publish
Manage
Measure
Developer Portal
LUIS.ai
• Language Understanding Intelligence Service
• Identify entities and intents of messages
• Train through GUI or programmatically
• Built in LUIS intent handling in bot framework
Tell me scenarios that make sense for a bot
Imagine a new kind of news reading app
That “knows” when you’re
driving and switches to a
conversational experience
(driving = busy hands/eyes = speech)
Bots adapt
AzureBot: Manage your cloud from Skype
Start from the desktop, list
your VMs, start a VM
(it all takes 5 seconds!)
AzureBot: Manage your cloud from Skype
Switch to your phone, confirm you want
to star the VM, receive the notification
when done.
-No logon required
-No app sync required
-Woks across all your devices and web
It. Just. Works.
github.com/microsoft/azurebot
Bots follow you everywhere
Call centers/help desk/customer service
Every company deals with this:
Call centers/help desk/customer service
Every company deals with this:
First
triage/data
collection
No waiting in line to be helped
Bots handle it
Call centers/help desk/customer service
Every company deals with this:
First
triage/data
collection
Simple and
repetitive
solutions
If it is simple and repetitive, it can
be coded. Bots can accelerate it
Call centers/help desk/customer service
Bot to human hand off: Complete or supervised
Call centers/help desk/customer service
Complete bot to human hand off
Thank you for providing all this information. I
have John with me now who will take from here
and help you out
Hello, this is John. I understand your computer
won’t power on. Let’s take a look at some service
options
Call centers/help desk/customer service
Supervised bot to human hand off
I’ve tried these steps, my computer still won’t turn on
Sounds lovely, thank you
I suggest us to request a hardware service. We can have one of
our service engineers look at your computer
Note to operator: It sounds like the user will need hardware
replacement, what next step should I take?
Apologize to
user
Suggest
hardware
service
Let me type
Bots delegate
Knowledge Base/FAQ bots
Bots that an answer any question
about a given data source
(relational, documents, etc)
Check QnAMaker.ai and Azure Search
Bots guide
What makes a bot great?
• It is not how “smart” they are
• It is not how much natural language they offer
• It is not whether they use voice or not
It’s whether it solves the user’s needs in the quickest/easiest
way compared to any other option
It’s all about user experience... Just like an app, or a website
The best bots make you type less, not more
A bot with a single dialog using 100 LUIS intents is a bad design:
Hello user! How can I help you?
One question
100 LUIS intents, * 100 different utterances
per intent = 10000 different things users
may say (plus the other 90000 possibilities
you didn’t predict)
100 different things your bot can do
Users will only guess 3 or so
So you just wasted 97% of your code
So instead:
Hello user! How can I
help you?
Events
Stages
Amenities
What events are you
interested in?
Music
Comedy
Film
Laser Dome
Spectacles
Theater
What music would you
like? (by the way, next
time you could just type
“I’m looking for a song
named xyz” and I will
know what to do)
• Guide the user
• Save time
• Help the user discover what your bot can do
• Users are often terrible at using search on web
• Add search to a bot and now you have a great tool to guide the user into refining their search
• Knowledge base, informational, Q&A bots are great scenarios. They typically use QnA Maker and
Azure Search for it
• QnAMaker.ai:
• Super low friction way of creating a Q&A bot
• Built in web and document crawler: Parses data and builds the QnA easily
• Not great for too many records
• Not great for deep level customization of the experience
• Azure Search:
• Can work with millions of records like a breeze
• Works with different document formats and data sources
• Takes more effort to prepare/code/fine-tune
• Sometimes buttons do everything you need.
• Avoid the engineer’s urge to complicate simple things
Your business requirement is NOT to pass the Turing Test: It is to solve your
user’s problem!
• Spec out an “app kind” of bot: https://github.com/MicrosoftDX/botFramework-
botSpecDocs/blob/master/src/CaaP%20Design%20spec.docx
• Even if standard channels can’t do it, you can always build your own UI/App/Web
• Think richer UIs with bots, HoloLens, etc. It is all possible
• They separate concerns and organize flows, exactly the same way:
• This is how we know how to navigate “back”
• Users won’t necessarily think that way
• You will almost never get it right at first:
• Iterate, test, learn. Again and agian until it “feels right”
• If your bot doesn’t collect data and doesn’t give you ways of understanding what it does well or
not, then it you can’t make it better
Refer to fact #10
Mat Velloso - Bots in the real world
Mat Velloso - Bots in the real world

More Related Content

What's hot

Conversational interfaces - beyond the hype
Conversational interfaces - beyond the hypeConversational interfaces - beyond the hype
Conversational interfaces - beyond the hypeMatthieu Varagnat
 
Building bots to automate common developer tasks - Writing your first smart c...
Building bots to automate common developer tasks - Writing your first smart c...Building bots to automate common developer tasks - Writing your first smart c...
Building bots to automate common developer tasks - Writing your first smart c...Sigmoid
 
Conversational apps UX best practices
Conversational apps UX best practicesConversational apps UX best practices
Conversational apps UX best practicesMatthieu Varagnat
 
Introduction to Microsoft Bot Framework
Introduction to Microsoft Bot FrameworkIntroduction to Microsoft Bot Framework
Introduction to Microsoft Bot FrameworkSam Fernando
 
챗봇 사용자 경험 디자인 (DESIGNING A CHATBOT USER EXPERIENCE)
챗봇 사용자 경험 디자인 (DESIGNING A CHATBOT USER EXPERIENCE)챗봇 사용자 경험 디자인 (DESIGNING A CHATBOT USER EXPERIENCE)
챗봇 사용자 경험 디자인 (DESIGNING A CHATBOT USER EXPERIENCE)Sungjae Hwang
 
Introduction to Chatbots
Introduction to ChatbotsIntroduction to Chatbots
Introduction to ChatbotsDaden Limited
 
Chatbot Artificial Intelligence
Chatbot Artificial IntelligenceChatbot Artificial Intelligence
Chatbot Artificial IntelligenceMd. Mahedi Mahfuj
 
AI and Python: Developing a Conversational Interface using Python
AI and Python: Developing a Conversational Interface using PythonAI and Python: Developing a Conversational Interface using Python
AI and Python: Developing a Conversational Interface using Pythonamyiris
 
Using Machine Learning and Chatbots to handle 1st line Technical Support
Using Machine Learning and Chatbots to handle 1st line Technical SupportUsing Machine Learning and Chatbots to handle 1st line Technical Support
Using Machine Learning and Chatbots to handle 1st line Technical SupportBarbara Fusinska
 
Chat bots and AI
Chat bots and AIChat bots and AI
Chat bots and AIGeff Thomas
 
Chatbot and Virtual AI Assistant Implementation in Natural Language Processing
Chatbot and Virtual AI Assistant Implementation in Natural Language Processing Chatbot and Virtual AI Assistant Implementation in Natural Language Processing
Chatbot and Virtual AI Assistant Implementation in Natural Language Processing Shrutika Oswal
 
chatbot and messenger as a platform
chatbot and messenger as a platformchatbot and messenger as a platform
chatbot and messenger as a platformDaisuke Minamide
 
AI Chatbot Development Methodology
AI Chatbot Development MethodologyAI Chatbot Development Methodology
AI Chatbot Development MethodologyIgor Luzhanskiy
 
Chatbot Basics - Building Chatbots using Google Dialogflow
Chatbot Basics - Building Chatbots using Google DialogflowChatbot Basics - Building Chatbots using Google Dialogflow
Chatbot Basics - Building Chatbots using Google DialogflowBiswaranjan Rout
 
How do Chatbots Work? A Guide to Chatbot Architecture
How do Chatbots Work? A Guide to Chatbot ArchitectureHow do Chatbots Work? A Guide to Chatbot Architecture
How do Chatbots Work? A Guide to Chatbot ArchitectureMaruti Techlabs
 
Chatbot 101 - Robert McGovern
Chatbot 101 - Robert McGovernChatbot 101 - Robert McGovern
Chatbot 101 - Robert McGovernRobert McGovern
 
The User Experience of Chatbots - Nielsen Norman Group
The User Experience of Chatbots - Nielsen Norman GroupThe User Experience of Chatbots - Nielsen Norman Group
The User Experience of Chatbots - Nielsen Norman GroupMinjoon Kim
 

What's hot (20)

Conversational interfaces - beyond the hype
Conversational interfaces - beyond the hypeConversational interfaces - beyond the hype
Conversational interfaces - beyond the hype
 
Building bots to automate common developer tasks - Writing your first smart c...
Building bots to automate common developer tasks - Writing your first smart c...Building bots to automate common developer tasks - Writing your first smart c...
Building bots to automate common developer tasks - Writing your first smart c...
 
Conversational apps UX best practices
Conversational apps UX best practicesConversational apps UX best practices
Conversational apps UX best practices
 
Introduction to Microsoft Bot Framework
Introduction to Microsoft Bot FrameworkIntroduction to Microsoft Bot Framework
Introduction to Microsoft Bot Framework
 
챗봇 사용자 경험 디자인 (DESIGNING A CHATBOT USER EXPERIENCE)
챗봇 사용자 경험 디자인 (DESIGNING A CHATBOT USER EXPERIENCE)챗봇 사용자 경험 디자인 (DESIGNING A CHATBOT USER EXPERIENCE)
챗봇 사용자 경험 디자인 (DESIGNING A CHATBOT USER EXPERIENCE)
 
Introduction to Chatbots
Introduction to ChatbotsIntroduction to Chatbots
Introduction to Chatbots
 
Chatbots 101
Chatbots 101Chatbots 101
Chatbots 101
 
Chatbot Artificial Intelligence
Chatbot Artificial IntelligenceChatbot Artificial Intelligence
Chatbot Artificial Intelligence
 
AI and Python: Developing a Conversational Interface using Python
AI and Python: Developing a Conversational Interface using PythonAI and Python: Developing a Conversational Interface using Python
AI and Python: Developing a Conversational Interface using Python
 
Using Machine Learning and Chatbots to handle 1st line Technical Support
Using Machine Learning and Chatbots to handle 1st line Technical SupportUsing Machine Learning and Chatbots to handle 1st line Technical Support
Using Machine Learning and Chatbots to handle 1st line Technical Support
 
Chat bots and AI
Chat bots and AIChat bots and AI
Chat bots and AI
 
Chatbot and Virtual AI Assistant Implementation in Natural Language Processing
Chatbot and Virtual AI Assistant Implementation in Natural Language Processing Chatbot and Virtual AI Assistant Implementation in Natural Language Processing
Chatbot and Virtual AI Assistant Implementation in Natural Language Processing
 
Chatbot
ChatbotChatbot
Chatbot
 
chatbot and messenger as a platform
chatbot and messenger as a platformchatbot and messenger as a platform
chatbot and messenger as a platform
 
Chat bots
Chat botsChat bots
Chat bots
 
AI Chatbot Development Methodology
AI Chatbot Development MethodologyAI Chatbot Development Methodology
AI Chatbot Development Methodology
 
Chatbot Basics - Building Chatbots using Google Dialogflow
Chatbot Basics - Building Chatbots using Google DialogflowChatbot Basics - Building Chatbots using Google Dialogflow
Chatbot Basics - Building Chatbots using Google Dialogflow
 
How do Chatbots Work? A Guide to Chatbot Architecture
How do Chatbots Work? A Guide to Chatbot ArchitectureHow do Chatbots Work? A Guide to Chatbot Architecture
How do Chatbots Work? A Guide to Chatbot Architecture
 
Chatbot 101 - Robert McGovern
Chatbot 101 - Robert McGovernChatbot 101 - Robert McGovern
Chatbot 101 - Robert McGovern
 
The User Experience of Chatbots - Nielsen Norman Group
The User Experience of Chatbots - Nielsen Norman GroupThe User Experience of Chatbots - Nielsen Norman Group
The User Experience of Chatbots - Nielsen Norman Group
 

Similar to Mat Velloso - Bots in the real world

Bot. You said bot? Let build bot then! - Laurent Ellerbach
Bot. You said bot? Let build bot then! - Laurent EllerbachBot. You said bot? Let build bot then! - Laurent Ellerbach
Bot. You said bot? Let build bot then! - Laurent EllerbachITCamp
 
ITCamp 2017 - Laurent Ellerbach - Bot. You said bot? Let's build a bot then...
ITCamp 2017 - Laurent Ellerbach - Bot. You said bot? Let's build a bot then...ITCamp 2017 - Laurent Ellerbach - Bot. You said bot? Let's build a bot then...
ITCamp 2017 - Laurent Ellerbach - Bot. You said bot? Let's build a bot then...ITCamp
 
Build an Intelligent Bot (Node.js)
Build an Intelligent Bot (Node.js)Build an Intelligent Bot (Node.js)
Build an Intelligent Bot (Node.js)Sorin Peste
 
Artificial Intelligence Virtual Assistants & Chatbots
Artificial Intelligence Virtual Assistants & ChatbotsArtificial Intelligence Virtual Assistants & Chatbots
Artificial Intelligence Virtual Assistants & ChatbotsaNumak & Company
 
Azure Chat Bot application
Azure Chat Bot application Azure Chat Bot application
Azure Chat Bot application Vivek Singh
 
Global Azure2021 Verona.pptx
Global Azure2021 Verona.pptxGlobal Azure2021 Verona.pptx
Global Azure2021 Verona.pptxLuis Beltran
 
Full stack conference talk slides
Full stack conference talk slidesFull stack conference talk slides
Full stack conference talk slidesSameer Al-Sakran
 
Chatbot development workshop with the Microsoft Bot Framework
Chatbot development workshop with the Microsoft Bot FrameworkChatbot development workshop with the Microsoft Bot Framework
Chatbot development workshop with the Microsoft Bot Frameworkgjuljo
 
Build a mobile chatbot with Xamarin
Build a mobile chatbot with XamarinBuild a mobile chatbot with Xamarin
Build a mobile chatbot with XamarinLuis Beltran
 
Clever data building a chatbot from your database
Clever data building a chatbot from your databaseClever data building a chatbot from your database
Clever data building a chatbot from your databaseLuis Beltran
 
Da 0 all'AI conversazionale usando Microsoft Azure
Da 0 all'AI conversazionale usando Microsoft AzureDa 0 all'AI conversazionale usando Microsoft Azure
Da 0 all'AI conversazionale usando Microsoft AzureMarco Parenzan
 
Student information chatbot final report
Student information chatbot  final report Student information chatbot  final report
Student information chatbot final report jaysavani5
 
Solvion Trendwerkstatt - Microsoft Azure + Bots
Solvion Trendwerkstatt - Microsoft Azure + BotsSolvion Trendwerkstatt - Microsoft Azure + Bots
Solvion Trendwerkstatt - Microsoft Azure + BotsHolzerKerstin
 
Lessons learned from building a commercial bot development platform
Lessons learned from building a commercial bot development platformLessons learned from building a commercial bot development platform
Lessons learned from building a commercial bot development platformJordi Cabot
 
Conversational UIs for internal comms
Conversational UIs for internal commsConversational UIs for internal comms
Conversational UIs for internal commsMarion Mulder
 

Similar to Mat Velloso - Bots in the real world (20)

Bot. You said bot? Let build bot then! - Laurent Ellerbach
Bot. You said bot? Let build bot then! - Laurent EllerbachBot. You said bot? Let build bot then! - Laurent Ellerbach
Bot. You said bot? Let build bot then! - Laurent Ellerbach
 
ITCamp 2017 - Laurent Ellerbach - Bot. You said bot? Let's build a bot then...
ITCamp 2017 - Laurent Ellerbach - Bot. You said bot? Let's build a bot then...ITCamp 2017 - Laurent Ellerbach - Bot. You said bot? Let's build a bot then...
ITCamp 2017 - Laurent Ellerbach - Bot. You said bot? Let's build a bot then...
 
Build an Intelligent Bot (Node.js)
Build an Intelligent Bot (Node.js)Build an Intelligent Bot (Node.js)
Build an Intelligent Bot (Node.js)
 
Artificial Intelligence Virtual Assistants & Chatbots
Artificial Intelligence Virtual Assistants & ChatbotsArtificial Intelligence Virtual Assistants & Chatbots
Artificial Intelligence Virtual Assistants & Chatbots
 
Azure Chat Bot application
Azure Chat Bot application Azure Chat Bot application
Azure Chat Bot application
 
Global Azure2021 Verona.pptx
Global Azure2021 Verona.pptxGlobal Azure2021 Verona.pptx
Global Azure2021 Verona.pptx
 
Full stack conference talk slides
Full stack conference talk slidesFull stack conference talk slides
Full stack conference talk slides
 
Chatbot development workshop with the Microsoft Bot Framework
Chatbot development workshop with the Microsoft Bot FrameworkChatbot development workshop with the Microsoft Bot Framework
Chatbot development workshop with the Microsoft Bot Framework
 
Build a mobile chatbot with Xamarin
Build a mobile chatbot with XamarinBuild a mobile chatbot with Xamarin
Build a mobile chatbot with Xamarin
 
Building intelligentchatbots
Building intelligentchatbotsBuilding intelligentchatbots
Building intelligentchatbots
 
Bot design AIsatPN 2018
Bot design AIsatPN 2018Bot design AIsatPN 2018
Bot design AIsatPN 2018
 
Clever data building a chatbot from your database
Clever data building a chatbot from your databaseClever data building a chatbot from your database
Clever data building a chatbot from your database
 
Da 0 all'AI conversazionale usando Microsoft Azure
Da 0 all'AI conversazionale usando Microsoft AzureDa 0 all'AI conversazionale usando Microsoft Azure
Da 0 all'AI conversazionale usando Microsoft Azure
 
Chatbot
ChatbotChatbot
Chatbot
 
Student information chatbot final report
Student information chatbot  final report Student information chatbot  final report
Student information chatbot final report
 
Solvion Trendwerkstatt - Microsoft Azure + Bots
Solvion Trendwerkstatt - Microsoft Azure + BotsSolvion Trendwerkstatt - Microsoft Azure + Bots
Solvion Trendwerkstatt - Microsoft Azure + Bots
 
Lessons learned from building a commercial bot development platform
Lessons learned from building a commercial bot development platformLessons learned from building a commercial bot development platform
Lessons learned from building a commercial bot development platform
 
Conversational UIs for internal comms
Conversational UIs for internal commsConversational UIs for internal comms
Conversational UIs for internal comms
 
LUIS and Bots
LUIS and BotsLUIS and Bots
LUIS and Bots
 
Conversational AI: What's New?
Conversational AI: What's New?Conversational AI: What's New?
Conversational AI: What's New?
 

More from Web à Québec

Guillaume Labbé-Morissette
Guillaume Labbé-MorissetteGuillaume Labbé-Morissette
Guillaume Labbé-MorissetteWeb à Québec
 
Frédérick Capovilla
Frédérick CapovillaFrédérick Capovilla
Frédérick CapovillaWeb à Québec
 
Cynthia Thibault-Larouche
Cynthia Thibault-LaroucheCynthia Thibault-Larouche
Cynthia Thibault-LaroucheWeb à Québec
 
Intelligence artificielle, Données massives et Internet des objets: Quels son...
Intelligence artificielle, Données massives et Internet des objets: Quels son...Intelligence artificielle, Données massives et Internet des objets: Quels son...
Intelligence artificielle, Données massives et Internet des objets: Quels son...Web à Québec
 
So you want to be a service designer - Jamin Hegeman
So you want to be a service designer - Jamin HegemanSo you want to be a service designer - Jamin Hegeman
So you want to be a service designer - Jamin HegemanWeb à Québec
 
AI & the future of the political party - Colin Megill
AI & the future of the political party - Colin MegillAI & the future of the political party - Colin Megill
AI & the future of the political party - Colin MegillWeb à Québec
 
comment le Canada peut Gagner dans le secteur du numérique - Alex Benay
comment le Canada peut Gagner dans le secteur du numérique - Alex Benay comment le Canada peut Gagner dans le secteur du numérique - Alex Benay
comment le Canada peut Gagner dans le secteur du numérique - Alex Benay Web à Québec
 
Rendre son équipe performante : plus simple qu'on le pense - Louis-Philippe C...
Rendre son équipe performante : plus simple qu'on le pense - Louis-Philippe C...Rendre son équipe performante : plus simple qu'on le pense - Louis-Philippe C...
Rendre son équipe performante : plus simple qu'on le pense - Louis-Philippe C...Web à Québec
 
Turning Research Ripples Into Waves: Growing UX Research Capacity Through Col...
Turning Research Ripples Into Waves: Growing UX Research Capacity Through Col...Turning Research Ripples Into Waves: Growing UX Research Capacity Through Col...
Turning Research Ripples Into Waves: Growing UX Research Capacity Through Col...Web à Québec
 
Complexité et systèmes opérables - Fred Hébert
Complexité et systèmes opérables - Fred HébertComplexité et systèmes opérables - Fred Hébert
Complexité et systèmes opérables - Fred HébertWeb à Québec
 

More from Web à Québec (20)

Kevin Bélanger
Kevin BélangerKevin Bélanger
Kevin Bélanger
 
Gabriel LeBreton
Gabriel LeBretonGabriel LeBreton
Gabriel LeBreton
 
Rémi Prévost
Rémi PrévostRémi Prévost
Rémi Prévost
 
Ludivine Durand
Ludivine DurandLudivine Durand
Ludivine Durand
 
Julie Simard
Julie SimardJulie Simard
Julie Simard
 
Guillaume Labbé-Morissette
Guillaume Labbé-MorissetteGuillaume Labbé-Morissette
Guillaume Labbé-Morissette
 
Katherine Mailloux
Katherine MaillouxKatherine Mailloux
Katherine Mailloux
 
Denis Martel
Denis MartelDenis Martel
Denis Martel
 
Charles Davignon
Charles DavignonCharles Davignon
Charles Davignon
 
Frédérick Capovilla
Frédérick CapovillaFrédérick Capovilla
Frédérick Capovilla
 
Cynthia Thibault-Larouche
Cynthia Thibault-LaroucheCynthia Thibault-Larouche
Cynthia Thibault-Larouche
 
Louis-André Labadie
Louis-André LabadieLouis-André Labadie
Louis-André Labadie
 
Christophe Clouzeau
Christophe ClouzeauChristophe Clouzeau
Christophe Clouzeau
 
Intelligence artificielle, Données massives et Internet des objets: Quels son...
Intelligence artificielle, Données massives et Internet des objets: Quels son...Intelligence artificielle, Données massives et Internet des objets: Quels son...
Intelligence artificielle, Données massives et Internet des objets: Quels son...
 
So you want to be a service designer - Jamin Hegeman
So you want to be a service designer - Jamin HegemanSo you want to be a service designer - Jamin Hegeman
So you want to be a service designer - Jamin Hegeman
 
AI & the future of the political party - Colin Megill
AI & the future of the political party - Colin MegillAI & the future of the political party - Colin Megill
AI & the future of the political party - Colin Megill
 
comment le Canada peut Gagner dans le secteur du numérique - Alex Benay
comment le Canada peut Gagner dans le secteur du numérique - Alex Benay comment le Canada peut Gagner dans le secteur du numérique - Alex Benay
comment le Canada peut Gagner dans le secteur du numérique - Alex Benay
 
Rendre son équipe performante : plus simple qu'on le pense - Louis-Philippe C...
Rendre son équipe performante : plus simple qu'on le pense - Louis-Philippe C...Rendre son équipe performante : plus simple qu'on le pense - Louis-Philippe C...
Rendre son équipe performante : plus simple qu'on le pense - Louis-Philippe C...
 
Turning Research Ripples Into Waves: Growing UX Research Capacity Through Col...
Turning Research Ripples Into Waves: Growing UX Research Capacity Through Col...Turning Research Ripples Into Waves: Growing UX Research Capacity Through Col...
Turning Research Ripples Into Waves: Growing UX Research Capacity Through Col...
 
Complexité et systèmes opérables - Fred Hébert
Complexité et systèmes opérables - Fred HébertComplexité et systèmes opérables - Fred Hébert
Complexité et systèmes opérables - Fred Hébert
 

Recently uploaded

Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DaySri Ambati
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 

Recently uploaded (20)

Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 

Mat Velloso - Bots in the real world

  • 1.
  • 2. Are bots just a hype?
  • 3. Once-in-a-decade opportunity • High demand from companies of all sizes • Opportunity for more natural experiences • Users spending more time on messaging apps • Simpler deployment/update model than apps • App ecosystem overly crowded • Everybody wants to automate something
  • 4.
  • 5.
  • 6. Your bot code Entity Extraction Speech Vision/Face Natural Language Translation + Microsoft Cognitive Services Search Emotion Knowledge API … Message input <> output State Management Bot Connector Service Conversation Canvas/Channels …… … Other services, APIs, Databases, Azure Machine Learning, Azure Search, etc… Bot Builder SDK Web Chat Direct Line… Email Facebook GroupMe Kik Skype Slack Telegram Twilio (SMS) An x-ray of a typical bot Bot Builder SDK Your code goes here
  • 7. Register your bot Connect to channels Test Publish Manage Measure Developer Portal
  • 8. LUIS.ai • Language Understanding Intelligence Service • Identify entities and intents of messages • Train through GUI or programmatically • Built in LUIS intent handling in bot framework
  • 9. Tell me scenarios that make sense for a bot
  • 10. Imagine a new kind of news reading app That “knows” when you’re driving and switches to a conversational experience (driving = busy hands/eyes = speech)
  • 12. AzureBot: Manage your cloud from Skype Start from the desktop, list your VMs, start a VM (it all takes 5 seconds!)
  • 13. AzureBot: Manage your cloud from Skype Switch to your phone, confirm you want to star the VM, receive the notification when done. -No logon required -No app sync required -Woks across all your devices and web It. Just. Works. github.com/microsoft/azurebot
  • 14.
  • 15. Bots follow you everywhere
  • 16. Call centers/help desk/customer service Every company deals with this:
  • 17. Call centers/help desk/customer service Every company deals with this: First triage/data collection No waiting in line to be helped Bots handle it
  • 18. Call centers/help desk/customer service Every company deals with this: First triage/data collection Simple and repetitive solutions If it is simple and repetitive, it can be coded. Bots can accelerate it
  • 19. Call centers/help desk/customer service Bot to human hand off: Complete or supervised
  • 20. Call centers/help desk/customer service Complete bot to human hand off Thank you for providing all this information. I have John with me now who will take from here and help you out Hello, this is John. I understand your computer won’t power on. Let’s take a look at some service options
  • 21. Call centers/help desk/customer service Supervised bot to human hand off I’ve tried these steps, my computer still won’t turn on Sounds lovely, thank you I suggest us to request a hardware service. We can have one of our service engineers look at your computer Note to operator: It sounds like the user will need hardware replacement, what next step should I take? Apologize to user Suggest hardware service Let me type
  • 23. Knowledge Base/FAQ bots Bots that an answer any question about a given data source (relational, documents, etc) Check QnAMaker.ai and Azure Search
  • 25. What makes a bot great? • It is not how “smart” they are • It is not how much natural language they offer • It is not whether they use voice or not It’s whether it solves the user’s needs in the quickest/easiest way compared to any other option It’s all about user experience... Just like an app, or a website
  • 26. The best bots make you type less, not more
  • 27.
  • 28. A bot with a single dialog using 100 LUIS intents is a bad design: Hello user! How can I help you? One question 100 LUIS intents, * 100 different utterances per intent = 10000 different things users may say (plus the other 90000 possibilities you didn’t predict) 100 different things your bot can do Users will only guess 3 or so So you just wasted 97% of your code
  • 29. So instead: Hello user! How can I help you? Events Stages Amenities What events are you interested in? Music Comedy Film Laser Dome Spectacles Theater What music would you like? (by the way, next time you could just type “I’m looking for a song named xyz” and I will know what to do) • Guide the user • Save time • Help the user discover what your bot can do
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.
  • 35.
  • 36.
  • 37.
  • 38. • Users are often terrible at using search on web • Add search to a bot and now you have a great tool to guide the user into refining their search • Knowledge base, informational, Q&A bots are great scenarios. They typically use QnA Maker and Azure Search for it
  • 39. • QnAMaker.ai: • Super low friction way of creating a Q&A bot • Built in web and document crawler: Parses data and builds the QnA easily • Not great for too many records • Not great for deep level customization of the experience • Azure Search: • Can work with millions of records like a breeze • Works with different document formats and data sources • Takes more effort to prepare/code/fine-tune
  • 40.
  • 41. • Sometimes buttons do everything you need. • Avoid the engineer’s urge to complicate simple things Your business requirement is NOT to pass the Turing Test: It is to solve your user’s problem!
  • 42. • Spec out an “app kind” of bot: https://github.com/MicrosoftDX/botFramework- botSpecDocs/blob/master/src/CaaP%20Design%20spec.docx
  • 43. • Even if standard channels can’t do it, you can always build your own UI/App/Web • Think richer UIs with bots, HoloLens, etc. It is all possible
  • 44. • They separate concerns and organize flows, exactly the same way:
  • 45. • This is how we know how to navigate “back” • Users won’t necessarily think that way
  • 46. • You will almost never get it right at first: • Iterate, test, learn. Again and agian until it “feels right”
  • 47. • If your bot doesn’t collect data and doesn’t give you ways of understanding what it does well or not, then it you can’t make it better Refer to fact #10