This session is based on the latest news presented around Microsoft Bot Framework and LUIS at Microsoft Ignite 2019.
The slides were used on the event #BotTO November 2019 Meetup @ TD
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
2019 11 26 BotTO November 2019 Meetup at TD
1. What’s new in Bot Framework and LUIS
Bruno Capuano
Innovation Lead
@elbruno
Update from Microsoft Ignite 2019
2. This session is based
on the latest news
presented around
Microsoft Bot
Framework and LUIS at
Microsoft Ignite 2019
Microsoft Ignite 2019
https://myignite.techcommunity.microsoft.com/sessions
3. From the Intelligent Cloud to the Intelligent Edge
Power Virtual AgentsTeams & Cortana
Software as a service, SaaS solutions
To enable out-of-the-box Conversational AI services for key solutions
Virtual Assistant
template
Solution accelerators and templates, PaaS
To extend and enable key Conversational AI solutions
Azure Bot Service
Managed Bot Service, Azure Bot Service
To accelerate building, management and deployment of conversational AI
BotKit SDK
Popular open source frameworks, Bot SDK on GitHub
To fully integrate and customize your solution, with any AI technology
Bot Framework
SpeechVision Language Web
Search
Decision
Pre-trained AI, Cognitive Services
To add and customize language, speech, knowledge & vision
Enterprise Assistant Solution Accelerator
Hospitality Assistant Solution Accelerator
Conversational AI Platform
4. Office Graph
Virtual Assistant
SecurityAnalyticsStorage IntegrationAzure Platform
Type Speak
Tap
User
Input
Devices
Channels
Azure Bot
Service
Adaptive
Cards
Bot Framework
Your Assistant
Your Brand
Your Personality
Language
Understanding
Speech
VisionQnA
Dispatch
Knowledge
Sources
Manuals
(PDF)
Data Sources
General
Knowledge
Points of
Interest
Mail
Automotive
Custom
Other
Bots
Skills
(Customizable)
APIs
Directory
Tasks
Calendar
3P Assistants
IoT Edge
5. Three ways to build bots with Azure AI
Build a sophisticated bot
Get started with the Microsoft Bot Framework
https://github.com/microsoft/botframework
Build your own branded virtual assistant
Get started Virtual Assistant solution accelerator:
https://aka.ms/VAsolution
Create a QnA Bot in minutes
Get started with QnAMaker:
https://www.qnamaker.ai/
6. SDK optimized for Teams
Fully integrated support for building Teams bots and
taking advantage of Teams specific message and channel
capabilities. More easily add bot to Teams channel and
group chats.
Bot Framework Skills in Preview
Create reusable conversational skills, with prebuilt
language models, QnA to add functionality to your bots.
Benefit from a catalog of skills in GitHub, like Calendar,
Email, Point of Interest & more.
Adaptive Dialogs in Preview
Build conversations that can dynamically change based
on context and events. Designed to to handle context
changes and interruptions.
Additionally, support for Language Generation, so your
bot can generate sophisticated and dynamic responses
based on context.
Support for Python, Java in Preview
Develop in your preferred language (now support for
Python, Java in preview.
http://github.com/Microsoft/BotFramework
7. SDK optimized for Teams
Fully integrated support for building Teams bots and
taking advantage of Teams specific message and
channel capabilities. More easily add bot to Teams
channel and group chats.
Bot Framework Skills in Preview
Create reusable conversational skills, with prebuilt
language models, QnA to add functionality to your
bots. Benefit from a catalog of skills in GitHub, like
Calendar, Email, Point of Interest & more.
Adaptive Dialogs in Preview
Build conversations that can dynamically change
based on context and events. Designed to to handle
context changes and interruptions.
Additionally, support for Language Generation, so
your bot can generate sophisticated and dynamic
responses based on context.
Support for Python, Java in
Preview
Develop in your preferred language (now support for
Python, Java in preview.
http://github.com/Microsoft/BotFramework
8. Bot Framework Composer
Bot Framework Composer is an integrated
development tool for developers and conversation
designers with a coding and business background to
create, edit, test and refine conversational apps (bots)
• A visual editing canvas for conversation flow
• In context editing for language
understanding (NLU)
• Tools to train, test and manage language
understanding (NLU) and QnA components
• Language generation and templating
system
• A ready-to-use bot runtime executable
11. Core language understanding
• Enabling developers to produce the next
level models using decomposition and
deeper hierarchical schemes (public
preview)
• A simplified labeling user experience to
power sophisticated model creation
(public preview)
Enhanced developer experience
• Runtime API V3 released and .lu file
format integration (GA)
• Streamlined keys experience (GA)
More language & prebuilt models
• Arabic & Hindi support (public preview)
What's New for Language Understanding (LUIS)
12. Languages/Pre-built models
Supporting more languages for pre-built entities
New Pre-built domains
Full support
(All Pre-built entities supported)
Major Support
(All pre-built entities except Person & Geo.)
Partial Support
(Some pre-built entities supported,
Person & Geo not supported)
English (US) Chinese, French (FR,CA),
German, Italian, Portuguese
(BR), Spanish (ES, MX), Turkish
Dutch, Japanese, Korean,
Hindi, Gujarati, Telugu,
Arabic
English (US), Chinese, Dutch, French
(FR), German, Italian, Japanese, Korean,
Portuguese (BR), Spanish (ES), Turkish
More coverage upcoming
13. [Utility](./Utility.lu)
# Greeting
- Hi
- Hello
- Good morning
# BookFlight
- book a flight from {fromCity=new york} to
{toCity=seattle}
## None
- Why is the sky blue
> # Entity definitions
$KEYWORD:simple
> # PREBUILT Entity definitions
$PREBUILT:number
$PREBUILT:geographyV2
14. Create a more natural experience with multiple, dynamic responses
# NewUserIntroCard
[Activity
Attachments = {json(NewUserIntroCardJson())}
]
# NewUserIntroCardTitle
- Hi There {Name}
- Hi There
- Welcome
- Pleased to meet you!
- Hello and welcome!
# NewUserIntroCardTitle
- Now that I’m up and running, explore the links
here to learn what I can do.
# NewUserIntroCardJson
- ```
{
"type": "AdaptiveCard",
"id": "NewUserGreeting",
"text": "@{NewUserIntroCardTitle()}",
"text": "@{NewUserIntroCardsSubtitle()}"
18. Automotive
Productivity Experimental
Calendar Skill Todo Skill News Weather Restaurant
Booking
Email Skill
KB SkillsKB Notifications Skills
Solution Accelerator
E N T E R P R I S E A S S I S T A N T
Solution Accelerator
H O S P I T A L I T Y A S S I S T A N T
+ +
Bot Framework
Virtual Assistant Template (C# / JS) Other Templates
Your Assistant Experience
Dispatcher Deployment
Multi-
Locale
Introductions Feedback
Context
Switching
QnA
Linked
Accounts
Speech Analytics
Android
Client
HospitalityPoint of
Interest
IT Service
Management
Virtual Assistant Approach
Skills
20. Bot Framework Composer
Shell
Integrated experience for creating
sophisticated conversations including
language understanding and generation
Dialogs
Manage conversation dialogs, triggers,
and events
Visual editor
A visual design surface for creating
complex conversation by composing
SDK components and dialogs. Powered
by BF SDK Adaptive Dialog declarative
format
Property Editor
Composer data driven UI based on SDK
component schema
21. Bot Framework Composer – Visual Designer / Design Flow
Dialogs
Manage conversation dialogs, triggers,
and events.
Visual editor
The dialog editor within Composer
allows bot builders to create complex
branching flows that include conditional
branches, looping and memory
manipulation.
Dialogs built with composer can use
external resources through an HTTP
Request action.
Dialogs can be reused, interlinked, and
composed into larger conversations.
23. Now available in Public Preview
http://github.com/microsoft/botframework-composer
Getting started with the Composer
24. Open Source
10+ Public Repos
• What’s New
• SDK V4: C#, JavaScript, Python, Java
• CLI Tools
• Emulator
• Bot Framework Solutions
• WebChat Control
• Documentation
• BotBuilder-Samples
25. BRK4001 - A deep-dive into conversational AI using Azure Bot Service and Cognitive Services
https://myignite.techcommunity.microsoft.com/sessions/81066
BRK1037 - Let’s build a knowledgeable chatbot with Microsoft Bot Framework, Azure Bot Services, and QnA Maker
https://myignite.techcommunity.microsoft.com/sessions/79311
THR2136 - create sophisticated, enterprise-ready bots from your existing data, with no code using Azure Cognitive
Services QnA Maker
https://myignite.techcommunity.microsoft.com/sessions/83915
BRK4001 - A deep-dive into conversational AI using Azure Bot Service and Cognitive Services
https://myignite.techcommunity.microsoft.com/sessions/81066
BRK1037 - Let’s build a knowledgeable chatbot with Microsoft Bot Framework, Azure Bot Services, and QnA Maker
https://myignite.techcommunity.microsoft.com/sessions/79311
BRK2188 - Advanced Natural Language Understanding (NLU) models using LUIS and Azure Cognitive Services
https://myignite.techcommunity.microsoft.com/sessions/83914
THR2018 - Creating enterprise conversational user experiences with virtual assistants
https://myignite.techcommunity.microsoft.com/sessions/81065
Resources