I tested several platforms for creating chatbots with the objective of simulating a patient coming to the emergency room so that medical students could ask questions to establish a diagnosis.
The major advances in the field of Natural Language Processing and Artificial Intelligence have seen the emergence of chatbot platforms to develop your own agent from a web service.
I will present 4 platforms from major technology companies offering their service in French.
Samah Ghalloussi - Ministère des solidarités et de la santé
https://dataxday.fr/
Video available: https://www.youtube.com/watch?v=4mNQIXI8VuE
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
DataXDay - Enhancing medical student practice with patient-like chatbots
1. May 17, 2018
Samah GHALLOUSSI
Data Scientist, NLP
Enhancing medical student practice with patient-like chatbots
2. @DataXDay
Samah GHALLOUSSI
R&D Engineer - Artificial Intelligence / Data Science / NLP
Health Information Technology Specialist
Public Interest Entrepreneur
Data Scientist for the French Ministry of Health
3. @DataXDay
PLAN
● INTRODUCTION
● COMPARISON: 4 platforms for creating chatbots
❖ Dialogflow (Google)
❖ Watson Assistant (IBM)
❖ Wit.ai (Facebook)
❖ LUIS (Microsoft)
● CONCLUSION & DEMO
3
4. @DataXDay
INTRODUCTION
What is a chatbot ?
4
● Computer program
● Simulates human conversation through Artificial Intelligence
● How it works :
5. @DataXDay
INTRODUCTION
Context
5
Serious Game as a medical training tool :
● Virtual Reality
● Immersive environment
● Conversational Analysis
● Simulation of a patient in the emergency room
● Making a diagnosis through the medical interview
7. @DataXDay
Dialogflow (formerly API.AI)
◊ Start-up Speaktoit created in 2010
◊ Acquired by Google in September 2016
◊ Renamed as Dialogflow in October 2017
◊ Machine Learning based solution
GOOGLE
7
8. @DataXDay
1. Operating mode :
GOOGLE : Dialogflow
Basic model of interaction
● Intents = matches what the user says with expected action
● Actions = steps to take when an intention is triggered
● Entities = parameters extracted to specify details
8
10. @DataXDay
3. Advantages and Disadvantages
Advantages
Disadvantages
GOOGLE : Dialogflow
❖ Easy to use
❖ High NLU quality
❖ Free Standard Edition
❖ Standard Edition Terms of Service (Enterprise Edition = $2 / 1000 request)
❖ No decision tree visible
❖ Intents modification one by one
10
Standard Edition : https://developers.google.com/terms/
Enterprise Edition : https://cloud.google.com/terms/
11. @DataXDay
Watson Assistant (formerly Conversation)
◊ Named after IBM's first CEO, Thomas J. Watson
◊ Question-answering computer system developed in IBM's DeepQA project
◊ Won in 2011 the quiz show “Jeopardy!”
◊ Machine-learning and rule-based system : pre-trained AI solution
IBM
11
12. @DataXDay
1. Operating mode :
12
IBM : Watson Assistant
3 types of artifacts
● Intents = goals expressed by the user
● Entities = relevant terms providing specific context
● Dialog = graphical representation in form of a decision tree
13. @DataXDay
2. Interface
IBM : Watson Assistant https://watson-assistant.ng.bluemix.net/
Access with Bluemix account
13
14. @DataXDay
3. Advantages and Disadvantages
Advantages
Disadvantages
❖ User friendly interface
❖ Decision tree : Simplifying dialog
❖ Data privacy
❖ Limited to 10,000 requests (then $2,5 /1000 requests)
❖ Too much reliance on defined entities
❖ Need NLP service integration to pre-process requests correctly
14
IBM : Watson Assistant
15. @DataXDay
WIT.AI
◊ Founded in 2013 with the goal of building "the Github of natural language"
◊ Acquired by Facebook in January 2015
◊ Rule based system
FACEBOOK
15
16. @DataXDay
1. Operating mode :
FACEBOOK : WIT.AI
Entity lookup strategies
● Trait = intents
● Keywords = named entities
● Free-text = expressions of non-categorized info
16
18. @DataXDay
3. Advantages and Disadvantages
Advantages
Disadvantages
❖ Access via github account possible
❖ No connection limitation
❖ Totally free: commercial use too
❖ Access to all business data
❖ Limited predefined knowledge
❖ Difficult to understand
18
FACEBOOK : WIT.AI
19. @DataXDay
LUIS : Language Understanding Intelligent Service
◊ Microsoft Cognitive Services (Project Oxford)
◊ Machine learning-based service
◊ Reinforcement Learning based on Active Learning method
MICROSOFT
19
20. @DataXDay
1. Operating mode :
20
● Intents = goals to accomplish (actions deduced)
● Utterances = textual input to interpret (example sentences)
● Entities = important information to highlight (variables)
MICROSOFT : LUIS
3 main concepts
22. @DataXDay
3. Advantages and Disadvantages
Advantages
Disadvantages
❖ Importing utterances in text format
❖ Detailed results with confidence scores
❖ Transparency and data privacy policies
❖ Limited to 10 000 free requests / month (0,633 € / 1000 requests)
❖ Need at least 5 utterances per intent or fail at training process
❖ Requires a BotFramework to work
22
MICROSOFT : LUIS
23. @DataXDay
◊ Same key concepts : intents, entities, …
◊ But different meanings
◊ Choosing the right platform depends on the usecase to implement
CONCLUSION
23