4. NLP in help article search
⬅ Search query
⬅ Help article search results
5. ⬅ Prompt for information
⬅ Predefined answer with a
direct call to action
⬅ Self-selected chat closure
⬅ The chat first turn (this could
be more than one message)
Automated self-service answers
and in-chat interactions (2019)
10. How to get NLP into production
Train a model Build the rest of the system
11. Everything around the NLP
Conversation
feature store
Labelled dataset
creation
Monitoring &
analysis
Serving infra &
orchestration
Data labelling
Model store
17. Our model store makes it easier to get
artifacts into production & gives us
insights about what we’re shipping
Lovely data
18. Serving infra & orchestration?
https://qconlondon.com/london2020/presentation/modern-banking-1500-microservices
19. Orchestrator
Classifier for A
Classifier for B
Classifier for C
Winner!
Rules that determine
eligibility for topic C
Classifier for D
Serving infra & orchestration enables us to
plug & play models, turn some off, and
surround them with business logic
20. Monitoring & analysis - we track our
models’ performance in the same place we
track our product’s performance
22. Everything around the NLP
Conversation
feature store
Labelled dataset
creation
Monitoring &
analysis
Serving infra &
orchestration
Data labelling
Model store