SlideShare une entreprise Scribd logo
1  sur  30
Drum into understanding of prediction builder with NBA
Hands-on Workshop: Step-by-Step Guide
Rajat Jain, Program Specialist @ MTX Group Inc.
rajat.jain@mtxb2b.com
@rajat_307
What is Machine Learning?
Machine Learning is using past data to predict the future
Computer algorithms find patterns in the historical data to
apply to new data and make predictions
Historical Data
Your historical records
For example, opportunities won/lost
in the last 12 months
New Data
Records to Predict
For example, new opportunities
What is it?
A wizard where you can define a machine
learning problem for the Einstein Platform to
solve
Who is it for?
Salesforce admins, in conjunction with with
their data experts
What is the value?
Easy to create predictions, iterate on
them and use predictions in production
Einstein Prediction Builder
Point, Click, Predict
Subtitle placeholder
What Einstein Builder Predicts For
Numeric Predictions
Leverage historical information to
predict a number
Binary Predictions
Leverage historical information to
answer a Yes/No question
Scores Returned:
● $400,000
● 30 days
● $1,200,000 (welcome to the Bay Area..)
Scores Returned:
● The likelihood a record churns
● The likelihood a lead converts
● The likelihood a student graduates
Example Questions:
● Is this customer going to churn?
● Is this lead going to convert?
● Will this student graduate on time?
Example Questions:
● How much is this deal likely worth?
● How long will this deal take to close?
● How much will this house sell for?
1. Define
your use
case
2. Plan
your
prediction
3. Fill out
the wizard
4. Review
your
scorecard
5. Enable
your
prediction
6. Use
model in
production
Einstein Prediction Builder Lifecycle
Q: What is the problem your company is facing?
Example: Only 60% of Medical Appointment shows up on time. How do I increase rate to get
patient to show on time for appointment?
Q: What type of prediction will help?
Example: Predict which Medical Appointment are likely to be No Show.
Q: Can this prediction be phrased as a yes/no or numeric question?
Example: Will this prediction be No Show?
How to Define Your Use Case
Q: How will I use this prediction?
Example: Call/SMS Patient in advance if they are going to be No Show.
Q: How do you measure if the prediction is successful?
Example: Percentage decrease in Patient No Show.
How to Define Your Use Case (cont.)
Plan Your Prediction
Building a Yes/No Prediction
-
+
-+ - ?
Example set (Training set)
Minimum 400 Records Required
Records to predict (Scoring set)
?
Will an Medical Appointment be a No Show?
Dataset
Segment
Positive
examples
Negative
examples
Prediction
Set
Prediction Set:
Records that have scheduled
Appointment but which is in future
Object:
Medical Appointment
Segment:
N/A
Positive examples:
Patient Records which did not shows up on time
Negative Examples:
Patient Records which shows up on time
Predicting Appointment No Shows
● Set up → Prediction Builder
● Click “New Prediction”
Create a Prediction Choose an Object and Type of
Prediction
Records to Learn from and
Records to Predict
Prediction Inputs and Output
● Give your prediction a name
● Click “Next”
Predicting Appointment No Shows
● Select “Medical Appointment__c”
● Click “Data Checker”
○Ensure you have enough records
in this object to build a prediction
Create a Prediction Choose an Object and Type of
Prediction
Records to Learn from and
Records to Predict
Prediction Inputs and Output
● The answer to “Will this appointment
be a No Show?“ is Yes/No
Predicting Appointment No Shows
● Field to Predict = “No Show”
● Appointments to learn from (e.g.
training examples) ~ 7800
○ Set condition to Appointments on or before
May 31, 2016
● Appointments to predict ~ 2200
○ Appointments after May 31, 2016
Create a Prediction Choose an Object and Type of
Prediction
Records to Learn from and
Records to Predict
Prediction Inputs and Output
Best Practice Tip:
● Always use Data Checker to confirm:
○ You have enough records to learn from
(training set).
○ You have enough positive and negative
examples in your training set
○ You know how many records will have a
prediction (records to predict)
Predicting Appointment No Shows
● Select fields in the appointment record
that should be used as input to predict
○Use as many as possible
● Click “Next”
Create a Prediction Choose an Object and Type of
Prediction
Records to Learn from and
Records to Predict
Prediction Inputs and Output
● Name the custom field that store your
prediction.
○ Note that the prediction will be a
number between 0-100 representing
the likelihood of “No Show”
● Click “Next”
● Click “Build Prediction”
Evaluating Prediction Accuracy
How good was that predictive model?
Use EPB Model Accuracy Package
Evaluating Prediction Accuracy
● Click on the “App Launcher”
● Click on “Analytics Studio”
Launch EPB Model
Accuracy
Complete the Wizard View Prediction Accuracy
● Click on “Create App”
Evaluating Prediction Accuracy
● Click on “Create App from Template'”
Launch EPB Model
Accuracy
Complete the Wizard View Prediction Accuracy
● Select “EPB Model Accuracy”
● Click “Continue”
● Click “Continue” again
Evaluating Prediction Accuracy
Fill in the following details about your
prediction
Fill in the following details about your
prediction
● Object = Medical Appointments 2
● Field containing actuals = No Show
Launch EPB Model
Accuracy
Complete the Wizard View Prediction Accuracy
Choose two business dimensions to
analyze your prediction accuracy. For
example you could:
● Choose “Age Bracket” and “Gender”
● Click “Looks good, next”
Evaluating Prediction Accuracy
Provide suitable labels:
● A high score (100) means ...No Show
● A low score (0) means...Show
● Click Next
● Click Next
Launch EPB Model
Accuracy
Complete the Wizard View Prediction Accuracy
Provide a Name for your App
● Click Create
Evaluating Prediction Accuracy
Wait for 2-3 minutes until you see
“Application Complete”
● Refresh your browser page
● Open the Binary Classification
Performance dashboard“
Launch EPB Model
Accuracy
Complete the Wizard View Prediction Accuracy
Switch to the confusion matrix view
● Set different thresholds and observe
the impact on Accuracy, False
Positives, False Negatives
● Discuss - Would you lower the
threshold to reduce overall accuracy
while minimizing false negatives?
Acting on your Prediction
Next Best Action
Use Prediction to Recommend the Best Course of Action
● Go to Setup
● Type “Next best ”
● Click on “Next Best Action”
● Click on “New Strategy”
Launch Next Best Action Craft a Strategy Display your Recommendation
● Name = “No Show Strategy”
● Object where Recommendations
Display = “Medical Appointment 2”
● Click “Create”
Use Prediction to Recommend the Best Course of Action
● Drag 2 Load Nodes on the strategy
builder
○ Node 1: Name “Call Patient” &
Description contains “Call”
○ Node 2: Name “SMS Patient” &
Description contains “SMS”
Launch Next Best Action Craft a Strategy Display your Recommendation
● Drag a “Branch Selector”
○ Label: “Predicted No Show?”
● Re-arrange nodes as shown
Use Prediction to Recommend the Best Course of Action
● Branch 1
○ No Show Score >= 18
Launch Next Best Action Craft a Strategy Display your Recommendation
● Branch 2
○ No Show Score < 18
Use Prediction to Recommend the Best Course of Action
○ Open a Medical Appointment 2
record
○ Click “Edit Page”
Launch Next Best Action Craft a Strategy Display your Recommendation
● Drag the Einstein Next Best Action to
the right pane
● Confirm your strategy is selected
● Now
○ Click “Save”
○ Click “Activate”
○ Click “Assign as Org Default”
○ Select “Desktop”.
○ Click “Next” & “Save”
● Click “Back”
Use Prediction to Recommend the Best Course of Action
Your Recommendation is displayed
Launch Next Best Action Craft a Strategy Display your Recommendation
Continue Learning About Einstein!
Check out content on the
Einstein Hub
Learn about the Einstein
Champions Program
Join the Einstein Trailblazer
Community Group
einstein-hub.com sfdc.co/einsteinchampions sfdc.co/einsteingroup
Questions?
Follow & Join New Delhi Salesforce DG
• Join to know about future events and to RSVP:
https://trailblazercommunitygroups.com/delhi-in-developers-group/
• Let’s start conversations on Success Community:
http://bit.ly/NewDelhiCommunity
• Follow us on Twitter: https://twitter.com/newdelhisfdcdug
• Hashtag: #ImpactSalesforceSaturday
• Follow us on Facebook: https://www.facebook.com/newdelhisfdcdug
• For all the content: https://newdelhisfdcdug.com

Contenu connexe

Tendances

How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
Optimizely
 

Tendances (20)

How to find data insights that will drive a 10X impact
How to find data insights that will drive a 10X impact How to find data insights that will drive a 10X impact
How to find data insights that will drive a 10X impact
 
From Personalization to Individualization – Delivering a Unique Experience
From Personalization to Individualization – Delivering a Unique ExperienceFrom Personalization to Individualization – Delivering a Unique Experience
From Personalization to Individualization – Delivering a Unique Experience
 
Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive Experimentation
 
Magento Meetup New Delhi- AB Testing
Magento Meetup New Delhi- AB TestingMagento Meetup New Delhi- AB Testing
Magento Meetup New Delhi- AB Testing
 
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
 
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
 
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product StrategyMaking Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product Strategy
 
Run High Impact Experimentation with High-quality Customer Discovery
Run High Impact Experimentation with High-quality Customer DiscoveryRun High Impact Experimentation with High-quality Customer Discovery
Run High Impact Experimentation with High-quality Customer Discovery
 
How to Reduce Customer Acquisition Costs and Optimize Advertising Spend
How to Reduce Customer Acquisition Costs and Optimize Advertising SpendHow to Reduce Customer Acquisition Costs and Optimize Advertising Spend
How to Reduce Customer Acquisition Costs and Optimize Advertising Spend
 
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
 
Experimentation Excellence Webinar Series: Time to scale up
Experimentation Excellence Webinar Series: Time to scale upExperimentation Excellence Webinar Series: Time to scale up
Experimentation Excellence Webinar Series: Time to scale up
 
Experimentation as a growth strategy: A conversation with The Motley Fool
Experimentation as a growth strategy: A conversation with The Motley FoolExperimentation as a growth strategy: A conversation with The Motley Fool
Experimentation as a growth strategy: A conversation with The Motley Fool
 
Becoming a True Experimentation Organization to Drive Innovation
Becoming a True Experimentation Organization to Drive InnovationBecoming a True Experimentation Organization to Drive Innovation
Becoming a True Experimentation Organization to Drive Innovation
 
Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...
Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...
Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...
 
Take Your Experimentation Program to the Next Level
Take Your Experimentation Program to the Next LevelTake Your Experimentation Program to the Next Level
Take Your Experimentation Program to the Next Level
 
Building a Culture of Product Experimentation by Optimizely PM
Building a Culture of Product Experimentation by Optimizely PMBuilding a Culture of Product Experimentation by Optimizely PM
Building a Culture of Product Experimentation by Optimizely PM
 
Optimizely's Optimization Benchmark Findings Webinar Slides
Optimizely's Optimization Benchmark Findings Webinar SlidesOptimizely's Optimization Benchmark Findings Webinar Slides
Optimizely's Optimization Benchmark Findings Webinar Slides
 
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
 
Testing Your Testing Program
Testing Your Testing ProgramTesting Your Testing Program
Testing Your Testing Program
 
Evolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product DevelopmentEvolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product Development
 

Similaire à #ImpactSalesforceSaturday: Drum into understanding of prediction builder with NBA

Nova Southeastern University H. Wayne Huizenga School of Bus.docx
Nova Southeastern University H. Wayne Huizenga School of Bus.docxNova Southeastern University H. Wayne Huizenga School of Bus.docx
Nova Southeastern University H. Wayne Huizenga School of Bus.docx
henrymartin15260
 
Marketing Analytics in a Week
Marketing Analytics in a WeekMarketing Analytics in a Week
Marketing Analytics in a Week
Act-On Software
 
Why We Test - Rethinking Your Approach
Why We Test - Rethinking Your ApproachWhy We Test - Rethinking Your Approach
Why We Test - Rethinking Your Approach
audreybloemer
 

Similaire à #ImpactSalesforceSaturday: Drum into understanding of prediction builder with NBA (20)

Data-Driven UI/UX Design with A/B Testing
Data-Driven UI/UX Design with A/B TestingData-Driven UI/UX Design with A/B Testing
Data-Driven UI/UX Design with A/B Testing
 
Behind The Scenes Data Science Coolblue 2018-03-22
Behind The Scenes Data Science Coolblue 2018-03-22Behind The Scenes Data Science Coolblue 2018-03-22
Behind The Scenes Data Science Coolblue 2018-03-22
 
Growth Hacking - High Tempo Testing
Growth Hacking - High Tempo TestingGrowth Hacking - High Tempo Testing
Growth Hacking - High Tempo Testing
 
Nova Southeastern University H. Wayne Huizenga School of Bus.docx
Nova Southeastern University H. Wayne Huizenga School of Bus.docxNova Southeastern University H. Wayne Huizenga School of Bus.docx
Nova Southeastern University H. Wayne Huizenga School of Bus.docx
 
The five essential steps to building a data product
The five essential steps to building a data productThe five essential steps to building a data product
The five essential steps to building a data product
 
Data Analysis - Making Big Data Work
Data Analysis - Making Big Data WorkData Analysis - Making Big Data Work
Data Analysis - Making Big Data Work
 
How to Use Data Effectively by Abra Sr. Business Analyst
How to Use Data Effectively by Abra Sr. Business AnalystHow to Use Data Effectively by Abra Sr. Business Analyst
How to Use Data Effectively by Abra Sr. Business Analyst
 
Analytics introduction for beginners
Analytics introduction for beginners Analytics introduction for beginners
Analytics introduction for beginners
 
Strategic planning
Strategic planningStrategic planning
Strategic planning
 
Evidence driven development - a lean methodology to product development
Evidence driven development - a lean methodology to product developmentEvidence driven development - a lean methodology to product development
Evidence driven development - a lean methodology to product development
 
Marketing Analytics in a Week
Marketing Analytics in a WeekMarketing Analytics in a Week
Marketing Analytics in a Week
 
Better Living Through Analytics - Louis Cialdella Product School
Better Living Through Analytics - Louis Cialdella Product SchoolBetter Living Through Analytics - Louis Cialdella Product School
Better Living Through Analytics - Louis Cialdella Product School
 
Identify Root Causes – C&E Matrix
Identify Root Causes – C&E MatrixIdentify Root Causes – C&E Matrix
Identify Root Causes – C&E Matrix
 
Lean UX workshop - Part Two
Lean UX workshop - Part TwoLean UX workshop - Part Two
Lean UX workshop - Part Two
 
Agile estimation
Agile estimationAgile estimation
Agile estimation
 
Analytics Academy 2017 Presentation Slides
Analytics Academy 2017 Presentation SlidesAnalytics Academy 2017 Presentation Slides
Analytics Academy 2017 Presentation Slides
 
Why We Test - Rethinking Your Approach
Why We Test - Rethinking Your ApproachWhy We Test - Rethinking Your Approach
Why We Test - Rethinking Your Approach
 
Einstein Analytics Prediction Builder
Einstein Analytics Prediction BuilderEinstein Analytics Prediction Builder
Einstein Analytics Prediction Builder
 
Talent Analytics: Maximizing the TA Value
Talent Analytics: Maximizing the TA ValueTalent Analytics: Maximizing the TA Value
Talent Analytics: Maximizing the TA Value
 
Risk And Relevance 20080414ppt
Risk And Relevance 20080414pptRisk And Relevance 20080414ppt
Risk And Relevance 20080414ppt
 

Plus de New Delhi Salesforce Developer Group

Plus de New Delhi Salesforce Developer Group (20)

ImpactSS | Introduction to Declarative Automation Tools
ImpactSS | Introduction to Declarative Automation ToolsImpactSS | Introduction to Declarative Automation Tools
ImpactSS | Introduction to Declarative Automation Tools
 
How to Build Your Career in the Salesforce Ecosystem Part 1 | New Delhi Sales...
How to Build Your Career in the Salesforce Ecosystem Part 1 | New Delhi Sales...How to Build Your Career in the Salesforce Ecosystem Part 1 | New Delhi Sales...
How to Build Your Career in the Salesforce Ecosystem Part 1 | New Delhi Sales...
 
KYC: Marketing Automation Part - 2
KYC: Marketing Automation Part - 2KYC: Marketing Automation Part - 2
KYC: Marketing Automation Part - 2
 
KYC Marketing Automation Part - 1
KYC Marketing Automation Part - 1KYC Marketing Automation Part - 1
KYC Marketing Automation Part - 1
 
Introduction to Journey builder
Introduction to Journey builder Introduction to Journey builder
Introduction to Journey builder
 
#ImpactSalesforceSaturday: Salesforce Solution design – Performance Considera...
#ImpactSalesforceSaturday: Salesforce Solution design – Performance Considera...#ImpactSalesforceSaturday: Salesforce Solution design – Performance Considera...
#ImpactSalesforceSaturday: Salesforce Solution design – Performance Considera...
 
#ImpactSalesforceSaturday: Personal Branding Knows No Boundaries
#ImpactSalesforceSaturday: Personal Branding Knows No Boundaries#ImpactSalesforceSaturday: Personal Branding Knows No Boundaries
#ImpactSalesforceSaturday: Personal Branding Knows No Boundaries
 
#ImpactSalesforceSaturday: Intro to digital marketing, Automation tools, SFMC...
#ImpactSalesforceSaturday: Intro to digital marketing, Automation tools, SFMC...#ImpactSalesforceSaturday: Intro to digital marketing, Automation tools, SFMC...
#ImpactSalesforceSaturday: Intro to digital marketing, Automation tools, SFMC...
 
#ImpactSalesforceSaturday: All about Data Preparation
#ImpactSalesforceSaturday: All about Data Preparation#ImpactSalesforceSaturday: All about Data Preparation
#ImpactSalesforceSaturday: All about Data Preparation
 
#ImpactSalesforceSaturday: Introduction (Four Pillars of Einstein)
#ImpactSalesforceSaturday: Introduction (Four Pillars of Einstein)#ImpactSalesforceSaturday: Introduction (Four Pillars of Einstein)
#ImpactSalesforceSaturday: Introduction (Four Pillars of Einstein)
 
#ImpactSalesforceSaturday: Einstein bot basic to advanced
#ImpactSalesforceSaturday: Einstein bot basic to advanced#ImpactSalesforceSaturday: Einstein bot basic to advanced
#ImpactSalesforceSaturday: Einstein bot basic to advanced
 
#ImpactSalesforceSaturday: Prepare for Salesforce Certified Heroku Architectu...
#ImpactSalesforceSaturday: Prepare for Salesforce Certified Heroku Architectu...#ImpactSalesforceSaturday: Prepare for Salesforce Certified Heroku Architectu...
#ImpactSalesforceSaturday: Prepare for Salesforce Certified Heroku Architectu...
 
TrailheaDX 2020 Global Gathering (Virtual)
TrailheaDX 2020 Global Gathering (Virtual)TrailheaDX 2020 Global Gathering (Virtual)
TrailheaDX 2020 Global Gathering (Virtual)
 
#ImpactSalesforceSaturday: Lightning Components 101: An Apex Developer’s Guide
#ImpactSalesforceSaturday: Lightning Components 101: An Apex Developer’s Guide#ImpactSalesforceSaturday: Lightning Components 101: An Apex Developer’s Guide
#ImpactSalesforceSaturday: Lightning Components 101: An Apex Developer’s Guide
 
#ImpactSalesforceSaturday: Email Marketing using Pardot
#ImpactSalesforceSaturday: Email Marketing using Pardot#ImpactSalesforceSaturday: Email Marketing using Pardot
#ImpactSalesforceSaturday: Email Marketing using Pardot
 
#ImpactSalesforceSaturday: Pardot Forms And Form Handlers
#ImpactSalesforceSaturday: Pardot Forms And Form Handlers#ImpactSalesforceSaturday: Pardot Forms And Form Handlers
#ImpactSalesforceSaturday: Pardot Forms And Form Handlers
 
#ImpactSalesforceSaturday:360 degree view of salesforce integrations
#ImpactSalesforceSaturday:360 degree view of salesforce integrations#ImpactSalesforceSaturday:360 degree view of salesforce integrations
#ImpactSalesforceSaturday:360 degree view of salesforce integrations
 
#ImpactSalesforceSaturday: Create a Chat Bot powered by Einstein Intent Predi...
#ImpactSalesforceSaturday: Create a Chat Bot powered by Einstein Intent Predi...#ImpactSalesforceSaturday: Create a Chat Bot powered by Einstein Intent Predi...
#ImpactSalesforceSaturday: Create a Chat Bot powered by Einstein Intent Predi...
 
Hear.com (Johann Furmann)
Hear.com (Johann Furmann) Hear.com (Johann Furmann)
Hear.com (Johann Furmann)
 
Sfdx presentation (Arpit) Hear.Com
Sfdx presentation (Arpit) Hear.ComSfdx presentation (Arpit) Hear.Com
Sfdx presentation (Arpit) Hear.Com
 

Dernier

Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
PECB
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
kauryashika82
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
fonyou31
 

Dernier (20)

APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpin
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdf
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 

#ImpactSalesforceSaturday: Drum into understanding of prediction builder with NBA

  • 1. Drum into understanding of prediction builder with NBA Hands-on Workshop: Step-by-Step Guide Rajat Jain, Program Specialist @ MTX Group Inc. rajat.jain@mtxb2b.com @rajat_307
  • 2. What is Machine Learning? Machine Learning is using past data to predict the future Computer algorithms find patterns in the historical data to apply to new data and make predictions Historical Data Your historical records For example, opportunities won/lost in the last 12 months New Data Records to Predict For example, new opportunities
  • 3. What is it? A wizard where you can define a machine learning problem for the Einstein Platform to solve Who is it for? Salesforce admins, in conjunction with with their data experts What is the value? Easy to create predictions, iterate on them and use predictions in production Einstein Prediction Builder Point, Click, Predict
  • 4. Subtitle placeholder What Einstein Builder Predicts For Numeric Predictions Leverage historical information to predict a number Binary Predictions Leverage historical information to answer a Yes/No question Scores Returned: ● $400,000 ● 30 days ● $1,200,000 (welcome to the Bay Area..) Scores Returned: ● The likelihood a record churns ● The likelihood a lead converts ● The likelihood a student graduates Example Questions: ● Is this customer going to churn? ● Is this lead going to convert? ● Will this student graduate on time? Example Questions: ● How much is this deal likely worth? ● How long will this deal take to close? ● How much will this house sell for?
  • 5. 1. Define your use case 2. Plan your prediction 3. Fill out the wizard 4. Review your scorecard 5. Enable your prediction 6. Use model in production Einstein Prediction Builder Lifecycle
  • 6. Q: What is the problem your company is facing? Example: Only 60% of Medical Appointment shows up on time. How do I increase rate to get patient to show on time for appointment? Q: What type of prediction will help? Example: Predict which Medical Appointment are likely to be No Show. Q: Can this prediction be phrased as a yes/no or numeric question? Example: Will this prediction be No Show? How to Define Your Use Case
  • 7. Q: How will I use this prediction? Example: Call/SMS Patient in advance if they are going to be No Show. Q: How do you measure if the prediction is successful? Example: Percentage decrease in Patient No Show. How to Define Your Use Case (cont.)
  • 9. Building a Yes/No Prediction - + -+ - ? Example set (Training set) Minimum 400 Records Required Records to predict (Scoring set) ?
  • 10. Will an Medical Appointment be a No Show? Dataset Segment Positive examples Negative examples Prediction Set Prediction Set: Records that have scheduled Appointment but which is in future Object: Medical Appointment Segment: N/A Positive examples: Patient Records which did not shows up on time Negative Examples: Patient Records which shows up on time
  • 11. Predicting Appointment No Shows ● Set up → Prediction Builder ● Click “New Prediction” Create a Prediction Choose an Object and Type of Prediction Records to Learn from and Records to Predict Prediction Inputs and Output ● Give your prediction a name ● Click “Next”
  • 12. Predicting Appointment No Shows ● Select “Medical Appointment__c” ● Click “Data Checker” ○Ensure you have enough records in this object to build a prediction Create a Prediction Choose an Object and Type of Prediction Records to Learn from and Records to Predict Prediction Inputs and Output ● The answer to “Will this appointment be a No Show?“ is Yes/No
  • 13. Predicting Appointment No Shows ● Field to Predict = “No Show” ● Appointments to learn from (e.g. training examples) ~ 7800 ○ Set condition to Appointments on or before May 31, 2016 ● Appointments to predict ~ 2200 ○ Appointments after May 31, 2016 Create a Prediction Choose an Object and Type of Prediction Records to Learn from and Records to Predict Prediction Inputs and Output Best Practice Tip: ● Always use Data Checker to confirm: ○ You have enough records to learn from (training set). ○ You have enough positive and negative examples in your training set ○ You know how many records will have a prediction (records to predict)
  • 14. Predicting Appointment No Shows ● Select fields in the appointment record that should be used as input to predict ○Use as many as possible ● Click “Next” Create a Prediction Choose an Object and Type of Prediction Records to Learn from and Records to Predict Prediction Inputs and Output ● Name the custom field that store your prediction. ○ Note that the prediction will be a number between 0-100 representing the likelihood of “No Show” ● Click “Next” ● Click “Build Prediction”
  • 15. Evaluating Prediction Accuracy How good was that predictive model? Use EPB Model Accuracy Package
  • 16. Evaluating Prediction Accuracy ● Click on the “App Launcher” ● Click on “Analytics Studio” Launch EPB Model Accuracy Complete the Wizard View Prediction Accuracy ● Click on “Create App”
  • 17. Evaluating Prediction Accuracy ● Click on “Create App from Template'” Launch EPB Model Accuracy Complete the Wizard View Prediction Accuracy ● Select “EPB Model Accuracy” ● Click “Continue” ● Click “Continue” again
  • 18. Evaluating Prediction Accuracy Fill in the following details about your prediction Fill in the following details about your prediction ● Object = Medical Appointments 2 ● Field containing actuals = No Show Launch EPB Model Accuracy Complete the Wizard View Prediction Accuracy Choose two business dimensions to analyze your prediction accuracy. For example you could: ● Choose “Age Bracket” and “Gender” ● Click “Looks good, next”
  • 19. Evaluating Prediction Accuracy Provide suitable labels: ● A high score (100) means ...No Show ● A low score (0) means...Show ● Click Next ● Click Next Launch EPB Model Accuracy Complete the Wizard View Prediction Accuracy Provide a Name for your App ● Click Create
  • 20. Evaluating Prediction Accuracy Wait for 2-3 minutes until you see “Application Complete” ● Refresh your browser page ● Open the Binary Classification Performance dashboard“ Launch EPB Model Accuracy Complete the Wizard View Prediction Accuracy Switch to the confusion matrix view ● Set different thresholds and observe the impact on Accuracy, False Positives, False Negatives ● Discuss - Would you lower the threshold to reduce overall accuracy while minimizing false negatives?
  • 21. Acting on your Prediction Next Best Action
  • 22. Use Prediction to Recommend the Best Course of Action ● Go to Setup ● Type “Next best ” ● Click on “Next Best Action” ● Click on “New Strategy” Launch Next Best Action Craft a Strategy Display your Recommendation ● Name = “No Show Strategy” ● Object where Recommendations Display = “Medical Appointment 2” ● Click “Create”
  • 23. Use Prediction to Recommend the Best Course of Action ● Drag 2 Load Nodes on the strategy builder ○ Node 1: Name “Call Patient” & Description contains “Call” ○ Node 2: Name “SMS Patient” & Description contains “SMS” Launch Next Best Action Craft a Strategy Display your Recommendation ● Drag a “Branch Selector” ○ Label: “Predicted No Show?” ● Re-arrange nodes as shown
  • 24. Use Prediction to Recommend the Best Course of Action ● Branch 1 ○ No Show Score >= 18 Launch Next Best Action Craft a Strategy Display your Recommendation ● Branch 2 ○ No Show Score < 18
  • 25. Use Prediction to Recommend the Best Course of Action ○ Open a Medical Appointment 2 record ○ Click “Edit Page” Launch Next Best Action Craft a Strategy Display your Recommendation ● Drag the Einstein Next Best Action to the right pane ● Confirm your strategy is selected ● Now ○ Click “Save” ○ Click “Activate” ○ Click “Assign as Org Default” ○ Select “Desktop”. ○ Click “Next” & “Save” ● Click “Back”
  • 26. Use Prediction to Recommend the Best Course of Action Your Recommendation is displayed Launch Next Best Action Craft a Strategy Display your Recommendation
  • 27. Continue Learning About Einstein! Check out content on the Einstein Hub Learn about the Einstein Champions Program Join the Einstein Trailblazer Community Group einstein-hub.com sfdc.co/einsteinchampions sfdc.co/einsteingroup
  • 29.
  • 30. Follow & Join New Delhi Salesforce DG • Join to know about future events and to RSVP: https://trailblazercommunitygroups.com/delhi-in-developers-group/ • Let’s start conversations on Success Community: http://bit.ly/NewDelhiCommunity • Follow us on Twitter: https://twitter.com/newdelhisfdcdug • Hashtag: #ImpactSalesforceSaturday • Follow us on Facebook: https://www.facebook.com/newdelhisfdcdug • For all the content: https://newdelhisfdcdug.com