SlideShare une entreprise Scribd logo
1  sur  40
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Solve complex business problems with
Amazon Forecast
and Amazon Personalize
Julien Simon
Global Evangelist, AI & Machine Learning
@julsimon
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Common applications & use cases
Personalized
recommendations
Search
reranking
Notifications and
emailsRelated Items
Personalizing user experience is proven to increase discoverability,
engagement, user satisfaction, and revenue
30% of page views on
Amazon are from
recommendations
… However, most customers find personalization hard to
get right
Effective personalization requires solving multiple hard problems
Reacting to user interactions in real time
Avoiding mostly showing popular items
Handling cold start (insufficient data about
new users/items)
Scale
Deep learning techniques have a direct impact on the bottom line
SimilarityPopularity
Neural
network
Matrix
factorization
+15.4%
Engagement
Recurrent
Neural Net +
Bandit
Rule-based card
ranker
Bayesian
network model
+7.4%
Engagement+29%
Click Through
+20%
Click Through
Deep Learning delivers state of the art performance
0.954
0.928 0.925 0.922
0.91
0.856
Rolling
Average
T-SVD [2009] PMF [2008] RRN [2017] DeepRec
[2017]
HRNN
Ratings RMSE on Netflix
98 MM interactions, 500k users, 18k items
Rolling Average T-SVD [2009] PMF [2008]
RRN [2017] DeepRec [2017] HRNN
0.933
0.916
0.871
0.857
0.846
Rolling
Average
FM [2012] I-AutoRec
[2015]
RNN HRNN
Ratings RMSE on MovieLens
20 MM interactions, 173k users, 131k items
Rolling Average FM [2012]
I-AutoRec [2015] RNN
Amazon Personalize
Improvecustomerexperienceswithpersonalizationandrecommendations
K E Y F E AT U R E S
Context-aware
Recommendations
Automated
machine learning
Continuous learning
to improve performance
Amazon Personalize: How it works
Amazon Personalize
Feeding data to Amazon Personalize
Historical user
activity
User
attributes
Item
catalog
Real-time data
Mobile
SDKs
(coming soon)
JavaScript SDK
Amazon S3
bucket
Server-Side SDKs
Offline data
Train custom models once you ingest data
Use AutoML or pick a
predefined algorithm
recipes AutoML
Hyper
Parameter Optimization
Demo
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Sample use cases
Product demand Workforce demand Financial
metrics
Inventory
planning
Accuracy is the most important factor in forecasting
Under-forecasting leads
to lost opportunity
Over-forecasting leads
to wasted resources
Traditional time-series models
Traditional time-series models
Trend
Traditional time-series models
Trend + Seasonality
Traditional time-series models
• Independent forecasts
• Strong structural assumptions
• De-facto industry standard
• Well-understood, > 50 yrs. research
• Data must match the structural
assumptions
• Cannot identify patterns
across time series
Example
Data
Seasonality
Trend
Noise ?
or useful information?
Traditional methods struggle with real-world forecasting
Can’t handle
time-series with
no history
Only process a
single time-series
at a time
Don’t consider
additional inputs:
related time-series,
metadata
Only predict a single
value: how trustworthy
is it?
Can we do better?
1 – Multiple time-series help identify common patterns
2 – Real-world time series are not well-behaved…
… but using additional inputs helps to figure them out
Using additional inputs
• Additional inputs can
• Explain historical data
• Drive forecast behavior
• Examples from retail
• Price information
• Information about promotions
• Out-of-stock information
• Web page views
• Known future events
• Categorical inputs can be used to
identify group-level patterns
Fashion
Women’s
Clothing
Shoes
Watches
Men’s
Clothing
Shoes
Watches
Girls'
Clothing
Shoes
Watches
Boys'
Clothing
Shoes
Watches
3 – The future could look like this…
Or like this.. So how confident are we?
Probabilistic forecasts: intervals and confidence
Probabilistic forecasts
• Quantification of uncertainty
• Support optimal decision making
• Make “wrong” forecasts useful
• Forecasts can be obtained for
different quantiles of the predictive
distribution
p10: 10% of predictions with be lower
p50: the mean value
p90: 90% of predictions with be lower
p10-p90 interval: 80% of possible predictions.
Deep learning time-series models
• Global models: identify patterns using
all available time series
• Group-dependent seasonality and lifecycle
• Behavior in response to extra inputs
• Weak structural assumptions
• Can be significantly more accurate than
traditional methods
• Can easily incorporate and learn from
rich metadata
• Support cold-start forecasts for new
items
Using deep learning increases forecast accuracy
MQ-RNN
cold start
spikes
Amazon Forecast
Improveforecastingaccuracyby up to 50% at 1/10th thecost
K E Y F E AT U R E S
Consider multiple
time-series
at once
Automatic
machine
learning
Visualize forecasts &
import results into
business apps
Evaluate model
accuracy
Schedule forecasts
and model
retraining
Pre-defined schemas for different business domains
domains
schemas
Amazon Forecast: How it works
Target time-series
Item meta-data
tegory, genre, brand, etc.
Amazon Forecast
Related time-series
Train custom models once you ingest data
Use AutoML or pick a
predefined algorithm
recipes AutoML
Hyper
Parameter Optimization
Key metrics reported by Amazon Forecast
Demo
https://github.com/aws-samples/amazon-forecast-samples
Getting started
https://ml.aws
https://aws.training/machinelearning
https://aws.amazon.com/personalize
https://aws.amazon.com/blogs/aws/amazon-personalize-real-time-
personalization-and-recommendation-for-everyone/
https://aws.amazon.com/forecast
https://aws.amazon.com/blogs/aws/amazon-forecast-time-series-forecasting-
made-easy/
Thank you!
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Julien Simon
Global Evangelist, AI & Machine Learning
@julsimon
https://medium.com/@julsimon

Contenu connexe

Tendances

Machine Learning Key Lessons Learned for Developers
Machine Learning Key Lessons Learned for DevelopersMachine Learning Key Lessons Learned for Developers
Machine Learning Key Lessons Learned for Developers
Amazon Web Services
 

Tendances (20)

Amazon SageMaker
Amazon SageMakerAmazon SageMaker
Amazon SageMaker
 
Introducing Amazon Personalize
Introducing Amazon PersonalizeIntroducing Amazon Personalize
Introducing Amazon Personalize
 
Amazon SageMaker Ground Truth: Build High-Quality and Accurate ML Training Da...
Amazon SageMaker Ground Truth: Build High-Quality and Accurate ML Training Da...Amazon SageMaker Ground Truth: Build High-Quality and Accurate ML Training Da...
Amazon SageMaker Ground Truth: Build High-Quality and Accurate ML Training Da...
 
Accelerating-ML-Adoption-with-Our-New-AI-Services
Accelerating-ML-Adoption-with-Our-New-AI-ServicesAccelerating-ML-Adoption-with-Our-New-AI-Services
Accelerating-ML-Adoption-with-Our-New-AI-Services
 
AWS Initiate - Transformação Digital Usando Machine Learning
AWS Initiate - Transformação Digital Usando Machine LearningAWS Initiate - Transformação Digital Usando Machine Learning
AWS Initiate - Transformação Digital Usando Machine Learning
 
Building and deploying AI/ML models on AWS for Biosciences professionals
Building and deploying AI/ML models on AWS for Biosciences professionalsBuilding and deploying AI/ML models on AWS for Biosciences professionals
Building and deploying AI/ML models on AWS for Biosciences professionals
 
Accelerate_Digital_Transformation_through_AI-powered_Cloud_Analytics_Moderniz...
Accelerate_Digital_Transformation_through_AI-powered_Cloud_Analytics_Moderniz...Accelerate_Digital_Transformation_through_AI-powered_Cloud_Analytics_Moderniz...
Accelerate_Digital_Transformation_through_AI-powered_Cloud_Analytics_Moderniz...
 
Machine Learning: From Inception to Inference - AWS Summit Sydney
Machine Learning: From Inception to Inference - AWS Summit SydneyMachine Learning: From Inception to Inference - AWS Summit Sydney
Machine Learning: From Inception to Inference - AWS Summit Sydney
 
Create a Serverless Searchable Media Library (AIM342-R1) - AWS re:Invent 2018
Create a Serverless Searchable Media Library (AIM342-R1) - AWS re:Invent 2018Create a Serverless Searchable Media Library (AIM342-R1) - AWS re:Invent 2018
Create a Serverless Searchable Media Library (AIM342-R1) - AWS re:Invent 2018
 
Intro to AI & ML at Amazon
Intro to AI & ML at AmazonIntro to AI & ML at Amazon
Intro to AI & ML at Amazon
 
Smart-Energy-Connect-Accelerating-Innovation-at-CLP
Smart-Energy-Connect-Accelerating-Innovation-at-CLPSmart-Energy-Connect-Accelerating-Innovation-at-CLP
Smart-Energy-Connect-Accelerating-Innovation-at-CLP
 
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...
AWS Summit Singapore 2019 | Big Data Analytics Architectural Patterns and Bes...
 
AWS reInvent 2017 Recap Webinar
AWS reInvent 2017 Recap WebinarAWS reInvent 2017 Recap Webinar
AWS reInvent 2017 Recap Webinar
 
AI & ML at Amazon: AWS Developer Workshop - Web Summit 2018
AI & ML at Amazon: AWS Developer Workshop - Web Summit 2018AI & ML at Amazon: AWS Developer Workshop - Web Summit 2018
AI & ML at Amazon: AWS Developer Workshop - Web Summit 2018
 
Machine Learning Key Lessons Learned for Developers
Machine Learning Key Lessons Learned for DevelopersMachine Learning Key Lessons Learned for Developers
Machine Learning Key Lessons Learned for Developers
 
Building Machine Learning inference pipelines at scale | AWS Summit Tel Aviv ...
Building Machine Learning inference pipelines at scale | AWS Summit Tel Aviv ...Building Machine Learning inference pipelines at scale | AWS Summit Tel Aviv ...
Building Machine Learning inference pipelines at scale | AWS Summit Tel Aviv ...
 
Bonus-Session-Interledger-DvP-Settlement-on-Amazon-Managed-Blockchain
Bonus-Session-Interledger-DvP-Settlement-on-Amazon-Managed-BlockchainBonus-Session-Interledger-DvP-Settlement-on-Amazon-Managed-Blockchain
Bonus-Session-Interledger-DvP-Settlement-on-Amazon-Managed-Blockchain
 
Deep Learning con TensorFlow and Apache MXNet su Amazon SageMaker
Deep Learning con TensorFlow and Apache MXNet su Amazon SageMakerDeep Learning con TensorFlow and Apache MXNet su Amazon SageMaker
Deep Learning con TensorFlow and Apache MXNet su Amazon SageMaker
 
Sviluppa, addestra e distribuisci modelli di machine learning.pdf
Sviluppa, addestra e distribuisci modelli di machine learning.pdfSviluppa, addestra e distribuisci modelli di machine learning.pdf
Sviluppa, addestra e distribuisci modelli di machine learning.pdf
 
Adding intelligence to applications - AIM201 - Chicago AWS Summit
Adding intelligence to applications - AIM201 - Chicago AWS SummitAdding intelligence to applications - AIM201 - Chicago AWS Summit
Adding intelligence to applications - AIM201 - Chicago AWS Summit
 

Similaire à Solve complex business problems with managed ML services.pdf

Similaire à Solve complex business problems with managed ML services.pdf (20)

Solve complex business problems with managed ML services: Personalize and For...
Solve complex business problems with managed ML services: Personalize and For...Solve complex business problems with managed ML services: Personalize and For...
Solve complex business problems with managed ML services: Personalize and For...
 
Barga Galvanize Sept 2015
Barga Galvanize Sept 2015Barga Galvanize Sept 2015
Barga Galvanize Sept 2015
 
Build sophisticated forecasting and recommendation models - AIM202 - New York...
Build sophisticated forecasting and recommendation models - AIM202 - New York...Build sophisticated forecasting and recommendation models - AIM202 - New York...
Build sophisticated forecasting and recommendation models - AIM202 - New York...
 
SDD2017 - 03 Abed Ajraou - putting data science in your business a first uti...
SDD2017 - 03 Abed Ajraou  - putting data science in your business a first uti...SDD2017 - 03 Abed Ajraou  - putting data science in your business a first uti...
SDD2017 - 03 Abed Ajraou - putting data science in your business a first uti...
 
Demystifying ML/AI
Demystifying ML/AIDemystifying ML/AI
Demystifying ML/AI
 
Putting data science in your business a first utility feedback
Putting data science in your business a first utility feedbackPutting data science in your business a first utility feedback
Putting data science in your business a first utility feedback
 
Machine Learning and Analytics Breakout Session
Machine Learning and Analytics Breakout SessionMachine Learning and Analytics Breakout Session
Machine Learning and Analytics Breakout Session
 
Machine Learning and Analytics Breakout Session
Machine Learning and Analytics Breakout SessionMachine Learning and Analytics Breakout Session
Machine Learning and Analytics Breakout Session
 
Disrupting Risk Management through Emerging Technologies
Disrupting Risk Management through Emerging TechnologiesDisrupting Risk Management through Emerging Technologies
Disrupting Risk Management through Emerging Technologies
 
Splunk for Machine Learning and Analytics
Splunk for Machine Learning and AnalyticsSplunk for Machine Learning and Analytics
Splunk for Machine Learning and Analytics
 
Splunk for Machine Learning and Analytics
Splunk for Machine Learning and AnalyticsSplunk for Machine Learning and Analytics
Splunk for Machine Learning and Analytics
 
AI & AWS DeepComposer
AI & AWS DeepComposerAI & AWS DeepComposer
AI & AWS DeepComposer
 
AI Class Topic 3: Building Machine Learning Predictive Systems (Predictive Ma...
AI Class Topic 3: Building Machine Learning Predictive Systems (Predictive Ma...AI Class Topic 3: Building Machine Learning Predictive Systems (Predictive Ma...
AI Class Topic 3: Building Machine Learning Predictive Systems (Predictive Ma...
 
Machine Learning Application to Manufacturing using Tableau, Tableau and Goog...
Machine Learning Application to Manufacturing using Tableau, Tableau and Goog...Machine Learning Application to Manufacturing using Tableau, Tableau and Goog...
Machine Learning Application to Manufacturing using Tableau, Tableau and Goog...
 
Why is Data Science still not a mainstream in corporations - Sasa Radovanovic
Why is Data Science still not a mainstream in corporations - Sasa RadovanovicWhy is Data Science still not a mainstream in corporations - Sasa Radovanovic
Why is Data Science still not a mainstream in corporations - Sasa Radovanovic
 
Frontline Optimization
Frontline OptimizationFrontline Optimization
Frontline Optimization
 
Time-to-Event Models, presented by DataSong and Revolution Analytics
Time-to-Event Models, presented by DataSong and Revolution AnalyticsTime-to-Event Models, presented by DataSong and Revolution Analytics
Time-to-Event Models, presented by DataSong and Revolution Analytics
 
AWS Innovate 2016: Digital Workloads on Amazon Web Services- Santanu Dutt
AWS Innovate 2016: Digital Workloads on Amazon Web Services- Santanu DuttAWS Innovate 2016: Digital Workloads on Amazon Web Services- Santanu Dutt
AWS Innovate 2016: Digital Workloads on Amazon Web Services- Santanu Dutt
 
Use of Analytics to recover from COVID19 hit economy
Use of Analytics to recover from COVID19 hit economyUse of Analytics to recover from COVID19 hit economy
Use of Analytics to recover from COVID19 hit economy
 
The Zen of DataOps – AWS Lake Formation and the Data Supply Chain Pipeline
The Zen of DataOps – AWS Lake Formation and the Data Supply Chain PipelineThe Zen of DataOps – AWS Lake Formation and the Data Supply Chain Pipeline
The Zen of DataOps – AWS Lake Formation and the Data Supply Chain Pipeline
 

Plus de Amazon Web Services

Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
Amazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
Amazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
Amazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
Amazon Web Services
 

Plus de Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Solve complex business problems with managed ML services.pdf