SlideShare une entreprise Scribd logo
1  sur  52
Télécharger pour lire hors ligne
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Felix Candelario
Creating a Machine Learning Factory
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Cover Slide
• Audience: Developers
• Services covered: Amazon SageMaker
• Rough level of the content: 300
• Abstract: Going from a hypothesis to a working machine learning model that infers answers in
production requires a lot of time and effort. Moreover, the ability to answer questions related to specific
results—such as, “what version of the code and data produced a particular inference?”—is paramount in highly
regulated industries such as Financial Services. Modern development practices like continuous integration and
deployment can accelerate the machine learning development process and provide a way to answer questions
about data lineage. During this talk, you will learn how to combine Amazon SageMaker (a fully managed service
that enables developers and data scientists to quickly and easily build, train, and deploy machine learning
models at any scale) with Amazon CodeCommit, CodeBuild, and CodePipeline to create a pipeline that
automatically triggers changes when either your model code or training data changes.
• Author: Felix Candelario, fcandela@
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Creating a machine learning factory
Regulatory obligations require
workloads that rely on ML be
operationalized ASAP
Why
Applying modern CI/CD
practices to ML workloads is
the fastest way forward
How
AWS is the best place to
operationalize your ML
workloads
Where
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Contents
Introduction
ML in Banking: Credit scoring
Regulatory implications
Operationalizing ML on AWS
Why ML on AWS?
Conclusion
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
“It is a renaissance, it is a golden age. We are now
solving problems with machine learning and artificial
intelligence that were … in the realm of science fiction
for the last several decades.”
— Jeff Bezos
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Algorithms
Data
Programming
Models
GPUs &
Acceleration
‘Golden Age’ of Artificial Intelligence
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Contents
Introduction
ML in Banking: Credit scoring
Regulatory implications
Operationalizing ML on AWS
Why ML on AWS?
Conclusion
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ML in Banking: Marketplace lenders
• Operating exclusively online
• Niche product focus
• High degree of automation
• User of non-traditional data
sources
• Rapid changes in decision
criteria and scoring models
Typical Characteristics
• Unsecured personal loans
• Education lending
• SMB loans and credit lines
• Real estate secured
Example products & lenders
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ML in Banking: Non-traditional data sources
• Payday and non-prime loan
information
• Check cashing services
• Rent-to-own transactions
• Mobile phone account openings
and payments
• Utility accounts & payments
Non-traditional data
• Social media and web surfing data
• Address stability
• Number and age of email-
addresses
• Local unemployment rates
• Profession or job function
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Contents
Introduction
ML in Banking: Credit scoring
Regulatory implications
Operationalizing ML on AWS
Why ML on AWS?
Conclusion
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Lending decisions are highly regulated
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ML for FSI workloads requires Industrialization
• Development happens on dev
desktops
• Iterative process that is prone to
experimentation
• Tooling, frameworks, and
languages in constant flux
• Difficult to acquire infrastructure
ML today is very artisanal
• Credit lifecycle processes moving
from decision trees to ML
• Highly regulated credit lifecycles
• Fair Lending, Fair Housing, GDPR
• Disparate impact is terrifying
FSI workloads require rigor
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Contents
Introduction
ML in Banking: Credit scoring
Regulatory implications
Operationalizing ML on AWS
Why ML on AWS?
Conclusion
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Competing requirements
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Continuous Integration/Continuous Delivery
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Solution Overview
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Deep Dive
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Commit Code
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Source Stage
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Build Stage
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Train Stage
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Industrialized machine learning workflow
AWS
CodeCommit AWS
CodeBuild
AWS
CodePipeline
ECR registryPipeline output
artifact bucket
Amazon
Sagemaker
Source
Train
Build
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Contents
Introduction
ML in Banking: Credit scoring
Regulatory implications
Operationalizing ML on AWS
Why ML on AWS?
Conclusion
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why ML on AWS?
PLATFORM SERVICES
APPLICATION SERVICES
FRAMEWORKS & INTERFACES
Caffe2 CNTK
Apache
MXNet
PyTorch TensorFlow Torch Keras Gluon
AWS Deep Learning AMIs
Amazon SageMaker AWS DeepLens
Rekognition Transcribe Translate Polly Comprehend Lex
Amazon Mechanical Turk Amazon ML
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Contents
Introduction
ML in Banking: Credit scoring
Regulatory implications
Operationalizing ML on AWS
Why ML on AWS?
Conclusion
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Creating a machine learning factory
Regulatory obligations
require workloads that rely
on ML be operationalized
ASAP
Why
Applying modern CI/CD
practices to ML workloads
is the fastest way forward
How
AWS is the best place to
operationalize your ML
workloads
Where
Submit Session Feedback
1. Tap the Schedule icon.
2. Select the session you
attended.
3. Tap Session Evaluation to
submit your feedback.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you!

Contenu connexe

Tendances

Serverless Stream Processing Tips & Tricks (ANT358) - AWS re:Invent 2018
Serverless Stream Processing Tips & Tricks (ANT358) - AWS re:Invent 2018Serverless Stream Processing Tips & Tricks (ANT358) - AWS re:Invent 2018
Serverless Stream Processing Tips & Tricks (ANT358) - AWS re:Invent 2018Amazon Web Services
 
Improve Accessibility Using Machine Learning (AIM332) - AWS re:Invent 2018
Improve Accessibility Using Machine Learning (AIM332) - AWS re:Invent 2018Improve Accessibility Using Machine Learning (AIM332) - AWS re:Invent 2018
Improve Accessibility Using Machine Learning (AIM332) - AWS re:Invent 2018Amazon Web Services
 
SRV317 Creating and Publishing AR and VR Apps with Amazon Sumerian
SRV317 Creating and Publishing AR and VR Apps with Amazon SumerianSRV317 Creating and Publishing AR and VR Apps with Amazon Sumerian
SRV317 Creating and Publishing AR and VR Apps with Amazon SumerianAmazon Web Services
 
Three Lessons from “Escape the Room” That Apply to Making Money with Your Ale...
Three Lessons from “Escape the Room” That Apply to Making Money with Your Ale...Three Lessons from “Escape the Room” That Apply to Making Money with Your Ale...
Three Lessons from “Escape the Room” That Apply to Making Money with Your Ale...Amazon Web Services
 
Build Intelligent Conversational Agents with Amazon Neptune and Amazon SageMa...
Build Intelligent Conversational Agents with Amazon Neptune and Amazon SageMa...Build Intelligent Conversational Agents with Amazon Neptune and Amazon SageMa...
Build Intelligent Conversational Agents with Amazon Neptune and Amazon SageMa...Amazon Web Services
 
Analyze Amazon CloudFront and Lambda@Edge Logs to Improve Customer Experience...
Analyze Amazon CloudFront and Lambda@Edge Logs to Improve Customer Experience...Analyze Amazon CloudFront and Lambda@Edge Logs to Improve Customer Experience...
Analyze Amazon CloudFront and Lambda@Edge Logs to Improve Customer Experience...Amazon Web Services
 
Financial Svcs: Mine Actionable Insights from Customer Interactions Using Mac...
Financial Svcs: Mine Actionable Insights from Customer Interactions Using Mac...Financial Svcs: Mine Actionable Insights from Customer Interactions Using Mac...
Financial Svcs: Mine Actionable Insights from Customer Interactions Using Mac...Amazon Web Services
 
Securing Data in Serverless Applications and Messaging Services (API317-R2) -...
Securing Data in Serverless Applications and Messaging Services (API317-R2) -...Securing Data in Serverless Applications and Messaging Services (API317-R2) -...
Securing Data in Serverless Applications and Messaging Services (API317-R2) -...Amazon Web Services
 
Build, Train, and Deploy ML Models with Amazon SageMaker (AIM410-R2) - AWS re...
Build, Train, and Deploy ML Models with Amazon SageMaker (AIM410-R2) - AWS re...Build, Train, and Deploy ML Models with Amazon SageMaker (AIM410-R2) - AWS re...
Build, Train, and Deploy ML Models with Amazon SageMaker (AIM410-R2) - AWS re...Amazon Web Services
 
Serverless Architectural Patterns and Best Practices (ARC305-R2) - AWS re:Inv...
Serverless Architectural Patterns and Best Practices (ARC305-R2) - AWS re:Inv...Serverless Architectural Patterns and Best Practices (ARC305-R2) - AWS re:Inv...
Serverless Architectural Patterns and Best Practices (ARC305-R2) - AWS re:Inv...Amazon Web Services
 
Accelerate ML Training on Amazon SageMaker Using GPU-Based EC2 P3 Instances (...
Accelerate ML Training on Amazon SageMaker Using GPU-Based EC2 P3 Instances (...Accelerate ML Training on Amazon SageMaker Using GPU-Based EC2 P3 Instances (...
Accelerate ML Training on Amazon SageMaker Using GPU-Based EC2 P3 Instances (...Amazon Web Services
 
Deep Dive on Amazon S3 Storage Classes: Creating Cost Efficiencies across You...
Deep Dive on Amazon S3 Storage Classes: Creating Cost Efficiencies across You...Deep Dive on Amazon S3 Storage Classes: Creating Cost Efficiencies across You...
Deep Dive on Amazon S3 Storage Classes: Creating Cost Efficiencies across You...Amazon Web Services
 
Building Deep Learning Applications with TensorFlow and SageMaker on AWS - Te...
Building Deep Learning Applications with TensorFlow and SageMaker on AWS - Te...Building Deep Learning Applications with TensorFlow and SageMaker on AWS - Te...
Building Deep Learning Applications with TensorFlow and SageMaker on AWS - Te...Amazon Web Services
 
What Can Your Logs Tell You? (ANT215) - AWS re:Invent 2018
What Can Your Logs Tell You? (ANT215) - AWS re:Invent 2018What Can Your Logs Tell You? (ANT215) - AWS re:Invent 2018
What Can Your Logs Tell You? (ANT215) - AWS re:Invent 2018Amazon Web Services
 
CI/CD for Your Machine Learning Pipeline with Amazon SageMaker (DVC303) - AWS...
CI/CD for Your Machine Learning Pipeline with Amazon SageMaker (DVC303) - AWS...CI/CD for Your Machine Learning Pipeline with Amazon SageMaker (DVC303) - AWS...
CI/CD for Your Machine Learning Pipeline with Amazon SageMaker (DVC303) - AWS...Amazon Web Services
 
How Peak.AI Uses Amazon SageMaker for Product Personalization (GPSTEC316) - A...
How Peak.AI Uses Amazon SageMaker for Product Personalization (GPSTEC316) - A...How Peak.AI Uses Amazon SageMaker for Product Personalization (GPSTEC316) - A...
How Peak.AI Uses Amazon SageMaker for Product Personalization (GPSTEC316) - A...Amazon Web Services
 
Industrialize Machine Learning Using CI/CD Techniques (FSV304-i) - AWS re:Inv...
Industrialize Machine Learning Using CI/CD Techniques (FSV304-i) - AWS re:Inv...Industrialize Machine Learning Using CI/CD Techniques (FSV304-i) - AWS re:Inv...
Industrialize Machine Learning Using CI/CD Techniques (FSV304-i) - AWS re:Inv...Amazon Web Services
 
Vonage & Aspect: Transform Real-Time Communications & Customer Engagement (TL...
Vonage & Aspect: Transform Real-Time Communications & Customer Engagement (TL...Vonage & Aspect: Transform Real-Time Communications & Customer Engagement (TL...
Vonage & Aspect: Transform Real-Time Communications & Customer Engagement (TL...Amazon Web Services
 
Train Models on Amazon SageMaker Using Data Not from Amazon S3 (AIM419) - AWS...
Train Models on Amazon SageMaker Using Data Not from Amazon S3 (AIM419) - AWS...Train Models on Amazon SageMaker Using Data Not from Amazon S3 (AIM419) - AWS...
Train Models on Amazon SageMaker Using Data Not from Amazon S3 (AIM419) - AWS...Amazon Web Services
 

Tendances (20)

Serverless Stream Processing Tips & Tricks (ANT358) - AWS re:Invent 2018
Serverless Stream Processing Tips & Tricks (ANT358) - AWS re:Invent 2018Serverless Stream Processing Tips & Tricks (ANT358) - AWS re:Invent 2018
Serverless Stream Processing Tips & Tricks (ANT358) - AWS re:Invent 2018
 
Improve Accessibility Using Machine Learning (AIM332) - AWS re:Invent 2018
Improve Accessibility Using Machine Learning (AIM332) - AWS re:Invent 2018Improve Accessibility Using Machine Learning (AIM332) - AWS re:Invent 2018
Improve Accessibility Using Machine Learning (AIM332) - AWS re:Invent 2018
 
SRV317 Creating and Publishing AR and VR Apps with Amazon Sumerian
SRV317 Creating and Publishing AR and VR Apps with Amazon SumerianSRV317 Creating and Publishing AR and VR Apps with Amazon Sumerian
SRV317 Creating and Publishing AR and VR Apps with Amazon Sumerian
 
Three Lessons from “Escape the Room” That Apply to Making Money with Your Ale...
Three Lessons from “Escape the Room” That Apply to Making Money with Your Ale...Three Lessons from “Escape the Room” That Apply to Making Money with Your Ale...
Three Lessons from “Escape the Room” That Apply to Making Money with Your Ale...
 
Build Intelligent Conversational Agents with Amazon Neptune and Amazon SageMa...
Build Intelligent Conversational Agents with Amazon Neptune and Amazon SageMa...Build Intelligent Conversational Agents with Amazon Neptune and Amazon SageMa...
Build Intelligent Conversational Agents with Amazon Neptune and Amazon SageMa...
 
Analyze Amazon CloudFront and Lambda@Edge Logs to Improve Customer Experience...
Analyze Amazon CloudFront and Lambda@Edge Logs to Improve Customer Experience...Analyze Amazon CloudFront and Lambda@Edge Logs to Improve Customer Experience...
Analyze Amazon CloudFront and Lambda@Edge Logs to Improve Customer Experience...
 
Financial Svcs: Mine Actionable Insights from Customer Interactions Using Mac...
Financial Svcs: Mine Actionable Insights from Customer Interactions Using Mac...Financial Svcs: Mine Actionable Insights from Customer Interactions Using Mac...
Financial Svcs: Mine Actionable Insights from Customer Interactions Using Mac...
 
Securing Data in Serverless Applications and Messaging Services (API317-R2) -...
Securing Data in Serverless Applications and Messaging Services (API317-R2) -...Securing Data in Serverless Applications and Messaging Services (API317-R2) -...
Securing Data in Serverless Applications and Messaging Services (API317-R2) -...
 
Build, Train, and Deploy ML Models with Amazon SageMaker (AIM410-R2) - AWS re...
Build, Train, and Deploy ML Models with Amazon SageMaker (AIM410-R2) - AWS re...Build, Train, and Deploy ML Models with Amazon SageMaker (AIM410-R2) - AWS re...
Build, Train, and Deploy ML Models with Amazon SageMaker (AIM410-R2) - AWS re...
 
Serverless Architectural Patterns and Best Practices (ARC305-R2) - AWS re:Inv...
Serverless Architectural Patterns and Best Practices (ARC305-R2) - AWS re:Inv...Serverless Architectural Patterns and Best Practices (ARC305-R2) - AWS re:Inv...
Serverless Architectural Patterns and Best Practices (ARC305-R2) - AWS re:Inv...
 
Accelerate ML Training on Amazon SageMaker Using GPU-Based EC2 P3 Instances (...
Accelerate ML Training on Amazon SageMaker Using GPU-Based EC2 P3 Instances (...Accelerate ML Training on Amazon SageMaker Using GPU-Based EC2 P3 Instances (...
Accelerate ML Training on Amazon SageMaker Using GPU-Based EC2 P3 Instances (...
 
Deep Dive on Amazon S3 Storage Classes: Creating Cost Efficiencies across You...
Deep Dive on Amazon S3 Storage Classes: Creating Cost Efficiencies across You...Deep Dive on Amazon S3 Storage Classes: Creating Cost Efficiencies across You...
Deep Dive on Amazon S3 Storage Classes: Creating Cost Efficiencies across You...
 
Building Deep Learning Applications with TensorFlow and SageMaker on AWS - Te...
Building Deep Learning Applications with TensorFlow and SageMaker on AWS - Te...Building Deep Learning Applications with TensorFlow and SageMaker on AWS - Te...
Building Deep Learning Applications with TensorFlow and SageMaker on AWS - Te...
 
What Can Your Logs Tell You? (ANT215) - AWS re:Invent 2018
What Can Your Logs Tell You? (ANT215) - AWS re:Invent 2018What Can Your Logs Tell You? (ANT215) - AWS re:Invent 2018
What Can Your Logs Tell You? (ANT215) - AWS re:Invent 2018
 
CI/CD for Your Machine Learning Pipeline with Amazon SageMaker (DVC303) - AWS...
CI/CD for Your Machine Learning Pipeline with Amazon SageMaker (DVC303) - AWS...CI/CD for Your Machine Learning Pipeline with Amazon SageMaker (DVC303) - AWS...
CI/CD for Your Machine Learning Pipeline with Amazon SageMaker (DVC303) - AWS...
 
Migrating database to cloud
Migrating database to cloudMigrating database to cloud
Migrating database to cloud
 
How Peak.AI Uses Amazon SageMaker for Product Personalization (GPSTEC316) - A...
How Peak.AI Uses Amazon SageMaker for Product Personalization (GPSTEC316) - A...How Peak.AI Uses Amazon SageMaker for Product Personalization (GPSTEC316) - A...
How Peak.AI Uses Amazon SageMaker for Product Personalization (GPSTEC316) - A...
 
Industrialize Machine Learning Using CI/CD Techniques (FSV304-i) - AWS re:Inv...
Industrialize Machine Learning Using CI/CD Techniques (FSV304-i) - AWS re:Inv...Industrialize Machine Learning Using CI/CD Techniques (FSV304-i) - AWS re:Inv...
Industrialize Machine Learning Using CI/CD Techniques (FSV304-i) - AWS re:Inv...
 
Vonage & Aspect: Transform Real-Time Communications & Customer Engagement (TL...
Vonage & Aspect: Transform Real-Time Communications & Customer Engagement (TL...Vonage & Aspect: Transform Real-Time Communications & Customer Engagement (TL...
Vonage & Aspect: Transform Real-Time Communications & Customer Engagement (TL...
 
Train Models on Amazon SageMaker Using Data Not from Amazon S3 (AIM419) - AWS...
Train Models on Amazon SageMaker Using Data Not from Amazon S3 (AIM419) - AWS...Train Models on Amazon SageMaker Using Data Not from Amazon S3 (AIM419) - AWS...
Train Models on Amazon SageMaker Using Data Not from Amazon S3 (AIM419) - AWS...
 

Similaire à ML Factory Using AWS Services

Create an ML Factory in Financial Services with CI/CD - FSI301 - Toronto AWS ...
Create an ML Factory in Financial Services with CI/CD - FSI301 - Toronto AWS ...Create an ML Factory in Financial Services with CI/CD - FSI301 - Toronto AWS ...
Create an ML Factory in Financial Services with CI/CD - FSI301 - Toronto AWS ...Amazon Web Services
 
Creating a Machine Learning Factory
Creating a Machine Learning FactoryCreating a Machine Learning Factory
Creating a Machine Learning FactoryAmazon Web Services
 
AI/ML with Data Lakes: Counterintuitive Consumer Insights in Retail (RET206) ...
AI/ML with Data Lakes: Counterintuitive Consumer Insights in Retail (RET206) ...AI/ML with Data Lakes: Counterintuitive Consumer Insights in Retail (RET206) ...
AI/ML with Data Lakes: Counterintuitive Consumer Insights in Retail (RET206) ...Amazon Web Services
 
Enterprise Cloud Adoption
Enterprise Cloud Adoption Enterprise Cloud Adoption
Enterprise Cloud Adoption Tom Laszewski
 
WhereML a Serverless ML Powered Location Guessing Twitter Bot
WhereML a Serverless ML Powered Location Guessing Twitter BotWhereML a Serverless ML Powered Location Guessing Twitter Bot
WhereML a Serverless ML Powered Location Guessing Twitter BotRandall Hunt
 
Come costruire una soluzione Digital Twin con AWS IoT e AI-ML
Come costruire una soluzione Digital Twin con AWS IoT e AI-MLCome costruire una soluzione Digital Twin con AWS IoT e AI-ML
Come costruire una soluzione Digital Twin con AWS IoT e AI-MLAmazon Web Services
 
Building the Organization of the Future: Leveraging AI & ML
Building the Organization of the Future: Leveraging AI & ML Building the Organization of the Future: Leveraging AI & ML
Building the Organization of the Future: Leveraging AI & ML Amazon Web Services
 
Accelerate Digital Transformation for Telecom Operators with Cloud-Native Amd...
Accelerate Digital Transformation for Telecom Operators with Cloud-Native Amd...Accelerate Digital Transformation for Telecom Operators with Cloud-Native Amd...
Accelerate Digital Transformation for Telecom Operators with Cloud-Native Amd...Amazon Web Services
 
[REPEAT 1] Safeguard the Integrity of Your Code for Fast and Secure Deploymen...
[REPEAT 1] Safeguard the Integrity of Your Code for Fast and Secure Deploymen...[REPEAT 1] Safeguard the Integrity of Your Code for Fast and Secure Deploymen...
[REPEAT 1] Safeguard the Integrity of Your Code for Fast and Secure Deploymen...Amazon Web Services
 
Safeguard the Integrity of Your Code for Fast and Secure Deployments (DEV349-...
Safeguard the Integrity of Your Code for Fast and Secure Deployments (DEV349-...Safeguard the Integrity of Your Code for Fast and Secure Deployments (DEV349-...
Safeguard the Integrity of Your Code for Fast and Secure Deployments (DEV349-...Amazon Web Services
 
Fraud Prevention and Detection on AWS
Fraud Prevention and Detection on AWSFraud Prevention and Detection on AWS
Fraud Prevention and Detection on AWSAmazon Web Services
 
AWS IoT for Frictionless Consumer Experiences in Retail (RET201) - AWS re:Inv...
AWS IoT for Frictionless Consumer Experiences in Retail (RET201) - AWS re:Inv...AWS IoT for Frictionless Consumer Experiences in Retail (RET201) - AWS re:Inv...
AWS IoT for Frictionless Consumer Experiences in Retail (RET201) - AWS re:Inv...Amazon Web Services
 
Mining Intelligent Insights: AI/ML for Financial Services
Mining Intelligent Insights: AI/ML for Financial ServicesMining Intelligent Insights: AI/ML for Financial Services
Mining Intelligent Insights: AI/ML for Financial ServicesAmazon Web Services LATAM
 
Accelerate Innovation and Maximize Business Value with Serverless Application...
Accelerate Innovation and Maximize Business Value with Serverless Application...Accelerate Innovation and Maximize Business Value with Serverless Application...
Accelerate Innovation and Maximize Business Value with Serverless Application...Amazon Web Services
 
Build Your Recommendation Engine on AWS Today - AWS Summit Berlin 2018
Build Your Recommendation Engine on AWS Today - AWS Summit Berlin 2018Build Your Recommendation Engine on AWS Today - AWS Summit Berlin 2018
Build Your Recommendation Engine on AWS Today - AWS Summit Berlin 2018Yotam Yarden
 
Introducing Amazon SageMaker - AWS Online Tech Talks
Introducing Amazon SageMaker - AWS Online Tech TalksIntroducing Amazon SageMaker - AWS Online Tech Talks
Introducing Amazon SageMaker - AWS Online Tech TalksAmazon Web Services
 
애드테크 플랫폼을 위한 AWS 도입 및 운영::김필중 솔루션즈 아키텍트 김석환 과장, IGAWorks::AWS Summit Seoul 2018
애드테크 플랫폼을 위한 AWS 도입 및 운영::김필중 솔루션즈 아키텍트 김석환 과장, IGAWorks::AWS Summit Seoul 2018애드테크 플랫폼을 위한 AWS 도입 및 운영::김필중 솔루션즈 아키텍트 김석환 과장, IGAWorks::AWS Summit Seoul 2018
애드테크 플랫폼을 위한 AWS 도입 및 운영::김필중 솔루션즈 아키텍트 김석환 과장, IGAWorks::AWS Summit Seoul 2018Amazon Web Services Korea
 
Go Fast and Remain Secure: How Millennium Enables Developers and Upholds Secu...
Go Fast and Remain Secure: How Millennium Enables Developers and Upholds Secu...Go Fast and Remain Secure: How Millennium Enables Developers and Upholds Secu...
Go Fast and Remain Secure: How Millennium Enables Developers and Upholds Secu...Amazon Web Services
 
Develop Integrations for Salesforce and AWS (API320) - AWS re:Invent 2018
Develop Integrations for Salesforce and AWS (API320) - AWS re:Invent 2018Develop Integrations for Salesforce and AWS (API320) - AWS re:Invent 2018
Develop Integrations for Salesforce and AWS (API320) - AWS re:Invent 2018Amazon Web Services
 

Similaire à ML Factory Using AWS Services (20)

Create an ML Factory in Financial Services with CI/CD - FSI301 - Toronto AWS ...
Create an ML Factory in Financial Services with CI/CD - FSI301 - Toronto AWS ...Create an ML Factory in Financial Services with CI/CD - FSI301 - Toronto AWS ...
Create an ML Factory in Financial Services with CI/CD - FSI301 - Toronto AWS ...
 
Creating a Machine Learning Factory
Creating a Machine Learning FactoryCreating a Machine Learning Factory
Creating a Machine Learning Factory
 
AI/ML with Data Lakes: Counterintuitive Consumer Insights in Retail (RET206) ...
AI/ML with Data Lakes: Counterintuitive Consumer Insights in Retail (RET206) ...AI/ML with Data Lakes: Counterintuitive Consumer Insights in Retail (RET206) ...
AI/ML with Data Lakes: Counterintuitive Consumer Insights in Retail (RET206) ...
 
Enterprise Cloud Adoption
Enterprise Cloud Adoption Enterprise Cloud Adoption
Enterprise Cloud Adoption
 
WhereML a Serverless ML Powered Location Guessing Twitter Bot
WhereML a Serverless ML Powered Location Guessing Twitter BotWhereML a Serverless ML Powered Location Guessing Twitter Bot
WhereML a Serverless ML Powered Location Guessing Twitter Bot
 
Come costruire una soluzione Digital Twin con AWS IoT e AI-ML
Come costruire una soluzione Digital Twin con AWS IoT e AI-MLCome costruire una soluzione Digital Twin con AWS IoT e AI-ML
Come costruire una soluzione Digital Twin con AWS IoT e AI-ML
 
Building the Organization of the Future: Leveraging AI & ML
Building the Organization of the Future: Leveraging AI & ML Building the Organization of the Future: Leveraging AI & ML
Building the Organization of the Future: Leveraging AI & ML
 
Introduction to Sagemaker
Introduction to SagemakerIntroduction to Sagemaker
Introduction to Sagemaker
 
Accelerate Digital Transformation for Telecom Operators with Cloud-Native Amd...
Accelerate Digital Transformation for Telecom Operators with Cloud-Native Amd...Accelerate Digital Transformation for Telecom Operators with Cloud-Native Amd...
Accelerate Digital Transformation for Telecom Operators with Cloud-Native Amd...
 
[REPEAT 1] Safeguard the Integrity of Your Code for Fast and Secure Deploymen...
[REPEAT 1] Safeguard the Integrity of Your Code for Fast and Secure Deploymen...[REPEAT 1] Safeguard the Integrity of Your Code for Fast and Secure Deploymen...
[REPEAT 1] Safeguard the Integrity of Your Code for Fast and Secure Deploymen...
 
Safeguard the Integrity of Your Code for Fast and Secure Deployments (DEV349-...
Safeguard the Integrity of Your Code for Fast and Secure Deployments (DEV349-...Safeguard the Integrity of Your Code for Fast and Secure Deployments (DEV349-...
Safeguard the Integrity of Your Code for Fast and Secure Deployments (DEV349-...
 
Fraud Prevention and Detection on AWS
Fraud Prevention and Detection on AWSFraud Prevention and Detection on AWS
Fraud Prevention and Detection on AWS
 
AWS IoT for Frictionless Consumer Experiences in Retail (RET201) - AWS re:Inv...
AWS IoT for Frictionless Consumer Experiences in Retail (RET201) - AWS re:Inv...AWS IoT for Frictionless Consumer Experiences in Retail (RET201) - AWS re:Inv...
AWS IoT for Frictionless Consumer Experiences in Retail (RET201) - AWS re:Inv...
 
Mining Intelligent Insights: AI/ML for Financial Services
Mining Intelligent Insights: AI/ML for Financial ServicesMining Intelligent Insights: AI/ML for Financial Services
Mining Intelligent Insights: AI/ML for Financial Services
 
Accelerate Innovation and Maximize Business Value with Serverless Application...
Accelerate Innovation and Maximize Business Value with Serverless Application...Accelerate Innovation and Maximize Business Value with Serverless Application...
Accelerate Innovation and Maximize Business Value with Serverless Application...
 
Build Your Recommendation Engine on AWS Today - AWS Summit Berlin 2018
Build Your Recommendation Engine on AWS Today - AWS Summit Berlin 2018Build Your Recommendation Engine on AWS Today - AWS Summit Berlin 2018
Build Your Recommendation Engine on AWS Today - AWS Summit Berlin 2018
 
Introducing Amazon SageMaker - AWS Online Tech Talks
Introducing Amazon SageMaker - AWS Online Tech TalksIntroducing Amazon SageMaker - AWS Online Tech Talks
Introducing Amazon SageMaker - AWS Online Tech Talks
 
애드테크 플랫폼을 위한 AWS 도입 및 운영::김필중 솔루션즈 아키텍트 김석환 과장, IGAWorks::AWS Summit Seoul 2018
애드테크 플랫폼을 위한 AWS 도입 및 운영::김필중 솔루션즈 아키텍트 김석환 과장, IGAWorks::AWS Summit Seoul 2018애드테크 플랫폼을 위한 AWS 도입 및 운영::김필중 솔루션즈 아키텍트 김석환 과장, IGAWorks::AWS Summit Seoul 2018
애드테크 플랫폼을 위한 AWS 도입 및 운영::김필중 솔루션즈 아키텍트 김석환 과장, IGAWorks::AWS Summit Seoul 2018
 
Go Fast and Remain Secure: How Millennium Enables Developers and Upholds Secu...
Go Fast and Remain Secure: How Millennium Enables Developers and Upholds Secu...Go Fast and Remain Secure: How Millennium Enables Developers and Upholds Secu...
Go Fast and Remain Secure: How Millennium Enables Developers and Upholds Secu...
 
Develop Integrations for Salesforce and AWS (API320) - AWS re:Invent 2018
Develop Integrations for Salesforce and AWS (API320) - AWS re:Invent 2018Develop Integrations for Salesforce and AWS (API320) - AWS re:Invent 2018
Develop Integrations for Salesforce and AWS (API320) - AWS re:Invent 2018
 

Plus de Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSAmazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAmazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWSAmazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckAmazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without serversAmazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceAmazon Web Services
 

Plus de Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

ML Factory Using AWS Services

  • 1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Felix Candelario Creating a Machine Learning Factory
  • 2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Cover Slide • Audience: Developers • Services covered: Amazon SageMaker • Rough level of the content: 300 • Abstract: Going from a hypothesis to a working machine learning model that infers answers in production requires a lot of time and effort. Moreover, the ability to answer questions related to specific results—such as, “what version of the code and data produced a particular inference?”—is paramount in highly regulated industries such as Financial Services. Modern development practices like continuous integration and deployment can accelerate the machine learning development process and provide a way to answer questions about data lineage. During this talk, you will learn how to combine Amazon SageMaker (a fully managed service that enables developers and data scientists to quickly and easily build, train, and deploy machine learning models at any scale) with Amazon CodeCommit, CodeBuild, and CodePipeline to create a pipeline that automatically triggers changes when either your model code or training data changes. • Author: Felix Candelario, fcandela@
  • 3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Creating a machine learning factory Regulatory obligations require workloads that rely on ML be operationalized ASAP Why Applying modern CI/CD practices to ML workloads is the fastest way forward How AWS is the best place to operationalize your ML workloads Where
  • 4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Contents Introduction ML in Banking: Credit scoring Regulatory implications Operationalizing ML on AWS Why ML on AWS? Conclusion
  • 5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. “It is a renaissance, it is a golden age. We are now solving problems with machine learning and artificial intelligence that were … in the realm of science fiction for the last several decades.” — Jeff Bezos
  • 6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Algorithms Data Programming Models GPUs & Acceleration ‘Golden Age’ of Artificial Intelligence
  • 7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Contents Introduction ML in Banking: Credit scoring Regulatory implications Operationalizing ML on AWS Why ML on AWS? Conclusion
  • 8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. ML in Banking: Marketplace lenders • Operating exclusively online • Niche product focus • High degree of automation • User of non-traditional data sources • Rapid changes in decision criteria and scoring models Typical Characteristics • Unsecured personal loans • Education lending • SMB loans and credit lines • Real estate secured Example products & lenders
  • 9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. ML in Banking: Non-traditional data sources • Payday and non-prime loan information • Check cashing services • Rent-to-own transactions • Mobile phone account openings and payments • Utility accounts & payments Non-traditional data • Social media and web surfing data • Address stability • Number and age of email- addresses • Local unemployment rates • Profession or job function
  • 10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Contents Introduction ML in Banking: Credit scoring Regulatory implications Operationalizing ML on AWS Why ML on AWS? Conclusion
  • 11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Lending decisions are highly regulated
  • 12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. ML for FSI workloads requires Industrialization • Development happens on dev desktops • Iterative process that is prone to experimentation • Tooling, frameworks, and languages in constant flux • Difficult to acquire infrastructure ML today is very artisanal • Credit lifecycle processes moving from decision trees to ML • Highly regulated credit lifecycles • Fair Lending, Fair Housing, GDPR • Disparate impact is terrifying FSI workloads require rigor
  • 13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Contents Introduction ML in Banking: Credit scoring Regulatory implications Operationalizing ML on AWS Why ML on AWS? Conclusion
  • 14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Competing requirements
  • 15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Continuous Integration/Continuous Delivery
  • 16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Solution Overview
  • 17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Deep Dive
  • 30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Commit Code
  • 34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Source Stage
  • 37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Build Stage
  • 40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 43. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Train Stage
  • 44. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 45. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 46. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Industrialized machine learning workflow AWS CodeCommit AWS CodeBuild AWS CodePipeline ECR registryPipeline output artifact bucket Amazon Sagemaker Source Train Build
  • 47. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Contents Introduction ML in Banking: Credit scoring Regulatory implications Operationalizing ML on AWS Why ML on AWS? Conclusion
  • 48. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why ML on AWS? PLATFORM SERVICES APPLICATION SERVICES FRAMEWORKS & INTERFACES Caffe2 CNTK Apache MXNet PyTorch TensorFlow Torch Keras Gluon AWS Deep Learning AMIs Amazon SageMaker AWS DeepLens Rekognition Transcribe Translate Polly Comprehend Lex Amazon Mechanical Turk Amazon ML
  • 49. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Contents Introduction ML in Banking: Credit scoring Regulatory implications Operationalizing ML on AWS Why ML on AWS? Conclusion
  • 50. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Creating a machine learning factory Regulatory obligations require workloads that rely on ML be operationalized ASAP Why Applying modern CI/CD practices to ML workloads is the fastest way forward How AWS is the best place to operationalize your ML workloads Where
  • 51. Submit Session Feedback 1. Tap the Schedule icon. 2. Select the session you attended. 3. Tap Session Evaluation to submit your feedback.
  • 52. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Thank you!