Ce diaporama a bien été signalé.
Nous utilisons votre profil LinkedIn et vos données d’activité pour vous proposer des publicités personnalisées et pertinentes. Vous pouvez changer vos préférences de publicités à tout moment.
BIG DATA SPAIN 2016
Continuously Deploy ML and AI Models:
From Notebook to Microservice
ThankYou, Madrid!
Chris Fregly, Re...
WHO AM I?
Chris Fregly
--------
Research Scientist @ PipelineIO
(Formerly Netflix and Databricks)
--------
http://pipeline...
WORKSHOP ON SATURDAY, NOV 19TH
HERE IN MADRID!!
http://pipeline.io
SOURCE CODE AND DOCKER IMAGES
• Github Repo: ~900 Stars, ~300 Forks
• DockerHub Repo: ~ 6,000 Pulls
WHAT IS PIPELINE.IO?
ExtendingYour ML Pipelines into Production
100% Open Source!
http://pipeline.io
BRAINSTORMING AND VALIDATING
• Major Gaming Company
• Large Ride Sharing Service
• Popular Q & A Site
• Online Clothing Re...
PIPELINE.IO FOCUS
• Model Deploying andTesting
• Model Scaling and Serving
• Online ModelTraining
• Native Code Generation
MODEL DEPLOYING AND TESTING
Continuously Test
and Deploy Models
in Production!
MODEL SCALING AND SERVING
ONLINE MODEL TRAINING
• Continuous, Incremental, and Partial Training
• Kafka + Spark Streaming + Spark ML
• Real-time, Dy...
NATIVE CODE GENERATION
Generate Optimized
Code from Spark ML!
BECOME A CONTRIBUTOR!
PIPELINE.IO FOCUS FOR 2017
• Performance, Performance, Performance
• Native Code Generation: CPU + GPU
• More Global Contr...
WE’RE HIRING!!
• Kafka, Spark ML, and TensorFlow Contributors
• Systems Engineers
• GPU/CUDA Engineers
• C++, Java, Scala,...
DEMO TIME!
DEMO: NETFLIX-BASED MICROSERVICES
Circuit Breakers and Request Batching
DEMO: DEPLOY NOTEBOOK TO PROD
Deploy to Cloud
or On-Premise!
DEMO: NATIVE CODE GENERATION
DEMO: TENSORFLOW SERVING
THANK YOU FOR CHOOSING ME!
http://pipeline.io
Prochain SlideShare
Chargement dans…5
×

Big Data Spain - Nov 17 2016 - Madrid Continuously Deploy Spark ML and Tensorflow AI Models: From Jupyter Notebook to NetflixOSS Microservice

1 744 vues

Publié le

In this talk, I describe some recent advancements in Streaming ML and AI Pipelines to enable data scientists to rapidly train and test on streaming data - and ultimately deploy models directly into production on their own with low friction and high impact.

With proper tooling and monitoring, data scientist have the freedom and responsibility to experiment rapidly on live, streaming data - and deploy directly into production as often as necessary. I’ll describe this tooling - and demonstrate a real production pipeline using Jupyter Notebook, Docker, Kubernetes, Spark ML, Kafka, TensorFlow, Jenkins, and Netflix Open Source.

Publié dans : Logiciels
  • D0WNL0AD FULL ▶ ▶ ▶ ▶ http://1url.pw/ZG3RX ◀ ◀ ◀ ◀
       Répondre 
    Voulez-vous vraiment ?  Oui  Non
    Votre message apparaîtra ici

Big Data Spain - Nov 17 2016 - Madrid Continuously Deploy Spark ML and Tensorflow AI Models: From Jupyter Notebook to NetflixOSS Microservice

  1. 1. BIG DATA SPAIN 2016 Continuously Deploy ML and AI Models: From Notebook to Microservice ThankYou, Madrid! Chris Fregly, Research Scientist @
  2. 2. WHO AM I? Chris Fregly -------- Research Scientist @ PipelineIO (Formerly Netflix and Databricks) -------- http://pipeline.io
  3. 3. WORKSHOP ON SATURDAY, NOV 19TH HERE IN MADRID!! http://pipeline.io
  4. 4. SOURCE CODE AND DOCKER IMAGES • Github Repo: ~900 Stars, ~300 Forks • DockerHub Repo: ~ 6,000 Pulls
  5. 5. WHAT IS PIPELINE.IO? ExtendingYour ML Pipelines into Production 100% Open Source! http://pipeline.io
  6. 6. BRAINSTORMING AND VALIDATING • Major Gaming Company • Large Ride Sharing Service • Popular Q & A Site • Online Clothing Retailer • DominantVideo Streaming
  7. 7. PIPELINE.IO FOCUS • Model Deploying andTesting • Model Scaling and Serving • Online ModelTraining • Native Code Generation
  8. 8. MODEL DEPLOYING AND TESTING Continuously Test and Deploy Models in Production!
  9. 9. MODEL SCALING AND SERVING
  10. 10. ONLINE MODEL TRAINING • Continuous, Incremental, and Partial Training • Kafka + Spark Streaming + Spark ML • Real-time, Dynamic Recommendations
  11. 11. NATIVE CODE GENERATION Generate Optimized Code from Spark ML!
  12. 12. BECOME A CONTRIBUTOR!
  13. 13. PIPELINE.IO FOCUS FOR 2017 • Performance, Performance, Performance • Native Code Generation: CPU + GPU • More Global Contributors!
  14. 14. WE’RE HIRING!! • Kafka, Spark ML, and TensorFlow Contributors • Systems Engineers • GPU/CUDA Engineers • C++, Java, Scala, Python WE ONLY HIRE NICE PEOPLE!!
  15. 15. DEMO TIME!
  16. 16. DEMO: NETFLIX-BASED MICROSERVICES Circuit Breakers and Request Batching
  17. 17. DEMO: DEPLOY NOTEBOOK TO PROD Deploy to Cloud or On-Premise!
  18. 18. DEMO: NATIVE CODE GENERATION
  19. 19. DEMO: TENSORFLOW SERVING
  20. 20. THANK YOU FOR CHOOSING ME! http://pipeline.io

×