Ce diaporama a bien été signalé.
Nous utilisons votre profil LinkedIn et vos données d’activité pour vous proposer des publicités personnalisées et pertinentes. Vous pouvez changer vos préférences de publicités à tout moment.

The Vision & Challenge of Applied Machine Learning

309 vues

Publié le

Learn how Cloudera provides a unified platform that breaks down data silos commonly seen in organizations. By unifying the data needed for applied machine learning, organizations are better equipped to gather valuable insights from their data.

Publié dans : Données & analyses
  • Soyez le premier à commenter

The Vision & Challenge of Applied Machine Learning

  1. 1. Cloudera Fast Forward Labs The Vision & Challenge of Applied Machine Learning Brian Goral | Business Manager
  2. 2. © Cloudera, Inc. All rights reserved. 2 Machine Learning, defined: Algorithms and methods that extract useful patterns from data.
  3. 3. © Cloudera, Inc. All rights reserved. 3 Big Data Analytics +-^x Data Science = ML ? AI
  4. 4. © Cloudera, Inc. All rights reserved. 4 “Artificial intelligence is whatever computers cannot do until they can.”
  5. 5. © Cloudera, Inc. All rights reserved. 5 Puppy or Bagel?
  6. 6. © Cloudera, Inc. All rights reserved. 6 Puppy, Muffin, or Fried Chicken?
  7. 7. © Cloudera, Inc. All rights reserved. 7
  8. 8. © Cloudera, Inc. All rights reserved. 8
  9. 9. © Cloudera, Inc. All rights reserved. 9
  10. 10. © Cloudera, Inc. All rights reserved. 10
  11. 11. © Cloudera, Inc. All rights reserved. 11 However…
  12. 12. © Cloudera, Inc. All rights reserved. 12
  13. 13. Design What should we build? Science Will it work? Data Data Data Data product lifecycle Engineering Will it scale? Performance Is it having an impact?
  14. 14. © Cloudera, Inc. All rights reserved. 14 (1) Uncertainty about the future (2) Machine learning silos (3) Collaboration and workflow issues Barriers to Transformation
  15. 15. © Cloudera, Inc. All rights reserved. 15
  16. 16. © Cloudera, Inc. All rights reserved. 16
  17. 17. © Cloudera, Inc. All rights reserved. 17
  18. 18. © Cloudera, Inc. All rights reserved. 18 (1) Uncertainty about the future (2) Machine learning silos (3) Collaboration and workflow issues Barriers to Transformation
  19. 19. © Cloudera, Inc. All rights reserved. 19 Typical pattern: machine learning “silos.” Fraud ClaimsUnderwriting MarketingClinical MEDI-SPAN
  20. 20. © Cloudera, Inc. All rights reserved. 20 ●Siloed teams complicate hiring, training, and work balance ●Siloed processes create complexity, overlap, and rework ●Siloed tools and data create multiple issues: • Synchronizing metrics • Difficult data access • Complex and challenging model deployment ●Machine learning silos markedly increase cost to ●license, provision, train, and maintain. ML silos impede transformation.
  21. 21. © Cloudera, Inc. All rights reserved. 21 Multi-Task Learning
  22. 22. © Cloudera, Inc. All rights reserved. 22 (1) Uncertainty about the future (2) Machine learning silos (3) Collaboration and workflow issues Barriers to Transformation
  23. 23. © Cloudera, Inc. All rights reserved. 23
  24. 24. © Cloudera, Inc. All rights reserved. 24
  25. 25. © Cloudera, Inc. All rights reserved. 25 • Business analyst: represents stakeholder, defines requirements • Data scientist: principal investigator, accountable for accuracy and validity • Peer data scientist: provides independent review of work • Machine learning specialists: expertise in subspecialties • Compliance specialists: verify that predictive model aligns with policy, regulations • Data engineer: develops production data pipelines • DevOps specialists: provide provisioning and support for data science platform • Data management specialists: provide expertise in data sources • Application developers: embed predictive models in end user applications • Systems administrators: support infrastructure for production application • Security specialists: evaluate application for security compliance How many people touch your data product?
  26. 26. © Cloudera, Inc. All rights reserved. 26 (1) Common unified platform for data science (2) Secure self-service access • Data • Compute • Storage (3) Support for the open source ecosystem (4) Tools that simplify collaboration (5) Support for the complete data science pipeline What do data science teams need?
  27. 27. © Cloudera, Inc. All rights reserved. 27 Big Data Analytics +-^x Data Science = ML ? AI
  28. 28. The general formulation of an algorithm ≠ the solution to your problem.
  29. 29. © Cloudera, Inc. All rights reserved. 29 Cloudera Fast Forward Labs
  30. 30. © Cloudera, Inc. All rights reserved. 30 Research & Advising Stay on top of emerging ML technologies Strategic Engagements Define data strategy Advise on implementation Application Development Track Feasibility studies: Build a ML product with you How Does Fast Forward Labs Engage?
  31. 31. © Cloudera, Inc. All rights reserved. 37 Provides clarity about Where & How to invest in ML/AI • Team/Infrastructure/Commercial Tools • Resource maximization • Resources for DS maintenance and growth Helps you deliver early value from ML/AI investments • Practical guidance on use of specific algorithms/techniques • Avoid technical dead ends • Expedite development • Communication with leadership on technical challenges Cloudera Fast Forward Labs
  32. 32. © Cloudera, Inc. All rights reserved. 38 We bring proprietary IP from our research process and our building of new applied data capabilities. We bring knowledge learned from our advising work across industries on valuable problems to solve. We use this to identify and execute on new product opportunities. Cloudera Fast Forward Labs
  33. 33. © Cloudera, Inc. All rights reserved. 39 Cloudera is a unified platform for data and machine learning.
  34. 34. © Cloudera, Inc. All rights reserved. 40 Cloudera Enterprise 46 The modern platform for machine learning and analytics optimized for the cloud EXTENSIBLE SERVICES CORE SERVICES DATA ENGINEERING OPERATIONAL DATABASE ANALYTIC DATABASE DATA CATALOG INGEST & REPLICATION SECURITY GOVERNANCE WORKLOAD MANAGEMENT DATA SCIENCE S3 ADLS HDFS KUDU STORAGE SERVICES
  35. 35. © Cloudera, Inc. All rights reserved. 41 Cloudera Fast Forward Labs • Helps you build strategy • Focus resources on specific effective techniques Cloudera Enterprise Platform • Unified platform • For data and machine learning Cloudera Data Science Workbench • Modern collaborative platform • Self-service access to data, storage and compute • Python, R, Spark, and Deep Learning ecosystems Cloudera: Data Science and Machine Learning For the Enterprise.
  36. 36. © Cloudera, Inc. All rights reserved. Thank you 42 Brian Goral - Cloudera Fast Forward Labs @brian_goral, @cloudera, @fastforwardlabs

×