SlideShare une entreprise Scribd logo
1  sur  18
IBM Cloud / Watson and Cloud Platform / © 2018 IBM Corporation
Simplifying AI and
Machine Learning
with Watson Studio
Sumit Goyal (@SumitG0yal)
Software Engineer
IBM Cloud / Watson and Cloud Platform / © 2018 IBM Corporation 2
About me
Sumit Goyal (@SumitG0yal)
Software Engineer, Watson Studio
Tools & Infrastructure
• Need an environment
that enables a “fail
fast” approach
• Discrete tools present
barriers to
productivity
Governance
• If the data isn’t
secure, self-service
isn’t a reality
• Challenge
understanding data
lineage and getting to
a system of truth
Skills
• Data Science skills
are in low supply and
high demand
• Nurturing new data
professionals is
challenging
Data
• Data resides in silos
& difficult to access
• Unstructured and
external data wasn’t
considered
3
Why are enterprises struggling to
capture the value of AI?
IBM Cloud / Watson and Cloud Platform / © 2018 IBM Corporation
Watson Studio: accelerating value from AI for enterprises
Watson Studio accelerates the machine and deep learning workflows required to infuse AI into
your business to drive innovation.
It provides a suite of tools for data scientists, application developers and subject matter experts
to collaboratively and easily work with data and use that data to build, train and deploy models at
scale.
AI Requires Teamwork
• AI is not magic
• AI is algorithms + data + team
IBM Cloud / Watson and Cloud Platform / © 2018 IBM Corporation 4
Watson: AI for Smarter Business
Watson Knowledge Catalog
Watson Business Solutions
Compliance
Assist
Customer
Care
Expert
Assist
Voice of
the
Customer
Watson Enriched Data &
Analytical Assets
Watson Powered Search &
Social Collaboration
Active Policy
Enforcement
Model Governance,
Traceability & Lineage
Data Kits
Learns from Small data
Watson Machine Learning and Deep Learning as a Service
Watson Studio
Search & Find
Relevant Data
Connect & Access
Data
Prepare Data
(Ingest, Curate,
& Enrich)
Build & Train
AI Models
Deploy
AI Models
Monitor, Analyze,
Manage
Continuous Learning
Watson APIs allow Applications to use AI and ML Models
Watson
Assistant
Watson
Cybersecurity
Compare &
Comply
Watson Applications
... ......
ISV & Third Party Applications
Her Job:
Builds AI application that meet the
requirements of the business.
What she does:
• Starts PoCs which includes
gathering content, dialog
building and model training
• Focus is on app building for the
team or company to use. Will
handle ML Ops as needed
Sometimes known as:
Front-end, back-end, full stack,
mobile or low-code developer
Tanya
Domain Expert
Her Job:
To transfer knowledge to Watson for
a successful user experience.
What she does:
• Range of domain knowledge and
uses that to teach Watson and
develop a custom models
• As Tanya gains more experience
she optimizes her knowledge to
teach Watson to design better
end-user experiences.
Sometimes known as:
Subject matter expert, content
strategist.
His Job:
Transform data into knowledge for
solving business problems.
What he does:
•Runs experiments to build custom
models that solve business problems.
•Use techniques such as Machine
Learning or Deep Learning and works
with Tanya to validate success of
trained models.
Watson Studio
Built for AI teams – enabling team productivity and collaboration
Sometimes known as:
ML/DL engineer, Modeler, Data Miner
Ed
Data Engineer
His Job:
Architects how data is organized
and ensures operability
What he does:
• Builds data infrastructure and ETL
pipelines. Works with Spark,
Hadoop, and HDFS.
• Works with data scientist to
transform research models into
production quality systems.
Sometimes known as:
Data infrastructure engineer
Mike
Data Scientist
Deb
The Developer
6
Watson Studio
Supporting the end-to-end AI workflow
Prepare Data
for Analysis
Build and Train
ML/DL Models
Deploy Models
Monitor, Analyze
and Manage
Search and Find
Relevant Data
Connect &
Access Data
Connect and
discover content
from multiple data
sources in the cloud
or on premises.
Bring structured
and unstructured
data to one toolkit.
Clean and prepare your
data with Data
Refinery, a tool to
create data preparation
pipelines visually.
Use popular open
source libraries to
prepare unstructured
data.
Democratize the
creation of ML and DL
models. Design your AI
models
programmatically or
visually with the most
popular open source
and IBM ML/DL
frameworks or leverage
transfer learning on
pre-trained models
using Watson tools to
adapt to your business
domain. Train at scale
on GPUs and
distributed compute
Deploy your models
easily and have them
scale automatically for
online, batch or
streaming use cases
Monitor the
performance of the
models in production
and trigger automatic
retraining and
redeployment of
models. Build
Enterprise Trust with
Bias Detection,
Mitigation Model
Robustness and
Testing Service Model
Security.
Find data (structured,
unstructured) and AI
assets (e.g., ML/DL
models, notebooks,
Watson Data Kits) in
the Knowledge
Catalog with intelligent
search and giving the
right access to the right
users.
7
Watson Studio
Tools for supporting the end-to-end AI workflow
Model Lifecycle Management
Machine Learning Runtimes Deep Learning Runtimes
Authoring Tools
Cloud Infrastructure as a Service
• Most popular open source frameworks
• IBM best-in-class frameworks
• Create, collaborate, deploy, and monitor
• Best of breed open source & IBM tools
• Code (R, Python or Scala) and no-code/visual
modeling tools
• Fully managed service
• Container-based resource management
• Elastic pay as you go cpu/gpu power
Projects
Add Members
AI and Data Science as a Team Sport
Knowledge Catalog
Add/connect
Data
Reuse Assets
from Catalog
Publish Assets
to Catalog
Work with Data and AI
• Process/cleanse Data
• Create/run Notebooks
• Analyze/visualize Data
• Train AI/ML/DL Models
• Deploy Models
• …
as a team or individually
Create Project
Share Enterprise Assets
• Data
• Connections
• Notebooks
• Models
• Dashboards
• …
governed at scale
IBM
Cloud
Other
Clouds
On
Prem
Watson and Cloud Platform / March 2018 / © 2017 IBM Corporation
Watson Studio
• AI & data science as a team sport - Lets AI experts,
data scientists, analysts, stakeholders collaborate to
collect, share, explore, analyze data to derive insights,
train models, and share/deploy resulting assets
• Projects provide a secure environment in which teams
or individuals work with and analyze data using
• Connections to connect cloud and on prem data sources
• Refinery – clean and shape data for analysis/ ML
• Notebooks – Jupyter + Spark int., comments, versions,
share as link, GitHub int., PixieDust, EMR int., …
• Flows – create flows running on Spark or SPSS
• ML/DL – train with Spark ML, ScikitLearn, SPSS, …
and deploy to Watson Machine Learning service for prod
• AI Tools – Visual Recognition training, neural network
builder, and more to come …
• Dashboards – visual analytics and sharing of insights
• RStudio integrated with Spark
• Integration with AI and Data in many places
• Watson AI Services, IBM Analytics Engine, …
• IBM Cloud and on-prem data services
• Third party cloud and on-prem data services
• Built on IBM Cloud platform
Try it at https://www.ibm.com/cloud/watson-studio
Connect to Data in IBM Cloud Data Services, On Prem Data, or Data on other Clouds
Store your data in the IBM Cloud Connect to your on-prem data and third-party cloud data
... ...
Visualize
Represent analytic results as compelling interactive
graphics.
Discover
Utilize data assets from the entire organization with
confidence by accessing them through the Data
Catalog.
Share
Deliver dashboards across the enterprise where
analytical insights are required to make business
decisions.
Making Insights Available to All
Visualize and Analyze Data through Dashboards
• Interactive Documents that contain
insights and the code to achieve them
• Text to explain what the Notebook does and document insights
• Code cells for accessing, processing,
and analyzing data
• Result cells with output and visualizations
• Jupyter http://jupyter.org is the most popular open source
project and de facto standard
• Allows to create, run, edit notebooks
in web browsers
• Can run with Python, R, Scala, and
many other kernels
• Notebooks are stored as .ipynb JSON objects
• Not only for Data Science and AI, also useful for
other applications that benefit from
text + code + insights + viz in interactive docs
• Popular for publishing interactive tutorials & demos with
runnable code inside, and reproducable research
13
Analyze Data in Jupyter Notebooks
Train Machine Learning Models and deploy to Watson Machine Learning
Create & Train Models in
Watson Studio
- ML Flows
- ML Wizard
- ML Notebooks
ML Models
ML Flows
Watson
Machine
Learning
Service
Apps on
IBM CLoud
or other
Apps
REST
API to
call
Model
Create
& Train
Deploy Invoke
• Data Scientists can train ML models in Watson Studio using data in Projects to create and train models
• Use ML Wizard for assisted creation and training of models using common patterns and algorithms
• Use Notebooks or Flows to train models for more advanced use cases and more flexibility
• Deploy models to Watson Machine Learning (WML) service in Bluemix to run them in production
• Use WML REST API to invoke your models for online scoring / predictions
Upload ZIPs with training images
Typically having at least 10 images per class suffices
to get good results
Use the Visual Recognition Model
Get the REST API URL plus code snippets to invoke
the Visual Recognition model from your application
Train a Visual Recogniton Model
Pick the classes you want to include in training the models,
Watson Studio automatically connects to Watson Visual
Recognition to train with the selected data
Collect training data for Visual Recognition and
train/test Visual Recognition Models
Train Visual Recognition Models
Watson Knowledge Catalog
Discover
Intelligent discovery of data, advanced classification
and profiling to provide context
Govern
Powerful governance policy tools to control and
protect access to data with visibility to data use
Catalog
A rich metadata index of all data, with social
collaboration and enhanced findability
Unlock tribal knowledge to unleash your
data professionals, powered by AI
Watson Studio
Differentiating Capabilities
• Data Scientists, Subject Matter experts,
Business Analysts & Developers all in one
environment to accelerate innovation,
collaboration and productivity
• Built-in learning to get started or go the
distance with advanced tutorials
Integrated Collaboration Environment
• Best in-breed open source and IBM tools that
support the end-to-end AI lifecycle
• Choice of code or no-code tools to build and
train your own ML/DL models or easily train
and customize pre-trained Watson APIs
Choice of Tools for the full AI lifecycle
• Use Watson smarts and recommendations
for the best algorithms to use given your data,
OR
• Use the rich capabilities and controls to fine
tune your models
Support for all levels of expertise
• Monitor batch training experiments then
compare cross-model performance without
worrying about log transfers and scripts to
visualize results.
• You focus on designing your neural networks.
We’ll manage and track your assets.
Experiment centric DL workflow
• Deploy models into production then monitor
them to evaluate performance.
• Capture new data for continuous learning and
retrain models so they continually adapt to
changing conditions.
Model lifecycle & management
• Intelligent discovery of data and AI assets
that enables reuse & improves productivity
• Seamlessly integrated for productive use with
Machine Learning and Data science
• Powerful governance tools to control and
protect access to data
Integrated with Knowledge Catalog
17
Demo
18IBM Cloud / Watson and Cloud Platform / © 2018 IBM Corporation
Try it at https://www.ibm.com/cloud/watson-studio

Contenu connexe

Tendances

Power BI Training | Getting Started with Power BI | Power BI Tutorial | Power...
Power BI Training | Getting Started with Power BI | Power BI Tutorial | Power...Power BI Training | Getting Started with Power BI | Power BI Tutorial | Power...
Power BI Training | Getting Started with Power BI | Power BI Tutorial | Power...Edureka!
 
Understanding Resources in FHIR - Session 3 of FHIR basics training series
Understanding Resources in FHIR - Session 3 of FHIR basics training seriesUnderstanding Resources in FHIR - Session 3 of FHIR basics training series
Understanding Resources in FHIR - Session 3 of FHIR basics training seriesKumar Satyam
 
Data Visualization & Analytics.pptx
Data Visualization & Analytics.pptxData Visualization & Analytics.pptx
Data Visualization & Analytics.pptxhiralpatel3085
 
[Webinar Slides] Developing a Successful Data Retention Policy
[Webinar Slides] Developing a Successful Data Retention Policy [Webinar Slides] Developing a Successful Data Retention Policy
[Webinar Slides] Developing a Successful Data Retention Policy AIIM International
 
Machine Learning and AI
Machine Learning and AIMachine Learning and AI
Machine Learning and AIJames Serra
 
Data Mesh using Microsoft Fabric
Data Mesh using Microsoft FabricData Mesh using Microsoft Fabric
Data Mesh using Microsoft FabricNathan Bijnens
 
Data Warehouse Tutorial For Beginners | Data Warehouse Concepts | Data Wareho...
Data Warehouse Tutorial For Beginners | Data Warehouse Concepts | Data Wareho...Data Warehouse Tutorial For Beginners | Data Warehouse Concepts | Data Wareho...
Data Warehouse Tutorial For Beginners | Data Warehouse Concepts | Data Wareho...Edureka!
 
DataEd Webinar: Reference & Master Data Management - Unlocking Business Value
DataEd Webinar:  Reference & Master Data Management - Unlocking Business ValueDataEd Webinar:  Reference & Master Data Management - Unlocking Business Value
DataEd Webinar: Reference & Master Data Management - Unlocking Business ValueDATAVERSITY
 
Power BI Dashboard | Microsoft Power BI Tutorial | Data Visualization | Edureka
Power BI Dashboard | Microsoft Power BI Tutorial | Data Visualization | EdurekaPower BI Dashboard | Microsoft Power BI Tutorial | Data Visualization | Edureka
Power BI Dashboard | Microsoft Power BI Tutorial | Data Visualization | EdurekaEdureka!
 
Databricks + Snowflake: Catalyzing Data and AI Initiatives
Databricks + Snowflake: Catalyzing Data and AI InitiativesDatabricks + Snowflake: Catalyzing Data and AI Initiatives
Databricks + Snowflake: Catalyzing Data and AI InitiativesDatabricks
 
Design and implementation of Clinical Databases using openEHR
Design and implementation of Clinical Databases using openEHRDesign and implementation of Clinical Databases using openEHR
Design and implementation of Clinical Databases using openEHRPablo Pazos
 
Designing modern dw and data lake
Designing modern dw and data lakeDesigning modern dw and data lake
Designing modern dw and data lakepunedevscom
 
Regulating Generative AI - LLMOps pipelines with Transparency
Regulating Generative AI - LLMOps pipelines with TransparencyRegulating Generative AI - LLMOps pipelines with Transparency
Regulating Generative AI - LLMOps pipelines with TransparencyDebmalya Biswas
 
Power BI Charts Tutorial | Counter Strike Data Analysis using Power BI | Powe...
Power BI Charts Tutorial | Counter Strike Data Analysis using Power BI | Powe...Power BI Charts Tutorial | Counter Strike Data Analysis using Power BI | Powe...
Power BI Charts Tutorial | Counter Strike Data Analysis using Power BI | Powe...Edureka!
 

Tendances (20)

Big data architecture
Big data architectureBig data architecture
Big data architecture
 
Power BI Training | Getting Started with Power BI | Power BI Tutorial | Power...
Power BI Training | Getting Started with Power BI | Power BI Tutorial | Power...Power BI Training | Getting Started with Power BI | Power BI Tutorial | Power...
Power BI Training | Getting Started with Power BI | Power BI Tutorial | Power...
 
Understanding Resources in FHIR - Session 3 of FHIR basics training series
Understanding Resources in FHIR - Session 3 of FHIR basics training seriesUnderstanding Resources in FHIR - Session 3 of FHIR basics training series
Understanding Resources in FHIR - Session 3 of FHIR basics training series
 
Data Visualization & Analytics.pptx
Data Visualization & Analytics.pptxData Visualization & Analytics.pptx
Data Visualization & Analytics.pptx
 
[Webinar Slides] Developing a Successful Data Retention Policy
[Webinar Slides] Developing a Successful Data Retention Policy [Webinar Slides] Developing a Successful Data Retention Policy
[Webinar Slides] Developing a Successful Data Retention Policy
 
Machine Learning and AI
Machine Learning and AIMachine Learning and AI
Machine Learning and AI
 
Data Mesh using Microsoft Fabric
Data Mesh using Microsoft FabricData Mesh using Microsoft Fabric
Data Mesh using Microsoft Fabric
 
Power BI for Developers
Power BI for DevelopersPower BI for Developers
Power BI for Developers
 
Data Warehouse Tutorial For Beginners | Data Warehouse Concepts | Data Wareho...
Data Warehouse Tutorial For Beginners | Data Warehouse Concepts | Data Wareho...Data Warehouse Tutorial For Beginners | Data Warehouse Concepts | Data Wareho...
Data Warehouse Tutorial For Beginners | Data Warehouse Concepts | Data Wareho...
 
MLOps for production-level machine learning
MLOps for production-level machine learningMLOps for production-level machine learning
MLOps for production-level machine learning
 
DataEd Webinar: Reference & Master Data Management - Unlocking Business Value
DataEd Webinar:  Reference & Master Data Management - Unlocking Business ValueDataEd Webinar:  Reference & Master Data Management - Unlocking Business Value
DataEd Webinar: Reference & Master Data Management - Unlocking Business Value
 
Power BI Dashboard | Microsoft Power BI Tutorial | Data Visualization | Edureka
Power BI Dashboard | Microsoft Power BI Tutorial | Data Visualization | EdurekaPower BI Dashboard | Microsoft Power BI Tutorial | Data Visualization | Edureka
Power BI Dashboard | Microsoft Power BI Tutorial | Data Visualization | Edureka
 
Big data and analytics
Big data and analyticsBig data and analytics
Big data and analytics
 
Databricks + Snowflake: Catalyzing Data and AI Initiatives
Databricks + Snowflake: Catalyzing Data and AI InitiativesDatabricks + Snowflake: Catalyzing Data and AI Initiatives
Databricks + Snowflake: Catalyzing Data and AI Initiatives
 
Power BI visuals
Power BI visualsPower BI visuals
Power BI visuals
 
Design and implementation of Clinical Databases using openEHR
Design and implementation of Clinical Databases using openEHRDesign and implementation of Clinical Databases using openEHR
Design and implementation of Clinical Databases using openEHR
 
Designing modern dw and data lake
Designing modern dw and data lakeDesigning modern dw and data lake
Designing modern dw and data lake
 
Regulating Generative AI - LLMOps pipelines with Transparency
Regulating Generative AI - LLMOps pipelines with TransparencyRegulating Generative AI - LLMOps pipelines with Transparency
Regulating Generative AI - LLMOps pipelines with Transparency
 
Power BI Charts Tutorial | Counter Strike Data Analysis using Power BI | Powe...
Power BI Charts Tutorial | Counter Strike Data Analysis using Power BI | Powe...Power BI Charts Tutorial | Counter Strike Data Analysis using Power BI | Powe...
Power BI Charts Tutorial | Counter Strike Data Analysis using Power BI | Powe...
 
Autonomous Data Warehouse
Autonomous Data WarehouseAutonomous Data Warehouse
Autonomous Data Warehouse
 

Similaire à Simplifying AI and Machine Learning with Watson Studio

Voxxed Athens 2018 - IBM Watson Machine Learning – Build and train AI models ...
Voxxed Athens 2018 - IBM Watson Machine Learning – Build and train AI models ...Voxxed Athens 2018 - IBM Watson Machine Learning – Build and train AI models ...
Voxxed Athens 2018 - IBM Watson Machine Learning – Build and train AI models ...Voxxed Athens
 
IBM Meetup on November 1, 2018: Machine Learning made easy with Watson Studio
IBM Meetup on November 1, 2018: Machine Learning made easy with Watson StudioIBM Meetup on November 1, 2018: Machine Learning made easy with Watson Studio
IBM Meetup on November 1, 2018: Machine Learning made easy with Watson StudioSvetlana Levitan, PhD
 
Introduction to Machine learning and Deep Learning
Introduction to Machine learning and Deep LearningIntroduction to Machine learning and Deep Learning
Introduction to Machine learning and Deep LearningNishan Aryal
 
Data Science at Speed. At Scale.
Data Science at Speed. At Scale.Data Science at Speed. At Scale.
Data Science at Speed. At Scale.DataWorks Summit
 
BBBT Watson Data Platform Presentation
BBBT Watson Data Platform PresentationBBBT Watson Data Platform Presentation
BBBT Watson Data Platform PresentationRitika Gunnar
 
Accelerating Data Science and Machine Learning Workflow with Azure Machine Le...
Accelerating Data Science and Machine Learning Workflow with Azure Machine Le...Accelerating Data Science and Machine Learning Workflow with Azure Machine Le...
Accelerating Data Science and Machine Learning Workflow with Azure Machine Le...Aditya Bhattacharya
 
Introduction to Azure Machine Learning
Introduction to Azure Machine LearningIntroduction to Azure Machine Learning
Introduction to Azure Machine LearningEng Teong Cheah
 
201906 02 Introduction to AutoML with ML.NET 1.0
201906 02 Introduction to AutoML with ML.NET 1.0201906 02 Introduction to AutoML with ML.NET 1.0
201906 02 Introduction to AutoML with ML.NET 1.0Mark Tabladillo
 
Ai & Data Analytics 2018 - Azure Databricks for data scientist
Ai & Data Analytics 2018 - Azure Databricks for data scientistAi & Data Analytics 2018 - Azure Databricks for data scientist
Ai & Data Analytics 2018 - Azure Databricks for data scientistAlberto Diaz Martin
 
IBM i & Data Science in the AI era.
IBM i & Data Science in the AI era.  IBM i & Data Science in the AI era.
IBM i & Data Science in the AI era. Benoit Marolleau
 
An AI Maturity Roadmap for Becoming a Data-Driven Organization
An AI Maturity Roadmap for Becoming a Data-Driven OrganizationAn AI Maturity Roadmap for Becoming a Data-Driven Organization
An AI Maturity Roadmap for Becoming a Data-Driven OrganizationDavid Solomon
 
201908 Overview of Automated ML
201908 Overview of Automated ML201908 Overview of Automated ML
201908 Overview of Automated MLMark Tabladillo
 
Norman Sasono - Incorporating AI/ML into Your Application Architecture
Norman Sasono - Incorporating AI/ML into Your Application ArchitectureNorman Sasono - Incorporating AI/ML into Your Application Architecture
Norman Sasono - Incorporating AI/ML into Your Application ArchitectureAgile Impact Conference
 
Norman Sasono - Incorporating AI/ML into Your Application Architecture
Norman Sasono - Incorporating AI/ML into Your Application ArchitectureNorman Sasono - Incorporating AI/ML into Your Application Architecture
Norman Sasono - Incorporating AI/ML into Your Application ArchitectureAgile Impact
 
Building a MLOps Platform Around MLflow to Enable Model Productionalization i...
Building a MLOps Platform Around MLflow to Enable Model Productionalization i...Building a MLOps Platform Around MLflow to Enable Model Productionalization i...
Building a MLOps Platform Around MLflow to Enable Model Productionalization i...Databricks
 
Making Data Science Scalable - 5 Lessons Learned
Making Data Science Scalable - 5 Lessons LearnedMaking Data Science Scalable - 5 Lessons Learned
Making Data Science Scalable - 5 Lessons LearnedLaurenz Wuttke
 
Microsoft Fabric Introduction
Microsoft Fabric IntroductionMicrosoft Fabric Introduction
Microsoft Fabric IntroductionJames Serra
 

Similaire à Simplifying AI and Machine Learning with Watson Studio (20)

Voxxed Athens 2018 - IBM Watson Machine Learning – Build and train AI models ...
Voxxed Athens 2018 - IBM Watson Machine Learning – Build and train AI models ...Voxxed Athens 2018 - IBM Watson Machine Learning – Build and train AI models ...
Voxxed Athens 2018 - IBM Watson Machine Learning – Build and train AI models ...
 
IBM Meetup on November 1, 2018: Machine Learning made easy with Watson Studio
IBM Meetup on November 1, 2018: Machine Learning made easy with Watson StudioIBM Meetup on November 1, 2018: Machine Learning made easy with Watson Studio
IBM Meetup on November 1, 2018: Machine Learning made easy with Watson Studio
 
Introduction to Machine learning and Deep Learning
Introduction to Machine learning and Deep LearningIntroduction to Machine learning and Deep Learning
Introduction to Machine learning and Deep Learning
 
Data Science at Speed. At Scale.
Data Science at Speed. At Scale.Data Science at Speed. At Scale.
Data Science at Speed. At Scale.
 
BBBT Watson Data Platform Presentation
BBBT Watson Data Platform PresentationBBBT Watson Data Platform Presentation
BBBT Watson Data Platform Presentation
 
Accelerating Data Science and Machine Learning Workflow with Azure Machine Le...
Accelerating Data Science and Machine Learning Workflow with Azure Machine Le...Accelerating Data Science and Machine Learning Workflow with Azure Machine Le...
Accelerating Data Science and Machine Learning Workflow with Azure Machine Le...
 
Introduction to Azure Machine Learning
Introduction to Azure Machine LearningIntroduction to Azure Machine Learning
Introduction to Azure Machine Learning
 
201906 02 Introduction to AutoML with ML.NET 1.0
201906 02 Introduction to AutoML with ML.NET 1.0201906 02 Introduction to AutoML with ML.NET 1.0
201906 02 Introduction to AutoML with ML.NET 1.0
 
Machine learning
Machine learningMachine learning
Machine learning
 
Ai & Data Analytics 2018 - Azure Databricks for data scientist
Ai & Data Analytics 2018 - Azure Databricks for data scientistAi & Data Analytics 2018 - Azure Databricks for data scientist
Ai & Data Analytics 2018 - Azure Databricks for data scientist
 
IBM i & Data Science in the AI era.
IBM i & Data Science in the AI era.  IBM i & Data Science in the AI era.
IBM i & Data Science in the AI era.
 
An AI Maturity Roadmap for Becoming a Data-Driven Organization
An AI Maturity Roadmap for Becoming a Data-Driven OrganizationAn AI Maturity Roadmap for Becoming a Data-Driven Organization
An AI Maturity Roadmap for Becoming a Data-Driven Organization
 
201908 Overview of Automated ML
201908 Overview of Automated ML201908 Overview of Automated ML
201908 Overview of Automated ML
 
Norman Sasono - Incorporating AI/ML into Your Application Architecture
Norman Sasono - Incorporating AI/ML into Your Application ArchitectureNorman Sasono - Incorporating AI/ML into Your Application Architecture
Norman Sasono - Incorporating AI/ML into Your Application Architecture
 
Norman Sasono - Incorporating AI/ML into Your Application Architecture
Norman Sasono - Incorporating AI/ML into Your Application ArchitectureNorman Sasono - Incorporating AI/ML into Your Application Architecture
Norman Sasono - Incorporating AI/ML into Your Application Architecture
 
Week 12: Cloud AI- DSA 441 Cloud Computing
Week 12: Cloud AI- DSA 441 Cloud ComputingWeek 12: Cloud AI- DSA 441 Cloud Computing
Week 12: Cloud AI- DSA 441 Cloud Computing
 
Future.ready().watson dataplatform 01
Future.ready().watson dataplatform 01Future.ready().watson dataplatform 01
Future.ready().watson dataplatform 01
 
Building a MLOps Platform Around MLflow to Enable Model Productionalization i...
Building a MLOps Platform Around MLflow to Enable Model Productionalization i...Building a MLOps Platform Around MLflow to Enable Model Productionalization i...
Building a MLOps Platform Around MLflow to Enable Model Productionalization i...
 
Making Data Science Scalable - 5 Lessons Learned
Making Data Science Scalable - 5 Lessons LearnedMaking Data Science Scalable - 5 Lessons Learned
Making Data Science Scalable - 5 Lessons Learned
 
Microsoft Fabric Introduction
Microsoft Fabric IntroductionMicrosoft Fabric Introduction
Microsoft Fabric Introduction
 

Plus de DataWorks Summit

Floating on a RAFT: HBase Durability with Apache Ratis
Floating on a RAFT: HBase Durability with Apache RatisFloating on a RAFT: HBase Durability with Apache Ratis
Floating on a RAFT: HBase Durability with Apache RatisDataWorks Summit
 
Tracking Crime as It Occurs with Apache Phoenix, Apache HBase and Apache NiFi
Tracking Crime as It Occurs with Apache Phoenix, Apache HBase and Apache NiFiTracking Crime as It Occurs with Apache Phoenix, Apache HBase and Apache NiFi
Tracking Crime as It Occurs with Apache Phoenix, Apache HBase and Apache NiFiDataWorks Summit
 
HBase Tales From the Trenches - Short stories about most common HBase operati...
HBase Tales From the Trenches - Short stories about most common HBase operati...HBase Tales From the Trenches - Short stories about most common HBase operati...
HBase Tales From the Trenches - Short stories about most common HBase operati...DataWorks Summit
 
Optimizing Geospatial Operations with Server-side Programming in HBase and Ac...
Optimizing Geospatial Operations with Server-side Programming in HBase and Ac...Optimizing Geospatial Operations with Server-side Programming in HBase and Ac...
Optimizing Geospatial Operations with Server-side Programming in HBase and Ac...DataWorks Summit
 
Managing the Dewey Decimal System
Managing the Dewey Decimal SystemManaging the Dewey Decimal System
Managing the Dewey Decimal SystemDataWorks Summit
 
Practical NoSQL: Accumulo's dirlist Example
Practical NoSQL: Accumulo's dirlist ExamplePractical NoSQL: Accumulo's dirlist Example
Practical NoSQL: Accumulo's dirlist ExampleDataWorks Summit
 
HBase Global Indexing to support large-scale data ingestion at Uber
HBase Global Indexing to support large-scale data ingestion at UberHBase Global Indexing to support large-scale data ingestion at Uber
HBase Global Indexing to support large-scale data ingestion at UberDataWorks Summit
 
Scaling Cloud-Scale Translytics Workloads with Omid and Phoenix
Scaling Cloud-Scale Translytics Workloads with Omid and PhoenixScaling Cloud-Scale Translytics Workloads with Omid and Phoenix
Scaling Cloud-Scale Translytics Workloads with Omid and PhoenixDataWorks Summit
 
Building the High Speed Cybersecurity Data Pipeline Using Apache NiFi
Building the High Speed Cybersecurity Data Pipeline Using Apache NiFiBuilding the High Speed Cybersecurity Data Pipeline Using Apache NiFi
Building the High Speed Cybersecurity Data Pipeline Using Apache NiFiDataWorks Summit
 
Supporting Apache HBase : Troubleshooting and Supportability Improvements
Supporting Apache HBase : Troubleshooting and Supportability ImprovementsSupporting Apache HBase : Troubleshooting and Supportability Improvements
Supporting Apache HBase : Troubleshooting and Supportability ImprovementsDataWorks Summit
 
Security Framework for Multitenant Architecture
Security Framework for Multitenant ArchitectureSecurity Framework for Multitenant Architecture
Security Framework for Multitenant ArchitectureDataWorks Summit
 
Presto: Optimizing Performance of SQL-on-Anything Engine
Presto: Optimizing Performance of SQL-on-Anything EnginePresto: Optimizing Performance of SQL-on-Anything Engine
Presto: Optimizing Performance of SQL-on-Anything EngineDataWorks Summit
 
Introducing MlFlow: An Open Source Platform for the Machine Learning Lifecycl...
Introducing MlFlow: An Open Source Platform for the Machine Learning Lifecycl...Introducing MlFlow: An Open Source Platform for the Machine Learning Lifecycl...
Introducing MlFlow: An Open Source Platform for the Machine Learning Lifecycl...DataWorks Summit
 
Extending Twitter's Data Platform to Google Cloud
Extending Twitter's Data Platform to Google CloudExtending Twitter's Data Platform to Google Cloud
Extending Twitter's Data Platform to Google CloudDataWorks Summit
 
Event-Driven Messaging and Actions using Apache Flink and Apache NiFi
Event-Driven Messaging and Actions using Apache Flink and Apache NiFiEvent-Driven Messaging and Actions using Apache Flink and Apache NiFi
Event-Driven Messaging and Actions using Apache Flink and Apache NiFiDataWorks Summit
 
Securing Data in Hybrid on-premise and Cloud Environments using Apache Ranger
Securing Data in Hybrid on-premise and Cloud Environments using Apache RangerSecuring Data in Hybrid on-premise and Cloud Environments using Apache Ranger
Securing Data in Hybrid on-premise and Cloud Environments using Apache RangerDataWorks Summit
 
Big Data Meets NVM: Accelerating Big Data Processing with Non-Volatile Memory...
Big Data Meets NVM: Accelerating Big Data Processing with Non-Volatile Memory...Big Data Meets NVM: Accelerating Big Data Processing with Non-Volatile Memory...
Big Data Meets NVM: Accelerating Big Data Processing with Non-Volatile Memory...DataWorks Summit
 
Computer Vision: Coming to a Store Near You
Computer Vision: Coming to a Store Near YouComputer Vision: Coming to a Store Near You
Computer Vision: Coming to a Store Near YouDataWorks Summit
 
Big Data Genomics: Clustering Billions of DNA Sequences with Apache Spark
Big Data Genomics: Clustering Billions of DNA Sequences with Apache SparkBig Data Genomics: Clustering Billions of DNA Sequences with Apache Spark
Big Data Genomics: Clustering Billions of DNA Sequences with Apache SparkDataWorks Summit
 

Plus de DataWorks Summit (20)

Data Science Crash Course
Data Science Crash CourseData Science Crash Course
Data Science Crash Course
 
Floating on a RAFT: HBase Durability with Apache Ratis
Floating on a RAFT: HBase Durability with Apache RatisFloating on a RAFT: HBase Durability with Apache Ratis
Floating on a RAFT: HBase Durability with Apache Ratis
 
Tracking Crime as It Occurs with Apache Phoenix, Apache HBase and Apache NiFi
Tracking Crime as It Occurs with Apache Phoenix, Apache HBase and Apache NiFiTracking Crime as It Occurs with Apache Phoenix, Apache HBase and Apache NiFi
Tracking Crime as It Occurs with Apache Phoenix, Apache HBase and Apache NiFi
 
HBase Tales From the Trenches - Short stories about most common HBase operati...
HBase Tales From the Trenches - Short stories about most common HBase operati...HBase Tales From the Trenches - Short stories about most common HBase operati...
HBase Tales From the Trenches - Short stories about most common HBase operati...
 
Optimizing Geospatial Operations with Server-side Programming in HBase and Ac...
Optimizing Geospatial Operations with Server-side Programming in HBase and Ac...Optimizing Geospatial Operations with Server-side Programming in HBase and Ac...
Optimizing Geospatial Operations with Server-side Programming in HBase and Ac...
 
Managing the Dewey Decimal System
Managing the Dewey Decimal SystemManaging the Dewey Decimal System
Managing the Dewey Decimal System
 
Practical NoSQL: Accumulo's dirlist Example
Practical NoSQL: Accumulo's dirlist ExamplePractical NoSQL: Accumulo's dirlist Example
Practical NoSQL: Accumulo's dirlist Example
 
HBase Global Indexing to support large-scale data ingestion at Uber
HBase Global Indexing to support large-scale data ingestion at UberHBase Global Indexing to support large-scale data ingestion at Uber
HBase Global Indexing to support large-scale data ingestion at Uber
 
Scaling Cloud-Scale Translytics Workloads with Omid and Phoenix
Scaling Cloud-Scale Translytics Workloads with Omid and PhoenixScaling Cloud-Scale Translytics Workloads with Omid and Phoenix
Scaling Cloud-Scale Translytics Workloads with Omid and Phoenix
 
Building the High Speed Cybersecurity Data Pipeline Using Apache NiFi
Building the High Speed Cybersecurity Data Pipeline Using Apache NiFiBuilding the High Speed Cybersecurity Data Pipeline Using Apache NiFi
Building the High Speed Cybersecurity Data Pipeline Using Apache NiFi
 
Supporting Apache HBase : Troubleshooting and Supportability Improvements
Supporting Apache HBase : Troubleshooting and Supportability ImprovementsSupporting Apache HBase : Troubleshooting and Supportability Improvements
Supporting Apache HBase : Troubleshooting and Supportability Improvements
 
Security Framework for Multitenant Architecture
Security Framework for Multitenant ArchitectureSecurity Framework for Multitenant Architecture
Security Framework for Multitenant Architecture
 
Presto: Optimizing Performance of SQL-on-Anything Engine
Presto: Optimizing Performance of SQL-on-Anything EnginePresto: Optimizing Performance of SQL-on-Anything Engine
Presto: Optimizing Performance of SQL-on-Anything Engine
 
Introducing MlFlow: An Open Source Platform for the Machine Learning Lifecycl...
Introducing MlFlow: An Open Source Platform for the Machine Learning Lifecycl...Introducing MlFlow: An Open Source Platform for the Machine Learning Lifecycl...
Introducing MlFlow: An Open Source Platform for the Machine Learning Lifecycl...
 
Extending Twitter's Data Platform to Google Cloud
Extending Twitter's Data Platform to Google CloudExtending Twitter's Data Platform to Google Cloud
Extending Twitter's Data Platform to Google Cloud
 
Event-Driven Messaging and Actions using Apache Flink and Apache NiFi
Event-Driven Messaging and Actions using Apache Flink and Apache NiFiEvent-Driven Messaging and Actions using Apache Flink and Apache NiFi
Event-Driven Messaging and Actions using Apache Flink and Apache NiFi
 
Securing Data in Hybrid on-premise and Cloud Environments using Apache Ranger
Securing Data in Hybrid on-premise and Cloud Environments using Apache RangerSecuring Data in Hybrid on-premise and Cloud Environments using Apache Ranger
Securing Data in Hybrid on-premise and Cloud Environments using Apache Ranger
 
Big Data Meets NVM: Accelerating Big Data Processing with Non-Volatile Memory...
Big Data Meets NVM: Accelerating Big Data Processing with Non-Volatile Memory...Big Data Meets NVM: Accelerating Big Data Processing with Non-Volatile Memory...
Big Data Meets NVM: Accelerating Big Data Processing with Non-Volatile Memory...
 
Computer Vision: Coming to a Store Near You
Computer Vision: Coming to a Store Near YouComputer Vision: Coming to a Store Near You
Computer Vision: Coming to a Store Near You
 
Big Data Genomics: Clustering Billions of DNA Sequences with Apache Spark
Big Data Genomics: Clustering Billions of DNA Sequences with Apache SparkBig Data Genomics: Clustering Billions of DNA Sequences with Apache Spark
Big Data Genomics: Clustering Billions of DNA Sequences with Apache Spark
 

Dernier

The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 

Dernier (20)

The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 

Simplifying AI and Machine Learning with Watson Studio

  • 1. IBM Cloud / Watson and Cloud Platform / © 2018 IBM Corporation Simplifying AI and Machine Learning with Watson Studio Sumit Goyal (@SumitG0yal) Software Engineer
  • 2. IBM Cloud / Watson and Cloud Platform / © 2018 IBM Corporation 2 About me Sumit Goyal (@SumitG0yal) Software Engineer, Watson Studio
  • 3. Tools & Infrastructure • Need an environment that enables a “fail fast” approach • Discrete tools present barriers to productivity Governance • If the data isn’t secure, self-service isn’t a reality • Challenge understanding data lineage and getting to a system of truth Skills • Data Science skills are in low supply and high demand • Nurturing new data professionals is challenging Data • Data resides in silos & difficult to access • Unstructured and external data wasn’t considered 3 Why are enterprises struggling to capture the value of AI? IBM Cloud / Watson and Cloud Platform / © 2018 IBM Corporation
  • 4. Watson Studio: accelerating value from AI for enterprises Watson Studio accelerates the machine and deep learning workflows required to infuse AI into your business to drive innovation. It provides a suite of tools for data scientists, application developers and subject matter experts to collaboratively and easily work with data and use that data to build, train and deploy models at scale. AI Requires Teamwork • AI is not magic • AI is algorithms + data + team IBM Cloud / Watson and Cloud Platform / © 2018 IBM Corporation 4
  • 5. Watson: AI for Smarter Business Watson Knowledge Catalog Watson Business Solutions Compliance Assist Customer Care Expert Assist Voice of the Customer Watson Enriched Data & Analytical Assets Watson Powered Search & Social Collaboration Active Policy Enforcement Model Governance, Traceability & Lineage Data Kits Learns from Small data Watson Machine Learning and Deep Learning as a Service Watson Studio Search & Find Relevant Data Connect & Access Data Prepare Data (Ingest, Curate, & Enrich) Build & Train AI Models Deploy AI Models Monitor, Analyze, Manage Continuous Learning Watson APIs allow Applications to use AI and ML Models Watson Assistant Watson Cybersecurity Compare & Comply Watson Applications ... ...... ISV & Third Party Applications
  • 6. Her Job: Builds AI application that meet the requirements of the business. What she does: • Starts PoCs which includes gathering content, dialog building and model training • Focus is on app building for the team or company to use. Will handle ML Ops as needed Sometimes known as: Front-end, back-end, full stack, mobile or low-code developer Tanya Domain Expert Her Job: To transfer knowledge to Watson for a successful user experience. What she does: • Range of domain knowledge and uses that to teach Watson and develop a custom models • As Tanya gains more experience she optimizes her knowledge to teach Watson to design better end-user experiences. Sometimes known as: Subject matter expert, content strategist. His Job: Transform data into knowledge for solving business problems. What he does: •Runs experiments to build custom models that solve business problems. •Use techniques such as Machine Learning or Deep Learning and works with Tanya to validate success of trained models. Watson Studio Built for AI teams – enabling team productivity and collaboration Sometimes known as: ML/DL engineer, Modeler, Data Miner Ed Data Engineer His Job: Architects how data is organized and ensures operability What he does: • Builds data infrastructure and ETL pipelines. Works with Spark, Hadoop, and HDFS. • Works with data scientist to transform research models into production quality systems. Sometimes known as: Data infrastructure engineer Mike Data Scientist Deb The Developer 6
  • 7. Watson Studio Supporting the end-to-end AI workflow Prepare Data for Analysis Build and Train ML/DL Models Deploy Models Monitor, Analyze and Manage Search and Find Relevant Data Connect & Access Data Connect and discover content from multiple data sources in the cloud or on premises. Bring structured and unstructured data to one toolkit. Clean and prepare your data with Data Refinery, a tool to create data preparation pipelines visually. Use popular open source libraries to prepare unstructured data. Democratize the creation of ML and DL models. Design your AI models programmatically or visually with the most popular open source and IBM ML/DL frameworks or leverage transfer learning on pre-trained models using Watson tools to adapt to your business domain. Train at scale on GPUs and distributed compute Deploy your models easily and have them scale automatically for online, batch or streaming use cases Monitor the performance of the models in production and trigger automatic retraining and redeployment of models. Build Enterprise Trust with Bias Detection, Mitigation Model Robustness and Testing Service Model Security. Find data (structured, unstructured) and AI assets (e.g., ML/DL models, notebooks, Watson Data Kits) in the Knowledge Catalog with intelligent search and giving the right access to the right users. 7
  • 8. Watson Studio Tools for supporting the end-to-end AI workflow Model Lifecycle Management Machine Learning Runtimes Deep Learning Runtimes Authoring Tools Cloud Infrastructure as a Service • Most popular open source frameworks • IBM best-in-class frameworks • Create, collaborate, deploy, and monitor • Best of breed open source & IBM tools • Code (R, Python or Scala) and no-code/visual modeling tools • Fully managed service • Container-based resource management • Elastic pay as you go cpu/gpu power
  • 9. Projects Add Members AI and Data Science as a Team Sport Knowledge Catalog Add/connect Data Reuse Assets from Catalog Publish Assets to Catalog Work with Data and AI • Process/cleanse Data • Create/run Notebooks • Analyze/visualize Data • Train AI/ML/DL Models • Deploy Models • … as a team or individually Create Project Share Enterprise Assets • Data • Connections • Notebooks • Models • Dashboards • … governed at scale IBM Cloud Other Clouds On Prem
  • 10. Watson and Cloud Platform / March 2018 / © 2017 IBM Corporation Watson Studio • AI & data science as a team sport - Lets AI experts, data scientists, analysts, stakeholders collaborate to collect, share, explore, analyze data to derive insights, train models, and share/deploy resulting assets • Projects provide a secure environment in which teams or individuals work with and analyze data using • Connections to connect cloud and on prem data sources • Refinery – clean and shape data for analysis/ ML • Notebooks – Jupyter + Spark int., comments, versions, share as link, GitHub int., PixieDust, EMR int., … • Flows – create flows running on Spark or SPSS • ML/DL – train with Spark ML, ScikitLearn, SPSS, … and deploy to Watson Machine Learning service for prod • AI Tools – Visual Recognition training, neural network builder, and more to come … • Dashboards – visual analytics and sharing of insights • RStudio integrated with Spark • Integration with AI and Data in many places • Watson AI Services, IBM Analytics Engine, … • IBM Cloud and on-prem data services • Third party cloud and on-prem data services • Built on IBM Cloud platform Try it at https://www.ibm.com/cloud/watson-studio
  • 11. Connect to Data in IBM Cloud Data Services, On Prem Data, or Data on other Clouds Store your data in the IBM Cloud Connect to your on-prem data and third-party cloud data ... ...
  • 12. Visualize Represent analytic results as compelling interactive graphics. Discover Utilize data assets from the entire organization with confidence by accessing them through the Data Catalog. Share Deliver dashboards across the enterprise where analytical insights are required to make business decisions. Making Insights Available to All Visualize and Analyze Data through Dashboards
  • 13. • Interactive Documents that contain insights and the code to achieve them • Text to explain what the Notebook does and document insights • Code cells for accessing, processing, and analyzing data • Result cells with output and visualizations • Jupyter http://jupyter.org is the most popular open source project and de facto standard • Allows to create, run, edit notebooks in web browsers • Can run with Python, R, Scala, and many other kernels • Notebooks are stored as .ipynb JSON objects • Not only for Data Science and AI, also useful for other applications that benefit from text + code + insights + viz in interactive docs • Popular for publishing interactive tutorials & demos with runnable code inside, and reproducable research 13 Analyze Data in Jupyter Notebooks
  • 14. Train Machine Learning Models and deploy to Watson Machine Learning Create & Train Models in Watson Studio - ML Flows - ML Wizard - ML Notebooks ML Models ML Flows Watson Machine Learning Service Apps on IBM CLoud or other Apps REST API to call Model Create & Train Deploy Invoke • Data Scientists can train ML models in Watson Studio using data in Projects to create and train models • Use ML Wizard for assisted creation and training of models using common patterns and algorithms • Use Notebooks or Flows to train models for more advanced use cases and more flexibility • Deploy models to Watson Machine Learning (WML) service in Bluemix to run them in production • Use WML REST API to invoke your models for online scoring / predictions
  • 15. Upload ZIPs with training images Typically having at least 10 images per class suffices to get good results Use the Visual Recognition Model Get the REST API URL plus code snippets to invoke the Visual Recognition model from your application Train a Visual Recogniton Model Pick the classes you want to include in training the models, Watson Studio automatically connects to Watson Visual Recognition to train with the selected data Collect training data for Visual Recognition and train/test Visual Recognition Models Train Visual Recognition Models
  • 16. Watson Knowledge Catalog Discover Intelligent discovery of data, advanced classification and profiling to provide context Govern Powerful governance policy tools to control and protect access to data with visibility to data use Catalog A rich metadata index of all data, with social collaboration and enhanced findability Unlock tribal knowledge to unleash your data professionals, powered by AI
  • 17. Watson Studio Differentiating Capabilities • Data Scientists, Subject Matter experts, Business Analysts & Developers all in one environment to accelerate innovation, collaboration and productivity • Built-in learning to get started or go the distance with advanced tutorials Integrated Collaboration Environment • Best in-breed open source and IBM tools that support the end-to-end AI lifecycle • Choice of code or no-code tools to build and train your own ML/DL models or easily train and customize pre-trained Watson APIs Choice of Tools for the full AI lifecycle • Use Watson smarts and recommendations for the best algorithms to use given your data, OR • Use the rich capabilities and controls to fine tune your models Support for all levels of expertise • Monitor batch training experiments then compare cross-model performance without worrying about log transfers and scripts to visualize results. • You focus on designing your neural networks. We’ll manage and track your assets. Experiment centric DL workflow • Deploy models into production then monitor them to evaluate performance. • Capture new data for continuous learning and retrain models so they continually adapt to changing conditions. Model lifecycle & management • Intelligent discovery of data and AI assets that enables reuse & improves productivity • Seamlessly integrated for productive use with Machine Learning and Data science • Powerful governance tools to control and protect access to data Integrated with Knowledge Catalog 17
  • 18. Demo 18IBM Cloud / Watson and Cloud Platform / © 2018 IBM Corporation Try it at https://www.ibm.com/cloud/watson-studio

Notes de l'éditeur

  1. The most visible part of the platform is the persona driven experiences for data professionals as well as the collaboration capabilities that make them truly productive as a team. The ability not just to find insights but to put them to use and keep them fresh by learning as new data comes in and collaborating with their peers during the process. The platform isnt only user experiences. developers and data scientists especially will rely on coding to get the most out of the assets they work with and deliver. The integrated platform and its API delivers a real engine for data innovation through the experiences we deliver, our partners extend and customers innovate on. The platform that enables you to: Connect to data of any kind, stored or streaming, cloud and onprem, human created or IOT generated Visualize prepare and cleanse that data for use Persist it in the most appropriate and cost effective scalable data stores (Object, noSQL, warehouse or transactional db) and catalog it for everyone to find and use Analyzing it in depth using projects, notebooks, machine learning models and more Deploy the insights as compelling visualizations you can make decisions on, or baking them into existing or new applications, processes and more Surrounding and supporting all these activities is unintrusive intelligent active governance allowing you to manage risk without slowing down innovation
  2. WDP provides a rich and growing set of options for working with and persisting data in the IBM cloud as well as the ability to access data of value anywhere. But access does not a platform make.
  3. Watson Data Platform provides the data catalog experience as an efficient and easy way to build and manage an index of all the asset across your business. It builds an intelligent model for those assets and provides context around those asset to make them easy to find and understand how that data should be used, accessed and managed. Data Engineers and Stewards are able to effectively manage the data and policy goals of the business Governing Data throughout its lifecycle Automatically discovery and provide context to data Ensuring it is used in a compliant manner Aid findability of data Take action to improve the data and its use Empower your knowledge workers to be more effective with their tools