SlideShare une entreprise Scribd logo
1  sur  14
Télécharger pour lire hors ligne
Predictive Vehicle Inspection
Matous Havlena
matous@havlena.net
Tim Ojo
timmyojo@gmail.com
Akin Alao
alaoraufu@yahoo.co.uk
Project Charter
Evaluate the feasibility of using Big Data analytics solutions for
Manufacturing to solve the problem of Predictive Vehicle
Inspection:
● Analyzing vehicle production history to predict car inspection
failures from the production line.
● Production shifts, specific employee, and other factors
The two Big Data Analytics solutions to be evaluated:
● IBM BigInsights
● Datameer 2.1
Approach & Proposed Solution
● Recognized the problem as a classification problem
similar to credit scoring or fraud detection.
● Classification is the problem of identifying to which of a
set of categories a new observation belongs, on the basis
of a training set of data containing observations whose
category membership is known.
● Build a predictive model based on machine learning
classification (supervised learning) to identify whether a
vehicle can be classified as good (passes quality check
on 1st try) or bad (fails quality check on 1st try)
Proposed Solutions - Tools
● BigInsights + SPSS Modeler
○ Hadoop is used to store big data and execute data
processing jobs in an efficient and distributed
fashion. IBM provides BigInsights as a management
and operational interface to simplify working with
Hadoop without doing much coding.
○ SPSS Modeler is a data analytics workbench that
allows the user to build predictive models by
leveraging built in algorithms and functions without
the need for programming
Proposed Solutions - Tools
● Datameer
○ Like BigInsights, Datameer Analytics Solution presents a
web based spreadsheet interface on top of a Hadoop
cluster and provides analytics functions and
visualizations out of the box without the need for writing
code.
○ DAS also has a Smart Analytics suite. One of the tools
available in that suite is a decision tree model which is a
descriptive model that can identify important factors that
affect quality.
○ Datameer can also be extended to run predictive models
created in R, SAS, SPSS, etc.
IBM Solution Architecture
SPSS Modeler
Client (only
Windows)

SPSS Modeler
Server (multiplatform)

SPSS Analytic Server
● allows analysts to do predictive analytics over big
data
● data centric architecture ensures scalability and
performance
SPSS Analytic Catalyst
● automatically discovers statistically interesting
relationships in data
● close the analytic specialist gap
● good in early discovery dataset stage (helps to
focus on important parts)
● automate some parts of CRISP-DM

SPSS Analytic
Server
(multiplatform)

SPSS Analytic
Catalyst

Hadoop
(BigInsights)
Prediction in SPSS Modeler

425 predictors
85.4% accuracy
(on the training dataset)
Model Outcome
Original value | Predicted value | Confidence
Predictor Importance
c5.0 Algorithm
● C5.o is an algorithm used to generate a decision tree
which can be used for classification therefore it is often
referred to as a statistical classifier
● A C5.0 model works by splitting the sample based on the
field that provides the maximum information gain. Each
subsample defined by the first split is then split again,
usually based on a different field, and the process
repeats until the subsamples cannot be split any further.
Finally, the lowest-level splits are reexamined, and those
that do not contribute significantly to the value of the
model are removed or pruned.
c5.0 Algorithm
● C5.0 models are quite robust in the presence of
problems such as missing data and large numbers of
input fields.
● They usually do not require long training times to
create. Because of the algorithm’s recursive nature it can
benefit from parallel processing.
● C5.0 offers the boosting method to increase accuracy of
classification
Datameer Analysis
● As previously mentioned Datameer has some built in
advanced analytics tools but most of them are in the
descriptive analytics area. The sole predictive analytics
tool they have is a specialized recommendation engine.
● Datameer can be extended to include predictive models
generated in tools like R, SAS, SPSS, etc. These take the
form of functions in DAS similar to the concept of
functions in Excel.
○ The disadvantage of this approach is that the hard work
of building the model is done without the support of big
data
○ Another disadvantage is the lack of tight integration that
is present in the IBM solution however you do get the
freedom to use any tool
Project Challenges & Opportunities
● Data understanding and formatting
● Time constraints
● More interaction with people on the ground
● More predictor data (diverse dataset is a key!)
○ Plant environment (temperature, humidity,
pressure)
○ Specific employees
○ Supplier & parts data
○ Warranty data
Questions?
Matous Havlena
matous@havlena.net
Tim Ojo
timmyojo@gmail.com
Akin Alao
alaoraufu@yahoo.co.uk

Contenu connexe

Tendances

Power BI : A Detailed Discussion
Power BI : A Detailed DiscussionPower BI : A Detailed Discussion
Power BI : A Detailed DiscussionSwatiTripathi44
 
The Rise of NeoBanks with the Power of Technology
The Rise of NeoBanks with the Power of Technology The Rise of NeoBanks with the Power of Technology
The Rise of NeoBanks with the Power of Technology Aspire Systems
 
Big Data Analytics in Government
Big Data Analytics in GovernmentBig Data Analytics in Government
Big Data Analytics in GovernmentDeepak Ramanathan
 
Business Analytics to solve your Business Problems
Business Analytics to solve your Business ProblemsBusiness Analytics to solve your Business Problems
Business Analytics to solve your Business ProblemsVishal Pawar
 
Blueworks LIve - Process Modeling Solution
Blueworks LIve - Process Modeling SolutionBlueworks LIve - Process Modeling Solution
Blueworks LIve - Process Modeling SolutionFrancesco Maria Rivera
 
Visualization using Tableau
Visualization using TableauVisualization using Tableau
Visualization using TableauGirija Muscut
 
Is Machine learning useful for Fraud Prevention?
Is Machine learning useful for Fraud Prevention?Is Machine learning useful for Fraud Prevention?
Is Machine learning useful for Fraud Prevention?Andrea Dal Pozzolo
 
Webinar: Practical use-cases to monetize Open Banking APIs
Webinar: Practical use-cases to monetize Open Banking APIsWebinar: Practical use-cases to monetize Open Banking APIs
Webinar: Practical use-cases to monetize Open Banking APIsShubaS4
 
Introduction to Machine Learning (case studies)
Introduction to Machine Learning (case studies)Introduction to Machine Learning (case studies)
Introduction to Machine Learning (case studies)Dmitry Efimov
 
Open banking-Future of Banking
Open banking-Future of BankingOpen banking-Future of Banking
Open banking-Future of Bankingfarhan ali
 
Digital redefinition of banking banking transformation
Digital redefinition of banking   banking transformationDigital redefinition of banking   banking transformation
Digital redefinition of banking banking transformationDraup
 
Business intelligence- Components, Tools, Need and Applications
Business intelligence- Components, Tools, Need and ApplicationsBusiness intelligence- Components, Tools, Need and Applications
Business intelligence- Components, Tools, Need and Applicationsraj
 
Big Data Ppt PowerPoint Presentation Slides
Big Data Ppt PowerPoint Presentation Slides Big Data Ppt PowerPoint Presentation Slides
Big Data Ppt PowerPoint Presentation Slides SlideTeam
 
Power bi (1)Power BI Online Training Hyderabad | power bi online training ben...
Power bi (1)Power BI Online Training Hyderabad | power bi online training ben...Power bi (1)Power BI Online Training Hyderabad | power bi online training ben...
Power bi (1)Power BI Online Training Hyderabad | power bi online training ben...Big IT Trainings
 
Your Roadmap for An Enterprise Graph Strategy
Your Roadmap for An Enterprise Graph StrategyYour Roadmap for An Enterprise Graph Strategy
Your Roadmap for An Enterprise Graph StrategyNeo4j
 
Monetization - The Right Business Model for Your Digital Assets
Monetization - The Right Business Model for Your Digital AssetsMonetization - The Right Business Model for Your Digital Assets
Monetization - The Right Business Model for Your Digital AssetsApigee | Google Cloud
 
Modern Business Intelligence - Design and Implementations
Modern Business Intelligence - Design and ImplementationsModern Business Intelligence - Design and Implementations
Modern Business Intelligence - Design and ImplementationsDavid J Rosenthal
 

Tendances (20)

Power BI : A Detailed Discussion
Power BI : A Detailed DiscussionPower BI : A Detailed Discussion
Power BI : A Detailed Discussion
 
The Rise of NeoBanks with the Power of Technology
The Rise of NeoBanks with the Power of Technology The Rise of NeoBanks with the Power of Technology
The Rise of NeoBanks with the Power of Technology
 
Big Data Analytics in Government
Big Data Analytics in GovernmentBig Data Analytics in Government
Big Data Analytics in Government
 
Business Analytics to solve your Business Problems
Business Analytics to solve your Business ProblemsBusiness Analytics to solve your Business Problems
Business Analytics to solve your Business Problems
 
Blueworks LIve - Process Modeling Solution
Blueworks LIve - Process Modeling SolutionBlueworks LIve - Process Modeling Solution
Blueworks LIve - Process Modeling Solution
 
Visualization using Tableau
Visualization using TableauVisualization using Tableau
Visualization using Tableau
 
Is Machine learning useful for Fraud Prevention?
Is Machine learning useful for Fraud Prevention?Is Machine learning useful for Fraud Prevention?
Is Machine learning useful for Fraud Prevention?
 
Webinar: Practical use-cases to monetize Open Banking APIs
Webinar: Practical use-cases to monetize Open Banking APIsWebinar: Practical use-cases to monetize Open Banking APIs
Webinar: Practical use-cases to monetize Open Banking APIs
 
Power bi overview
Power bi overview Power bi overview
Power bi overview
 
Introduction to Machine Learning (case studies)
Introduction to Machine Learning (case studies)Introduction to Machine Learning (case studies)
Introduction to Machine Learning (case studies)
 
Open banking-Future of Banking
Open banking-Future of BankingOpen banking-Future of Banking
Open banking-Future of Banking
 
Digital redefinition of banking banking transformation
Digital redefinition of banking   banking transformationDigital redefinition of banking   banking transformation
Digital redefinition of banking banking transformation
 
Data analytics and powerbi intro
Data analytics and powerbi introData analytics and powerbi intro
Data analytics and powerbi intro
 
Business intelligence- Components, Tools, Need and Applications
Business intelligence- Components, Tools, Need and ApplicationsBusiness intelligence- Components, Tools, Need and Applications
Business intelligence- Components, Tools, Need and Applications
 
Big Data Ppt PowerPoint Presentation Slides
Big Data Ppt PowerPoint Presentation Slides Big Data Ppt PowerPoint Presentation Slides
Big Data Ppt PowerPoint Presentation Slides
 
Power bi (1)Power BI Online Training Hyderabad | power bi online training ben...
Power bi (1)Power BI Online Training Hyderabad | power bi online training ben...Power bi (1)Power BI Online Training Hyderabad | power bi online training ben...
Power bi (1)Power BI Online Training Hyderabad | power bi online training ben...
 
Your Roadmap for An Enterprise Graph Strategy
Your Roadmap for An Enterprise Graph StrategyYour Roadmap for An Enterprise Graph Strategy
Your Roadmap for An Enterprise Graph Strategy
 
Monetization - The Right Business Model for Your Digital Assets
Monetization - The Right Business Model for Your Digital AssetsMonetization - The Right Business Model for Your Digital Assets
Monetization - The Right Business Model for Your Digital Assets
 
Big data ppt
Big data pptBig data ppt
Big data ppt
 
Modern Business Intelligence - Design and Implementations
Modern Business Intelligence - Design and ImplementationsModern Business Intelligence - Design and Implementations
Modern Business Intelligence - Design and Implementations
 

En vedette

Sample SOP For MS in Business Analytics
Sample SOP For MS in Business AnalyticsSample SOP For MS in Business Analytics
Sample SOP For MS in Business AnalyticsSOP MBA
 
Functional Programming Fundamentals
Functional Programming FundamentalsFunctional Programming Fundamentals
Functional Programming FundamentalsShahriar Hyder
 
Modeling with Hadoop kdd2011
Modeling with Hadoop kdd2011Modeling with Hadoop kdd2011
Modeling with Hadoop kdd2011Milind Bhandarkar
 
Lambda Calculus by Dustin Mulcahey
Lambda Calculus by Dustin Mulcahey Lambda Calculus by Dustin Mulcahey
Lambda Calculus by Dustin Mulcahey Hakka Labs
 
Interactive Scientific Image Analysis using Spark
Interactive Scientific Image Analysis using SparkInteractive Scientific Image Analysis using Spark
Interactive Scientific Image Analysis using SparkKevin Mader
 
Functional programming
Functional programmingFunctional programming
Functional programmingedusmildo
 
Machine Learning with Apache Mahout
Machine Learning with Apache MahoutMachine Learning with Apache Mahout
Machine Learning with Apache MahoutDaniel Glauser
 
Functional Programming in JavaScript by Luis Atencio
Functional Programming in JavaScript by Luis AtencioFunctional Programming in JavaScript by Luis Atencio
Functional Programming in JavaScript by Luis AtencioLuis Atencio
 
The Lambda Calculus and The JavaScript
The Lambda Calculus and The JavaScriptThe Lambda Calculus and The JavaScript
The Lambda Calculus and The JavaScriptNorman Richards
 
Functional programming
Functional programmingFunctional programming
Functional programmingPrateek Jain
 
Functional programming ii
Functional programming iiFunctional programming ii
Functional programming iiPrashant Kalkar
 
Introduction to Functional Programming in JavaScript
Introduction to Functional Programming in JavaScriptIntroduction to Functional Programming in JavaScript
Introduction to Functional Programming in JavaScripttmont
 

En vedette (12)

Sample SOP For MS in Business Analytics
Sample SOP For MS in Business AnalyticsSample SOP For MS in Business Analytics
Sample SOP For MS in Business Analytics
 
Functional Programming Fundamentals
Functional Programming FundamentalsFunctional Programming Fundamentals
Functional Programming Fundamentals
 
Modeling with Hadoop kdd2011
Modeling with Hadoop kdd2011Modeling with Hadoop kdd2011
Modeling with Hadoop kdd2011
 
Lambda Calculus by Dustin Mulcahey
Lambda Calculus by Dustin Mulcahey Lambda Calculus by Dustin Mulcahey
Lambda Calculus by Dustin Mulcahey
 
Interactive Scientific Image Analysis using Spark
Interactive Scientific Image Analysis using SparkInteractive Scientific Image Analysis using Spark
Interactive Scientific Image Analysis using Spark
 
Functional programming
Functional programmingFunctional programming
Functional programming
 
Machine Learning with Apache Mahout
Machine Learning with Apache MahoutMachine Learning with Apache Mahout
Machine Learning with Apache Mahout
 
Functional Programming in JavaScript by Luis Atencio
Functional Programming in JavaScript by Luis AtencioFunctional Programming in JavaScript by Luis Atencio
Functional Programming in JavaScript by Luis Atencio
 
The Lambda Calculus and The JavaScript
The Lambda Calculus and The JavaScriptThe Lambda Calculus and The JavaScript
The Lambda Calculus and The JavaScript
 
Functional programming
Functional programmingFunctional programming
Functional programming
 
Functional programming ii
Functional programming iiFunctional programming ii
Functional programming ii
 
Introduction to Functional Programming in JavaScript
Introduction to Functional Programming in JavaScriptIntroduction to Functional Programming in JavaScript
Introduction to Functional Programming in JavaScript
 

Similaire à Predictive Analytics Project in Automotive Industry

MOPs & ML Pipelines on GCP - Session 6, RGDC
MOPs & ML Pipelines on GCP - Session 6, RGDCMOPs & ML Pipelines on GCP - Session 6, RGDC
MOPs & ML Pipelines on GCP - Session 6, RGDCgdgsurrey
 
A Machine learning based framework for Verification and Validation of Massive...
A Machine learning based framework for Verification and Validation of Massive...A Machine learning based framework for Verification and Validation of Massive...
A Machine learning based framework for Verification and Validation of Massive...IRJET Journal
 
Data Science as a Service: Intersection of Cloud Computing and Data Science
Data Science as a Service: Intersection of Cloud Computing and Data ScienceData Science as a Service: Intersection of Cloud Computing and Data Science
Data Science as a Service: Intersection of Cloud Computing and Data SciencePouria Amirian
 
Data Science as a Service: Intersection of Cloud Computing and Data Science
Data Science as a Service: Intersection of Cloud Computing and Data ScienceData Science as a Service: Intersection of Cloud Computing and Data Science
Data Science as a Service: Intersection of Cloud Computing and Data SciencePouria Amirian
 
Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...
Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...
Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...Daniel Zivkovic
 
Data Engineer vs Data Scientist vs Data Analyst.pptx
Data Engineer vs Data Scientist vs Data Analyst.pptxData Engineer vs Data Scientist vs Data Analyst.pptx
Data Engineer vs Data Scientist vs Data Analyst.pptxCarolineRebeccaD
 
laptop price prediction presentation
laptop price prediction presentationlaptop price prediction presentation
laptop price prediction presentationNeerajNishad4
 
Microsoft_Databricks Datathon - Submission Deck TEMPLATE.pptx
Microsoft_Databricks Datathon - Submission Deck TEMPLATE.pptxMicrosoft_Databricks Datathon - Submission Deck TEMPLATE.pptx
Microsoft_Databricks Datathon - Submission Deck TEMPLATE.pptxAbdoulaye DOUCOURE
 
Choosing The Right Data Annotation Option: Pros And Cons
Choosing The Right Data Annotation Option: Pros And ConsChoosing The Right Data Annotation Option: Pros And Cons
Choosing The Right Data Annotation Option: Pros And ConsArnav Malhotra
 
Practical data science
Practical data sciencePractical data science
Practical data scienceDing Li
 
Automated Machine Learning
Automated Machine LearningAutomated Machine Learning
Automated Machine LearningYuriy Guts
 
Bhadale group of companies data science project methodologies catalogue
Bhadale group of companies data science project methodologies catalogueBhadale group of companies data science project methodologies catalogue
Bhadale group of companies data science project methodologies catalogueVijayananda Mohire
 

Similaire à Predictive Analytics Project in Automotive Industry (20)

Demystifying Data Science
Demystifying Data ScienceDemystifying Data Science
Demystifying Data Science
 
MOPs & ML Pipelines on GCP - Session 6, RGDC
MOPs & ML Pipelines on GCP - Session 6, RGDCMOPs & ML Pipelines on GCP - Session 6, RGDC
MOPs & ML Pipelines on GCP - Session 6, RGDC
 
A Machine learning based framework for Verification and Validation of Massive...
A Machine learning based framework for Verification and Validation of Massive...A Machine learning based framework for Verification and Validation of Massive...
A Machine learning based framework for Verification and Validation of Massive...
 
Python and data analytics
Python and data analyticsPython and data analytics
Python and data analytics
 
Data Science as a Service: Intersection of Cloud Computing and Data Science
Data Science as a Service: Intersection of Cloud Computing and Data ScienceData Science as a Service: Intersection of Cloud Computing and Data Science
Data Science as a Service: Intersection of Cloud Computing and Data Science
 
Data Science as a Service: Intersection of Cloud Computing and Data Science
Data Science as a Service: Intersection of Cloud Computing and Data ScienceData Science as a Service: Intersection of Cloud Computing and Data Science
Data Science as a Service: Intersection of Cloud Computing and Data Science
 
Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...
Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...
Canadian Experts Discuss Modern Data Stacks and Cloud Computing for 5 Years o...
 
MLOps.pptx
MLOps.pptxMLOps.pptx
MLOps.pptx
 
Data Engineer vs Data Scientist vs Data Analyst.pptx
Data Engineer vs Data Scientist vs Data Analyst.pptxData Engineer vs Data Scientist vs Data Analyst.pptx
Data Engineer vs Data Scientist vs Data Analyst.pptx
 
laptop price prediction presentation
laptop price prediction presentationlaptop price prediction presentation
laptop price prediction presentation
 
Aws autopilot
Aws autopilotAws autopilot
Aws autopilot
 
Microsoft_Databricks Datathon - Submission Deck TEMPLATE.pptx
Microsoft_Databricks Datathon - Submission Deck TEMPLATE.pptxMicrosoft_Databricks Datathon - Submission Deck TEMPLATE.pptx
Microsoft_Databricks Datathon - Submission Deck TEMPLATE.pptx
 
Choosing The Right Data Annotation Option: Pros And Cons
Choosing The Right Data Annotation Option: Pros And ConsChoosing The Right Data Annotation Option: Pros And Cons
Choosing The Right Data Annotation Option: Pros And Cons
 
Practical data science
Practical data sciencePractical data science
Practical data science
 
Automated Machine Learning
Automated Machine LearningAutomated Machine Learning
Automated Machine Learning
 
Bhadale group of companies data science project methodologies catalogue
Bhadale group of companies data science project methodologies catalogueBhadale group of companies data science project methodologies catalogue
Bhadale group of companies data science project methodologies catalogue
 
Machine Learning
Machine LearningMachine Learning
Machine Learning
 
Ibm watson
Ibm watsonIbm watson
Ibm watson
 
DS Life Cycle
DS Life CycleDS Life Cycle
DS Life Cycle
 
DS Life Cycle
DS Life CycleDS Life Cycle
DS Life Cycle
 

Plus de Matouš Havlena

Plus de Matouš Havlena (6)

Data warehousing
Data warehousingData warehousing
Data warehousing
 
Predictive Analytics [UTC]
Predictive Analytics [UTC]Predictive Analytics [UTC]
Predictive Analytics [UTC]
 
Big Data Analytics [UTC]
Big Data Analytics [UTC]Big Data Analytics [UTC]
Big Data Analytics [UTC]
 
Koucink [MUNI]
Koucink [MUNI]Koucink [MUNI]
Koucink [MUNI]
 
Agile requirementspraguefinal
Agile requirementspraguefinalAgile requirementspraguefinal
Agile requirementspraguefinal
 
Presentation IBM Rational AppScan
Presentation IBM Rational AppScanPresentation IBM Rational AppScan
Presentation IBM Rational AppScan
 

Dernier

MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesManik S Magar
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfNeo4j
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...itnewsafrica
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Alkin Tezuysal
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Nikki Chapple
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI AgeCprime
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfpanagenda
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationKnoldus Inc.
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxfnnc6jmgwh
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...itnewsafrica
 

Dernier (20)

MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdf
 
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI Age
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog Presentation
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...Abdul Kader Baba- Managing Cybersecurity Risks  and Compliance Requirements i...
Abdul Kader Baba- Managing Cybersecurity Risks and Compliance Requirements i...
 

Predictive Analytics Project in Automotive Industry

  • 1. Predictive Vehicle Inspection Matous Havlena matous@havlena.net Tim Ojo timmyojo@gmail.com Akin Alao alaoraufu@yahoo.co.uk
  • 2. Project Charter Evaluate the feasibility of using Big Data analytics solutions for Manufacturing to solve the problem of Predictive Vehicle Inspection: ● Analyzing vehicle production history to predict car inspection failures from the production line. ● Production shifts, specific employee, and other factors The two Big Data Analytics solutions to be evaluated: ● IBM BigInsights ● Datameer 2.1
  • 3. Approach & Proposed Solution ● Recognized the problem as a classification problem similar to credit scoring or fraud detection. ● Classification is the problem of identifying to which of a set of categories a new observation belongs, on the basis of a training set of data containing observations whose category membership is known. ● Build a predictive model based on machine learning classification (supervised learning) to identify whether a vehicle can be classified as good (passes quality check on 1st try) or bad (fails quality check on 1st try)
  • 4. Proposed Solutions - Tools ● BigInsights + SPSS Modeler ○ Hadoop is used to store big data and execute data processing jobs in an efficient and distributed fashion. IBM provides BigInsights as a management and operational interface to simplify working with Hadoop without doing much coding. ○ SPSS Modeler is a data analytics workbench that allows the user to build predictive models by leveraging built in algorithms and functions without the need for programming
  • 5. Proposed Solutions - Tools ● Datameer ○ Like BigInsights, Datameer Analytics Solution presents a web based spreadsheet interface on top of a Hadoop cluster and provides analytics functions and visualizations out of the box without the need for writing code. ○ DAS also has a Smart Analytics suite. One of the tools available in that suite is a decision tree model which is a descriptive model that can identify important factors that affect quality. ○ Datameer can also be extended to run predictive models created in R, SAS, SPSS, etc.
  • 6. IBM Solution Architecture SPSS Modeler Client (only Windows) SPSS Modeler Server (multiplatform) SPSS Analytic Server ● allows analysts to do predictive analytics over big data ● data centric architecture ensures scalability and performance SPSS Analytic Catalyst ● automatically discovers statistically interesting relationships in data ● close the analytic specialist gap ● good in early discovery dataset stage (helps to focus on important parts) ● automate some parts of CRISP-DM SPSS Analytic Server (multiplatform) SPSS Analytic Catalyst Hadoop (BigInsights)
  • 7. Prediction in SPSS Modeler 425 predictors 85.4% accuracy (on the training dataset)
  • 8. Model Outcome Original value | Predicted value | Confidence
  • 10. c5.0 Algorithm ● C5.o is an algorithm used to generate a decision tree which can be used for classification therefore it is often referred to as a statistical classifier ● A C5.0 model works by splitting the sample based on the field that provides the maximum information gain. Each subsample defined by the first split is then split again, usually based on a different field, and the process repeats until the subsamples cannot be split any further. Finally, the lowest-level splits are reexamined, and those that do not contribute significantly to the value of the model are removed or pruned.
  • 11. c5.0 Algorithm ● C5.0 models are quite robust in the presence of problems such as missing data and large numbers of input fields. ● They usually do not require long training times to create. Because of the algorithm’s recursive nature it can benefit from parallel processing. ● C5.0 offers the boosting method to increase accuracy of classification
  • 12. Datameer Analysis ● As previously mentioned Datameer has some built in advanced analytics tools but most of them are in the descriptive analytics area. The sole predictive analytics tool they have is a specialized recommendation engine. ● Datameer can be extended to include predictive models generated in tools like R, SAS, SPSS, etc. These take the form of functions in DAS similar to the concept of functions in Excel. ○ The disadvantage of this approach is that the hard work of building the model is done without the support of big data ○ Another disadvantage is the lack of tight integration that is present in the IBM solution however you do get the freedom to use any tool
  • 13. Project Challenges & Opportunities ● Data understanding and formatting ● Time constraints ● More interaction with people on the ground ● More predictor data (diverse dataset is a key!) ○ Plant environment (temperature, humidity, pressure) ○ Specific employees ○ Supplier & parts data ○ Warranty data