SlideShare une entreprise Scribd logo
1  sur  26
Télécharger pour lire hors ligne
Business Intelligence
    Data Mining
      (Part 2 of 2)
The End?
How far can I go?

• Storing and analyzing historical data you can see just
  one part of reality (the past and the present)
• Is there a way to answer questions not yet made?
  Can I look into the future?
• Can I predict how my business is going to work?
  What about the market? And my customers?
Data Mining

• Is a process to extract patterns from data
• “We’re drowning in data but information
  thirsty”
• Data Mining borrows techniques from
  statistics, probability, maths, artificial
  intelligence and other fields
Business Problems
• Recommendations
• Anomaly Detection
• Customer abandon analysis
• Risk Management
• Customer segmentation
• Targeted advertising
• Projections
Data Mining Tasks

• Classification
• Estimation / Regression
• Prediction / Projection (Forecasting)
• Association Rules / Affinity Groups
• Clusterization
Predictive Models
• Classifications
 • Discrete value prediction
   • Yes, No
   • High, Medium, Low
• Estimation / Regression
 • Continuous value prediction
   • Amounts
   • Numbers
• Projection / Forecasting
Descriptive Models
• Association Rules / Affinity
 • Looks for correlation indexes among
    diverse associated elements
 • Market Basket Analysis
• Clusterization
 • Groups items according to similarity
 • “Automatic” classification
Work Cycle

                           Transform
                            Data to
                          Information




Identify Business Opportunities             Act with
                                          Information




                        Measure Results
Data Mining and DWh

• The Data Warehsouse unifies diverse data sources
  in one common repository
• Before the DM process, you must have reliable data
  sources
• Data must be presented in a way that eases analysis
Project Cycle
• Business Problem Formulation
• Data Gathering
• Data transformation and cleansing
• Model Construction
• Model Evaluation
• Reports and Prediction
• Application Integration
• Model Management
What is a Model?
• The model is a set of conclusions reached (in
  mathematical format) after data processing
• Is used to extract knowledge and to compare it
  to new data to reach to new conclusions
• It has some efficency percentage
• Must be adjusted to make helpful predictions
• It is time-constrainted
Cases
Outlook    Temperature (C)    Humidity   Wind   Play Golf?
 Sunny          29.4            85%      NO        No
 Sunny          26.6            90%      YES       No
Overcast        28.3            78%      NO        Yes
 Rainy          21.1            96%      NO        Yes
 Rainy          20.0            80%      NO        Yes
 Rainy          18.3            70%      YES       No
Overcast        17.7            65%      YES       Yes
 Sunny          22.2            95%      NO        No
 Sunny          20.5            70%      NO        Yes
 Rainy          23.8            80%      NO        Yes
 Sunny          23.8            70%      YES       Yes
Overcast        22.2            90%      YES       Yes
Overcast        27.2            75%      NO        Yes
 Rainy          21.6            80%      YES       No
Model
                  Outlook

Overcast        Rainy                    Sunny

  YES              Wind              Humidity

           NO               YES <=77.5            >77.5

            YES         NO          YES      NO
Data Mining Algorithms
 • Naive Bayes
 • Decission Trees
 • Autoregression trees (ARTxp and ARIMA)
 • K-Means
 • Kohonen Maps
 • Neural Networks
 • Logistic regression
 • Time Series
Where can I use them?
• Marketing: Segmentation, Campaigns, Results,
  Loyalty,...
• Sales: Behaviour detection, Sales habits
• Finances: Investments, Portfolio Management
• Banks and Assurance: Credit Check
• Security: Fraud Detection
• Medicine: Possible treatment analysis
• Manufacturing: Quality Control
• Internet: Click analysis, Text Mining
Data Mining and CRM (1)

 • Detect the best prospect / customers
 • Select the best communication channel for
   prospects / customers
 • Select an appropriate message to
   prospects / customers
 • Cross-selling, Up-selling and sales
   recommendation engines
Data Mining and CRM (2)

 • Improve direct marketing campaign results
 • Customer base segmentation
 • Reduce credit risk exposure
 • Customer Lifetime Value
 • Customer retention and loss
Clustering
• “Self” Customer Segmentation
 • Descriptive Characteristics
 • Behavioural Characteristics
   • Relationship
   • Purchases
   • Payments
Classification
• Customers by purchase behaviour
• Customers by payment behaviour
• Customers by resources devoted/needed
  to their service
• Customers by credit profile
• Customers by attention required
Association Rules

• Market Basket Analysis
• Cross Selling
• Up Selling
Prediction / Forecasting

• Revenue Projection
• Payment Projection
• Number of Products sold Projection
• Cash Flow Projection
Some other DM cases


• Key Influencers
• Predictions Calculator
Some Possible
             Problems (1)
• To learn things that are not true
 • The patterns may not represent any underlying rule
 • The model may not represent a relevant number of
    examples
 • Data may be in a detail level not enough for analysis
Possible Problems... (1I)

• To learn things that are true, but not
  useful
 • Learn things that we already knew
 • Learn things that cannot be applied
Thank you!

Contenu connexe

Tendances

Data visualization in a Nutshell
Data visualization in a NutshellData visualization in a Nutshell
Data visualization in a NutshellWingChan46
 
Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?DATAVERSITY
 
Data Visualization Design Best Practices Workshop
Data Visualization Design Best Practices WorkshopData Visualization Design Best Practices Workshop
Data Visualization Design Best Practices WorkshopJSI
 
Business intelligence in the real time economy
Business intelligence in the real time economyBusiness intelligence in the real time economy
Business intelligence in the real time economyJohan Blomme
 
Data Visualization
Data VisualizationData Visualization
Data Visualizationsimonwandrew
 
Better decision making with proper business intelligence
Better decision making with proper business intelligenceBetter decision making with proper business intelligence
Better decision making with proper business intelligencemadhavlankapati
 
Business Intelligence & Data Analytics– An Architected Approach
Business Intelligence & Data Analytics– An Architected ApproachBusiness Intelligence & Data Analytics– An Architected Approach
Business Intelligence & Data Analytics– An Architected ApproachDATAVERSITY
 
Introduction to Business Intelligence
Introduction to Business IntelligenceIntroduction to Business Intelligence
Introduction to Business IntelligenceAlmog Ramrajkar
 
Data Storytelling: The only way to unlock true insight from your data
Data Storytelling: The only way to unlock true insight from your dataData Storytelling: The only way to unlock true insight from your data
Data Storytelling: The only way to unlock true insight from your dataBright North
 
Best Practices for Killer Data Visualization
Best Practices for Killer Data VisualizationBest Practices for Killer Data Visualization
Best Practices for Killer Data VisualizationQualtrics
 
Building an AI organisation
Building an AI organisationBuilding an AI organisation
Building an AI organisationVikash Mishra
 
Data visualization introduction
Data visualization introductionData visualization introduction
Data visualization introductionManokamnaKochar1
 

Tendances (20)

Data visualization in a Nutshell
Data visualization in a NutshellData visualization in a Nutshell
Data visualization in a Nutshell
 
Business Intelligence Presentation
Business Intelligence PresentationBusiness Intelligence Presentation
Business Intelligence Presentation
 
Business intelligence
Business intelligenceBusiness intelligence
Business intelligence
 
Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?
 
Data Visualization Design Best Practices Workshop
Data Visualization Design Best Practices WorkshopData Visualization Design Best Practices Workshop
Data Visualization Design Best Practices Workshop
 
Business intelligence in the real time economy
Business intelligence in the real time economyBusiness intelligence in the real time economy
Business intelligence in the real time economy
 
Data Visualization
Data VisualizationData Visualization
Data Visualization
 
Better decision making with proper business intelligence
Better decision making with proper business intelligenceBetter decision making with proper business intelligence
Better decision making with proper business intelligence
 
Business Intelligence & Data Analytics– An Architected Approach
Business Intelligence & Data Analytics– An Architected ApproachBusiness Intelligence & Data Analytics– An Architected Approach
Business Intelligence & Data Analytics– An Architected Approach
 
Data modelling 101
Data modelling 101Data modelling 101
Data modelling 101
 
Data Visualization
Data VisualizationData Visualization
Data Visualization
 
Business Intelligence - Conceptual Introduction
Business Intelligence - Conceptual IntroductionBusiness Intelligence - Conceptual Introduction
Business Intelligence - Conceptual Introduction
 
Introduction to Business Intelligence
Introduction to Business IntelligenceIntroduction to Business Intelligence
Introduction to Business Intelligence
 
Data analytics
Data analyticsData analytics
Data analytics
 
Data Storytelling: The only way to unlock true insight from your data
Data Storytelling: The only way to unlock true insight from your dataData Storytelling: The only way to unlock true insight from your data
Data Storytelling: The only way to unlock true insight from your data
 
Business intelligence
Business intelligenceBusiness intelligence
Business intelligence
 
Best Practices for Killer Data Visualization
Best Practices for Killer Data VisualizationBest Practices for Killer Data Visualization
Best Practices for Killer Data Visualization
 
Building an AI organisation
Building an AI organisationBuilding an AI organisation
Building an AI organisation
 
Data visualization introduction
Data visualization introductionData visualization introduction
Data visualization introduction
 
3 data visualization
3 data visualization3 data visualization
3 data visualization
 

Similaire à Business Intelligence Presentation - Data Mining (2/2)

Levon Ter-Isahakyan, Agoda. Machine Learning and Culture changes for better F...
Levon Ter-Isahakyan, Agoda. Machine Learning and Culture changes for better F...Levon Ter-Isahakyan, Agoda. Machine Learning and Culture changes for better F...
Levon Ter-Isahakyan, Agoda. Machine Learning and Culture changes for better F...IT Arena
 
Marketing Mix Modelling - Marketing Analytics Summit
Marketing Mix Modelling - Marketing Analytics SummitMarketing Mix Modelling - Marketing Analytics Summit
Marketing Mix Modelling - Marketing Analytics SummitPetri Mertanen
 
Data Refinement: The missing link between data collection and decisions
Data Refinement: The missing link between data collection and decisionsData Refinement: The missing link between data collection and decisions
Data Refinement: The missing link between data collection and decisionsVivastream
 
Introduction to Data mining
Introduction to Data miningIntroduction to Data mining
Introduction to Data miningHadi Fadlallah
 
Winning in Today's Data-Centric Economy (Part 1)
Winning in Today's Data-Centric Economy (Part 1)Winning in Today's Data-Centric Economy (Part 1)
Winning in Today's Data-Centric Economy (Part 1)Alexander Loth
 
Why You Need to STOP Using Spreadsheets for Audit Analysis
Why You Need to STOP Using Spreadsheets for Audit AnalysisWhy You Need to STOP Using Spreadsheets for Audit Analysis
Why You Need to STOP Using Spreadsheets for Audit AnalysisCaseWare IDEA
 
Top 10 Tips for Retail Site Selection
Top 10 Tips for Retail Site SelectionTop 10 Tips for Retail Site Selection
Top 10 Tips for Retail Site SelectionPrecisely
 
Is Your Marketing Database "Model Ready"?
Is Your Marketing Database "Model Ready"?Is Your Marketing Database "Model Ready"?
Is Your Marketing Database "Model Ready"?Vivastream
 
Is Your Marketing Database "Model Ready"?
Is Your Marketing Database "Model Ready"?Is Your Marketing Database "Model Ready"?
Is Your Marketing Database "Model Ready"?Vivastream
 
Why business people should always be involved
Why business people should always be involvedWhy business people should always be involved
Why business people should always be involvedJaap Vink
 
Tableau Conference 2014: How One Agency Evolved from Vendor to Strategic Partner
Tableau Conference 2014: How One Agency Evolved from Vendor to Strategic PartnerTableau Conference 2014: How One Agency Evolved from Vendor to Strategic Partner
Tableau Conference 2014: How One Agency Evolved from Vendor to Strategic PartnerSIGMA Marketing Insights
 
#MME15: Red Hat + Mintigo - Leveraging Customer Insights To Transform B2B De...
#MME15:  Red Hat + Mintigo - Leveraging Customer Insights To Transform B2B De...#MME15:  Red Hat + Mintigo - Leveraging Customer Insights To Transform B2B De...
#MME15: Red Hat + Mintigo - Leveraging Customer Insights To Transform B2B De...Mintigo1
 
Barga Galvanize Sept 2015
Barga Galvanize Sept 2015Barga Galvanize Sept 2015
Barga Galvanize Sept 2015Roger Barga
 
Artificial Intelligence high ROI case studies from around the world: approach...
Artificial Intelligence high ROI case studies from around the world: approach...Artificial Intelligence high ROI case studies from around the world: approach...
Artificial Intelligence high ROI case studies from around the world: approach...Data Driven Innovation
 
Presentation by Cédric Charlier (Elia) at the Data Vault Modelling and Data G...
Presentation by Cédric Charlier (Elia) at the Data Vault Modelling and Data G...Presentation by Cédric Charlier (Elia) at the Data Vault Modelling and Data G...
Presentation by Cédric Charlier (Elia) at the Data Vault Modelling and Data G...Patrick Van Renterghem
 

Similaire à Business Intelligence Presentation - Data Mining (2/2) (20)

Levon Ter-Isahakyan, Agoda. Machine Learning and Culture changes for better F...
Levon Ter-Isahakyan, Agoda. Machine Learning and Culture changes for better F...Levon Ter-Isahakyan, Agoda. Machine Learning and Culture changes for better F...
Levon Ter-Isahakyan, Agoda. Machine Learning and Culture changes for better F...
 
Marketing Mix Modelling - Marketing Analytics Summit
Marketing Mix Modelling - Marketing Analytics SummitMarketing Mix Modelling - Marketing Analytics Summit
Marketing Mix Modelling - Marketing Analytics Summit
 
Data Refinement: The missing link between data collection and decisions
Data Refinement: The missing link between data collection and decisionsData Refinement: The missing link between data collection and decisions
Data Refinement: The missing link between data collection and decisions
 
Introduction to Data mining
Introduction to Data miningIntroduction to Data mining
Introduction to Data mining
 
Winning in Today's Data-Centric Economy (Part 1)
Winning in Today's Data-Centric Economy (Part 1)Winning in Today's Data-Centric Economy (Part 1)
Winning in Today's Data-Centric Economy (Part 1)
 
Metrics patterns session discussion at DAAG 2015
Metrics patterns session discussion at DAAG 2015Metrics patterns session discussion at DAAG 2015
Metrics patterns session discussion at DAAG 2015
 
Why You Need to STOP Using Spreadsheets for Audit Analysis
Why You Need to STOP Using Spreadsheets for Audit AnalysisWhy You Need to STOP Using Spreadsheets for Audit Analysis
Why You Need to STOP Using Spreadsheets for Audit Analysis
 
Top 10 Tips for Retail Site Selection
Top 10 Tips for Retail Site SelectionTop 10 Tips for Retail Site Selection
Top 10 Tips for Retail Site Selection
 
Is Your Marketing Database "Model Ready"?
Is Your Marketing Database "Model Ready"?Is Your Marketing Database "Model Ready"?
Is Your Marketing Database "Model Ready"?
 
Is Your Marketing Database "Model Ready"?
Is Your Marketing Database "Model Ready"?Is Your Marketing Database "Model Ready"?
Is Your Marketing Database "Model Ready"?
 
BigDataforSMEs
BigDataforSMEsBigDataforSMEs
BigDataforSMEs
 
Why business people should always be involved
Why business people should always be involvedWhy business people should always be involved
Why business people should always be involved
 
Tableau Conference 2014: How One Agency Evolved from Vendor to Strategic Partner
Tableau Conference 2014: How One Agency Evolved from Vendor to Strategic PartnerTableau Conference 2014: How One Agency Evolved from Vendor to Strategic Partner
Tableau Conference 2014: How One Agency Evolved from Vendor to Strategic Partner
 
#MME15: Red Hat + Mintigo - Leveraging Customer Insights To Transform B2B De...
#MME15:  Red Hat + Mintigo - Leveraging Customer Insights To Transform B2B De...#MME15:  Red Hat + Mintigo - Leveraging Customer Insights To Transform B2B De...
#MME15: Red Hat + Mintigo - Leveraging Customer Insights To Transform B2B De...
 
Barga Galvanize Sept 2015
Barga Galvanize Sept 2015Barga Galvanize Sept 2015
Barga Galvanize Sept 2015
 
Artificial Intelligence high ROI case studies from around the world: approach...
Artificial Intelligence high ROI case studies from around the world: approach...Artificial Intelligence high ROI case studies from around the world: approach...
Artificial Intelligence high ROI case studies from around the world: approach...
 
Presentation by Cédric Charlier (Elia) at the Data Vault Modelling and Data G...
Presentation by Cédric Charlier (Elia) at the Data Vault Modelling and Data G...Presentation by Cédric Charlier (Elia) at the Data Vault Modelling and Data G...
Presentation by Cédric Charlier (Elia) at the Data Vault Modelling and Data G...
 
Data mining
Data miningData mining
Data mining
 
Service zen1
Service zen1Service zen1
Service zen1
 
Service zen1
Service zen1Service zen1
Service zen1
 

Plus de Bernardo Najlis

Named Entity Recognition from Online News
Named Entity Recognition from Online NewsNamed Entity Recognition from Online News
Named Entity Recognition from Online NewsBernardo Najlis
 
Named Entity Recognition from Online News
Named Entity Recognition from Online NewsNamed Entity Recognition from Online News
Named Entity Recognition from Online NewsBernardo Najlis
 
Investment Fund Analytics
Investment Fund AnalyticsInvestment Fund Analytics
Investment Fund AnalyticsBernardo Najlis
 
Social Media World News Impact on Stock Index Values - Investment Fund Analyt...
Social Media World News Impact on Stock Index Values - Investment Fund Analyt...Social Media World News Impact on Stock Index Values - Investment Fund Analyt...
Social Media World News Impact on Stock Index Values - Investment Fund Analyt...Bernardo Najlis
 
Social Media Analytics on Canadian Airlines
Social Media Analytics on Canadian AirlinesSocial Media Analytics on Canadian Airlines
Social Media Analytics on Canadian AirlinesBernardo Najlis
 
Toastmasters speech #7 - Research your Subject
Toastmasters speech #7  - Research your SubjectToastmasters speech #7  - Research your Subject
Toastmasters speech #7 - Research your SubjectBernardo Najlis
 
Toastmasters project #5 - Just a jump
Toastmasters project #5  - Just a jumpToastmasters project #5  - Just a jump
Toastmasters project #5 - Just a jumpBernardo Najlis
 

Plus de Bernardo Najlis (11)

Named Entity Recognition from Online News
Named Entity Recognition from Online NewsNamed Entity Recognition from Online News
Named Entity Recognition from Online News
 
Named Entity Recognition from Online News
Named Entity Recognition from Online NewsNamed Entity Recognition from Online News
Named Entity Recognition from Online News
 
Investment Fund Analytics
Investment Fund AnalyticsInvestment Fund Analytics
Investment Fund Analytics
 
Social Media World News Impact on Stock Index Values - Investment Fund Analyt...
Social Media World News Impact on Stock Index Values - Investment Fund Analyt...Social Media World News Impact on Stock Index Values - Investment Fund Analyt...
Social Media World News Impact on Stock Index Values - Investment Fund Analyt...
 
Social Media Analytics on Canadian Airlines
Social Media Analytics on Canadian AirlinesSocial Media Analytics on Canadian Airlines
Social Media Analytics on Canadian Airlines
 
#FluxFlow
#FluxFlow#FluxFlow
#FluxFlow
 
Introduction to knime
Introduction to knimeIntroduction to knime
Introduction to knime
 
Toastmasters speech #7 - Research your Subject
Toastmasters speech #7  - Research your SubjectToastmasters speech #7  - Research your Subject
Toastmasters speech #7 - Research your Subject
 
Toastmasters project #5 - Just a jump
Toastmasters project #5  - Just a jumpToastmasters project #5  - Just a jump
Toastmasters project #5 - Just a jump
 
What is lomography?
What is lomography?What is lomography?
What is lomography?
 
Plethora
PlethoraPlethora
Plethora
 

Business Intelligence Presentation - Data Mining (2/2)

  • 1. Business Intelligence Data Mining (Part 2 of 2)
  • 3. How far can I go? • Storing and analyzing historical data you can see just one part of reality (the past and the present) • Is there a way to answer questions not yet made? Can I look into the future? • Can I predict how my business is going to work? What about the market? And my customers?
  • 4. Data Mining • Is a process to extract patterns from data • “We’re drowning in data but information thirsty” • Data Mining borrows techniques from statistics, probability, maths, artificial intelligence and other fields
  • 5. Business Problems • Recommendations • Anomaly Detection • Customer abandon analysis • Risk Management • Customer segmentation • Targeted advertising • Projections
  • 6. Data Mining Tasks • Classification • Estimation / Regression • Prediction / Projection (Forecasting) • Association Rules / Affinity Groups • Clusterization
  • 7. Predictive Models • Classifications • Discrete value prediction • Yes, No • High, Medium, Low • Estimation / Regression • Continuous value prediction • Amounts • Numbers • Projection / Forecasting
  • 8. Descriptive Models • Association Rules / Affinity • Looks for correlation indexes among diverse associated elements • Market Basket Analysis • Clusterization • Groups items according to similarity • “Automatic” classification
  • 9. Work Cycle Transform Data to Information Identify Business Opportunities Act with Information Measure Results
  • 10. Data Mining and DWh • The Data Warehsouse unifies diverse data sources in one common repository • Before the DM process, you must have reliable data sources • Data must be presented in a way that eases analysis
  • 11. Project Cycle • Business Problem Formulation • Data Gathering • Data transformation and cleansing • Model Construction • Model Evaluation • Reports and Prediction • Application Integration • Model Management
  • 12. What is a Model? • The model is a set of conclusions reached (in mathematical format) after data processing • Is used to extract knowledge and to compare it to new data to reach to new conclusions • It has some efficency percentage • Must be adjusted to make helpful predictions • It is time-constrainted
  • 13. Cases Outlook Temperature (C) Humidity Wind Play Golf? Sunny 29.4 85% NO No Sunny 26.6 90% YES No Overcast 28.3 78% NO Yes Rainy 21.1 96% NO Yes Rainy 20.0 80% NO Yes Rainy 18.3 70% YES No Overcast 17.7 65% YES Yes Sunny 22.2 95% NO No Sunny 20.5 70% NO Yes Rainy 23.8 80% NO Yes Sunny 23.8 70% YES Yes Overcast 22.2 90% YES Yes Overcast 27.2 75% NO Yes Rainy 21.6 80% YES No
  • 14. Model Outlook Overcast Rainy Sunny YES Wind Humidity NO YES <=77.5 >77.5 YES NO YES NO
  • 15. Data Mining Algorithms • Naive Bayes • Decission Trees • Autoregression trees (ARTxp and ARIMA) • K-Means • Kohonen Maps • Neural Networks • Logistic regression • Time Series
  • 16. Where can I use them? • Marketing: Segmentation, Campaigns, Results, Loyalty,... • Sales: Behaviour detection, Sales habits • Finances: Investments, Portfolio Management • Banks and Assurance: Credit Check • Security: Fraud Detection • Medicine: Possible treatment analysis • Manufacturing: Quality Control • Internet: Click analysis, Text Mining
  • 17. Data Mining and CRM (1) • Detect the best prospect / customers • Select the best communication channel for prospects / customers • Select an appropriate message to prospects / customers • Cross-selling, Up-selling and sales recommendation engines
  • 18. Data Mining and CRM (2) • Improve direct marketing campaign results • Customer base segmentation • Reduce credit risk exposure • Customer Lifetime Value • Customer retention and loss
  • 19. Clustering • “Self” Customer Segmentation • Descriptive Characteristics • Behavioural Characteristics • Relationship • Purchases • Payments
  • 20. Classification • Customers by purchase behaviour • Customers by payment behaviour • Customers by resources devoted/needed to their service • Customers by credit profile • Customers by attention required
  • 21. Association Rules • Market Basket Analysis • Cross Selling • Up Selling
  • 22. Prediction / Forecasting • Revenue Projection • Payment Projection • Number of Products sold Projection • Cash Flow Projection
  • 23. Some other DM cases • Key Influencers • Predictions Calculator
  • 24. Some Possible Problems (1) • To learn things that are not true • The patterns may not represent any underlying rule • The model may not represent a relevant number of examples • Data may be in a detail level not enough for analysis
  • 25. Possible Problems... (1I) • To learn things that are true, but not useful • Learn things that we already knew • Learn things that cannot be applied