37. Data Mining and Business Intelligence Increasing potential to support business decisions End User Business Analyst Data Analyst DBA Making Decisions Data Presentation Visualization Techniques Data Mining Information Discovery Data Exploration OLAP, MDA Statistical Analysis, Querying and Reporting Data Warehouses / Data Marts Data Sources Paper, Files, Information Providers, Database Systems, OLTP
38.
39. Data Mining: Confluence of Multiple Disciplines Data Mining Database Technology Statistics Other Disciplines Information Science Machine Learning Visualization
40.
41.
42.
43. An OLAM Architecture Data Warehouse Meta Data MDDB OLAM Engine OLAP Engine User GUI API Data Cube API Database API Data cleaning Data integration Layer3 OLAP/OLAM Layer2 MDDB Layer1 Data Repository Layer4 User Interface Filtering&Integration Filtering Databases Mining query Mining result
44. DBMS, OLAP, and Data Mining Who will buy a mutual fund in the next 6 months and why? What is the average income of mutual fund buyers by region by year? Who purchased mutual funds in the last 3 years? Example question Induction (Build the model, apply it to new data, get the result) Multidimensional data modeling, Aggregation, Statistics Deduction (Ask the question, verify with data) Method Insight and Prediction Analysis Information Type of result Knowledge discovery of hidden patterns and insights Summaries, trends and forecasts Extraction of detailed and summary data Task Data Mining OLAP DBMS
45. Example of DBMS, OLAP and Data Mining: Weather Data DBMS: no true 91 71 rainy 14 yes false 75 81 overcast 13 yes true 90 72 overcast 12 yes true 70 75 sunny 11 yes false 80 75 rainy 10 yes false 70 69 sunny 9 no false 95 72 sunny 8 yes true 65 64 overcast 7 no true 70 65 rainy 6 yes false 80 68 rainy 5 yes false 96 70 rainy 4 yes false 86 83 overcast 3 no true 90 80 sunny 2 no false 85 85 sunny 1 play windy humidity temperature outlook Day