SlideShare a Scribd company logo
1 of 39
The issus I’ll make focus 
on… 
 What is data ware house? 
 Architecture of data ware house? 
 Olap server and its various types and 
their working? 
 Data marts?
What is this 
dataware 
house all 
about ??
A data warehouse is a 
Subject-oriented ->DATABASE AND DATAWARE HOUSE ARE 2 
DIFFERENT THINGS SO DIFFERENT APPROACH S OF STORING DATA INTO THEM . 
Integrated -> BRINGING INTO A COMMON FORMAT 
Time-varying ->HISTORICAL DATA ,DATE ASSOCIATED WITH TIME 
Non-volatile -> UNDELETABLE AND NON UPDATABLE FORMAT 
collection of data that is used 
primarily in organizational decision 
making.
Subject oriented?? 
5 
Operational Database 
Application -orientation 
Order 
processing 
Saving account 
Data ware house 
Subject-orientation 
sales 
account 
Stock mgmt 
Billing 
Current account 
Loan account 
Business 
Bank
Explanation 
 As we can see in both business and bank example the 
databases store the data application wise . It simply 
means that for every operational application of the 
organization there is a storage associated in which 
that application specific data are stored. These 
storages are called database. 
 But in the case of data ware house of the organization 
the data are stored subject wise , this subject is most 
important aspect of the organization . for bank 
account is important for business sale is important
Integrated ?? 
•Data in DW comes from several operational systems. 
•Different datasets in these operational system have different file formats. 
•Example: Data for subject Account comes from 3 different data 
sources.(AS SHOWN IN FIGURE) 
Account 
savings 
current 
Loan 
Subject = account 
Operational environment
o So variations could be there, like: 
1. Naming conventions could be different. 
Example: Saving account no. could be of 8 bytes long but only 6 bytes for 
checking accounts. 
1. Number of total Attributes for data items could be different. 
Example :saving account can have 5 attribute while checking account can 
have 7 attribute associated with it.
Time variant?? 
Data warehouse 
 The operational database stores only current data but the data 
ware house stores all present as well as past data in order to full fill 
its purposes. 
 Data is stored as series of snapshots each representing a period of 
time. 
 Data is tagged with some element of time - creation date, as of 
date, etc. 
 Data is available on-line for long periods of time for trend analysis 
and forecasting. For example, five or more years
Non-volatile?? 
Data from operational systems are moved into DW after specific 
intervals.(process is called refreashing) 
 Business transaction don’t update in Data ware house. 
Data from Data ware house is not deleted.
The 3 tier architecture of Data Ware 
house--- 
•When all the components of the system are combined together to 
form the complete system then the style of designing(combining) of 
that structure is known as the architecture of the system.(ex-the 
architecture of a school building). 
•In data ware house the components are- 
1. Data acquisition 
2. Data storage 
3. Data processing 
4. Data delivery 
Layers(ex. Osi reference model in computer network ) means the 
system is made by logically separated components and tier means 
the system is made by physically separated components.
The various possible architecture 
while dealing with database: 
Hare database (in the 
form of files) is itself 
stored in the client 
computer. 
Hare database server is 
present in the distant 
place and client machine 
and database are 
connected via network.
Here between the client 
machine and the database 
server we have included an 
application server which is 
mainly at server side and does 
the processing and return 
results to the client machine.
conclusions 
Tiers 
Security 
Maintainability 
No . Of users 
Speed 
cost
The architecture of data ware house 
Data tier logic tier presentation 
Information Sources Data Warehouse 
Server 
(Tier 1) 
OLAP Servers 
(Tier 2) 
Clients 
(Tier 3) 
External 
sources 
Operational 
DB’s 
extract 
transform 
load 
Data 
Warehous 
e 
Data Marts 
MOLAP 
serve 
ROLAP 
OLAP 
Query/Report 
ing 
Data Mining 
serve 
serve 
tier
The bottom most: 
Operational databases 
External sourse 
•These are the application 
specific database which are 
used to store all the daily 
basis transactional data of 
the organization. 
•This is the database which 
is used to store all 
important external 
information.
Database vs. data ware house 
OLTP (on-line transaction processing) 
 Major task of traditional relational DBMS 
 Day-to-day operations: purchasing, inventory, 
banking, manufacturing, payroll, registration, 
accounting, etc. 
 OLAP (on-line analytical processing) 
 Major task of data warehouse system. 
 Data analysis and decision making. 
 Forecasting, monitoring of business.
How loading is done of the 
Warehouse?? 
This is done using back end tools. To 
know about back end tools go to the next 
page.
Data extraction: 
get data from multiple, heterogeneous, and external sources. 
Data cleaning: 
correcting values. 
Data transformation: 
converting from one format to another format. (pond kg , 
age dob) 
Load: 
summarize tables are loaded into data ware house. 
Refresh: 
propagate the updates from the data sources to the warehouse.
Tier 1 :data ware house 
 It is the data ware house that is 
loaded with strategy making 
information. 
 This tier also consists of data marts.
Tier 2 
 This tier consists of Olap server which 
are used for the processing purposes. Here 
the following issues are also handled— 
 Security of data.(you are not letting user directly communicate 
with data base) 
 Business logic(here you can decide what kind of information to be 
shown to a particular kind of query ). 
 Translation(users high level query are converted into low level sql 
query). 
 Intermediate calculations(removes burden from user 
interface and database )
Olap server 
Rolap server Molap server 
Choose this if space is 
important for you 
Choose this if time is 
important for you
HOW DOES ROLAP 
WORK??
Multi dimensional 
view 
Desktop 
client 
Rolap server 
Creating data cube 
dynamically (on the 
fly) 
Rdbms 
server 
Data 
ware 
house 
ROLAP
DETAILS 
 Relational online analytical processing (ROLAP) is a 
form of online analytical processing (olap) that 
performs multidimensional analysis of data which is 
stored in a relational database rather than in 
a multidimensional database. 
 In a three-tiered architecture, the user submits a 
request for multidimensional analysis and the ROLAP 
engine converts the request to SQL for submission to 
the relational database. Then the operation is 
performed in reverse: the engine converts the 
resulting data from SQL to a multidimensional 
format(on the fly) before it is returned to the client 
for viewing.
Add up total sale amount by day 
In SQL: SELECT date, sum(amt) FROM 
SALE GROUP BY date 
ans date sum 
1 81 
2 48 
sale prodId storeId date amt 
p1 s1 1 12 
p2 s1 1 11 
p1 s3 1 50 
p2 s2 1 8 
p1 s1 2 44 
p1 s2 2 4 
QUERY
HOW DOES MOLAP 
WORK??
Multi dimensional 
view 
Desktop 
client 
Molap server 
Rdbms 
server 
Data 
ware 
house 
Multidimensional database 
Molap
POINTS ABOUT MOLAP: 
 Here we use Multidimensional database for the 
purpose of data fetching when an analytical query is 
submitted by user. 
 Facts (fact table)are stored in multi-dimensional 
arrays. 
 Dimensions(dimension table) used to index the arrays. 
 One of the major distinctions of molap against a rolap 
tool is that data are pre-summarized pre-calculated and 
are stored in an optimized format in a multidimensional 
cube, instead of in a relational database , in accordance 
with a client’s reporting requirements .
MOLAP is more optimized for fast query performance and 
retrieval of summarized information. 
There are certain limitations to implementation of a MOLAP system, one 
primary weakness of which is that MOLAP tool is less scalable than a 
ROLAP tool as the former is capable of handling only a limited amount of 
data. 
Pre-calculating or pre-consolidating transactional data improves speed.
The MOLAP Cube 
Add up total sale amount by day 
Fact table view: Multi-dimensional cube: 
sale prodId storeId amt 
p1 s1 12 
p2 s1 11 
p1 s3 50 
p2 s2 8 
s1 s2 s3 
p1 12 50 
p2 11 8 
dimensions = 2
Add up total sale amount by day 
Fact table view: Multi-dimensional cube: 
dimensions = 3 
sale prodId storeId date amt 
p1 s1 1 12 
p2 s1 1 11 
p1 s3 1 50 
p2 s2 1 8 
p1 s1 2 44 
p1 s2 2 4 
day 2 s1 s2 s3 
p1 44 4 
p2 
s1 s2 s3 
p1 12 50 
p2 11 8 
day 1
The total sale of of computers in year 2008 at the location asia is 200 unit 
The total sale of of books in year 2008 at the location Europe is 200
Hybrid OLAP (HOLAP) 
 HOLAP = Hybrid OLAP: 
 Best of both worlds 
 Storing detailed data in RDBMS 
 Storing aggregated data in MDBMS 
 User access via MOLAP tools
Data Flow in HOLAP 
MDBMS Server Client 
Multi-dimensiona 
l access Multidimensiona 
l Viewer 
Relational 
Viewer 
Multi-dimension 
aldata 
SQL-Read 
RDBMS Server 
User 
data Meta data 
Derived 
data 
SQL-Reach 
Through 
SQL-Read
Pie chart 
reports 
Front end tools 
Mobile phone 
computer 
Query result Graphs Bar chart
Data mart 
37
THANK 
YOU

More Related Content

What's hot

Seminar datawarehousing
Seminar datawarehousingSeminar datawarehousing
Seminar datawarehousingKavisha Uniyal
 
Dimensional Modeling
Dimensional ModelingDimensional Modeling
Dimensional ModelingSunita Sahu
 
Introduction Data warehouse
Introduction Data warehouseIntroduction Data warehouse
Introduction Data warehouseAmin Choroomi
 
Star ,Snow and Fact-Constullation Schemas??
Star ,Snow and  Fact-Constullation Schemas??Star ,Snow and  Fact-Constullation Schemas??
Star ,Snow and Fact-Constullation Schemas??Abdul Aslam
 
Data Warehouse Modeling
Data Warehouse ModelingData Warehouse Modeling
Data Warehouse Modelingvivekjv
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data WarehousingEdureka!
 
Introduction to data warehousing
Introduction to data warehousing   Introduction to data warehousing
Introduction to data warehousing Girish Dhareshwar
 
Lect 08 materialized view
Lect 08 materialized viewLect 08 materialized view
Lect 08 materialized viewBilal khan
 
Tableau 2018 - Introduction to Visual analytics
Tableau 2018 - Introduction to Visual analyticsTableau 2018 - Introduction to Visual analytics
Tableau 2018 - Introduction to Visual analyticsArun K
 
Data Visualization
Data VisualizationData Visualization
Data Visualizationgzargary
 
Data warehouse concepts
Data warehouse conceptsData warehouse concepts
Data warehouse conceptsobieefans
 
Project Presentation on Data WareHouse
Project Presentation on Data WareHouseProject Presentation on Data WareHouse
Project Presentation on Data WareHouseAbhi Bhardwaj
 

What's hot (20)

Seminar datawarehousing
Seminar datawarehousingSeminar datawarehousing
Seminar datawarehousing
 
Dimensional Modeling
Dimensional ModelingDimensional Modeling
Dimensional Modeling
 
Introduction Data warehouse
Introduction Data warehouseIntroduction Data warehouse
Introduction Data warehouse
 
Data warehouse
Data warehouseData warehouse
Data warehouse
 
Data modelling 101
Data modelling 101Data modelling 101
Data modelling 101
 
Star ,Snow and Fact-Constullation Schemas??
Star ,Snow and  Fact-Constullation Schemas??Star ,Snow and  Fact-Constullation Schemas??
Star ,Snow and Fact-Constullation Schemas??
 
Data Warehouse Designing: Dimensional Modelling and E-R Modelling
Data Warehouse Designing: Dimensional Modelling and E-R ModellingData Warehouse Designing: Dimensional Modelling and E-R Modelling
Data Warehouse Designing: Dimensional Modelling and E-R Modelling
 
Data warehouse
Data warehouseData warehouse
Data warehouse
 
Data Warehouse Modeling
Data Warehouse ModelingData Warehouse Modeling
Data Warehouse Modeling
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data Warehousing
 
Introduction to data warehousing
Introduction to data warehousing   Introduction to data warehousing
Introduction to data warehousing
 
Lect 08 materialized view
Lect 08 materialized viewLect 08 materialized view
Lect 08 materialized view
 
Tableau 2018 - Introduction to Visual analytics
Tableau 2018 - Introduction to Visual analyticsTableau 2018 - Introduction to Visual analytics
Tableau 2018 - Introduction to Visual analytics
 
Data warehouse
Data warehouse Data warehouse
Data warehouse
 
Data Visualization
Data VisualizationData Visualization
Data Visualization
 
Data warehouse concepts
Data warehouse conceptsData warehouse concepts
Data warehouse concepts
 
Project Presentation on Data WareHouse
Project Presentation on Data WareHouseProject Presentation on Data WareHouse
Project Presentation on Data WareHouse
 
ETL Process
ETL ProcessETL Process
ETL Process
 
Introduction to ETL and Data Integration
Introduction to ETL and Data IntegrationIntroduction to ETL and Data Integration
Introduction to ETL and Data Integration
 
Ppt
PptPpt
Ppt
 

Viewers also liked

Data warehouse architecture
Data warehouse architectureData warehouse architecture
Data warehouse architecturepcherukumalla
 
DATA WAREHOUSING
DATA WAREHOUSINGDATA WAREHOUSING
DATA WAREHOUSINGKing Julian
 
Components of a Data-Warehouse
Components of a Data-WarehouseComponents of a Data-Warehouse
Components of a Data-WarehouseAbdul Aslam
 
CV - SARFRAZ BIN ZUBAIR - FOR CENTRAL WARE HOUSE
CV - SARFRAZ BIN ZUBAIR -  FOR CENTRAL  WARE HOUSECV - SARFRAZ BIN ZUBAIR -  FOR CENTRAL  WARE HOUSE
CV - SARFRAZ BIN ZUBAIR - FOR CENTRAL WARE HOUSESarfraz Zubair
 
Shri hanuman chalisa_telugu
Shri hanuman chalisa_teluguShri hanuman chalisa_telugu
Shri hanuman chalisa_teluguabhiram403
 
DWH Modeling Approaches
DWH Modeling ApproachesDWH Modeling Approaches
DWH Modeling ApproachesIgor Bralgin
 
Home Delivery Scheme of Foodgrains
Home Delivery Scheme of FoodgrainsHome Delivery Scheme of Foodgrains
Home Delivery Scheme of FoodgrainsSheetal Kachare
 
Datawarehouse & bi introduction
Datawarehouse & bi introductionDatawarehouse & bi introduction
Datawarehouse & bi introductionShivmohan Purohit
 
Mesa a Great Destination Presentation
Mesa a Great Destination PresentationMesa a Great Destination Presentation
Mesa a Great Destination PresentationJames Tevault
 
Teradata Apps Salesforce Quick Overview for SI's 2013 v4
Teradata Apps Salesforce Quick Overview for SI's 2013 v4Teradata Apps Salesforce Quick Overview for SI's 2013 v4
Teradata Apps Salesforce Quick Overview for SI's 2013 v4Motheral
 
Aprimo Solutions Overview
Aprimo Solutions OverviewAprimo Solutions Overview
Aprimo Solutions OverviewInformatica
 
Print Service Providers - Centripetal Marketing
Print Service Providers - Centripetal MarketingPrint Service Providers - Centripetal Marketing
Print Service Providers - Centripetal MarketingMotheral
 
Lecture 02 - The Data Warehouse Environment
Lecture 02 - The Data Warehouse Environment Lecture 02 - The Data Warehouse Environment
Lecture 02 - The Data Warehouse Environment phanleson
 
My Sql Data Migration
My Sql Data MigrationMy Sql Data Migration
My Sql Data MigrationAnil Yadav
 
Aprimo 7.5 Modules Box Pictures Cgb
Aprimo 7.5 Modules Box Pictures   CgbAprimo 7.5 Modules Box Pictures   Cgb
Aprimo 7.5 Modules Box Pictures Cgbcguisebrown
 
Data ware house design
Data ware house designData ware house design
Data ware house designSayed Ahmed
 

Viewers also liked (20)

Data warehouse architecture
Data warehouse architectureData warehouse architecture
Data warehouse architecture
 
Data ware house
Data ware houseData ware house
Data ware house
 
DATA WAREHOUSING
DATA WAREHOUSINGDATA WAREHOUSING
DATA WAREHOUSING
 
Data-ware Housing
Data-ware HousingData-ware Housing
Data-ware Housing
 
Components of a Data-Warehouse
Components of a Data-WarehouseComponents of a Data-Warehouse
Components of a Data-Warehouse
 
CV - SARFRAZ BIN ZUBAIR - FOR CENTRAL WARE HOUSE
CV - SARFRAZ BIN ZUBAIR -  FOR CENTRAL  WARE HOUSECV - SARFRAZ BIN ZUBAIR -  FOR CENTRAL  WARE HOUSE
CV - SARFRAZ BIN ZUBAIR - FOR CENTRAL WARE HOUSE
 
Shri hanuman chalisa_telugu
Shri hanuman chalisa_teluguShri hanuman chalisa_telugu
Shri hanuman chalisa_telugu
 
DWH Modeling Approaches
DWH Modeling ApproachesDWH Modeling Approaches
DWH Modeling Approaches
 
Home Delivery Scheme of Foodgrains
Home Delivery Scheme of FoodgrainsHome Delivery Scheme of Foodgrains
Home Delivery Scheme of Foodgrains
 
Datawarehouse & bi introduction
Datawarehouse & bi introductionDatawarehouse & bi introduction
Datawarehouse & bi introduction
 
Mesa a Great Destination Presentation
Mesa a Great Destination PresentationMesa a Great Destination Presentation
Mesa a Great Destination Presentation
 
Teradata Apps Salesforce Quick Overview for SI's 2013 v4
Teradata Apps Salesforce Quick Overview for SI's 2013 v4Teradata Apps Salesforce Quick Overview for SI's 2013 v4
Teradata Apps Salesforce Quick Overview for SI's 2013 v4
 
Aprimo Solutions Overview
Aprimo Solutions OverviewAprimo Solutions Overview
Aprimo Solutions Overview
 
Print Service Providers - Centripetal Marketing
Print Service Providers - Centripetal MarketingPrint Service Providers - Centripetal Marketing
Print Service Providers - Centripetal Marketing
 
Lecture 02 - The Data Warehouse Environment
Lecture 02 - The Data Warehouse Environment Lecture 02 - The Data Warehouse Environment
Lecture 02 - The Data Warehouse Environment
 
Data warehousing
Data warehousingData warehousing
Data warehousing
 
My Sql Data Migration
My Sql Data MigrationMy Sql Data Migration
My Sql Data Migration
 
Aprimo 7.5 Modules Box Pictures Cgb
Aprimo 7.5 Modules Box Pictures   CgbAprimo 7.5 Modules Box Pictures   Cgb
Aprimo 7.5 Modules Box Pictures Cgb
 
Data ware house design
Data ware house designData ware house design
Data ware house design
 
Godown management
Godown managementGodown management
Godown management
 

Similar to Data ware house architecture

86921864 olap-case-study-vj
86921864 olap-case-study-vj86921864 olap-case-study-vj
86921864 olap-case-study-vjhomeworkping4
 
SAP BODS -quick guide.docx
SAP BODS -quick guide.docxSAP BODS -quick guide.docx
SAP BODS -quick guide.docxKen T
 
Informatica and datawarehouse Material
Informatica and datawarehouse MaterialInformatica and datawarehouse Material
Informatica and datawarehouse Materialobieefans
 
Unit-IV-Introduction to Data Warehousing .pptx
Unit-IV-Introduction to Data Warehousing .pptxUnit-IV-Introduction to Data Warehousing .pptx
Unit-IV-Introduction to Data Warehousing .pptxHarsha Patel
 
Informatica Interview Questions & Answers
Informatica Interview Questions & AnswersInformatica Interview Questions & Answers
Informatica Interview Questions & AnswersZaranTech LLC
 
UNIT-5 DATA WAREHOUSING.docx
UNIT-5 DATA WAREHOUSING.docxUNIT-5 DATA WAREHOUSING.docx
UNIT-5 DATA WAREHOUSING.docxDURGADEVIL
 
OLAP Cubes in Datawarehousing
OLAP Cubes in DatawarehousingOLAP Cubes in Datawarehousing
OLAP Cubes in DatawarehousingPrithwis Mukerjee
 
Online analytical processing
Online analytical processingOnline analytical processing
Online analytical processingSamraiz Tejani
 
What is OLAP -Data Warehouse Concepts - IT Online Training @ Newyorksys
What is OLAP -Data Warehouse Concepts - IT Online Training @ NewyorksysWhat is OLAP -Data Warehouse Concepts - IT Online Training @ Newyorksys
What is OLAP -Data Warehouse Concepts - IT Online Training @ NewyorksysNEWYORKSYS-IT SOLUTIONS
 
DWDM Unit 1 (1).pptx
DWDM Unit 1 (1).pptxDWDM Unit 1 (1).pptx
DWDM Unit 1 (1).pptxSalehaMariyam
 
Datawarehouse Overview
Datawarehouse OverviewDatawarehouse Overview
Datawarehouse Overviewashok kumar
 
Datawarehousing & DSS
Datawarehousing & DSSDatawarehousing & DSS
Datawarehousing & DSSDeepali Raut
 

Similar to Data ware house architecture (20)

Dwh faqs
Dwh faqsDwh faqs
Dwh faqs
 
3 OLAP.pptx
3 OLAP.pptx3 OLAP.pptx
3 OLAP.pptx
 
bi notes.docx
bi notes.docxbi notes.docx
bi notes.docx
 
Data Management
Data ManagementData Management
Data Management
 
86921864 olap-case-study-vj
86921864 olap-case-study-vj86921864 olap-case-study-vj
86921864 olap-case-study-vj
 
SAP BODS -quick guide.docx
SAP BODS -quick guide.docxSAP BODS -quick guide.docx
SAP BODS -quick guide.docx
 
Informatica and datawarehouse Material
Informatica and datawarehouse MaterialInformatica and datawarehouse Material
Informatica and datawarehouse Material
 
Unit-IV-Introduction to Data Warehousing .pptx
Unit-IV-Introduction to Data Warehousing .pptxUnit-IV-Introduction to Data Warehousing .pptx
Unit-IV-Introduction to Data Warehousing .pptx
 
3dw
3dw3dw
3dw
 
Informatica Interview Questions & Answers
Informatica Interview Questions & AnswersInformatica Interview Questions & Answers
Informatica Interview Questions & Answers
 
3dw
3dw3dw
3dw
 
Chapter 2
Chapter 2Chapter 2
Chapter 2
 
UNIT-5 DATA WAREHOUSING.docx
UNIT-5 DATA WAREHOUSING.docxUNIT-5 DATA WAREHOUSING.docx
UNIT-5 DATA WAREHOUSING.docx
 
OLAP Cubes in Datawarehousing
OLAP Cubes in DatawarehousingOLAP Cubes in Datawarehousing
OLAP Cubes in Datawarehousing
 
Data Warehouse
Data Warehouse Data Warehouse
Data Warehouse
 
Online analytical processing
Online analytical processingOnline analytical processing
Online analytical processing
 
What is OLAP -Data Warehouse Concepts - IT Online Training @ Newyorksys
What is OLAP -Data Warehouse Concepts - IT Online Training @ NewyorksysWhat is OLAP -Data Warehouse Concepts - IT Online Training @ Newyorksys
What is OLAP -Data Warehouse Concepts - IT Online Training @ Newyorksys
 
DWDM Unit 1 (1).pptx
DWDM Unit 1 (1).pptxDWDM Unit 1 (1).pptx
DWDM Unit 1 (1).pptx
 
Datawarehouse Overview
Datawarehouse OverviewDatawarehouse Overview
Datawarehouse Overview
 
Datawarehousing & DSS
Datawarehousing & DSSDatawarehousing & DSS
Datawarehousing & DSS
 

Recently uploaded

CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete RecordCCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete RecordAsst.prof M.Gokilavani
 
KubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghlyKubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghlysanyuktamishra911
 
Coefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxCoefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxAsutosh Ranjan
 
The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...
The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...
The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...ranjana rawat
 
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...ranjana rawat
 
Online banking management system project.pdf
Online banking management system project.pdfOnline banking management system project.pdf
Online banking management system project.pdfKamal Acharya
 
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...roncy bisnoi
 
Introduction and different types of Ethernet.pptx
Introduction and different types of Ethernet.pptxIntroduction and different types of Ethernet.pptx
Introduction and different types of Ethernet.pptxupamatechverse
 
MANUFACTURING PROCESS-II UNIT-1 THEORY OF METAL CUTTING
MANUFACTURING PROCESS-II UNIT-1 THEORY OF METAL CUTTINGMANUFACTURING PROCESS-II UNIT-1 THEORY OF METAL CUTTING
MANUFACTURING PROCESS-II UNIT-1 THEORY OF METAL CUTTINGSIVASHANKAR N
 
Porous Ceramics seminar and technical writing
Porous Ceramics seminar and technical writingPorous Ceramics seminar and technical writing
Porous Ceramics seminar and technical writingrakeshbaidya232001
 
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...ranjana rawat
 
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...ranjana rawat
 
UNIT-II FMM-Flow Through Circular Conduits
UNIT-II FMM-Flow Through Circular ConduitsUNIT-II FMM-Flow Through Circular Conduits
UNIT-II FMM-Flow Through Circular Conduitsrknatarajan
 
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 BookingVIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Bookingdharasingh5698
 
UNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its PerformanceUNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its Performancesivaprakash250
 
Processing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxProcessing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxpranjaldaimarysona
 
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...Dr.Costas Sachpazis
 
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSMANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSSIVASHANKAR N
 
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...Call Girls in Nagpur High Profile
 
AKTU Computer Networks notes --- Unit 3.pdf
AKTU Computer Networks notes ---  Unit 3.pdfAKTU Computer Networks notes ---  Unit 3.pdf
AKTU Computer Networks notes --- Unit 3.pdfankushspencer015
 

Recently uploaded (20)

CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete RecordCCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
CCS335 _ Neural Networks and Deep Learning Laboratory_Lab Complete Record
 
KubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghlyKubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghly
 
Coefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxCoefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptx
 
The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...
The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...
The Most Attractive Pune Call Girls Manchar 8250192130 Will You Miss This Cha...
 
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
 
Online banking management system project.pdf
Online banking management system project.pdfOnline banking management system project.pdf
Online banking management system project.pdf
 
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
 
Introduction and different types of Ethernet.pptx
Introduction and different types of Ethernet.pptxIntroduction and different types of Ethernet.pptx
Introduction and different types of Ethernet.pptx
 
MANUFACTURING PROCESS-II UNIT-1 THEORY OF METAL CUTTING
MANUFACTURING PROCESS-II UNIT-1 THEORY OF METAL CUTTINGMANUFACTURING PROCESS-II UNIT-1 THEORY OF METAL CUTTING
MANUFACTURING PROCESS-II UNIT-1 THEORY OF METAL CUTTING
 
Porous Ceramics seminar and technical writing
Porous Ceramics seminar and technical writingPorous Ceramics seminar and technical writing
Porous Ceramics seminar and technical writing
 
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
 
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
 
UNIT-II FMM-Flow Through Circular Conduits
UNIT-II FMM-Flow Through Circular ConduitsUNIT-II FMM-Flow Through Circular Conduits
UNIT-II FMM-Flow Through Circular Conduits
 
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 BookingVIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
 
UNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its PerformanceUNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its Performance
 
Processing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxProcessing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptx
 
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
 
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSMANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
 
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
 
AKTU Computer Networks notes --- Unit 3.pdf
AKTU Computer Networks notes ---  Unit 3.pdfAKTU Computer Networks notes ---  Unit 3.pdf
AKTU Computer Networks notes --- Unit 3.pdf
 

Data ware house architecture

  • 1.
  • 2. The issus I’ll make focus on…  What is data ware house?  Architecture of data ware house?  Olap server and its various types and their working?  Data marts?
  • 3. What is this dataware house all about ??
  • 4. A data warehouse is a Subject-oriented ->DATABASE AND DATAWARE HOUSE ARE 2 DIFFERENT THINGS SO DIFFERENT APPROACH S OF STORING DATA INTO THEM . Integrated -> BRINGING INTO A COMMON FORMAT Time-varying ->HISTORICAL DATA ,DATE ASSOCIATED WITH TIME Non-volatile -> UNDELETABLE AND NON UPDATABLE FORMAT collection of data that is used primarily in organizational decision making.
  • 5. Subject oriented?? 5 Operational Database Application -orientation Order processing Saving account Data ware house Subject-orientation sales account Stock mgmt Billing Current account Loan account Business Bank
  • 6. Explanation  As we can see in both business and bank example the databases store the data application wise . It simply means that for every operational application of the organization there is a storage associated in which that application specific data are stored. These storages are called database.  But in the case of data ware house of the organization the data are stored subject wise , this subject is most important aspect of the organization . for bank account is important for business sale is important
  • 7. Integrated ?? •Data in DW comes from several operational systems. •Different datasets in these operational system have different file formats. •Example: Data for subject Account comes from 3 different data sources.(AS SHOWN IN FIGURE) Account savings current Loan Subject = account Operational environment
  • 8. o So variations could be there, like: 1. Naming conventions could be different. Example: Saving account no. could be of 8 bytes long but only 6 bytes for checking accounts. 1. Number of total Attributes for data items could be different. Example :saving account can have 5 attribute while checking account can have 7 attribute associated with it.
  • 9. Time variant?? Data warehouse  The operational database stores only current data but the data ware house stores all present as well as past data in order to full fill its purposes.  Data is stored as series of snapshots each representing a period of time.  Data is tagged with some element of time - creation date, as of date, etc.  Data is available on-line for long periods of time for trend analysis and forecasting. For example, five or more years
  • 10. Non-volatile?? Data from operational systems are moved into DW after specific intervals.(process is called refreashing)  Business transaction don’t update in Data ware house. Data from Data ware house is not deleted.
  • 11. The 3 tier architecture of Data Ware house--- •When all the components of the system are combined together to form the complete system then the style of designing(combining) of that structure is known as the architecture of the system.(ex-the architecture of a school building). •In data ware house the components are- 1. Data acquisition 2. Data storage 3. Data processing 4. Data delivery Layers(ex. Osi reference model in computer network ) means the system is made by logically separated components and tier means the system is made by physically separated components.
  • 12. The various possible architecture while dealing with database: Hare database (in the form of files) is itself stored in the client computer. Hare database server is present in the distant place and client machine and database are connected via network.
  • 13. Here between the client machine and the database server we have included an application server which is mainly at server side and does the processing and return results to the client machine.
  • 14. conclusions Tiers Security Maintainability No . Of users Speed cost
  • 15. The architecture of data ware house Data tier logic tier presentation Information Sources Data Warehouse Server (Tier 1) OLAP Servers (Tier 2) Clients (Tier 3) External sources Operational DB’s extract transform load Data Warehous e Data Marts MOLAP serve ROLAP OLAP Query/Report ing Data Mining serve serve tier
  • 16. The bottom most: Operational databases External sourse •These are the application specific database which are used to store all the daily basis transactional data of the organization. •This is the database which is used to store all important external information.
  • 17. Database vs. data ware house OLTP (on-line transaction processing)  Major task of traditional relational DBMS  Day-to-day operations: purchasing, inventory, banking, manufacturing, payroll, registration, accounting, etc.  OLAP (on-line analytical processing)  Major task of data warehouse system.  Data analysis and decision making.  Forecasting, monitoring of business.
  • 18. How loading is done of the Warehouse?? This is done using back end tools. To know about back end tools go to the next page.
  • 19. Data extraction: get data from multiple, heterogeneous, and external sources. Data cleaning: correcting values. Data transformation: converting from one format to another format. (pond kg , age dob) Load: summarize tables are loaded into data ware house. Refresh: propagate the updates from the data sources to the warehouse.
  • 20. Tier 1 :data ware house  It is the data ware house that is loaded with strategy making information.  This tier also consists of data marts.
  • 21. Tier 2  This tier consists of Olap server which are used for the processing purposes. Here the following issues are also handled—  Security of data.(you are not letting user directly communicate with data base)  Business logic(here you can decide what kind of information to be shown to a particular kind of query ).  Translation(users high level query are converted into low level sql query).  Intermediate calculations(removes burden from user interface and database )
  • 22. Olap server Rolap server Molap server Choose this if space is important for you Choose this if time is important for you
  • 23. HOW DOES ROLAP WORK??
  • 24. Multi dimensional view Desktop client Rolap server Creating data cube dynamically (on the fly) Rdbms server Data ware house ROLAP
  • 25. DETAILS  Relational online analytical processing (ROLAP) is a form of online analytical processing (olap) that performs multidimensional analysis of data which is stored in a relational database rather than in a multidimensional database.  In a three-tiered architecture, the user submits a request for multidimensional analysis and the ROLAP engine converts the request to SQL for submission to the relational database. Then the operation is performed in reverse: the engine converts the resulting data from SQL to a multidimensional format(on the fly) before it is returned to the client for viewing.
  • 26. Add up total sale amount by day In SQL: SELECT date, sum(amt) FROM SALE GROUP BY date ans date sum 1 81 2 48 sale prodId storeId date amt p1 s1 1 12 p2 s1 1 11 p1 s3 1 50 p2 s2 1 8 p1 s1 2 44 p1 s2 2 4 QUERY
  • 27. HOW DOES MOLAP WORK??
  • 28. Multi dimensional view Desktop client Molap server Rdbms server Data ware house Multidimensional database Molap
  • 29. POINTS ABOUT MOLAP:  Here we use Multidimensional database for the purpose of data fetching when an analytical query is submitted by user.  Facts (fact table)are stored in multi-dimensional arrays.  Dimensions(dimension table) used to index the arrays.  One of the major distinctions of molap against a rolap tool is that data are pre-summarized pre-calculated and are stored in an optimized format in a multidimensional cube, instead of in a relational database , in accordance with a client’s reporting requirements .
  • 30. MOLAP is more optimized for fast query performance and retrieval of summarized information. There are certain limitations to implementation of a MOLAP system, one primary weakness of which is that MOLAP tool is less scalable than a ROLAP tool as the former is capable of handling only a limited amount of data. Pre-calculating or pre-consolidating transactional data improves speed.
  • 31. The MOLAP Cube Add up total sale amount by day Fact table view: Multi-dimensional cube: sale prodId storeId amt p1 s1 12 p2 s1 11 p1 s3 50 p2 s2 8 s1 s2 s3 p1 12 50 p2 11 8 dimensions = 2
  • 32. Add up total sale amount by day Fact table view: Multi-dimensional cube: dimensions = 3 sale prodId storeId date amt p1 s1 1 12 p2 s1 1 11 p1 s3 1 50 p2 s2 1 8 p1 s1 2 44 p1 s2 2 4 day 2 s1 s2 s3 p1 44 4 p2 s1 s2 s3 p1 12 50 p2 11 8 day 1
  • 33. The total sale of of computers in year 2008 at the location asia is 200 unit The total sale of of books in year 2008 at the location Europe is 200
  • 34. Hybrid OLAP (HOLAP)  HOLAP = Hybrid OLAP:  Best of both worlds  Storing detailed data in RDBMS  Storing aggregated data in MDBMS  User access via MOLAP tools
  • 35. Data Flow in HOLAP MDBMS Server Client Multi-dimensiona l access Multidimensiona l Viewer Relational Viewer Multi-dimension aldata SQL-Read RDBMS Server User data Meta data Derived data SQL-Reach Through SQL-Read
  • 36. Pie chart reports Front end tools Mobile phone computer Query result Graphs Bar chart
  • 38.