SlideShare une entreprise Scribd logo
1  sur  20
Building Data WareHouse
by Inmon
Chapter 09: Migration to the Architected Environment




                              http://it-slideshares.blogspot.com
9. Migration to the Architected
Environment
     1. A Migration Plan
     2.   The Feedback Loop
     3.   Strategic Considerations
     4.   Methodology and Migration
     5.   Summary




                             http://it-slideshares.blogspot.com
9.1 A Migration Plan
 Beginning point: Data Model -
  represents the information needs of
  the corporation.
 Data Model needs to identify at a
  minimum:
    ◦ Major subjects of the corporation
    ◦ Definition of the major subjects of the
      corporation
    ◦ Relationships between the major subjects
    ◦ Groupings of keys and attributes that
      more fully represent the major subjects
9.1 A Migration Plan (ct.)
 After having the corporate data
  model, the next activity is defining the
  system of record.
 It is nothing more than the identification
  of the “best” data that the corporation
  has:
    ◦   Most timely
    ◦   Most accurate
    ◦   Most complete
    ◦   Nearest to the external source
    ◦   Most structurally compatible
9.1 A Migration Plan (ct.)
9.1 A Migration Plan (ct.)
   Technological challenges in bringing
    the system-of-record data into the
    DW:
    ◦ A change in DBMS
    ◦ A change in operating systems
    ◦ The need to merge data from different
      DBMSs and operating systems
    ◦ The capture of the Web-based data in the
      Web logs
    ◦ A change in basic data formats
9.1 A Migration Plan (ct.)
 After the system of record is defined, the
  next step is to design the data
  warehouse.
 The following things need to be done:
    ◦ An element of time needs to be added to the
      key structure if one is not already present.
    ◦ All purely operational data needs to be
      eliminated.
    ◦ Referential integrity relationships need to be
      turned into artifacts.
    ◦ Derived data that is frequently needed is
      added to the design.
9.1 A Migration Plan (ct.)
9.1 A Migration Plan (ct.)
 After the data warehouse is
  designed, the next step is to design and
  build the interfaces between the system
  of record and the DW.
 Interfaces’ activities:
    ◦ Being an extract process
    ◦ Integration of data from the
      operational, application-oriented environment
    ◦ Alteration of the time basis of data
    ◦ Condensation of data
    ◦ Efficient scanning of the existing systems
      environment
9.1 A Migration Plan (ct.)
   Once the interface programs are
    designed and built, the next activity is
    to start the population of the first
    subject area:
    ◦ The first of the data is read in the legacy
      environment; and then it is captured and
      transported to the data warehouse
      environment.
    ◦ Directories are updated
    ◦ Metadata is created
    ◦ Indexes are made
                              http://it-slideshares.blogspot.com
9.1 A Migration Plan (ct.)


 Caution: If you
 wait for existing
 systems to be
 cleaned up, you
 will never build a
 data warehouse
9.2 The Feedback Loop
   At the heart of success in the long-term
    development of the data warehouse is the
    feedback loop between the data architect and
    the DSS analyst.
   The DSS analyst:
    ◦ uses the data warehouse as a basis for
      analysis
    ◦ conveys those requirements to the data
      architect
   The data architect:
    ◦ add data, delete data, alter data, and so forth
      based on the recommendations of the DSS
      analyst
                               http://it-slideshares.blogspot.com
9.2 The Feedback Loop
(ct.)




              http://it-slideshares.blogspot.com
9.3 Strategic
       Considerations
   The DW
    environment is
    designed and built
    for the purpose of
    supporting the DSS
    needs of the
    organization.




                         http://it-slideshares.blogspot.com
9.3 Strategic Considerations
     (ct.)
 Besides that, the
  corporation has
  operational needs
  as well.
 But the
  operational world
  is shown as being
  in a state of
  chaos.

                       http://it-slideshares.blogspot.com
9.3 Strategic Considerations
(ct.)
   The steps the data architect takes to
    restructure the operational
    environment:
    ◦   Create a ‘delta’ list
    ◦   The impact analysis
    ◦   Create the resource estimate
    ◦   All the preceding are packaged in a report
        that goes to information systems
        management.

                               http://it-slideshares.blogspot.com
9.3 Strategic Considerations
(ct.)
   Operation cleanup plan:
9.4 Methodology and Migration
 The methodology for the building of
  the data warehouse is called a spiral
  development methodology.
 The spiral methodology not only
  contains information about how to
  build a data warehouse, but also
  describes how to use the data
  warehouse.


                       http://it-slideshares.blogspot.com
9.4 Methodology and Migration
(ct.)
   The differences between the waterfall
    approach and the spiral approach:
9.5 Summary
 The starting point for the design of the data
  warehouse is the corporate data model,.
 The data warehouse is built iteratively.
 The development approach for the data
  warehouse environment is said to be an
  iterative or a spiral development approach.
 The feedback loop between the data
  architect and the end user is an important
  part of the migration process.


                           http://it-slideshares.blogspot.com

Contenu connexe

Similaire à Lecture 09 - Migration to the Architected Environment

CV2015_06_30 -NG van Zyl
CV2015_06_30 -NG van ZylCV2015_06_30 -NG van Zyl
CV2015_06_30 -NG van Zyl
Gerhard van Zyl
 
IOUG93 - Technical Architecture for the Data Warehouse - Paper
IOUG93 - Technical Architecture for the Data Warehouse - PaperIOUG93 - Technical Architecture for the Data Warehouse - Paper
IOUG93 - Technical Architecture for the Data Warehouse - Paper
David Walker
 
Alejandro Chico Resume
Alejandro Chico ResumeAlejandro Chico Resume
Alejandro Chico Resume
Alex Chico
 

Similaire à Lecture 09 - Migration to the Architected Environment (20)

Modern data warehouse presentation
Modern data warehouse presentationModern data warehouse presentation
Modern data warehouse presentation
 
How to make your data count webinar, 26 Nov 2018
How to make your data count webinar, 26 Nov 2018How to make your data count webinar, 26 Nov 2018
How to make your data count webinar, 26 Nov 2018
 
Database System Development Life Cycle ( DDLC )
Database System Development Life Cycle ( DDLC )Database System Development Life Cycle ( DDLC )
Database System Development Life Cycle ( DDLC )
 
Database Management Systems 2
Database Management Systems 2Database Management Systems 2
Database Management Systems 2
 
Cloud migration presentation
Cloud migration presentationCloud migration presentation
Cloud migration presentation
 
CV2015_06_30 -NG van Zyl
CV2015_06_30 -NG van ZylCV2015_06_30 -NG van Zyl
CV2015_06_30 -NG van Zyl
 
IOUG93 - Technical Architecture for the Data Warehouse - Paper
IOUG93 - Technical Architecture for the Data Warehouse - PaperIOUG93 - Technical Architecture for the Data Warehouse - Paper
IOUG93 - Technical Architecture for the Data Warehouse - Paper
 
Agile Data Warehouse Modeling: Introduction to Data Vault Data Modeling
Agile Data Warehouse Modeling: Introduction to Data Vault Data ModelingAgile Data Warehouse Modeling: Introduction to Data Vault Data Modeling
Agile Data Warehouse Modeling: Introduction to Data Vault Data Modeling
 
Database development life cycle unit 2 part 1
Database development life cycle  unit 2 part 1Database development life cycle  unit 2 part 1
Database development life cycle unit 2 part 1
 
INF3703 - Chapter 10 Database Development Process
INF3703 - Chapter 10 Database Development ProcessINF3703 - Chapter 10 Database Development Process
INF3703 - Chapter 10 Database Development Process
 
RESUME3
RESUME3RESUME3
RESUME3
 
Database design (conceptual, logical and physical design) unit 2 part 2
Database design (conceptual, logical and physical design)  unit 2 part 2Database design (conceptual, logical and physical design)  unit 2 part 2
Database design (conceptual, logical and physical design) unit 2 part 2
 
Data Engineer's Lunch #85: Designing a Modern Data Stack
Data Engineer's Lunch #85: Designing a Modern Data StackData Engineer's Lunch #85: Designing a Modern Data Stack
Data Engineer's Lunch #85: Designing a Modern Data Stack
 
Database development life cycle unit 2 part 1
Database development life cycle  unit 2 part 1Database development life cycle  unit 2 part 1
Database development life cycle unit 2 part 1
 
Who's in your Cloud? Cloud State Monitoring
Who's in your Cloud? Cloud State MonitoringWho's in your Cloud? Cloud State Monitoring
Who's in your Cloud? Cloud State Monitoring
 
(OTW13) Agile Data Warehousing: Introduction to Data Vault Modeling
(OTW13) Agile Data Warehousing: Introduction to Data Vault Modeling(OTW13) Agile Data Warehousing: Introduction to Data Vault Modeling
(OTW13) Agile Data Warehousing: Introduction to Data Vault Modeling
 
Using Data Platforms That Are Fit-For-Purpose
Using Data Platforms That Are Fit-For-PurposeUsing Data Platforms That Are Fit-For-Purpose
Using Data Platforms That Are Fit-For-Purpose
 
Agile Data Engineering - Intro to Data Vault Modeling (2016)
Agile Data Engineering - Intro to Data Vault Modeling (2016)Agile Data Engineering - Intro to Data Vault Modeling (2016)
Agile Data Engineering - Intro to Data Vault Modeling (2016)
 
Alejandro Chico Resume
Alejandro Chico ResumeAlejandro Chico Resume
Alejandro Chico Resume
 
Best Practices in the Cloud for Data Management (US)
Best Practices in the Cloud for Data Management (US)Best Practices in the Cloud for Data Management (US)
Best Practices in the Cloud for Data Management (US)
 

Plus de phanleson

Lecture 1 - Getting to know XML
Lecture 1 - Getting to know XMLLecture 1 - Getting to know XML
Lecture 1 - Getting to know XML
phanleson
 

Plus de phanleson (20)

Learning spark ch01 - Introduction to Data Analysis with Spark
Learning spark ch01 - Introduction to Data Analysis with SparkLearning spark ch01 - Introduction to Data Analysis with Spark
Learning spark ch01 - Introduction to Data Analysis with Spark
 
Firewall - Network Defense in Depth Firewalls
Firewall - Network Defense in Depth FirewallsFirewall - Network Defense in Depth Firewalls
Firewall - Network Defense in Depth Firewalls
 
Mobile Security - Wireless hacking
Mobile Security - Wireless hackingMobile Security - Wireless hacking
Mobile Security - Wireless hacking
 
Authentication in wireless - Security in Wireless Protocols
Authentication in wireless - Security in Wireless ProtocolsAuthentication in wireless - Security in Wireless Protocols
Authentication in wireless - Security in Wireless Protocols
 
E-Commerce Security - Application attacks - Server Attacks
E-Commerce Security - Application attacks - Server AttacksE-Commerce Security - Application attacks - Server Attacks
E-Commerce Security - Application attacks - Server Attacks
 
Hacking web applications
Hacking web applicationsHacking web applications
Hacking web applications
 
HBase In Action - Chapter 04: HBase table design
HBase In Action - Chapter 04: HBase table designHBase In Action - Chapter 04: HBase table design
HBase In Action - Chapter 04: HBase table design
 
HBase In Action - Chapter 10 - Operations
HBase In Action - Chapter 10 - OperationsHBase In Action - Chapter 10 - Operations
HBase In Action - Chapter 10 - Operations
 
Hbase in action - Chapter 09: Deploying HBase
Hbase in action - Chapter 09: Deploying HBaseHbase in action - Chapter 09: Deploying HBase
Hbase in action - Chapter 09: Deploying HBase
 
Learning spark ch11 - Machine Learning with MLlib
Learning spark ch11 - Machine Learning with MLlibLearning spark ch11 - Machine Learning with MLlib
Learning spark ch11 - Machine Learning with MLlib
 
Learning spark ch10 - Spark Streaming
Learning spark ch10 - Spark StreamingLearning spark ch10 - Spark Streaming
Learning spark ch10 - Spark Streaming
 
Learning spark ch09 - Spark SQL
Learning spark ch09 - Spark SQLLearning spark ch09 - Spark SQL
Learning spark ch09 - Spark SQL
 
Learning spark ch07 - Running on a Cluster
Learning spark ch07 - Running on a ClusterLearning spark ch07 - Running on a Cluster
Learning spark ch07 - Running on a Cluster
 
Learning spark ch06 - Advanced Spark Programming
Learning spark ch06 - Advanced Spark ProgrammingLearning spark ch06 - Advanced Spark Programming
Learning spark ch06 - Advanced Spark Programming
 
Learning spark ch05 - Loading and Saving Your Data
Learning spark ch05 - Loading and Saving Your DataLearning spark ch05 - Loading and Saving Your Data
Learning spark ch05 - Loading and Saving Your Data
 
Learning spark ch04 - Working with Key/Value Pairs
Learning spark ch04 - Working with Key/Value PairsLearning spark ch04 - Working with Key/Value Pairs
Learning spark ch04 - Working with Key/Value Pairs
 
Learning spark ch01 - Introduction to Data Analysis with Spark
Learning spark ch01 - Introduction to Data Analysis with SparkLearning spark ch01 - Introduction to Data Analysis with Spark
Learning spark ch01 - Introduction to Data Analysis with Spark
 
Hướng Dẫn Đăng Ký LibertaGia - A guide and introduciton about Libertagia
Hướng Dẫn Đăng Ký LibertaGia - A guide and introduciton about LibertagiaHướng Dẫn Đăng Ký LibertaGia - A guide and introduciton about Libertagia
Hướng Dẫn Đăng Ký LibertaGia - A guide and introduciton about Libertagia
 
Lecture 1 - Getting to know XML
Lecture 1 - Getting to know XMLLecture 1 - Getting to know XML
Lecture 1 - Getting to know XML
 
Lecture 4 - Adding XTHML for the Web
Lecture  4 - Adding XTHML for the WebLecture  4 - Adding XTHML for the Web
Lecture 4 - Adding XTHML for the Web
 

Dernier

Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 

Dernier (20)

Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
21st_Century_Skills_Framework_Final_Presentation_2.pptx
21st_Century_Skills_Framework_Final_Presentation_2.pptx21st_Century_Skills_Framework_Final_Presentation_2.pptx
21st_Century_Skills_Framework_Final_Presentation_2.pptx
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
 
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptxOn_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
Philosophy of china and it's charactistics
Philosophy of china and it's charactisticsPhilosophy of china and it's charactistics
Philosophy of china and it's charactistics
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptx
 
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptxCOMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
 

Lecture 09 - Migration to the Architected Environment

  • 1. Building Data WareHouse by Inmon Chapter 09: Migration to the Architected Environment http://it-slideshares.blogspot.com
  • 2. 9. Migration to the Architected Environment 1. A Migration Plan 2. The Feedback Loop 3. Strategic Considerations 4. Methodology and Migration 5. Summary http://it-slideshares.blogspot.com
  • 3. 9.1 A Migration Plan  Beginning point: Data Model - represents the information needs of the corporation.  Data Model needs to identify at a minimum: ◦ Major subjects of the corporation ◦ Definition of the major subjects of the corporation ◦ Relationships between the major subjects ◦ Groupings of keys and attributes that more fully represent the major subjects
  • 4. 9.1 A Migration Plan (ct.)  After having the corporate data model, the next activity is defining the system of record.  It is nothing more than the identification of the “best” data that the corporation has: ◦ Most timely ◦ Most accurate ◦ Most complete ◦ Nearest to the external source ◦ Most structurally compatible
  • 5. 9.1 A Migration Plan (ct.)
  • 6. 9.1 A Migration Plan (ct.)  Technological challenges in bringing the system-of-record data into the DW: ◦ A change in DBMS ◦ A change in operating systems ◦ The need to merge data from different DBMSs and operating systems ◦ The capture of the Web-based data in the Web logs ◦ A change in basic data formats
  • 7. 9.1 A Migration Plan (ct.)  After the system of record is defined, the next step is to design the data warehouse.  The following things need to be done: ◦ An element of time needs to be added to the key structure if one is not already present. ◦ All purely operational data needs to be eliminated. ◦ Referential integrity relationships need to be turned into artifacts. ◦ Derived data that is frequently needed is added to the design.
  • 8. 9.1 A Migration Plan (ct.)
  • 9. 9.1 A Migration Plan (ct.)  After the data warehouse is designed, the next step is to design and build the interfaces between the system of record and the DW.  Interfaces’ activities: ◦ Being an extract process ◦ Integration of data from the operational, application-oriented environment ◦ Alteration of the time basis of data ◦ Condensation of data ◦ Efficient scanning of the existing systems environment
  • 10. 9.1 A Migration Plan (ct.)  Once the interface programs are designed and built, the next activity is to start the population of the first subject area: ◦ The first of the data is read in the legacy environment; and then it is captured and transported to the data warehouse environment. ◦ Directories are updated ◦ Metadata is created ◦ Indexes are made http://it-slideshares.blogspot.com
  • 11. 9.1 A Migration Plan (ct.)  Caution: If you wait for existing systems to be cleaned up, you will never build a data warehouse
  • 12. 9.2 The Feedback Loop  At the heart of success in the long-term development of the data warehouse is the feedback loop between the data architect and the DSS analyst.  The DSS analyst: ◦ uses the data warehouse as a basis for analysis ◦ conveys those requirements to the data architect  The data architect: ◦ add data, delete data, alter data, and so forth based on the recommendations of the DSS analyst http://it-slideshares.blogspot.com
  • 13. 9.2 The Feedback Loop (ct.) http://it-slideshares.blogspot.com
  • 14. 9.3 Strategic Considerations  The DW environment is designed and built for the purpose of supporting the DSS needs of the organization. http://it-slideshares.blogspot.com
  • 15. 9.3 Strategic Considerations (ct.)  Besides that, the corporation has operational needs as well.  But the operational world is shown as being in a state of chaos. http://it-slideshares.blogspot.com
  • 16. 9.3 Strategic Considerations (ct.)  The steps the data architect takes to restructure the operational environment: ◦ Create a ‘delta’ list ◦ The impact analysis ◦ Create the resource estimate ◦ All the preceding are packaged in a report that goes to information systems management. http://it-slideshares.blogspot.com
  • 17. 9.3 Strategic Considerations (ct.)  Operation cleanup plan:
  • 18. 9.4 Methodology and Migration  The methodology for the building of the data warehouse is called a spiral development methodology.  The spiral methodology not only contains information about how to build a data warehouse, but also describes how to use the data warehouse. http://it-slideshares.blogspot.com
  • 19. 9.4 Methodology and Migration (ct.)  The differences between the waterfall approach and the spiral approach:
  • 20. 9.5 Summary  The starting point for the design of the data warehouse is the corporate data model,.  The data warehouse is built iteratively.  The development approach for the data warehouse environment is said to be an iterative or a spiral development approach.  The feedback loop between the data architect and the end user is an important part of the migration process. http://it-slideshares.blogspot.com