SlideShare une entreprise Scribd logo

Prague data management meetup 2017-03-28

•
•
Martin Bém
Martin Bém

This document provides an overview of metadata and its role in data warehousing (DW) and business intelligence (BI). It discusses different types of metadata including descriptive, structural, and administrative metadata. Examples of metadata are provided relating to conceptual models, business rules, processes, data structures, transformations and movement. The importance of metadata for context, consolidation, and ensuring truth in data is highlighted. The metadata lifecycle of creating, maintaining, updating, storing, and publishing is also summarized.

Technologie
1  sur  54
Télécharger pour lire hors ligne
Metadata v DW/BI #13 28. 3. 2017 Prague Data Management Meetup
Agenda • Prague Data Management Meetup • Metadata v DW/BI
Prague Data Management Meetup Data Management Získávaní dat Ukládání dat Zpracování dat Interpretace dat Použití dat • Otevřená profesionální zájmová skupina • Každý je vítán (ať už v pasivní nebo aktivní roli) • Témat není nikdy dost • Snaha o pravidelné měsíční setkávání • Fungujeme od září 2015
Historie # Datum Téma 1 10. 9. 2015 Data Management 2 14. 10. 2015 Data Lake 3 23. 11. 2015 Dark Data (without Dark Energy and Dark Force) 4 12. 1. 2016 Data Lake (znova) 5 7. 3. 2016 Sad Stories About DW Modeling (sad stories only) 6 23. 3. 2016 Self-service BI Street Battle 7 27. 4. 2016 Let's explore the new Microsoft PowerBI! 8 22. 9. 2016 Data Management pro začátečníky 9 17. 10. 2016 Small Big Data 10 22. 11. 2016 Základy modelování DW 11 23.1.2017 Komponenty datových skladů 12 28.2.2017 Operational Data Store 13 28.3.2017 Metadata v DW/BI 14 25.4.2017 Jak se stát DW/BI konzultantem 15 16.5.2017 SQL
Data Management
Big Data
Aktuality Pár zajímavostí
Gartner Magic Quadrant for Data Management Solutions for Analytics 2017
Metadata v DW/BI Věc naprosto kritická
DWH/BI Logical Layers Stage Area Relational Area Consolidation Area Data Mart Area • Data Mart Area • L2 • User Access Layer • Consolidation Area • Consolidated L1 • Common aggregates for L2 • Cleansed and consolidated data • Relational Area • Detailed L1 • Consistent, integrated, subject oriented data, universal data structure, historical data, maximal detail • System of record • Stage Area • Direct copy of source systems Extracts Reports Note: Consolidated and Detailed L1 can share same data structures General DWH Staging Area ODS Presentation Layer Datamart Area (Dependent Datamarts) Source systems Customer DB ETL Other...S4S3S2S1 Analytic tools (SPSS, SAS..) OLAP S1 S2 S3 S4 Other S1 Ostatní...S4S3S2 ETL Materialization OLAP? ETL ETL ETL ETL ETL ETL ETL ETL ETL ETL CDB ETL EAI ReportingReporting Reporting Reporting Relational Area ETL Application Application Materialization Application Application ETL
Metadata • Metadata is data in context • Data about data • Data that provides information about other data • Metadata is structured information that describes, explains, locates, or otherwise makes it easier to retrieve, use, or manage an information resource. Metadata is often called data about data or information about information. Descriptive metadata • Describes a resource for purposes such as discovery and identification. It can include elements such as title, abstract, author, and keywords. Structural metadata • Metadata about containers of data and indicates how compound objects are put together, for example, how pages are ordered to form chapters. Administrative metadata • Provides information to help manage a resource, such as when and how it was created, file type and other technical information, and who can access it.
Metadata Examples
Business Process Analysis #2 Analysis #1 Application Integration vs. Data Integration Some data are lost… Some data unusable… Some data unused… Operations Analytics
Conceptual models Metadata “Glue” Business subject areas Conceptual data models Business systems CASE models (live) Business systems (databases, ERPs, legacy etc.) The metadata glue Key business data elements CASE metadata Physical metadata
Truth in data 22 Primary data Primary data (another system) Secondary data Consolidated data …Noise generator Truth • Independent data truth does not exist • Truth depends on Business and Data architect definition (metadata)
Adastra Business Intelligence Reference Architecture 23 ODS Operational reporting Enterprise DWH Big Data Platform Data Lake Event Processing Semantic Models Advanced Analytics Perceptual / cognitive intelligence Information Management Relational / Structured data Unstructured data Streaming Data Workflow Orchestration Data Transformation / Processing Data Management Event Ingestion Complex Event Processing Notifications BI / Application Integration Machine Learning In-database Data Mining, R Recognition of human interaction and intent SMP and MPP In-memory technologies In-memory Columnar In-memory technologies Hadoop, NoSQL Business Intelligence / Data Delivery Real-time DashboardsDashboards and visualizationsReports Self-service BIMobile BI IoT Network Field Gateway Big data OLAP Metadata Metadata Metadata Metadata Metadata Metadata Metadata Metadata Metadata Metadata Metadata
Metadata vs. Datová architektura DW/BI Kontext • Terminologie • Metriky • Business pravidla • Business procesy Statika  Struktury  Slovníky  Statistiky Dynamika • Pohyb dat • Transformace • Stárnutí
Techninal & Business Metadata
Metadata Lifecycle Creating Metadata Maintaining Metadata Updating Metadata Storing Metadata Data Deletetion Metadata Publishing
Good vs. Bad Metadata
Metadata Quality Accuracy Availability Completeness Conformance (Standard) Consistency Credibility & Origination Processability (Machine- readable) Relevance Timeliness
Metadata Consolidation History Program based • Sequential or index-sequential or direct access files Tagged file formats • Structured input format standards, XML Database data dictionaries Repositories • CASE , ETL tools, Analytical tools Enterprise metadata repositories Consolidated Column Hierarchy Parent MemberLead Reverse Individual Entrepreneur 2 1 AddressBirth placeAddressIssuer 1 2 Business <<ODS Table>> Party Party Relationship Party Party Relationship Key Party Party Relationship Type Key Instance Party Key 1 Instance Party Key 2 Source System ID Source ID <<Ref Table>> Party Party Relationship Type Party Party Relationship Type Key Reverse Party Party Relationship Type Key Source System ID Source ID <<Ref Table>> Phone Purpose Phone Purpose Key Source System ID Source ID <<Ref Table>> Address Purpose Address Purpose Key Source System ID Source ID <<ODS Table>> Party Segment Party Segment Key Instance Party Key Segment Key Unified Party Key Business Key Source System ID Segmentation Key Source ID <<Ref Table>> Segment Segment Key Parent Segment Key Segmentation Key Source ID Source System ID <<ODS Table>> POS Segment POS Segment Key POS Key POS Segment Type Key Segment Key Segmentation Key Source System ID Source ID <<Ref Table>> POS Segment Type POS Segment Type Key Parent POS Segment Type Key Source System ID Source ID <<ODS Table>> Instance ID Card Instance ID Card Key ID Card Type Key Instance Party Key Unified ID Card Key Country Key Source System ID Source ID <<Ref Table>> ID Card Type ID Card Type Key Source System ID Source ID <<DW Table>> BW Party BW Party Key Instance Party Key Source System ID Country Key Located Address Key Loc Source System ID Instance Phone Key Ins Source System ID BW List Key Bw List Action Key BW List Reason Key Instance ID Card Key Inserted Instance Party Key Updated Instance Party Key Canceled Instance Party Key Employer Instance Party Key <<Ref Table>> BW List Reason BW List Reason Key BW List Key Source ID Source System ID <<ODS Table>> Instance Email Instance Email Key POS Key Instance Party Key POS Chain Key Email Purpose Key Source System ID Source ID <<ODS Table>> Instance Bank Contact Instance Bank Contact Key POS Key Instance Party Key Currency Key Source System ID Source ID <<ODS Table>> Party Daily Fact Party Daily Fact Key Instance Party Key Source System ID Snapshot Date <<ODS Table>> Party Monthly Fact Party Monthly Fact Key Instance Party Key Source System ID Snapshot Date <<ODS Table>> Household Household Key Unified Party Key Business Key Located Address Key Source ID Source System ID <<ODS Table>> Corporate Household Corporate Household Key Lead Unified Party Key Member Unified Party Key Member Business Key Source System ID Source ID <<ODS Table>> Unified Party Unified Party Key Business Key <<ODS Table>> Located Address Located Address Key Country Key Address District Key Source System ID Source ID <<Ref Table>> BW List BW List Key Source ID Source System ID <<ODS Table>> POS Credit Limit POS Credit Limit Key POS Key Source System ID Source ID <<ODS Table>> POS Payment POS Payment Key POS Key Source System ID Source ID <<Ref Table>> Party Type Party Type Key Source System ID Source ID <<ODS Table>> POS Contract POS Contract Key POS Key Source System ID Source ID <<ODS Table>> Instance Web Page Instance Web Page Key POS Key Instance Party Key Web Page Purpose Key Source System ID Source ID <<ODS Table>> POS Product Restriction POS Business Product Restriction Key POS Key Business Product Type Key Source ID <<Ref Table>> Party Status Party Status Key Source System ID Source ID <<ODS Table>> POS Party Relationship POS Party Relationship Key POS Key Instance Party Key Party Role Type Key POS Chain Key Source System ID Source ID <<Ref Table>> Party Role Type (<GE_IA_Logical_Product>) Party Role Type Key Source System ID Source ID <<Ref Table>> POS Status POS Status Key Source System ID Source ID <<Ref Table>> POS Type POS Type Key Source System ID Source ID <<Ref Table>> POS Placement POS Placement Key Source System ID Source ID <<ODS Table>> POS Commodity Register POS Commodity Key POS Key Commodity Key Source System ID Source ID <<ODS Table>> POS Chain POS Chain Key Instance Party Key Source System ID Source ID <<ODS Table>> POS Application POS Application Key POS Key Source System ID Source ID <<Ref Table>> Web Page Purpose Web Page Purpose Key Source System ID Source ID <<ODS Table>> Unified ID Card Unified IDCard Key Source System ID Source ID <<Ref Table>> Phone Type Phone Type Key Source System ID Source ID <<ODS Table>> Unified Party Alias Individual Unified Party Key Individual Business Key Entrepreneur Unified Party Key Entrepreneur Business Key Source System ID Source ID <<DW Table>> ECB Client ECB Client Key Unified Party Key Business Key Party Type Key Birth Place Country Key Address Country Key Legal Form Key Gender Key Party Role Key Source System ID Source ID <<DW Table>> ECB Operation ECB Operation Key ECB Client Key ECB Operation Phase Key ECB Operation Type Key ECB Payment Type Key ECB Personal Guarantee Type Key ECB Material Guarantee Type Key ECB Payment Period Key ECB Signalization Key ECB Installment Type Key ECB Transfer Type Key Source System ID Source ID <<ADS Table>> ECB Personal Information ECB Personal Information Key ECB Client Key ID Card Type Key Issuer Country Key Address Country Key Source System ID Source ID <<DW Table>> ECB Address ECB Address Key Country Key ECB Client Key Source System ID Source ID <<ADS Table>> ECB Shareholder ECB Shareholder Key ECB Client Key 1 ECB Client Key 2 Party Type Key Legal Form Key Party Party Relationship Type Key Source System ID Source ID <<Ref Table>> Fact Type Fact Type Key Source ID Source System ID <<ODS Table>> Address District Address District Key Source System ID Source ID <<Ref Table>> Segmentation Segmentation Key Source ID Source System ID <<DW Table>> ECB Operation Person ECB Operation Person Key ECB Operation Inst Key ECB Client Key Party Role Key Source System ID Source ID <<Ref Table>> Country Country Key Source System ID Source ID <<DW Table>> ECB Operation NonInst History ECB Operation NonInst History Key ECB Operation Key Source System ID Source ID <<Ref Table>> Language Language Key Source System ID Source ID <<DW Table>> ECB Event ECB Event Key ECB Event Type Key ECB Client Key Source System ID Source ID <<Ref Table>> Business Sector Business Sector Key Source System ID Source ID <<DW Table>> ECB Event Type ECB Event Type Key Source System ID Source ID <<Ref Table>> Stay Type Stay Type Key Source System ID Source ID <<Ref Table>> ECB Operation Phase ECB Operation Phase Key Source System ID Source ID <<Ref Table>> Occupation Occupation Key Source System ID Source ID <<DW Table>> ECB Installment Type ECB Installment Type Key Source System ID Source ID <<Ref Table>> Legal Form Legal Form Key Source System ID Source ID <<DW Table>> ECB Material Guarantee Type ECB Material Guarantee Type Key Source System ID Source ID<<Ref Table>> ECB Operation Type ECB Operation Type Key Source System ID Source ID <<Ref Table>> ECB Payment Period ECB Payment Period Key Source System ID Source ID <<Ref Table>> ECB Payment Type ECB Payment Type Key Source System ID Source ID <<ODS Table>> POS Product Fact POS Product Fact Key POS Key Unified Party Key Business Key Source System ID Source ID <<Ref Table>> ECB Personal Guarantee Type ECB Personal Guarantee Type Key Source System ID Source ID <<Ref Table>> OKEC OKEC Key Source ID Source System ID <<Ref Table>> ECB Signalization ECB Signalization Key Source System ID Source ID <<ODS Table>> Party OKEC Party OKEC Key OKEC Key Instance Party Key Source System ID Source ID <<Ref Table>> ECB Transfer Type ECB Transfer Type Key Source System ID Source ID <<ODS Table>> Party Fact Party Fact Key Instance Party Key Fact Type Key Source System ID Source ID <<Ref Table>> Region Source System ID Source ID Region Key <<Ref Table>> District Source System ID Source ID District Key <<ODS Table>> Instance Party Instance Party Key Unified Party Key Business Key Party Type Key Party Status Key Language Key Country Key Business Sector Key Occupation Key Stay Type Key Legal Form Key Gender Key Employee Type Key Employment Status Key Marital Status Key Housing Status Key Education Status Key OKEC Key CNB Classification Key Source System ID Source ID District key <<ODS Table>> Instance Address Instance Address Key Located Address Key Address Purpose Key POS Key Instance Party Key POS Chain Key Country Key Source System ID Source ID <<ODS Table>> Instance Phone Instance Phone Key Phone Purpose Key Unified Phone Key POS Key Instance Party Key POS Chain Key Phone Type Key Source System ID Source ID <<Ref Table>> POS Invoice Type POS Invoice Type Key Source System ID Source ID <<Ref Table>> POS Ownership Type POS Ownership Type Key Source System ID Source ID <<ODS Table>> POS POS Key Business Key POS Status Key POS Type Key POS Payment Key Business POS Chain Key Invoice POS Chain Key POS Ownership Type Key District Key Region Key Source System ID Source ID POS Placement Key POS Invoice Type Key <<Ref Table>> Gender Gender Key Source System ID Source ID <<Ref Table>> Employment Type Employment Type Key Source System ID Source ID <<Ref Table>> Employment Status Employment Status Key Source System ID Source ID <<ODS Table>> Unified Phone Unified Phone Key Source System ID Source ID <<Ref Table>> Marital Status Marital Status Key Source System ID Source ID <<Ref Table>> Housing Status Housing Status Key Source System ID Source ID <<Ref Table>> Education Status Education Status Key Source System ID Source ID <<Ref Table>> Business (<GE_IA_Logical_Product>) Business Key Parent Business Key Source System ID Source ID A_SEG Segment Key Source ID Source System ID SEG <<Ref Table>> Currency (<GE_IA_Logical_Product>) Currency Key <<ODS Table>> Instance Party Cleaned Instance Party Key Source System ID Source ID <<ODS Table>> Instance Phone Cleaned Instance Phone Key Source System ID Source ID <<ODS Table>> Instance Address Cleaned Instance Address Key Source System ID Source ID <<Ref Table>> CNB Classification CNB Classification Key Source System ID Source ID <<Ref Table>> Party Accounting Type Party Accounting Type Key Source System ID Source ID <<Ref Table>> Occupation Detail Occupation Detail Key Occupation Key Source System ID Source ID <<Ref Table>> Phone IDC Phone IDC Key Source System ID Source ID <<Ref Table>> Company Branch Source System ID Source ID Company Branch Key <<Ref Table>> CR Registered Seat Source System ID Source ID CR Registered Seat Key <<Ref Table>> Selected Profession Group Type Source System ID Source ID Selected Profession Group Type Key <<Ref Table>> Statutory Body Type Statutory Body Type Key Source ID Source System ID <<ODS Table>> Instance Party Fact Instance Party Fact Key Instance Party Key Source System ID Snapshot Date <<ODS Table>> Manual Override Rule Manual Override Rule Key Parent Instance Party Key Child Instance Party Key Source System ID <<ODS Table>> Unified Party Segment Unified Party Segment Key Segment Key Segmentation Key Unified Party Key Business Key Source System ID Source ID <<Ref Table>> SAS Customer Type SAS Customer Type Key <<ODS Table>> SAS Unified Party Type Sas Unified Party Type Key SAS Customer Type Key SAS Customer Subtype Key Unified Party Key <<Ref Table>> SAS Customer Subtype SAS Customer Subtype Key <<ODS Table>> Unified Party Monthly Fact Unified Party Monthly Fact Key Unified Party Key Business Key <<Ref Table>> Company Employee Count Source System ID Source ID Company Employee Count Key <<Ref Table>> ID Card Purpose Source System ID Source ID ID Card Purpose Key <<Ref Table>> Occupation Lookup Occupation Lookup Key Occupation Key Occupation Detail Key Source System ID Source ID
Metadata Tools
Modeling and Metadata
SAP PowerDesigner
SAP PowerDesigner
SAP PowerDesigner
SAP PowerDesigner
Design standards • Naming conventions • Models, nodes, layers, schemas • Entities • Attributes • Keys • Relationships • Indexes, constraints • Level of normalization • Level of convergence • Key strategy • Standard attributes Supplier standards Customer standards Third party product standards
Design Standard Example
Name Code Account ACC Deposit DEP Balance BAL Amount AMT Party PT Probability of Default PD Adjusted ADJ Complex Name Good Example Bad Example Deposit Account DEP_ACC CURRENT_ACCNT Deposit Account Adjusted Balance DEP_ACC_ADJ_BAL DEP_ACC_ADJ_BALANCE Account Probability of Default ACC_PD ACC_PROB_OF_DEF Party Account PT_ACC PARTY_ACC Party Deposit PT_DEP PARTY_DEPOSIT Acronyms • Very simple dictionary • Simplify naming • “Common Language” • Shorter names
Adastra System Metamodel for Oracle DB Database Schema (OWNER) PowerDesigner Physical Data Models (.PDM) Tables Mappings ETLs Generic Non-Generic APIs
FK_INTRSBASRXFACT_INTRSBASRX FK_GLACC__GLACCTP FK_GLACC__CCY FK_GLACC__ACCSTAT FK_FXRXFACT__FXRX FK_FXRX_FX_CCY FX FK_FXRX__FXRXTP FK_FXRX__CCY FK_ENTRTRN__PROD FK_ENTRTRN__POS FK_ENTRTRN__MERCH FK_ENTRTRN__CNL FK_ENTRTRN__AUTHSTAT FK_ENTRTRN_DEBIT_ACC Debit FK_ACCTRN_MERCH_PT MERCH FK_ACCTRN__POS FK_ACCTRN__CRDB FK_ACCTRN__CNLFK_ACCTRN__CCY FK_ACCTRN__ACCTRNTP FK_ACCTRN__ACCTRNSTAT FK_ACCTRN__ACC FK_ACCPRODREL__PROD FK_ACCPRODREL__ACCPRODRELTP FK_ACCPRODREL__ACCFK_ACCHOLDFACT__POS FK_ACCHOLDFACT__MERCH FK_ACCHOLDFACT__CNL FK_ACCHOLDFACT__CCY FK_ACCHOLDFACT__BLOCTP FK_ACCHOLDFACT__BLOCSTAT FK_ACCHOLDFACT__AUTHSTAT FK_ACCHOLDFACT__ACC FK_ACCBALFACT__ACC FK_ACC__PT FK_ACC__GLACC FK_ACC__CCY FK_ACC__ACCTP FK_ACC__ACCSTAT <<Ref Table>> Account Status (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Account Status Key Identifier Description Local Description Active Flag Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <ak> <<ADS Table>> Account <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Account Key Party Key Account Type Key Account Status Key Currency Key GL Account Key POS Key Account Number Account ID Account Name Account Symbol IBAN Open Date Activation Date Close Date Company Code Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date Source Update DateTime INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) DATE DATE DATE VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <pk> <fk5> <fk1> <fk2> <fk3> <fk4> <fk6> <ak> <pk,ak,fk4,fk5,fk6> <<Ref Table>> Account Type (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Account Type Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <ak> <<Ref Table>> Currency (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Currency Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <<ADS Table>> GL Account <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> GL Account Key Account Status Key Currency Key GL Account Type Key GL Account Number GL Account Group Description Party Account Flag Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date Source Update DateTime INTEGER INTEGER INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <pk> <fk1> <fk2> <fk3> <ak> <pk,ak> <<ADS Table>> Party (<ABDM_DWH_CLIENT_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Party Key Unified Party Key Consolidate Party Key Party Type Key Party Status Key Business Sector Key Legal Form Key Country Key Language Key Housing Type Key Gender Key Personal Identifier Company Identifier P Code First Name First Name Latin Family Name Family Name Latin Middle Name Business Name Business Name Latin Short Name Short Name Latin Salutation Birth Date Resident Flag Bankruptcy Flag Start Date End Date Party Identifier Source System Identifier Source Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date Source Update DateTime INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) DATE INTEGER INTEGER DATE DATE VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <pk> <fk8> <fk7> <fk1> <fk6> <fk2> <fk5> <fk4> <fk3> <pk,ak> <ak> <<ADS Table>> Account Balance Fact <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Snap Date Account Key Balance Overdraft Balance Reserve Balance Planned Balance Account Hold Amount Available Amount Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date Source Update DateTime DATE INTEGER NUMBER(19,3) NUMBER(19,3) NUMBER(19,3) NUMBER(19,3) NUMBER(19,3) NUMBER(19,3) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <pk,ak> <pk,fk> <ak> <pk,ak,fk> <<ADS Table>> Account Hold Fact <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<DW Column>> Snap Date Account Hold Fact Key Account Key Blocation Type Key Blocking Status Key Authorization Status Key Merchant Key POS Key Channel Key Currency Key Expiry Blocking Date Blocking Description Hold Value Date Hold Entry Date Hold Reference Number Hold Batch Identifier Hold Amount Hold Amount Local Currency Hold Account FX Rate Source Identifier Source System Identifier Update Datetime Update Process Identifier Delete Flag Insert Process Identifier Insert Datetime Update Effective Date Source Update DateTime DATE INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER DATE VARCHAR2(255 CHAR) DATE DATE VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) NUMBER(19,3) NUMBER(19,3) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) DATE VARCHAR2(255) INTEGER VARCHAR2(255) DATE DATE DATE <pk,ak> <pk> <fk1> <fk7> <fk6> <fk2> <fk3> <fk4> <fk5> <fk8> <ak> <pk,ak,fk1,fk3,fk4> <<Ref Table>> Authorization Status (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Authorization Status Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <ak> <<Ref Table>> Blocking Status (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Blocking Status Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <ak> <<Ref Table>> Blocation Type (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Blocation Type Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <ak> <<Ref Table>> Channel (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<DW Column>> Channel Key Identifier Description Local Description Source Identifier Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier Channel Category Key INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) INTEGER <pk> <ak> <ak> <fk> <<ADS Table>> Merchant (<ABDM_DWH_CLIENT_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Merchant Key Party Key Merchant Type Key Merchant Code Key Merchant Category Key Business Product Type Key Channel Key Merchant Rate Merchant Commission Rate Test Mode Flag Discount Percent Merchant Contact Person Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Source Update DateTime Update Effective Date INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER NUMBER(10,6) NUMBER(10,6) INTEGER Number VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <pk> <fk6> <fk5> <fk4> <fk3> <fk1> <fk2> <ak> <pk,ak,fk6> <<ADS Table>> POS (<ABDM_DWH_CLIENT_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<DW Column>> <<DW Column>> POS Key Party Key POS Type Key POS Financial Category Key POS Identifier POS Description Opening Hours Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Source Update DateTime Update Effective Date SC Code MFO INTEGER INTEGER INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) <pk> <fk3> <fk2> <fk1> <ak> <pk,ak,fk3> <<ADS Table>> Account Product Relationship <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Account Product Relationship Key Account Key Product Key Account Product Relationship Type Key Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date Source Update DateTime INTEGER INTEGER INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <pk> <fk2> <fk1> <fk3> <ak> <pk,ak,fk1,fk2> <<Ref Table>> Account Product Relationship Type (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Account Product Relationship Type Key Identifier Description Local Description Main Account Flag Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <ak> <<ADS Table>> Product (<ABDM_DWH_PRODUCT_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Product Key Contract Key Product Status Key Business Product Type Key System Product Type Key Term Type Key Commodity Key Accrual Basis Key Point of Sale Key Channel Key Bank Module Key Product Number Credit Bureau ID Customer Product Description Campaign Promotional code Open Date Close Date Maturity Date Main Product Flag External Register Report Flag Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date Source Update DateTime INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) DATE DATE DATE INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <ak1> <ak2> <ak1,ak2> <<ADS Table>> Account Transaction <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<DW Column>> Account Transaction Key Transaction Date POS Key Credit Account Key Debit Account Key Credit GL Account Key Debit GL Account Key Account Transaction Type Key Account Transaction Status Key Currency Key Employee Key Account Transaction Order Key Entry Transaction Key Transaction Value Date Transaction Entry DateTime Transaction Amount Transaction Local Currency Amount Transaction Account FX Rate Transaction Reference Number Transaction Authorization Number Transaction Batch Identifier Transaction Application Identifier Transaction Entry Identifier Transaction Order Identifier Transaction Document Number Transaction Ground Description Cancel Flag Message For Recipient Message For Sender Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date Source Update DateTime INTEGER DATE INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER DATE DATE NUMBER(19,3) NUMBER(19,3) NUMBER(10,6) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <pk> <pk,ak,fk6> <fk5> <fk1> <fk2,fk8> <fk3> <fk4> <fk6> <ak> <pk,ak,fk1,fk5,f...> <<Ref Table>> Account Transaction Status (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Account Transaction Status Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <ak> <<Ref Table>> Account Transaction Type (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Account Transaction Type Key Account Transaction Category Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier Account Transaction Code DR/CR Indicator Level 1 Description Level 2 Description Level 3 Description Level 4 Description Level 1 Code Level 2 Code Level 4 Code Level 3 Code INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) <pk> <fk> <ak> <ak> <<Ref Table>> Credit/Debit (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Credit/Debit Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <ak> <<ADS Table>> Entry Transaction <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<DW Column>> Entry Transaction Key Transaction Date Entry Transaction Type Key Entry Transaction Sub Type Key Entry Transaction Status Key Debit Account key Credit Account Key Product Key Card Key Authorization Status Key Channel Key Merchant Key POS Key POS Type Key Country Key Card Transaction Location Key Acquirer Financial Institution Key Issuer Financial Institution Key Currency Key Original Currency Key Transaction Amount Transaction Local Currency Amount Transaction Original Currency Amount Transaction FX Rate Transaction Value Date Transaction Entry Date Transaction Expiry Date Entry Transaction Identifier Transaction Reference Number Transaction Authorization Identifier Transaction Card Mask Transaction Card BIN Identifier Transaction Batch Identifier Transaction STAN Identifier Source Identifier Source System Identifier Update Datetime Update Process Identifier Delete Flag Insert Process Identifier Insert Datetime Update Effective Date Source Update DateTime INTEGER DATE INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER NUMBER(19,3) NUMBER(19,3) NUMBER(19,3) VARCHAR2(255 CHAR) DATE DATE DATE VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) DATE VARCHAR2(255) INTEGER VARCHAR2(255) DATE DATE DATE <pk> <pk,ak> <fk10> <fk1> <fk9> <fk6> <fk11> <fk2> <fk5> <fk3> <fk4> <ak> <pk,ak,fk1,fk3,f...> <<ADS Table>> FX Rate <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> FX Rate Key Currency Key FX Currency Key FX Rate Type Key FX Scale Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date Source Update DateTime INTEGER INTEGER INTEGER INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <pk> <fk1> <fk2> <fk3> <ak> <pk,ak> <<Ref Table>> FX Rate Type (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> FX Rate Type Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <ak> <<ADS Table>> FX Rate Fact <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Snap Date FX Rate Key Buy Rate Rate Sell Rate Value Date Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date Source Update DateTime DATE INTEGER NUMBER(10,6) NUMBER(10,6) NUMBER(10,6) DATE VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <pk,ak> <pk,fk> <ak> <pk,ak,fk> <<Ref Table>> GL Account Type (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<DW Column>> <<DW Column>> GL Account Type Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier GL Account Category Key NBG_FLAG INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) INTEGER INTEGER <pk> <ak> <ak> <fk> <<Ref Table>> Interest Base Rate (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Interest Base Rate Key Period Frequency Key Identifier Description Local Description Market Flag Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <fk> <ak> <ak> <<ADS Table>> Interest Base Rate Fact <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Snap Date Interest Base Rate Key Rate Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date DATE INTEGER NUMBER(10,6) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE <pk,ak> <pk,fk> <ak> <pk,ak>
Metadata vs. Reference Data Reference Data is sometimes Metadata!!!
Model-Based Engineering Model-Driven Engineering Model-Driven Development Model-Driven Architecture Source: David Ameller
Metadata v datové transformaci Source table Target table table Target table Filter SRC Filter TRG Differential member (minus, outer join or 10gMerge) Filter OUT Lookup tables Join SRC
Přínosy MDD Silná orientace na metadata (metadata- driven) Fakticky 100% konzistence modelu s výslednou implementací Otevřená architektura Snadná rozšiřitelnost Kratší a efektivnější vývojový cyklus (o cca. 50% oproti klasickému způsobu vývoje) Nižší náklady na vývoj Více času na analýzu Standardizace implementace (vysoce srozumitelný kód) Udržovaná dokumentace (vedlejší efekt silné orientace na metadata) API/ETL change management Impact analýza Možnost provádět automatické kontroly kvality Verzování User-friendly
SQLDep www.sqldep.com
Oracle Enterprise Metadata Manager http://www.oracle.com/technetwork/middleware/oemm/overview/ind ex.html
Prague data management meetup 2017-03-28
Prague data management meetup 2017-03-28
Prague data management meetup 2017-03-28
Prague data management meetup 2017-03-28
Prague data management meetup 2017-03-28
Prague data management meetup 2017-03-28

Recommandé

Xml
XmlXml
XmlAbhishek Raj
 
Overview of business intelligence
Overview of business intelligenceOverview of business intelligence
Overview of business intelligenceAhsan Kabir
 
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...OpenSource Connections
 
George McGeachie's Favourite PowerDesigner features
George McGeachie's Favourite PowerDesigner featuresGeorge McGeachie's Favourite PowerDesigner features
George McGeachie's Favourite PowerDesigner featuresGeorge McGeachie
 
Data Modelling Zone 2019 - data modelling and JSON
Data Modelling Zone 2019 - data modelling and JSONData Modelling Zone 2019 - data modelling and JSON
Data Modelling Zone 2019 - data modelling and JSONGeorge McGeachie
 
Choosing your NoSQL storage
Choosing your NoSQL storageChoosing your NoSQL storage
Choosing your NoSQL storageImteyaz Khan
 
Chapter 6(introduction to documnet databse) no sql for mere mortals
Chapter 6(introduction to documnet databse) no sql for mere mortalsChapter 6(introduction to documnet databse) no sql for mere mortals
Chapter 6(introduction to documnet databse) no sql for mere mortalsnehabsairam
 
Lightning talk at PG Conf UK 2018
Lightning talk at PG Conf UK 2018Lightning talk at PG Conf UK 2018
Lightning talk at PG Conf UK 2018George McGeachie
 

Recommandé

Xml
XmlXml
XmlAbhishek Raj
 
Overview of business intelligence
Overview of business intelligenceOverview of business intelligence
Overview of business intelligenceAhsan Kabir
 
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...
Haystack 2019 - Improving Search Relevance with Numeric Features in Elasticse...OpenSource Connections
 
George McGeachie's Favourite PowerDesigner features
George McGeachie's Favourite PowerDesigner featuresGeorge McGeachie's Favourite PowerDesigner features
George McGeachie's Favourite PowerDesigner featuresGeorge McGeachie
 
Data Modelling Zone 2019 - data modelling and JSON
Data Modelling Zone 2019 - data modelling and JSONData Modelling Zone 2019 - data modelling and JSON
Data Modelling Zone 2019 - data modelling and JSONGeorge McGeachie
 
Choosing your NoSQL storage
Choosing your NoSQL storageChoosing your NoSQL storage
Choosing your NoSQL storageImteyaz Khan
 
Chapter 6(introduction to documnet databse) no sql for mere mortals
Chapter 6(introduction to documnet databse) no sql for mere mortalsChapter 6(introduction to documnet databse) no sql for mere mortals
Chapter 6(introduction to documnet databse) no sql for mere mortalsnehabsairam
 
Lightning talk at PG Conf UK 2018
Lightning talk at PG Conf UK 2018Lightning talk at PG Conf UK 2018
Lightning talk at PG Conf UK 2018George McGeachie
 
Dimensional Modelling
Dimensional ModellingDimensional Modelling
Dimensional ModellingPrithwis Mukerjee
 
Prague data management meetup 2016-11-22
Prague data management meetup 2016-11-22Prague data management meetup 2016-11-22
Prague data management meetup 2016-11-22Martin Bém
 
Dataware housing
Dataware housingDataware housing
Dataware housingwork
 
dw_concepts_2_day_course.ppt
dw_concepts_2_day_course.pptdw_concepts_2_day_course.ppt
dw_concepts_2_day_course.pptDougSchoemaker
 
BI Security (1).ppt
BI Security (1).pptBI Security (1).ppt
BI Security (1).pptcsekar2
 
Database 2 External Schema
Database 2 External SchemaDatabase 2 External Schema
Database 2 External SchemaAshwani Kumar Ramani
 
Master Data Management methodology
Master Data Management methodologyMaster Data Management methodology
Master Data Management methodologyDatabase Architechs
 
Sap Bw 3.5 Overview
Sap Bw 3.5 OverviewSap Bw 3.5 Overview
Sap Bw 3.5 OverviewTrevor Prescod
 
Datawarehouse Overview
Datawarehouse OverviewDatawarehouse Overview
Datawarehouse Overviewashok kumar
 
Systems Analyst and Design - Data Dictionary
Systems Analyst and Design - Data DictionarySystems Analyst and Design - Data Dictionary
Systems Analyst and Design - Data DictionaryKimberly Coquilla
 
Data Warehouse
Data WarehouseData Warehouse
Data Warehouseganblues
 
Business process modeling and analysis for data warehouse design
Business process modeling and analysis for data warehouse designBusiness process modeling and analysis for data warehouse design
Business process modeling and analysis for data warehouse designSlava Kokaev
 
3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.pptBsMath3rdsem
 
The Modern World of Information Architecture
The Modern World of Information ArchitectureThe Modern World of Information Architecture
The Modern World of Information ArchitectureRecordPoint
 
SSAS R2 and SharePoint 2010 – Business Intelligence
SSAS R2 and SharePoint 2010 – Business IntelligenceSSAS R2 and SharePoint 2010 – Business Intelligence
SSAS R2 and SharePoint 2010 – Business IntelligenceSlava Kokaev
 
Technical Documentation 101 for Data Engineers.pdf
Technical Documentation 101 for Data Engineers.pdfTechnical Documentation 101 for Data Engineers.pdf
Technical Documentation 101 for Data Engineers.pdfShristi Shrestha
 
Using neo4j for enterprise metadata requirements
Using neo4j for enterprise metadata requirementsUsing neo4j for enterprise metadata requirements
Using neo4j for enterprise metadata requirementsNeo4j
 
Bhawani prasad mdm-cdh-methodology
Bhawani prasad mdm-cdh-methodologyBhawani prasad mdm-cdh-methodology
Bhawani prasad mdm-cdh-methodologyBhawani N Prasad
 
New
NewNew
Newchew kok meng
 
Performance management capability
Performance management capabilityPerformance management capability
Performance management capabilitydesigner DATA
 
Prague data management meetup #30 2019-10-04
Prague data management meetup #30 2019-10-04Prague data management meetup #30 2019-10-04
Prague data management meetup #30 2019-10-04Martin Bém
 
Prague data management meetup #31 2020-01-27
Prague data management meetup #31 2020-01-27Prague data management meetup #31 2020-01-27
Prague data management meetup #31 2020-01-27Martin Bém
 

Contenu connexe

Similaire à Prague data management meetup 2017-03-28

Prague data management meetup 2016-11-22
Prague data management meetup 2016-11-22Prague data management meetup 2016-11-22
Prague data management meetup 2016-11-22Martin Bém
 
Dataware housing
Dataware housingDataware housing
Dataware housingwork
 
dw_concepts_2_day_course.ppt
dw_concepts_2_day_course.pptdw_concepts_2_day_course.ppt
dw_concepts_2_day_course.pptDougSchoemaker
 
BI Security (1).ppt
BI Security (1).pptBI Security (1).ppt
BI Security (1).pptcsekar2
 
Master Data Management methodology
Master Data Management methodologyMaster Data Management methodology
Master Data Management methodologyDatabase Architechs
 
Datawarehouse Overview
Datawarehouse OverviewDatawarehouse Overview
Datawarehouse Overviewashok kumar
 
Systems Analyst and Design - Data Dictionary
Systems Analyst and Design - Data DictionarySystems Analyst and Design - Data Dictionary
Systems Analyst and Design - Data DictionaryKimberly Coquilla
 
Data Warehouse
Data WarehouseData Warehouse
Data Warehouseganblues
 
Business process modeling and analysis for data warehouse design
Business process modeling and analysis for data warehouse designBusiness process modeling and analysis for data warehouse design
Business process modeling and analysis for data warehouse designSlava Kokaev
 
3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.pptBsMath3rdsem
 
The Modern World of Information Architecture
The Modern World of Information ArchitectureThe Modern World of Information Architecture
The Modern World of Information ArchitectureRecordPoint
 
SSAS R2 and SharePoint 2010 – Business Intelligence
SSAS R2 and SharePoint 2010 – Business IntelligenceSSAS R2 and SharePoint 2010 – Business Intelligence
SSAS R2 and SharePoint 2010 – Business IntelligenceSlava Kokaev
 
Technical Documentation 101 for Data Engineers.pdf
Technical Documentation 101 for Data Engineers.pdfTechnical Documentation 101 for Data Engineers.pdf
Technical Documentation 101 for Data Engineers.pdfShristi Shrestha
 
Using neo4j for enterprise metadata requirements
Using neo4j for enterprise metadata requirementsUsing neo4j for enterprise metadata requirements
Using neo4j for enterprise metadata requirementsNeo4j
 
Bhawani prasad mdm-cdh-methodology
Bhawani prasad mdm-cdh-methodologyBhawani prasad mdm-cdh-methodology
Bhawani prasad mdm-cdh-methodologyBhawani N Prasad
 
Performance management capability
Performance management capabilityPerformance management capability
Performance management capabilitydesigner DATA
 

Similaire à Prague data management meetup 2017-03-28 (20)

Dimensional Modelling
Dimensional ModellingDimensional Modelling
Dimensional Modelling
 
Prague data management meetup 2016-11-22
Prague data management meetup 2016-11-22Prague data management meetup 2016-11-22
Prague data management meetup 2016-11-22
 
Dataware housing
Dataware housingDataware housing
Dataware housing
 
dw_concepts_2_day_course.ppt
dw_concepts_2_day_course.pptdw_concepts_2_day_course.ppt
dw_concepts_2_day_course.ppt
 
BI Security (1).ppt
BI Security (1).pptBI Security (1).ppt
BI Security (1).ppt
 
Database 2 External Schema
Database 2 External SchemaDatabase 2 External Schema
Database 2 External Schema
 
Master Data Management methodology
Master Data Management methodologyMaster Data Management methodology
Master Data Management methodology
 
Sap Bw 3.5 Overview
Sap Bw 3.5 OverviewSap Bw 3.5 Overview
Sap Bw 3.5 Overview
 
Datawarehouse Overview
Datawarehouse OverviewDatawarehouse Overview
Datawarehouse Overview
 
Systems Analyst and Design - Data Dictionary
Systems Analyst and Design - Data DictionarySystems Analyst and Design - Data Dictionary
Systems Analyst and Design - Data Dictionary
 
Data Warehouse
Data WarehouseData Warehouse
Data Warehouse
 
Business process modeling and analysis for data warehouse design
Business process modeling and analysis for data warehouse designBusiness process modeling and analysis for data warehouse design
Business process modeling and analysis for data warehouse design
 
3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt
 
The Modern World of Information Architecture
The Modern World of Information ArchitectureThe Modern World of Information Architecture
The Modern World of Information Architecture
 
SSAS R2 and SharePoint 2010 – Business Intelligence
SSAS R2 and SharePoint 2010 – Business IntelligenceSSAS R2 and SharePoint 2010 – Business Intelligence
SSAS R2 and SharePoint 2010 – Business Intelligence
 
Technical Documentation 101 for Data Engineers.pdf
Technical Documentation 101 for Data Engineers.pdfTechnical Documentation 101 for Data Engineers.pdf
Technical Documentation 101 for Data Engineers.pdf
 
Using neo4j for enterprise metadata requirements
Using neo4j for enterprise metadata requirementsUsing neo4j for enterprise metadata requirements
Using neo4j for enterprise metadata requirements
 
Bhawani prasad mdm-cdh-methodology
Bhawani prasad mdm-cdh-methodologyBhawani prasad mdm-cdh-methodology
Bhawani prasad mdm-cdh-methodology
 
New
NewNew
New
 
Performance management capability
Performance management capabilityPerformance management capability
Performance management capability
 

Plus de Martin Bém

Prague data management meetup #30 2019-10-04
Prague data management meetup #30 2019-10-04Prague data management meetup #30 2019-10-04
Prague data management meetup #30 2019-10-04Martin Bém
 
Prague data management meetup #31 2020-01-27
Prague data management meetup #31 2020-01-27Prague data management meetup #31 2020-01-27
Prague data management meetup #31 2020-01-27Martin Bém
 
Pitfalls of Data Warehousing_2019-04-24
Pitfalls of Data Warehousing_2019-04-24Pitfalls of Data Warehousing_2019-04-24
Pitfalls of Data Warehousing_2019-04-24Martin Bém
 
Meetup 2018-10-23
Meetup 2018-10-23Meetup 2018-10-23
Meetup 2018-10-23Martin Bém
 
Prague data management meetup 2018-04-17
Prague data management meetup 2018-04-17Prague data management meetup 2018-04-17
Prague data management meetup 2018-04-17Martin Bém
 
Prague data management meetup 2018-05-22
Prague data management meetup 2018-05-22Prague data management meetup 2018-05-22
Prague data management meetup 2018-05-22Martin Bém
 
Prague data management meetup 2018-03-27
Prague data management meetup 2018-03-27Prague data management meetup 2018-03-27
Prague data management meetup 2018-03-27Martin Bém
 
Prague data management meetup 2018-02-27
Prague data management meetup 2018-02-27Prague data management meetup 2018-02-27
Prague data management meetup 2018-02-27Martin Bém
 
Prague data management meetup 2018-01-30
Prague data management meetup 2018-01-30Prague data management meetup 2018-01-30
Prague data management meetup 2018-01-30Martin Bém
 
Prague data management meetup 2017-11-21
Prague data management meetup 2017-11-21Prague data management meetup 2017-11-21
Prague data management meetup 2017-11-21Martin Bém
 
Prague data management meetup 2017-10-24
Prague data management meetup 2017-10-24Prague data management meetup 2017-10-24
Prague data management meetup 2017-10-24Martin Bém
 
Prague data management meetup 2017-09-26
Prague data management meetup 2017-09-26Prague data management meetup 2017-09-26
Prague data management meetup 2017-09-26Martin Bém
 
Prague data management meetup 2017-05-16
Prague data management meetup 2017-05-16Prague data management meetup 2017-05-16
Prague data management meetup 2017-05-16Martin Bém
 
Prague data management meetup 2017-04-25
Prague data management meetup 2017-04-25Prague data management meetup 2017-04-25
Prague data management meetup 2017-04-25Martin Bém
 
Prague data management meetup 2017-02-28
Prague data management meetup 2017-02-28Prague data management meetup 2017-02-28
Prague data management meetup 2017-02-28Martin Bém
 
Prague data management meetup 2017-01-23
Prague data management meetup 2017-01-23Prague data management meetup 2017-01-23
Prague data management meetup 2017-01-23Martin Bém
 
Prague data management meetup 2016-10-17
Prague data management meetup 2016-10-17Prague data management meetup 2016-10-17
Prague data management meetup 2016-10-17Martin Bém
 
Prague data management meetup 2016-09-22
Prague data management meetup 2016-09-22Prague data management meetup 2016-09-22
Prague data management meetup 2016-09-22Martin Bém
 
Prague data management meetup 2016-03-07
Prague data management meetup 2016-03-07Prague data management meetup 2016-03-07
Prague data management meetup 2016-03-07Martin Bém
 
Prague data management meetup 2016-01-12 pub
Prague data management meetup 2016-01-12 pubPrague data management meetup 2016-01-12 pub
Prague data management meetup 2016-01-12 pubMartin Bém
 

Plus de Martin Bém (20)

Prague data management meetup #30 2019-10-04
Prague data management meetup #30 2019-10-04Prague data management meetup #30 2019-10-04
Prague data management meetup #30 2019-10-04
 
Prague data management meetup #31 2020-01-27
Prague data management meetup #31 2020-01-27Prague data management meetup #31 2020-01-27
Prague data management meetup #31 2020-01-27
 
Pitfalls of Data Warehousing_2019-04-24
Pitfalls of Data Warehousing_2019-04-24Pitfalls of Data Warehousing_2019-04-24
Pitfalls of Data Warehousing_2019-04-24
 
Meetup 2018-10-23
Meetup 2018-10-23Meetup 2018-10-23
Meetup 2018-10-23
 
Prague data management meetup 2018-04-17
Prague data management meetup 2018-04-17Prague data management meetup 2018-04-17
Prague data management meetup 2018-04-17
 
Prague data management meetup 2018-05-22
Prague data management meetup 2018-05-22Prague data management meetup 2018-05-22
Prague data management meetup 2018-05-22
 
Prague data management meetup 2018-03-27
Prague data management meetup 2018-03-27Prague data management meetup 2018-03-27
Prague data management meetup 2018-03-27
 
Prague data management meetup 2018-02-27
Prague data management meetup 2018-02-27Prague data management meetup 2018-02-27
Prague data management meetup 2018-02-27
 
Prague data management meetup 2018-01-30
Prague data management meetup 2018-01-30Prague data management meetup 2018-01-30
Prague data management meetup 2018-01-30
 
Prague data management meetup 2017-11-21
Prague data management meetup 2017-11-21Prague data management meetup 2017-11-21
Prague data management meetup 2017-11-21
 
Prague data management meetup 2017-10-24
Prague data management meetup 2017-10-24Prague data management meetup 2017-10-24
Prague data management meetup 2017-10-24
 
Prague data management meetup 2017-09-26
Prague data management meetup 2017-09-26Prague data management meetup 2017-09-26
Prague data management meetup 2017-09-26
 
Prague data management meetup 2017-05-16
Prague data management meetup 2017-05-16Prague data management meetup 2017-05-16
Prague data management meetup 2017-05-16
 
Prague data management meetup 2017-04-25
Prague data management meetup 2017-04-25Prague data management meetup 2017-04-25
Prague data management meetup 2017-04-25
 
Prague data management meetup 2017-02-28
Prague data management meetup 2017-02-28Prague data management meetup 2017-02-28
Prague data management meetup 2017-02-28
 
Prague data management meetup 2017-01-23
Prague data management meetup 2017-01-23Prague data management meetup 2017-01-23
Prague data management meetup 2017-01-23
 
Prague data management meetup 2016-10-17
Prague data management meetup 2016-10-17Prague data management meetup 2016-10-17
Prague data management meetup 2016-10-17
 
Prague data management meetup 2016-09-22
Prague data management meetup 2016-09-22Prague data management meetup 2016-09-22
Prague data management meetup 2016-09-22
 
Prague data management meetup 2016-03-07
Prague data management meetup 2016-03-07Prague data management meetup 2016-03-07
Prague data management meetup 2016-03-07
 
Prague data management meetup 2016-01-12 pub
Prague data management meetup 2016-01-12 pubPrague data management meetup 2016-01-12 pub
Prague data management meetup 2016-01-12 pub
 

Dernier

How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...apidays
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...apidays
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistandanishmna97
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Angeliki Cooney
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMECloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 

Dernier (20)

How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMECloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 

Prague data management meetup 2017-03-28

  • 1. Metadata v DW/BI #13 28. 3. 2017 Prague Data Management Meetup
  • 2. Agenda • Prague Data Management Meetup • Metadata v DW/BI
  • 3. Prague Data Management Meetup Data Management Získávaní dat Ukládání dat Zpracování dat Interpretace dat Použití dat • Otevřená profesionální zájmová skupina • Každý je vítán (ať už v pasivní nebo aktivní roli) • Témat není nikdy dost • Snaha o pravidelné měsíční setkávání • Fungujeme od září 2015
  • 4. Historie # Datum Téma 1 10. 9. 2015 Data Management 2 14. 10. 2015 Data Lake 3 23. 11. 2015 Dark Data (without Dark Energy and Dark Force) 4 12. 1. 2016 Data Lake (znova) 5 7. 3. 2016 Sad Stories About DW Modeling (sad stories only) 6 23. 3. 2016 Self-service BI Street Battle 7 27. 4. 2016 Let's explore the new Microsoft PowerBI! 8 22. 9. 2016 Data Management pro začátečníky 9 17. 10. 2016 Small Big Data 10 22. 11. 2016 Základy modelování DW 11 23.1.2017 Komponenty datových skladů 12 28.2.2017 Operational Data Store 13 28.3.2017 Metadata v DW/BI 14 25.4.2017 Jak se stát DW/BI konzultantem 15 16.5.2017 SQL
  • 8.
  • 9.
  • 10.
  • 11. Gartner Magic Quadrant for Data Management Solutions for Analytics 2017
  • 12.
  • 13. Metadata v DW/BI Věc naprosto kritická
  • 14. DWH/BI Logical Layers Stage Area Relational Area Consolidation Area Data Mart Area • Data Mart Area • L2 • User Access Layer • Consolidation Area • Consolidated L1 • Common aggregates for L2 • Cleansed and consolidated data • Relational Area • Detailed L1 • Consistent, integrated, subject oriented data, universal data structure, historical data, maximal detail • System of record • Stage Area • Direct copy of source systems Extracts Reports Note: Consolidated and Detailed L1 can share same data structures General DWH Staging Area ODS Presentation Layer Datamart Area (Dependent Datamarts) Source systems Customer DB ETL Other...S4S3S2S1 Analytic tools (SPSS, SAS..) OLAP S1 S2 S3 S4 Other S1 Ostatní...S4S3S2 ETL Materialization OLAP? ETL ETL ETL ETL ETL ETL ETL ETL ETL ETL CDB ETL EAI ReportingReporting Reporting Reporting Relational Area ETL Application Application Materialization Application Application ETL
  • 15.
  • 16. Metadata • Metadata is data in context • Data about data • Data that provides information about other data • Metadata is structured information that describes, explains, locates, or otherwise makes it easier to retrieve, use, or manage an information resource. Metadata is often called data about data or information about information. Descriptive metadata • Describes a resource for purposes such as discovery and identification. It can include elements such as title, abstract, author, and keywords. Structural metadata • Metadata about containers of data and indicates how compound objects are put together, for example, how pages are ordered to form chapters. Administrative metadata • Provides information to help manage a resource, such as when and how it was created, file type and other technical information, and who can access it.
  • 18.
  • 19.
  • 20. Business Process Analysis #2 Analysis #1 Application Integration vs. Data Integration Some data are lost… Some data unusable… Some data unused… Operations Analytics
  • 21. Conceptual models Metadata “Glue” Business subject areas Conceptual data models Business systems CASE models (live) Business systems (databases, ERPs, legacy etc.) The metadata glue Key business data elements CASE metadata Physical metadata
  • 22. Truth in data 22 Primary data Primary data (another system) Secondary data Consolidated data …Noise generator Truth • Independent data truth does not exist • Truth depends on Business and Data architect definition (metadata)
  • 23. Adastra Business Intelligence Reference Architecture 23 ODS Operational reporting Enterprise DWH Big Data Platform Data Lake Event Processing Semantic Models Advanced Analytics Perceptual / cognitive intelligence Information Management Relational / Structured data Unstructured data Streaming Data Workflow Orchestration Data Transformation / Processing Data Management Event Ingestion Complex Event Processing Notifications BI / Application Integration Machine Learning In-database Data Mining, R Recognition of human interaction and intent SMP and MPP In-memory technologies In-memory Columnar In-memory technologies Hadoop, NoSQL Business Intelligence / Data Delivery Real-time DashboardsDashboards and visualizationsReports Self-service BIMobile BI IoT Network Field Gateway Big data OLAP Metadata Metadata Metadata Metadata Metadata Metadata Metadata Metadata Metadata Metadata Metadata
  • 24. Metadata vs. Datová architektura DW/BI Kontext • Terminologie • Metriky • Business pravidla • Business procesy Statika  Struktury  Slovníky  Statistiky Dynamika • Pohyb dat • Transformace • Stárnutí
  • 27. Good vs. Bad Metadata
  • 28. Metadata Quality Accuracy Availability Completeness Conformance (Standard) Consistency Credibility & Origination Processability (Machine- readable) Relevance Timeliness
  • 29. Metadata Consolidation History Program based • Sequential or index-sequential or direct access files Tagged file formats • Structured input format standards, XML Database data dictionaries Repositories • CASE , ETL tools, Analytical tools Enterprise metadata repositories Consolidated Column Hierarchy Parent MemberLead Reverse Individual Entrepreneur 2 1 AddressBirth placeAddressIssuer 1 2 Business <<ODS Table>> Party Party Relationship Party Party Relationship Key Party Party Relationship Type Key Instance Party Key 1 Instance Party Key 2 Source System ID Source ID <<Ref Table>> Party Party Relationship Type Party Party Relationship Type Key Reverse Party Party Relationship Type Key Source System ID Source ID <<Ref Table>> Phone Purpose Phone Purpose Key Source System ID Source ID <<Ref Table>> Address Purpose Address Purpose Key Source System ID Source ID <<ODS Table>> Party Segment Party Segment Key Instance Party Key Segment Key Unified Party Key Business Key Source System ID Segmentation Key Source ID <<Ref Table>> Segment Segment Key Parent Segment Key Segmentation Key Source ID Source System ID <<ODS Table>> POS Segment POS Segment Key POS Key POS Segment Type Key Segment Key Segmentation Key Source System ID Source ID <<Ref Table>> POS Segment Type POS Segment Type Key Parent POS Segment Type Key Source System ID Source ID <<ODS Table>> Instance ID Card Instance ID Card Key ID Card Type Key Instance Party Key Unified ID Card Key Country Key Source System ID Source ID <<Ref Table>> ID Card Type ID Card Type Key Source System ID Source ID <<DW Table>> BW Party BW Party Key Instance Party Key Source System ID Country Key Located Address Key Loc Source System ID Instance Phone Key Ins Source System ID BW List Key Bw List Action Key BW List Reason Key Instance ID Card Key Inserted Instance Party Key Updated Instance Party Key Canceled Instance Party Key Employer Instance Party Key <<Ref Table>> BW List Reason BW List Reason Key BW List Key Source ID Source System ID <<ODS Table>> Instance Email Instance Email Key POS Key Instance Party Key POS Chain Key Email Purpose Key Source System ID Source ID <<ODS Table>> Instance Bank Contact Instance Bank Contact Key POS Key Instance Party Key Currency Key Source System ID Source ID <<ODS Table>> Party Daily Fact Party Daily Fact Key Instance Party Key Source System ID Snapshot Date <<ODS Table>> Party Monthly Fact Party Monthly Fact Key Instance Party Key Source System ID Snapshot Date <<ODS Table>> Household Household Key Unified Party Key Business Key Located Address Key Source ID Source System ID <<ODS Table>> Corporate Household Corporate Household Key Lead Unified Party Key Member Unified Party Key Member Business Key Source System ID Source ID <<ODS Table>> Unified Party Unified Party Key Business Key <<ODS Table>> Located Address Located Address Key Country Key Address District Key Source System ID Source ID <<Ref Table>> BW List BW List Key Source ID Source System ID <<ODS Table>> POS Credit Limit POS Credit Limit Key POS Key Source System ID Source ID <<ODS Table>> POS Payment POS Payment Key POS Key Source System ID Source ID <<Ref Table>> Party Type Party Type Key Source System ID Source ID <<ODS Table>> POS Contract POS Contract Key POS Key Source System ID Source ID <<ODS Table>> Instance Web Page Instance Web Page Key POS Key Instance Party Key Web Page Purpose Key Source System ID Source ID <<ODS Table>> POS Product Restriction POS Business Product Restriction Key POS Key Business Product Type Key Source ID <<Ref Table>> Party Status Party Status Key Source System ID Source ID <<ODS Table>> POS Party Relationship POS Party Relationship Key POS Key Instance Party Key Party Role Type Key POS Chain Key Source System ID Source ID <<Ref Table>> Party Role Type (<GE_IA_Logical_Product>) Party Role Type Key Source System ID Source ID <<Ref Table>> POS Status POS Status Key Source System ID Source ID <<Ref Table>> POS Type POS Type Key Source System ID Source ID <<Ref Table>> POS Placement POS Placement Key Source System ID Source ID <<ODS Table>> POS Commodity Register POS Commodity Key POS Key Commodity Key Source System ID Source ID <<ODS Table>> POS Chain POS Chain Key Instance Party Key Source System ID Source ID <<ODS Table>> POS Application POS Application Key POS Key Source System ID Source ID <<Ref Table>> Web Page Purpose Web Page Purpose Key Source System ID Source ID <<ODS Table>> Unified ID Card Unified IDCard Key Source System ID Source ID <<Ref Table>> Phone Type Phone Type Key Source System ID Source ID <<ODS Table>> Unified Party Alias Individual Unified Party Key Individual Business Key Entrepreneur Unified Party Key Entrepreneur Business Key Source System ID Source ID <<DW Table>> ECB Client ECB Client Key Unified Party Key Business Key Party Type Key Birth Place Country Key Address Country Key Legal Form Key Gender Key Party Role Key Source System ID Source ID <<DW Table>> ECB Operation ECB Operation Key ECB Client Key ECB Operation Phase Key ECB Operation Type Key ECB Payment Type Key ECB Personal Guarantee Type Key ECB Material Guarantee Type Key ECB Payment Period Key ECB Signalization Key ECB Installment Type Key ECB Transfer Type Key Source System ID Source ID <<ADS Table>> ECB Personal Information ECB Personal Information Key ECB Client Key ID Card Type Key Issuer Country Key Address Country Key Source System ID Source ID <<DW Table>> ECB Address ECB Address Key Country Key ECB Client Key Source System ID Source ID <<ADS Table>> ECB Shareholder ECB Shareholder Key ECB Client Key 1 ECB Client Key 2 Party Type Key Legal Form Key Party Party Relationship Type Key Source System ID Source ID <<Ref Table>> Fact Type Fact Type Key Source ID Source System ID <<ODS Table>> Address District Address District Key Source System ID Source ID <<Ref Table>> Segmentation Segmentation Key Source ID Source System ID <<DW Table>> ECB Operation Person ECB Operation Person Key ECB Operation Inst Key ECB Client Key Party Role Key Source System ID Source ID <<Ref Table>> Country Country Key Source System ID Source ID <<DW Table>> ECB Operation NonInst History ECB Operation NonInst History Key ECB Operation Key Source System ID Source ID <<Ref Table>> Language Language Key Source System ID Source ID <<DW Table>> ECB Event ECB Event Key ECB Event Type Key ECB Client Key Source System ID Source ID <<Ref Table>> Business Sector Business Sector Key Source System ID Source ID <<DW Table>> ECB Event Type ECB Event Type Key Source System ID Source ID <<Ref Table>> Stay Type Stay Type Key Source System ID Source ID <<Ref Table>> ECB Operation Phase ECB Operation Phase Key Source System ID Source ID <<Ref Table>> Occupation Occupation Key Source System ID Source ID <<DW Table>> ECB Installment Type ECB Installment Type Key Source System ID Source ID <<Ref Table>> Legal Form Legal Form Key Source System ID Source ID <<DW Table>> ECB Material Guarantee Type ECB Material Guarantee Type Key Source System ID Source ID<<Ref Table>> ECB Operation Type ECB Operation Type Key Source System ID Source ID <<Ref Table>> ECB Payment Period ECB Payment Period Key Source System ID Source ID <<Ref Table>> ECB Payment Type ECB Payment Type Key Source System ID Source ID <<ODS Table>> POS Product Fact POS Product Fact Key POS Key Unified Party Key Business Key Source System ID Source ID <<Ref Table>> ECB Personal Guarantee Type ECB Personal Guarantee Type Key Source System ID Source ID <<Ref Table>> OKEC OKEC Key Source ID Source System ID <<Ref Table>> ECB Signalization ECB Signalization Key Source System ID Source ID <<ODS Table>> Party OKEC Party OKEC Key OKEC Key Instance Party Key Source System ID Source ID <<Ref Table>> ECB Transfer Type ECB Transfer Type Key Source System ID Source ID <<ODS Table>> Party Fact Party Fact Key Instance Party Key Fact Type Key Source System ID Source ID <<Ref Table>> Region Source System ID Source ID Region Key <<Ref Table>> District Source System ID Source ID District Key <<ODS Table>> Instance Party Instance Party Key Unified Party Key Business Key Party Type Key Party Status Key Language Key Country Key Business Sector Key Occupation Key Stay Type Key Legal Form Key Gender Key Employee Type Key Employment Status Key Marital Status Key Housing Status Key Education Status Key OKEC Key CNB Classification Key Source System ID Source ID District key <<ODS Table>> Instance Address Instance Address Key Located Address Key Address Purpose Key POS Key Instance Party Key POS Chain Key Country Key Source System ID Source ID <<ODS Table>> Instance Phone Instance Phone Key Phone Purpose Key Unified Phone Key POS Key Instance Party Key POS Chain Key Phone Type Key Source System ID Source ID <<Ref Table>> POS Invoice Type POS Invoice Type Key Source System ID Source ID <<Ref Table>> POS Ownership Type POS Ownership Type Key Source System ID Source ID <<ODS Table>> POS POS Key Business Key POS Status Key POS Type Key POS Payment Key Business POS Chain Key Invoice POS Chain Key POS Ownership Type Key District Key Region Key Source System ID Source ID POS Placement Key POS Invoice Type Key <<Ref Table>> Gender Gender Key Source System ID Source ID <<Ref Table>> Employment Type Employment Type Key Source System ID Source ID <<Ref Table>> Employment Status Employment Status Key Source System ID Source ID <<ODS Table>> Unified Phone Unified Phone Key Source System ID Source ID <<Ref Table>> Marital Status Marital Status Key Source System ID Source ID <<Ref Table>> Housing Status Housing Status Key Source System ID Source ID <<Ref Table>> Education Status Education Status Key Source System ID Source ID <<Ref Table>> Business (<GE_IA_Logical_Product>) Business Key Parent Business Key Source System ID Source ID A_SEG Segment Key Source ID Source System ID SEG <<Ref Table>> Currency (<GE_IA_Logical_Product>) Currency Key <<ODS Table>> Instance Party Cleaned Instance Party Key Source System ID Source ID <<ODS Table>> Instance Phone Cleaned Instance Phone Key Source System ID Source ID <<ODS Table>> Instance Address Cleaned Instance Address Key Source System ID Source ID <<Ref Table>> CNB Classification CNB Classification Key Source System ID Source ID <<Ref Table>> Party Accounting Type Party Accounting Type Key Source System ID Source ID <<Ref Table>> Occupation Detail Occupation Detail Key Occupation Key Source System ID Source ID <<Ref Table>> Phone IDC Phone IDC Key Source System ID Source ID <<Ref Table>> Company Branch Source System ID Source ID Company Branch Key <<Ref Table>> CR Registered Seat Source System ID Source ID CR Registered Seat Key <<Ref Table>> Selected Profession Group Type Source System ID Source ID Selected Profession Group Type Key <<Ref Table>> Statutory Body Type Statutory Body Type Key Source ID Source System ID <<ODS Table>> Instance Party Fact Instance Party Fact Key Instance Party Key Source System ID Snapshot Date <<ODS Table>> Manual Override Rule Manual Override Rule Key Parent Instance Party Key Child Instance Party Key Source System ID <<ODS Table>> Unified Party Segment Unified Party Segment Key Segment Key Segmentation Key Unified Party Key Business Key Source System ID Source ID <<Ref Table>> SAS Customer Type SAS Customer Type Key <<ODS Table>> SAS Unified Party Type Sas Unified Party Type Key SAS Customer Type Key SAS Customer Subtype Key Unified Party Key <<Ref Table>> SAS Customer Subtype SAS Customer Subtype Key <<ODS Table>> Unified Party Monthly Fact Unified Party Monthly Fact Key Unified Party Key Business Key <<Ref Table>> Company Employee Count Source System ID Source ID Company Employee Count Key <<Ref Table>> ID Card Purpose Source System ID Source ID ID Card Purpose Key <<Ref Table>> Occupation Lookup Occupation Lookup Key Occupation Key Occupation Detail Key Source System ID Source ID
  • 36. Design standards • Naming conventions • Models, nodes, layers, schemas • Entities • Attributes • Keys • Relationships • Indexes, constraints • Level of normalization • Level of convergence • Key strategy • Standard attributes Supplier standards Customer standards Third party product standards
  • 38. Name Code Account ACC Deposit DEP Balance BAL Amount AMT Party PT Probability of Default PD Adjusted ADJ Complex Name Good Example Bad Example Deposit Account DEP_ACC CURRENT_ACCNT Deposit Account Adjusted Balance DEP_ACC_ADJ_BAL DEP_ACC_ADJ_BALANCE Account Probability of Default ACC_PD ACC_PROB_OF_DEF Party Account PT_ACC PARTY_ACC Party Deposit PT_DEP PARTY_DEPOSIT Acronyms • Very simple dictionary • Simplify naming • “Common Language” • Shorter names
  • 39. Adastra System Metamodel for Oracle DB Database Schema (OWNER) PowerDesigner Physical Data Models (.PDM) Tables Mappings ETLs Generic Non-Generic APIs
  • 40. FK_INTRSBASRXFACT_INTRSBASRX FK_GLACC__GLACCTP FK_GLACC__CCY FK_GLACC__ACCSTAT FK_FXRXFACT__FXRX FK_FXRX_FX_CCY FX FK_FXRX__FXRXTP FK_FXRX__CCY FK_ENTRTRN__PROD FK_ENTRTRN__POS FK_ENTRTRN__MERCH FK_ENTRTRN__CNL FK_ENTRTRN__AUTHSTAT FK_ENTRTRN_DEBIT_ACC Debit FK_ACCTRN_MERCH_PT MERCH FK_ACCTRN__POS FK_ACCTRN__CRDB FK_ACCTRN__CNLFK_ACCTRN__CCY FK_ACCTRN__ACCTRNTP FK_ACCTRN__ACCTRNSTAT FK_ACCTRN__ACC FK_ACCPRODREL__PROD FK_ACCPRODREL__ACCPRODRELTP FK_ACCPRODREL__ACCFK_ACCHOLDFACT__POS FK_ACCHOLDFACT__MERCH FK_ACCHOLDFACT__CNL FK_ACCHOLDFACT__CCY FK_ACCHOLDFACT__BLOCTP FK_ACCHOLDFACT__BLOCSTAT FK_ACCHOLDFACT__AUTHSTAT FK_ACCHOLDFACT__ACC FK_ACCBALFACT__ACC FK_ACC__PT FK_ACC__GLACC FK_ACC__CCY FK_ACC__ACCTP FK_ACC__ACCSTAT <<Ref Table>> Account Status (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Account Status Key Identifier Description Local Description Active Flag Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <ak> <<ADS Table>> Account <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Account Key Party Key Account Type Key Account Status Key Currency Key GL Account Key POS Key Account Number Account ID Account Name Account Symbol IBAN Open Date Activation Date Close Date Company Code Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date Source Update DateTime INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) DATE DATE DATE VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <pk> <fk5> <fk1> <fk2> <fk3> <fk4> <fk6> <ak> <pk,ak,fk4,fk5,fk6> <<Ref Table>> Account Type (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Account Type Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <ak> <<Ref Table>> Currency (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Currency Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <<ADS Table>> GL Account <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> GL Account Key Account Status Key Currency Key GL Account Type Key GL Account Number GL Account Group Description Party Account Flag Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date Source Update DateTime INTEGER INTEGER INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <pk> <fk1> <fk2> <fk3> <ak> <pk,ak> <<ADS Table>> Party (<ABDM_DWH_CLIENT_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Party Key Unified Party Key Consolidate Party Key Party Type Key Party Status Key Business Sector Key Legal Form Key Country Key Language Key Housing Type Key Gender Key Personal Identifier Company Identifier P Code First Name First Name Latin Family Name Family Name Latin Middle Name Business Name Business Name Latin Short Name Short Name Latin Salutation Birth Date Resident Flag Bankruptcy Flag Start Date End Date Party Identifier Source System Identifier Source Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date Source Update DateTime INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) DATE INTEGER INTEGER DATE DATE VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <pk> <fk8> <fk7> <fk1> <fk6> <fk2> <fk5> <fk4> <fk3> <pk,ak> <ak> <<ADS Table>> Account Balance Fact <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Snap Date Account Key Balance Overdraft Balance Reserve Balance Planned Balance Account Hold Amount Available Amount Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date Source Update DateTime DATE INTEGER NUMBER(19,3) NUMBER(19,3) NUMBER(19,3) NUMBER(19,3) NUMBER(19,3) NUMBER(19,3) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <pk,ak> <pk,fk> <ak> <pk,ak,fk> <<ADS Table>> Account Hold Fact <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<DW Column>> Snap Date Account Hold Fact Key Account Key Blocation Type Key Blocking Status Key Authorization Status Key Merchant Key POS Key Channel Key Currency Key Expiry Blocking Date Blocking Description Hold Value Date Hold Entry Date Hold Reference Number Hold Batch Identifier Hold Amount Hold Amount Local Currency Hold Account FX Rate Source Identifier Source System Identifier Update Datetime Update Process Identifier Delete Flag Insert Process Identifier Insert Datetime Update Effective Date Source Update DateTime DATE INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER DATE VARCHAR2(255 CHAR) DATE DATE VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) NUMBER(19,3) NUMBER(19,3) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) DATE VARCHAR2(255) INTEGER VARCHAR2(255) DATE DATE DATE <pk,ak> <pk> <fk1> <fk7> <fk6> <fk2> <fk3> <fk4> <fk5> <fk8> <ak> <pk,ak,fk1,fk3,fk4> <<Ref Table>> Authorization Status (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Authorization Status Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <ak> <<Ref Table>> Blocking Status (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Blocking Status Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <ak> <<Ref Table>> Blocation Type (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Blocation Type Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <ak> <<Ref Table>> Channel (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<DW Column>> Channel Key Identifier Description Local Description Source Identifier Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier Channel Category Key INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) INTEGER <pk> <ak> <ak> <fk> <<ADS Table>> Merchant (<ABDM_DWH_CLIENT_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Merchant Key Party Key Merchant Type Key Merchant Code Key Merchant Category Key Business Product Type Key Channel Key Merchant Rate Merchant Commission Rate Test Mode Flag Discount Percent Merchant Contact Person Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Source Update DateTime Update Effective Date INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER NUMBER(10,6) NUMBER(10,6) INTEGER Number VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <pk> <fk6> <fk5> <fk4> <fk3> <fk1> <fk2> <ak> <pk,ak,fk6> <<ADS Table>> POS (<ABDM_DWH_CLIENT_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<DW Column>> <<DW Column>> POS Key Party Key POS Type Key POS Financial Category Key POS Identifier POS Description Opening Hours Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Source Update DateTime Update Effective Date SC Code MFO INTEGER INTEGER INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) <pk> <fk3> <fk2> <fk1> <ak> <pk,ak,fk3> <<ADS Table>> Account Product Relationship <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Account Product Relationship Key Account Key Product Key Account Product Relationship Type Key Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date Source Update DateTime INTEGER INTEGER INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <pk> <fk2> <fk1> <fk3> <ak> <pk,ak,fk1,fk2> <<Ref Table>> Account Product Relationship Type (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Account Product Relationship Type Key Identifier Description Local Description Main Account Flag Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <ak> <<ADS Table>> Product (<ABDM_DWH_PRODUCT_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Product Key Contract Key Product Status Key Business Product Type Key System Product Type Key Term Type Key Commodity Key Accrual Basis Key Point of Sale Key Channel Key Bank Module Key Product Number Credit Bureau ID Customer Product Description Campaign Promotional code Open Date Close Date Maturity Date Main Product Flag External Register Report Flag Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date Source Update DateTime INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) DATE DATE DATE INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <ak1> <ak2> <ak1,ak2> <<ADS Table>> Account Transaction <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<DW Column>> Account Transaction Key Transaction Date POS Key Credit Account Key Debit Account Key Credit GL Account Key Debit GL Account Key Account Transaction Type Key Account Transaction Status Key Currency Key Employee Key Account Transaction Order Key Entry Transaction Key Transaction Value Date Transaction Entry DateTime Transaction Amount Transaction Local Currency Amount Transaction Account FX Rate Transaction Reference Number Transaction Authorization Number Transaction Batch Identifier Transaction Application Identifier Transaction Entry Identifier Transaction Order Identifier Transaction Document Number Transaction Ground Description Cancel Flag Message For Recipient Message For Sender Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date Source Update DateTime INTEGER DATE INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER DATE DATE NUMBER(19,3) NUMBER(19,3) NUMBER(10,6) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <pk> <pk,ak,fk6> <fk5> <fk1> <fk2,fk8> <fk3> <fk4> <fk6> <ak> <pk,ak,fk1,fk5,f...> <<Ref Table>> Account Transaction Status (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Account Transaction Status Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <ak> <<Ref Table>> Account Transaction Type (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Account Transaction Type Key Account Transaction Category Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier Account Transaction Code DR/CR Indicator Level 1 Description Level 2 Description Level 3 Description Level 4 Description Level 1 Code Level 2 Code Level 4 Code Level 3 Code INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) <pk> <fk> <ak> <ak> <<Ref Table>> Credit/Debit (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Credit/Debit Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <ak> <<ADS Table>> Entry Transaction <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<DW Column>> Entry Transaction Key Transaction Date Entry Transaction Type Key Entry Transaction Sub Type Key Entry Transaction Status Key Debit Account key Credit Account Key Product Key Card Key Authorization Status Key Channel Key Merchant Key POS Key POS Type Key Country Key Card Transaction Location Key Acquirer Financial Institution Key Issuer Financial Institution Key Currency Key Original Currency Key Transaction Amount Transaction Local Currency Amount Transaction Original Currency Amount Transaction FX Rate Transaction Value Date Transaction Entry Date Transaction Expiry Date Entry Transaction Identifier Transaction Reference Number Transaction Authorization Identifier Transaction Card Mask Transaction Card BIN Identifier Transaction Batch Identifier Transaction STAN Identifier Source Identifier Source System Identifier Update Datetime Update Process Identifier Delete Flag Insert Process Identifier Insert Datetime Update Effective Date Source Update DateTime INTEGER DATE INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER INTEGER NUMBER(19,3) NUMBER(19,3) NUMBER(19,3) VARCHAR2(255 CHAR) DATE DATE DATE VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) DATE VARCHAR2(255) INTEGER VARCHAR2(255) DATE DATE DATE <pk> <pk,ak> <fk10> <fk1> <fk9> <fk6> <fk11> <fk2> <fk5> <fk3> <fk4> <ak> <pk,ak,fk1,fk3,f...> <<ADS Table>> FX Rate <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> FX Rate Key Currency Key FX Currency Key FX Rate Type Key FX Scale Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date Source Update DateTime INTEGER INTEGER INTEGER INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <pk> <fk1> <fk2> <fk3> <ak> <pk,ak> <<Ref Table>> FX Rate Type (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> FX Rate Type Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <ak> <ak> <<ADS Table>> FX Rate Fact <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Snap Date FX Rate Key Buy Rate Rate Sell Rate Value Date Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date Source Update DateTime DATE INTEGER NUMBER(10,6) NUMBER(10,6) NUMBER(10,6) DATE VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE DATE <pk,ak> <pk,fk> <ak> <pk,ak,fk> <<Ref Table>> GL Account Type (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<DW Column>> <<DW Column>> GL Account Type Key Identifier Description Local Description Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier GL Account Category Key NBG_FLAG INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) INTEGER INTEGER <pk> <ak> <ak> <fk> <<Ref Table>> Interest Base Rate (<ABDM_DWH_REF_TAB_ADS>) <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Interest Base Rate Key Period Frequency Key Identifier Description Local Description Market Flag Source ID Source System ID Delete Flag Insert Datetime Insert Process Identifier Update Datetime Update Effective Date Update Process Identifier INTEGER INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER DATE VARCHAR2(255) DATE DATE VARCHAR2(255) <pk> <fk> <ak> <ak> <<ADS Table>> Interest Base Rate Fact <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<DW Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> <<Audit Column>> Snap Date Interest Base Rate Key Rate Source Identifier Source System Identifier Delete Flag Insert Process Identifier Insert Datetime Update Process Identifier Update Datetime Update Effective Date DATE INTEGER NUMBER(10,6) VARCHAR2(255 CHAR) VARCHAR2(255 CHAR) INTEGER VARCHAR2(255) DATE VARCHAR2(255) DATE DATE <pk,ak> <pk,fk> <ak> <pk,ak>
  • 41.
  • 42. Metadata vs. Reference Data Reference Data is sometimes Metadata!!!
  • 44. Metadata v datové transformaci Source table Target table table Target table Filter SRC Filter TRG Differential member (minus, outer join or 10gMerge) Filter OUT Lookup tables Join SRC
  • 45. Přínosy MDD Silná orientace na metadata (metadata- driven) Fakticky 100% konzistence modelu s výslednou implementací Otevřená architektura Snadná rozšiřitelnost Kratší a efektivnější vývojový cyklus (o cca. 50% oproti klasickému způsobu vývoje) Nižší náklady na vývoj Více času na analýzu Standardizace implementace (vysoce srozumitelný kód) Udržovaná dokumentace (vedlejší efekt silné orientace na metadata) API/ETL change management Impact analýza Možnost provádět automatické kontroly kvality Verzování User-friendly
  • 47.
  • 48. Oracle Enterprise Metadata Manager http://www.oracle.com/technetwork/middleware/oemm/overview/ind ex.html