SlideShare une entreprise Scribd logo
1  sur  10
Télécharger pour lire hors ligne
PG Day, Horwood House, July 9th 2014
(Why you should) Get Modelling!
George McGeachie
Metadata Matters Limited
PG Day, Horwood House, July 9th 2014
It’s a lot more than just a Diagram
2
What is a Data Model?
PG Day, Horwood House, July 9th 2014 3
Simon and Hannu
say …
Page 59
• Plan a new database
◦ Design structure and estimate size
 A data modelling tool is perfect for that job
• This is an iterative process
◦ Need version control and ability to apply deltas
PG Day, Horwood House, July 9th 2014
 Migrate from Oracle to
PostgreSQL
 Reverse-engineer from
database, WSDL, XSDs etc.
 create logical and
conceptual views
 Generate XML Schemas
4
Automate tasks
PG Day, Horwood House, July 9th 2014
 Use standard and bespoke
model checks to validate
models
 Enforce naming standards
using a Glossary
 Use your default physical
options
 Create / update your database
 Produce scripts the way you
want them, avoid errors
caused by editing scripts
5
Validate and Generate
PG Day, Horwood House, July 9th 2014 6
Model and Generate OLAP
FK_MONTH_RELATIONS_YEAR
FK_BOOK_SAL_RELATIONS_MONTH
FK_BOOK_SAL_RELATIONS_PUBLICAT
Publication
Book Title
Publication Media Type Code
Publication Date
Dollar List Price
ISBN
Page Count
Primary Author Name
Primary Author Pseudonym
Primary Author Royalty Percent
age
CHAR(100)
NUMBER(2)
DATE
NUMBER(5,2)
NUMBER(13)
NUMBER(4)
CHAR(100)
CHAR(100)
NUMBER(2)
<pk>
<pk>
<i>
<i>
not null
not null
null
not null
not null
null
not null
null
null
Book Sales
Year Code
Month Code
Book Title
Publication Media Type Code
Gross Sales Value Amount
NUMBER(2)
NUMBER(2)
CHAR(100)
NUMBER(2)
NUMBER(5,2)
<pk,fk1>
<pk,fk1>
<pk,fk2>
<pk,fk2>
<i1,i2>
<i1,i2>
<i1,i3>
<i1,i3>
not null
not null
not null
not null
not null
Month
Year Code
Month Code
Month Description
CHAR(60)
CHAR(60)
CHAR(256)
<pk,fk>
<pk>
<i1,i2>
<i1>
not null
not null
null
Year
Year Code
Year Description
CHAR(60)
CHAR(256)
<pk> <i> not null
not null
Book Sales - Year_Month
Book Sales - Publication
Measure
Book Sales
Gross Sales Value Amount
Year Code
Month Code
Book Title
Publication Media Type Code
Year_Month
Year Year Code
Year Description
Month Year Code
Month Code
Month Description
<h:1>
<h:2>
<h:3>
Hierarchy_1 <Default> <h>
Publication
Book Title
Publication Media Type Code
Publication Date
Dollar List Price
ISBN
Page Count
Primary Author Name
Primary Author Pseudonym
Primary Author Royalty Percentage
<h:1>
<h:2>
Hierarchy_1 <Default> <h>
Attributes
Hierarchy
PG Day, Horwood House, July 9th 2014 7
Simon and Hannu
say …
Page 53
• Understand Database
Dependencies
◦ e.g. Table  View  Procedure
PG Day, Horwood House, July 9th 2014
 ETL Jobs
 Forms and Reports
 Applications
 XML Message Schemas
 Regulatory Requirements
 Business Processes
 Use Cases
 JIRA tickets
etc.
8
What about dependencies that
aren’t in your database?
Application
produce
use use
use
use
use
produce
<Undefined>
use
Behind the scenes,
Data objects are being
accessed
Databases are linked to the Physical Data Models that
describe them
Report
Database 1
PostgreSQL
Data Warehouse
Database 2
Teradata
Data Mart
ETL or other Data Movement
Windows Screen
Window form
Web Form
Web form
PG Day, Horwood House, July 9th 2014
 Map data movements, generate data
movement scripts, ETL scripts, replication
scripts etc
9
Create Mappings
Marts
ice ss pdm
Post Codes
Lookup
EDW
EDW_PDM
OLTP
PDM
OLTP to EDW EDW to Marts
PG Day, Horwood House, July 9th 2014 10
Get Modelling!
Build a database of your database metadata, and join the dots to other stuff
What Tools are there?
The big 3
ERwin, ER/Studio, PowerDesigner
Others
Dezign
Sparx EA
ModelRight
Silverrun
IBM Infosphere Data Architect
Toad Data Modeller
might not all support PG

Contenu connexe

Similaire à Lightning talk at UK PG Day, 2014 - Get Modelling!

Big Data Presentation at SCQAA-SF on June 12 2013
Big Data Presentation at SCQAA-SF on June 12 2013Big Data Presentation at SCQAA-SF on June 12 2013
Big Data Presentation at SCQAA-SF on June 12 2013
Sujit Ghosh
 

Similaire à Lightning talk at UK PG Day, 2014 - Get Modelling! (20)

Frank Bien Opening Keynote - Join 2016
Frank Bien Opening Keynote - Join 2016Frank Bien Opening Keynote - Join 2016
Frank Bien Opening Keynote - Join 2016
 
You Don't Know SEO
You Don't Know SEOYou Don't Know SEO
You Don't Know SEO
 
Data Profiling: The First Step to Big Data Quality
Data Profiling: The First Step to Big Data QualityData Profiling: The First Step to Big Data Quality
Data Profiling: The First Step to Big Data Quality
 
Join 2017_Deep Dive_Integrating Looker with R and Python
Join 2017_Deep Dive_Integrating Looker with R and PythonJoin 2017_Deep Dive_Integrating Looker with R and Python
Join 2017_Deep Dive_Integrating Looker with R and Python
 
Your Raw Data is Ready - Introduction to Analytics Engineering | SMX Advanced...
Your Raw Data is Ready - Introduction to Analytics Engineering | SMX Advanced...Your Raw Data is Ready - Introduction to Analytics Engineering | SMX Advanced...
Your Raw Data is Ready - Introduction to Analytics Engineering | SMX Advanced...
 
Redgate Community Circle: Tools For SQL Server Performance Tuning
Redgate Community Circle: Tools For SQL Server Performance TuningRedgate Community Circle: Tools For SQL Server Performance Tuning
Redgate Community Circle: Tools For SQL Server Performance Tuning
 
DU Series - Day 4.pptx
DU Series - Day 4.pptxDU Series - Day 4.pptx
DU Series - Day 4.pptx
 
Power BI Overview
Power BI OverviewPower BI Overview
Power BI Overview
 
Engaging Agile Teams for Data Governance Professionals
Engaging Agile Teams for Data Governance ProfessionalsEngaging Agile Teams for Data Governance Professionals
Engaging Agile Teams for Data Governance Professionals
 
Leading the Product 2017 - Wendy Glasgow
Leading the Product 2017 - Wendy GlasgowLeading the Product 2017 - Wendy Glasgow
Leading the Product 2017 - Wendy Glasgow
 
Boosting your SEO with data markup
Boosting your SEO with data markupBoosting your SEO with data markup
Boosting your SEO with data markup
 
Table structured schema markup
Table structured schema markupTable structured schema markup
Table structured schema markup
 
Fried data summit big data for lob content
Fried data summit big data for lob contentFried data summit big data for lob content
Fried data summit big data for lob content
 
Big Data Presentation at SCQAA-SF on June 12 2013
Big Data Presentation at SCQAA-SF on June 12 2013Big Data Presentation at SCQAA-SF on June 12 2013
Big Data Presentation at SCQAA-SF on June 12 2013
 
From Foundation to Mastery – Building a Mature Analytics Roadmap - Manav Misra
From Foundation to Mastery – Building a Mature Analytics Roadmap - Manav MisraFrom Foundation to Mastery – Building a Mature Analytics Roadmap - Manav Misra
From Foundation to Mastery – Building a Mature Analytics Roadmap - Manav Misra
 
Big Data Evolution
Big Data EvolutionBig Data Evolution
Big Data Evolution
 
Ensuring Data Quality in Databricks Unleashing the Power of Great Expectation...
Ensuring Data Quality in Databricks Unleashing the Power of Great Expectation...Ensuring Data Quality in Databricks Unleashing the Power of Great Expectation...
Ensuring Data Quality in Databricks Unleashing the Power of Great Expectation...
 
Overview of Business Intelligence
Overview of Business IntelligenceOverview of Business Intelligence
Overview of Business Intelligence
 
Data Quality: principles, approaches, and best practices
Data Quality: principles, approaches, and best practicesData Quality: principles, approaches, and best practices
Data Quality: principles, approaches, and best practices
 
Webinar: Scaling MongoDB
Webinar: Scaling MongoDBWebinar: Scaling MongoDB
Webinar: Scaling MongoDB
 

Plus de George McGeachie

Plus de George McGeachie (6)

SAP PowerDesigner Masterclass for the UK SAP Database & Technology User Group...
SAP PowerDesigner Masterclass for the UK SAP Database & Technology User Group...SAP PowerDesigner Masterclass for the UK SAP Database & Technology User Group...
SAP PowerDesigner Masterclass for the UK SAP Database & Technology User Group...
 
Data Modelling Zone 2019 - data modelling and JSON
Data Modelling Zone 2019 - data modelling and JSONData Modelling Zone 2019 - data modelling and JSON
Data Modelling Zone 2019 - data modelling and JSON
 
George McGeachie's Favourite PowerDesigner features
George McGeachie's Favourite PowerDesigner featuresGeorge McGeachie's Favourite PowerDesigner features
George McGeachie's Favourite PowerDesigner features
 
Lightning talk at PG Conf UK 2018
Lightning talk at PG Conf UK 2018Lightning talk at PG Conf UK 2018
Lightning talk at PG Conf UK 2018
 
What can power designer do for me
What can power designer do for meWhat can power designer do for me
What can power designer do for me
 
Generating XML schemas from a Logical Data Model (EDW 2011)
Generating XML schemas from a Logical Data Model (EDW 2011)Generating XML schemas from a Logical Data Model (EDW 2011)
Generating XML schemas from a Logical Data Model (EDW 2011)
 

Dernier

%+27788225528 love spells in Knoxville Psychic Readings, Attraction spells,Br...
%+27788225528 love spells in Knoxville Psychic Readings, Attraction spells,Br...%+27788225528 love spells in Knoxville Psychic Readings, Attraction spells,Br...
%+27788225528 love spells in Knoxville Psychic Readings, Attraction spells,Br...
masabamasaba
 
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
masabamasaba
 
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
masabamasaba
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
Health
 

Dernier (20)

WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...
WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...
WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...
 
WSO2CON 2024 - Does Open Source Still Matter?
WSO2CON 2024 - Does Open Source Still Matter?WSO2CON 2024 - Does Open Source Still Matter?
WSO2CON 2024 - Does Open Source Still Matter?
 
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
 
WSO2Con204 - Hard Rock Presentation - Keynote
WSO2Con204 - Hard Rock Presentation - KeynoteWSO2Con204 - Hard Rock Presentation - Keynote
WSO2Con204 - Hard Rock Presentation - Keynote
 
%+27788225528 love spells in Knoxville Psychic Readings, Attraction spells,Br...
%+27788225528 love spells in Knoxville Psychic Readings, Attraction spells,Br...%+27788225528 love spells in Knoxville Psychic Readings, Attraction spells,Br...
%+27788225528 love spells in Knoxville Psychic Readings, Attraction spells,Br...
 
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
 
tonesoftg
tonesoftgtonesoftg
tonesoftg
 
%in Benoni+277-882-255-28 abortion pills for sale in Benoni
%in Benoni+277-882-255-28 abortion pills for sale in Benoni%in Benoni+277-882-255-28 abortion pills for sale in Benoni
%in Benoni+277-882-255-28 abortion pills for sale in Benoni
 
WSO2CON 2024 - Navigating API Complexity: REST, GraphQL, gRPC, Websocket, Web...
WSO2CON 2024 - Navigating API Complexity: REST, GraphQL, gRPC, Websocket, Web...WSO2CON 2024 - Navigating API Complexity: REST, GraphQL, gRPC, Websocket, Web...
WSO2CON 2024 - Navigating API Complexity: REST, GraphQL, gRPC, Websocket, Web...
 
WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...
WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...
WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...
 
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
 
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park %in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
 
Architecture decision records - How not to get lost in the past
Architecture decision records - How not to get lost in the pastArchitecture decision records - How not to get lost in the past
Architecture decision records - How not to get lost in the past
 
Devoxx UK 2024 - Going serverless with Quarkus, GraalVM native images and AWS...
Devoxx UK 2024 - Going serverless with Quarkus, GraalVM native images and AWS...Devoxx UK 2024 - Going serverless with Quarkus, GraalVM native images and AWS...
Devoxx UK 2024 - Going serverless with Quarkus, GraalVM native images and AWS...
 
%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein
%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein
%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein
 
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...
WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...
 
WSO2CON 2024 Slides - Open Source to SaaS
WSO2CON 2024 Slides - Open Source to SaaSWSO2CON 2024 Slides - Open Source to SaaS
WSO2CON 2024 Slides - Open Source to SaaS
 
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
 
WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...
WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...
WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
 

Lightning talk at UK PG Day, 2014 - Get Modelling!

  • 1. PG Day, Horwood House, July 9th 2014 (Why you should) Get Modelling! George McGeachie Metadata Matters Limited
  • 2. PG Day, Horwood House, July 9th 2014 It’s a lot more than just a Diagram 2 What is a Data Model?
  • 3. PG Day, Horwood House, July 9th 2014 3 Simon and Hannu say … Page 59 • Plan a new database ◦ Design structure and estimate size  A data modelling tool is perfect for that job • This is an iterative process ◦ Need version control and ability to apply deltas
  • 4. PG Day, Horwood House, July 9th 2014  Migrate from Oracle to PostgreSQL  Reverse-engineer from database, WSDL, XSDs etc.  create logical and conceptual views  Generate XML Schemas 4 Automate tasks
  • 5. PG Day, Horwood House, July 9th 2014  Use standard and bespoke model checks to validate models  Enforce naming standards using a Glossary  Use your default physical options  Create / update your database  Produce scripts the way you want them, avoid errors caused by editing scripts 5 Validate and Generate
  • 6. PG Day, Horwood House, July 9th 2014 6 Model and Generate OLAP FK_MONTH_RELATIONS_YEAR FK_BOOK_SAL_RELATIONS_MONTH FK_BOOK_SAL_RELATIONS_PUBLICAT Publication Book Title Publication Media Type Code Publication Date Dollar List Price ISBN Page Count Primary Author Name Primary Author Pseudonym Primary Author Royalty Percent age CHAR(100) NUMBER(2) DATE NUMBER(5,2) NUMBER(13) NUMBER(4) CHAR(100) CHAR(100) NUMBER(2) <pk> <pk> <i> <i> not null not null null not null not null null not null null null Book Sales Year Code Month Code Book Title Publication Media Type Code Gross Sales Value Amount NUMBER(2) NUMBER(2) CHAR(100) NUMBER(2) NUMBER(5,2) <pk,fk1> <pk,fk1> <pk,fk2> <pk,fk2> <i1,i2> <i1,i2> <i1,i3> <i1,i3> not null not null not null not null not null Month Year Code Month Code Month Description CHAR(60) CHAR(60) CHAR(256) <pk,fk> <pk> <i1,i2> <i1> not null not null null Year Year Code Year Description CHAR(60) CHAR(256) <pk> <i> not null not null Book Sales - Year_Month Book Sales - Publication Measure Book Sales Gross Sales Value Amount Year Code Month Code Book Title Publication Media Type Code Year_Month Year Year Code Year Description Month Year Code Month Code Month Description <h:1> <h:2> <h:3> Hierarchy_1 <Default> <h> Publication Book Title Publication Media Type Code Publication Date Dollar List Price ISBN Page Count Primary Author Name Primary Author Pseudonym Primary Author Royalty Percentage <h:1> <h:2> Hierarchy_1 <Default> <h> Attributes Hierarchy
  • 7. PG Day, Horwood House, July 9th 2014 7 Simon and Hannu say … Page 53 • Understand Database Dependencies ◦ e.g. Table  View  Procedure
  • 8. PG Day, Horwood House, July 9th 2014  ETL Jobs  Forms and Reports  Applications  XML Message Schemas  Regulatory Requirements  Business Processes  Use Cases  JIRA tickets etc. 8 What about dependencies that aren’t in your database? Application produce use use use use use produce <Undefined> use Behind the scenes, Data objects are being accessed Databases are linked to the Physical Data Models that describe them Report Database 1 PostgreSQL Data Warehouse Database 2 Teradata Data Mart ETL or other Data Movement Windows Screen Window form Web Form Web form
  • 9. PG Day, Horwood House, July 9th 2014  Map data movements, generate data movement scripts, ETL scripts, replication scripts etc 9 Create Mappings Marts ice ss pdm Post Codes Lookup EDW EDW_PDM OLTP PDM OLTP to EDW EDW to Marts
  • 10. PG Day, Horwood House, July 9th 2014 10 Get Modelling! Build a database of your database metadata, and join the dots to other stuff What Tools are there? The big 3 ERwin, ER/Studio, PowerDesigner Others Dezign Sparx EA ModelRight Silverrun IBM Infosphere Data Architect Toad Data Modeller might not all support PG