Contenu connexe Similaire à Strategic imperative the enterprise data model (20) Strategic imperative the enterprise data model1. 1© 2019 IDERA, Inc. All rights reserved.
STRATEGIC IMPERATIVE: THE ENTERPRISE DATA MODEL
APRIL 16, 2019
Ron Huizenga
Senior Product Manager, Enterprise Architecture & Modeling
@DataAviator
2. 2© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 2© 2019 IDERA, Inc. All rights reserved.
PREFLIGHT BRIEFING
▪ Information capability
▪ Data environment complexity
▪ Enterprise data model
• Context
• Approach
• Focal point for all data architecture
• Related implementation models
▪ Service Oriented Architecture (SOA)
• Canonical model
▪ Data governance considerations
▪ Wrap-up
3. 3© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 3© 2019 IDERA, Inc. All rights reserved.
INFORMATION CAPABILITY STUDY – HOW ARE WE DOING?
▪ Very few organizations utilize information to its full potential
▪ Deficiencies in technical capability, skills, lacking data culture
▪ Lack of investment in value-driven information strategies
▪ Very few understand how to derive maximum value from information
• This will erode corporate value if not corrected
* Based on 2015 PwC/Iron Mountain study: Seizing the Information Advantage
4. 4© 2019 IDERA, Inc. All rights reserved.
INFORMATION MANAGEMENT DISPARITY
▪ Misguided Majority – 76%
• Informed but constrained
• Uninformed and ill-equipped
▪ Data seen as a byproduct, or taken
for granted
• Low comprehension of commercial
benefits that can be gained
▪ Constrained by legacy approaches,
regulations
▪ Weak analytic capability, or
• strong analytic capability, lacking
value focus
• Low analytical capacity
▪ Can be overwhelmed by data volume
▪ Data is domain of data architects
▪ IT led rather than business led
▪ “Spreadsheet hell”
▪ Information Elite – 4%
▪ Proactive Action
• Diversify business models
• Improve operating efficiency
• Identify / implement new market
opportunities
▪ Tangible data value
• Linked to organizational KPIs
▪ Exploit data for competitive advantage
▪ Balanced approach between security
and value extraction
▪ Holistic approach
• Governance is part of normal business
▪ Well defined information strategy
• Reflects business objectives
▪ Often in following sectors
• Healthcare, Manufacturing & Engineering
5. 5© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 5© 2019 IDERA, Inc. All rights reserved.
SOME IMPORTANT PERSPECTIVE
“Organizations that do not understand the overwhelming importance of
managing data and information as tangible assets in the new economy will
not survive.”
- Tom Peters
“Your Organization is all about Data,
until it's not about Data"
- Peter Aiken
6. 6© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 6© 2019 IDERA, Inc. All rights reserved.
BUSINESS STAKEHOLDERS’ DATA USAGE
Suspect that business stakeholders
INTERPRET DATA INCORRECTLY
Yes, frequently
14%
Yes, occasionally
67%
No, never
9%
I don’t know
10%
Suspect that business stakeholders make decisions
USING THE WRONG DATA?
Yes, frequently
11%
Yes, occasionally
64%
No, never
13%
I don’t know
12%
7. 7© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 7© 2019 IDERA, Inc. All rights reserved.
DATA MODEL USAGE & UNDERSTANDING
13%
3%
16%
19%
31%
18%
0% 5% 10% 15% 20% 25% 30% 35%
We don’t use data models
Other
Our data team does most data models but
developers also build them as needed
Our database administrators own data modeling
Developers develop their own data models
We have a data modeling team that is
responsible for data models
Completely
understand
20%
Understand
somewhat
60%
Don’t understand
17%
I don’t know
3%
87%
What is your organization’s approach to data modeling?
How well does your organization’s technology leadership team
understand the value of using data models?
8. 8© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 8© 2019 IDERA, Inc. All rights reserved.
Logical Data Lake
DATA ECOSYSTEM
RDBMS
DataIngestion
Approved
Raw Data
Sandboxes
(Data Science)
Raw Transient
Data
Refinery Refined
Data
Trusted
Data
MDM
Store
Self-serve
Analytics &
Reporting
9. 9© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 9© 2019 IDERA, Inc. All rights reserved.
MAPPING THE DATA
▪ Data Models
• Conceptual
• Logical
• Physical
• Dimensional
• Enterprise/Canonical
▪ Visual Data Lineage
▪ Enterprise Data
Dictionaries
• Naming Standards
• Attachments
▪ Metadata Repository
• Business Glossaries
10. 10© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 10© 2019 IDERA, Inc. All rights reserved.
DATA MODELING CONTEXT
Implementation Models
Categories
CustomerCustomerDemo
CustomerDemographicsCustomers
Employees
EmployeeTerritories
Order Details
Orders
Products
Region
Shippers
Suppliers
Territories
Data Warehouse
Enterprise Model
Enterprise Data Dictionaries
ConceptualModels
11. 11© 2019 IDERA, Inc. All rights reserved.
ENTERPRISE DATA MODEL
▪ Long-term focus (ongoing)
▪ Investment
▪ Basis for communication
▪ Foundation for standardization
▪ Continually evolving - incrementally
▪ Framework for all enterprise data assets
▪ Business focused
▪ Strategic imperative
▪ Requires both business and data modeling
expertise
▪ A rationalized, intelligent design
▪ Platform independent
▪ Common sense and practical
▪ A project
▪ Operational expense
▪ Just a pretty picture
▪ Incompatible with agile
▪ Ivory tower artefact
▪ Application/business area specific
▪ For IT use only
▪ Waste of time
▪ Something that can be created by
developers or junior modelers
▪ Documentation after the fact
▪ For a specific database
▪ An academic exercise
What it is What it is NOT
12. 12© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 12© 2019 IDERA, Inc. All rights reserved.
ALIGN ENTERPRISE SUB-MODELS TO BUSINESS AREAS
Supply Chain
Example
Corporate
Structure
Document
Management
Facilties and
Equipment
Equipment
Object
Facilities
Infrastructure
Maintenance
Planning
Operations
Inventory/Linefill
Sampling
Transit Metrics
Order Processing
Change Requests
Nominations and
Splits
Nominations -
Basic
Nominations -
Enhancements
Nominations -
Scenarios
Planning and
Scheduling
Capacity
Management
Scheduling
Rules Framework
Planning
Portal Framework
Portal
Permissions
Products Supply Contracts
13. 13© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 13© 2019 IDERA, Inc. All rights reserved.
THE NEED FOR COMMON UNDERSTANDING
14. 14© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 14© 2019 IDERA, Inc. All rights reserved.
THE KEYS TO COMPREHENSION
• Business Data Objects
• Business Entities
• Relationships
• Business rules
• Canonical Model
Enterprise
Data Model
• Classification Metadata
• Data Types
• Domains
• Naming Standards
• Security Properties
Enterprise
Data
Dictionary
• Terms/Definitions
• Business area glossaries
• Technical glossaries
• Governance Catalog/Policies
• Reference & Master Data Catalog
Business
Glossaries
15. 15© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 15© 2019 IDERA, Inc. All rights reserved.
Consult
Accountable
Responsible
Inform
16. 16© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 16© 2019 IDERA, Inc. All rights reserved.
ENTERPRISE DATA MODEL: GOVERNANCE METADATA
17. 17© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 17© 2019 IDERA, Inc. All rights reserved.
LINK ENTITY INSTANCES
Enterprise Data Model
Implementation Model 1 Implementation Model 2
Purchase Order Header
Purchase Item
Customer Address
Address
Sales Order Header
Manufacture Item
City
Country
Sales Order Line
Supplier Address
Purchase Order Line
Vendor
Supplier
SuppliersProduct
Item
Part
Customer
Client CustomersProvince State
State / Province
Universal Mappings - Repository
18. 18© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 18© 2019 IDERA, Inc. All rights reserved.
UNIVERSAL MAPPINGS
▪ Ability to link “like” or related objects
• Within same model file
• Across separate model files
▪ Entity/Table level
▪ Attribute/Column level
19. 19© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 19© 2019 IDERA, Inc. All rights reserved.
DATA LINEAGE (TYPICAL ANALYTICS/BI ETL)
20. 20© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 20© 2019 IDERA, Inc. All rights reserved.
DATA - LIFECYCLE
▪ Describes how a data element is created,
read, updated, deleted (CRUD)
▪ Many factors come into play
• Business rules
• Business processes
• Applications
▪ There may be more than 1 way a particular
data element is created
▪ Need to model:
• Business process
• Data lineage
• Data flow
• Integration
• Include Extract Transform and Load (ETL) for
data warehouse/data marts and staging areas
Create/Collect
Classify
Store
Use/ModifyShare
Retain/Archive
Destroy
21. 21© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 21© 2019 IDERA, Inc. All rights reserved.
DATA FLOW AND LINEAGE (POINT TO POINT INTERFACE)
22. 22© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 22© 2019 IDERA, Inc. All rights reserved.
SERVICE ORIENTED ARCHITECTURE (SOA)
▪ An architecture design pattern based on distinct components providing services
to other components
• Application functionality
• Data services
▪ Independent of
• Any specific vendor
• Any specific product
• Any specific technology
23. 23© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 23© 2019 IDERA, Inc. All rights reserved.
CANONICAL MODEL
▪ SOA design pattern that uses
standardized data model(s) across
all data services
▪ Based on Enterprise Data Model
▪ Standardized and consistent data
elements
▪ Standardized messages
• And payload
• All transformations based on
canonical schema
• From data sources
• To data subscribers
Enterprise Data
Model
Canonical
Model/Schema
Canonical
Messages
24. 24© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 24© 2019 IDERA, Inc. All rights reserved.
SERVICE ORIENTED ARCHITECTURE WITH CANONICAL MODEL
Managed Service Connectivity
Change & ControlMediationConnection
Business Process
Collaborative Team Workflow
Event DetectionProcess Orchestration Business Activity Monitoring
Business Intelligence Rules Management
Service Consumers
Mash UpsComposite ApplicationsPortals
Service Enablement
StandardsContracts
Deployment Hosting
Configuration Endpoints
Data Services
Integration
Services & ETL
Distributed
Query
Data Replication
EII
Messaging
Legacy
Adaptation
Protocol & API
Adaptation
Durable &
Reliable Delivery
Quality of Service
Identity & Authorization Management
Service Oriented
Management &
Governance
Registry
SLA
Management
Health
Monitoring
Policy
Enforcement
Canonical Model
&
Canonical Message
Based
25. 25© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 25© 2019 IDERA, Inc. All rights reserved.
DATA LINEAGE: SOA PUBLISH & SUBSCRIBE
26. INFORMATION IN THE RIGHT PLACE, AT THE RIGHT TIME
Data
Governance
Metadata
Management
Data
Quality
Enterprise
Data Model
Business
Concepts
+ Rules
Data
Integration
(SOA)
Data
Rationalization
• A major investment
• With major returns
An Enterprise Data Model is the focal point for comprehension of
information, in context, facilitating effective communication throughout
the organization.
27. 27© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 27© 2019 IDERA, Inc. All rights reserved.
ENABLING GOVERNANCE
Data
Governance
Data
Architecture
Data Modeling
& Design
Data Storage
& Operations
Data Security
Data
Integration &
Interoperability
Documents &
Content
Reference &
Master Data
Data
Warehousing
& Business
Intelligence
MetaData
Data Quality
28. 28© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 28© 2019 IDERA, Inc. All rights reserved.
Corporate
Accounting
Customer
Service
Human
Resources
Marketing Sales
Supply
Chain
Governance
policies
GDPR
HIPAA
PCI
PIPEDA
SOX
MDM
catalog
Reference
Data
Master Data
BUSINESS GLOSSARIES
29. 29© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 29© 2019 IDERA, Inc. All rights reserved.
GLOSSARY & TERMS
30. 30© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 30© 2019 IDERA, Inc. All rights reserved.
GOVERNANCE POLICY CATALOG
31. 31© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 31© 2019 IDERA, Inc. All rights reserved.
HIPAA: SPECIFIC POLICY STATEMENTS
32. 32© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 32© 2019 IDERA, Inc. All rights reserved.
HIPAA: RELATED POLICY STATEMENTS FOR THE OBJECT
33. 33© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 33© 2019 IDERA, Inc. All rights reserved.
MODEL DRIVEN SECURITY ALERTS
34. 34© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 34© 2019 IDERA, Inc. All rights reserved.
REFERENCE DATA SET LIBRARY
35. 35© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 35© 2019 IDERA, Inc. All rights reserved.
SPECIFIC REFERENCE DATA SETS (LINK TO SOURCE)
36. 36© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 36© 2019 IDERA, Inc. All rights reserved.
FINAL THOUGHTS: ENTERPRISE DATA MODEL BENEFITS
▪ Strategic business alignment
• Improved understanding
• Improved communication
▪ Manages complexity
• Context for all organizational data assets
• Consistency for data assets
▪ Lower implementation costs
• Reduced rework
▪ A framework for service oriented architecture
• Canonical model
• Data Services
▪ A foundation for enterprise data governance
37. 37© 2016 IDERA, Inc. All rights reserved. Proprietary and confidential. 37© 2019 IDERA, Inc. All rights reserved.
THANKS!
Any questions?
You can find me at:
ron.huizenga@idera.com
@DataAviator