From the Data Governance trenches
A real-life perspective

2
From the Data Governance trenches
19/10/2019
Find
Understand
Trust
How to better
Your Data

3
Agenda
•
•
•
•
•
•
•
•
19/10/2019

Why Data Governance?

5
Find and
Understand
Relevant
for me
How to
access
the data
For which
purpose
to use
Who can I
share it
with
Who is
the SME
Who has
used it
before
Which
data is
similar
Linked
business
terms
Trust
Certified?
Quality
Reviews
Historical
usage
Is it governed?
Trusted
source?
Cross industry studies show that, on average, less than half of an organization’s structured data is
actively used in making decisions - HBR
Find, Understand and Trust Find Understand Trust

Data Governance Building Blocks

7
Building Blocks
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
DataGovernanceBuildingBlocks

8
Building Blocks - A Glossary Example
DataGovernanceBuildingBlocks

9
Building Blocks - Search
19/10/2019
DataGovernanceBuildingBlocks

10
19/10/2019
Building Blocks - Data Catalog –Search
DataGovernanceBuildingBlocks

11
19/10/2019
Building Blocks - Workflow – Critical to operationalize
DataGovernanceBuildingBlocks

12
Building Blocks - Typical Workflows
19/10/2019
DataGovernanceBuildingBlocks

13
Building Blocks - Business Lineage
19/10/2019
DataGovernanceBuildingBlocks

14
19/10/2019
Building Blocks - Technical Lineage
DataGovernanceBuildingBlocks

15
Building Blocks - End-to-End Lineage – For Compliance
19/10/2019
DataGovernanceBuildingBlocks

16
19/10/2019
Building Blocks –
MDM example - Relation to Business Process and Rules
DataGovernanceBuildingBlocks

GDPR As Part Of Your DG

18
GDPR Data Register - Connected & Reusable
GDPR
Data Sets
Processes
Data
Elements
Roles
Systems
Terms and
definitions
Projects …
GDPRAsPartOfYourDG

19
19/10/2019
GDPRAsPartOfYourDG

GDPRAsPartOfYourDG

Business Relevant Data Quality
Metrics

22Data Quality results
Fine grained measured in a DQ tool and uploaded
19/10/2019
BusinessRelevantDataQualityMetrics

23
Data Quality results – Aggregated to a higher level
19/10/2019
BusinessRelevantDataQualityMetrics

24
Example of DQ issue analysis of a report
19/10/2019
BusinessRelevantDataQualityMetrics

25
Data Quality results – Aggregated from column level to report level
19/10/2019
BusinessRelevantDataQualityMetrics

26
Tags, Ratings, Comments...
19/10/2019
BusinessRelevantDataQualityMetrics

Governing A Multi-Store Reality

28
The Multiple Data Store Reality
19/10/2019
Applications BI and visualisation tools Advanced analytics
Structured Data Semi structured and Unstructured Data
SQL NoSQL Real Time Python R….
GoverningAMulti-StoreReality

29
A Popular Data Integration Pattern
Structured Data
MDM
Party Prod
Loc
EDW
DM
Graph
database
Appliance
Semi structured and Unstructured Data
•
•
•
•
•
•
•
GoverningAMulti-StoreReality

30
Logical Data Lake
19/10/2019
Structured Data
MDM
Party Prod
Loc
Semi structured and Unstructured Data
ODS
DW
DM
Staging
Images
Video Sensor
Published
Archived
In
progress
data
text
Data Virtualization services Data Catalog - Glossary
RawUnstructured
lessgoverned
Trusted-governed
Data Consumers
GoverningAMulti-StoreReality

31
Data Catalog – Fundamental Role
19/10/2019
Raw
Data
Clean and
Integrate
service
Trusted Data
Data Catalog
Re-usable Data
Service
Raw
Data
Producers
Clean and
Integrate
service
Publish
Consume
Trusted Data
Reuse data or service Feedback
Consumers
Validation and Certification
GoverningAMulti-StoreReality

32
Feature Promise < > Governance Nightmare
19/10/2019
•
•
GoverningAMulti-StoreReality

33
How to bring in volatile/variety of sources?
ETL ETL ETL
ETL ETL
DMDWH
Staging
Areas
Source
systems
ETL ETL ETL ETL
GoverningAMulti-StoreReality

34
Logical DWH Architecture
ETL ETL ETL
DMDWH
Staging
Areas
Source
systems
DataVirtualizationServer
AbstractionFederationCaching
GoverningAMulti-StoreReality

Getting Started

37
Getting Started
•
•
•
•
•
•
•
19/10/2019

Q&A
DATALUMEN, VELDKANT 31, 2550 KONTICH, BELGIUM
WWW.DATALUMEN.EU