What are the benefits of metadata-driven automation for big data and data warehouse solutions? Here you can find the slide of Gregor Zeiler's session at the Data Modeling Zone (#DMZone) on the 25th of September in Dusseldorf, Germany

1. BASEL BERN BRUGG DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. GENF
HAMBURG KOPENHAGEN LAUSANNE MÜNCHEN STUTTGART WIEN ZÜRICH
Gregor Zeiler
Head of Productmanagement & Sales
Bring Your Model Alive
with Automation
@biGENiUS_DWA

2. DWH & Big Data Automation2 25.09.2018

3. Reduced testing effort
Substantial time and
cost savings
Standardization
Generator
Database
Objects
Mappings
Data Flows
Model Meta-
definition
Staging
Cleansing
DWH-Core
Data Mart
Source Source Source
Automation of
Development tasks
Huge amount of
recurring and monotonic
development tasks.
Standards/
Best Practices
1
Drive Development Performance and Ensure Standardization

4. Design Models
Manage Models,
Projects,Versions, ...
Manage Design Patterns,
Design Objects
Design/Modelling
Application/UI
Modelling Objects
Design
Patterns
Architecture
Naming Conventions
Assembly chart
Best Practices
Design/
Model
Metadata
Modelled Objects
Business Logic
Source/
Target
Metadata
Source Structure
Target Structure
Metadata
Repository
Generation
Deployment
DWH Structure & Database Objects
Data Flows
Load Management Objects
Deployment Objects
Test Automation Objects
Additional Content
Services
Documentation
Data Lineage
Metadata/Model Validation
Load Control/Monitoring
Source Code Control
Change Management
Lifecycle Support
Version
Metadata
Versioning
Metadata-driven Automation Approach

5. Design Models
Manage Models,
Projects,Versions, ...
Manage Design Patterns,
Design Objects
Design/Modelling
Application/UI
Modelling Objects
Design
Patterns
Architecture
Naming Conventions
Assembly chart
Best Practice
Design/
Model
Metadata
Modelled Objects
Business Logic
Source/
Target
Metadata
Source Structure
Target Structure
Metadata
Repository
Generation
Deployment
DWH Structure and DB Objects
Data Flows
Load Management Objects
Deployment Objects
Test Automation Objects
Additional Content
Services
Documentation
Data Lineage
Metadata/Model Validation
Load Control/Monitoring
Source Code Control
Change Management
Lifecycle Support
Version
Metadata
Versioning
Metadata-driven Automation Approach

6. Business Model
Semantic/logical
Generator Configuration
Design Patterns
Target Environment
Platform, Solution
Architecture
Modelling
Technology
Platform
Architecture
Modelling
Technology
Platform
Architecture
Modelling
Technology
Platform
Architecture
Modelling
Technology
Platform
E
E
F
E
E
E
SO SOSO
Gen. Config 1
Gen. Config 2
Gen. Config 3
Gen. Config 4

7. Semantic Modelling Objects and Design Patterns
(sample Generator Configuration)
DWH & Big Data Automation7 25.09.2018
Stage
Object
Source
Object
Entity Fact
Mart
Object
V L T V L TV L T A V
Staging Cleansing Core Data Mart
Semantic
Modeling
Objects
Configuration
Main Objects
L T
DWH Part Group DWH Part Group DWH Part Group DWH Part Group
DWH Parts
Default
Templates
Indiv. Model
Templates
Layer
DesignPattern

8. LL S1.nS1.n
Semantic Modelling Objects and Design Patterns
(sample Data Vault Generator Configuration)
DWH & Big Data Automation8 25.09.2018
Stage
Object
Source
Object
Entity Fact
Mart
Object
V L T Lo HV L T A V
Staging Cleansing Core Data Mart
Semantic
Modeling
Objects
Configuration
Main Objects
L T
DWH Part Group DWH Part Group DWH Part Group DWH Part Group
DWH Parts
Default
Templates
Indiv. Model
Templates
Layer
DesignPattern
S1.nLo
Li
LL
Lo
Lo
S1.nS1.nS1.n
Relation
ship

9. DW and Big Data Automation9 24.04.2018
Let´s see
how it works
Analytical Data Management
Automation

10. DW and Big Data Automation10 24.04.2018
It´s all about
metadata
Stay connected!

11. Business
Glossary
Data
catalogue
Reference
Data
Master
Data
Data
Quality
Meta-
data
DWH/
Big Data
Automation
DWH & Big Data Automation11 25.09.2018
Data
modeling

12. DWH in the age
of Big Data
The end of an era?

13. Big Data Cluster
Data Science
/ BI Tools
Enterprise Data
Warehouse (RDB)
SQL / R
Search /
Explore
Online &
Mobile Apps
Search
SQL /
Export
DFS
StageCoreMarts
Parallel
Processing
DFS
DFS
File Import
SQL Import
Location
Social
Click
stream
Sensor
Data
Weather
Data
Mobile
Apps
Event
Stream
Marts
SQL
Event
Hub
Event
Hub
Message
Exchange
System
Machine
Data
Microservice Cluster
Microservice State
{ }
API
NoSQL
Stream Analytics Cluster
Stream
Processor
State
{ }
Query API
Service
Event
Stream
DWH
Syrius
E-Gate
KBM
Archive
Core
Parallel
Processing
…
Change
Data
Capture
Service
Data
Flow
Data
Lake
ERP
CRM
MES
…
Event
Hub
Analytical Data Management – Fit for Digital Business
25.09.2018 DWH & Big Data Automation13

14. SO
SO
SO
EV
ST
ST
ST
ST
ST
EV
SO
E
E
F
F
M
M
Generator
Configuration
Generator
Configuration
Generator
Configuration
EV
Business Model
Semantic/logical
Target Environment
Platform, Solution
Generator Configuration
Design Patterns

15. semantic model object
design pattern
Script to generate
StreamSets pipe
25.09.2018 DWH & Big Data Automation15

16. DWH & Big Data Automation16 25.09.2018
semantic model object
design pattern
Spark SQL script to
generate Hive tables

17. Manage data landscape
complexity
Be agile and bring your model alive by Automation!
Be the master of your architecture and
configure your own analytical world!
Be independent of the volatility of new technologies!

18. DWH Automation - tdwi 20171827.06.2017
Feel the Speed of
Big Data &
Data Warehouse
Automation!
Stop by for a live demo
www.biGENiUS.info
Data Vault
Decision Guide

19. BASEL BERN BRUGG DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. GENF
HAMBURG KOPENHAGEN LAUSANNE MÜNCHEN STUTTGART WIEN ZÜRICH
Gregor Zeiler
Senior Solution Manager BI/Big Data
gregor.zeiler@trivadis.com

20. Jumpstart
Analytical Data Management Automation
OUR OFFER
 Jumpstart scope depending on business case
 Included coaching contingent with biGENiUS professional
 Temporary biGENiUS Subscription
YOUR BENEFITS
 Learn how biGENiUS works on a real project case
 Benefit from Automation while implementing your project
 Possibility to use the results in production environments