Presentation: Big Data – From Strategy to Production - Mario Meir-Huber, Big Data Leader Eastern Europe, Teradata GmbH (AT), at the European Data Economy Workshop taking place back to back to SEMANTiCS2015 on 15 September 2015 in Vienna
6. 6
Big Data Technology Stack
Hadoop
Ecosystem
Big Data
Platforms
Data
Ingestion
And
Processing
Efficiency
Trust
Workload
Governance
Tools
Platform
Programming
Parallel
Big Data
Analytics
Data
Science
Transform
question
to
algorithm
Machine
Learning
Analysis
Integration
Query
Performance
Transform
Warehousing
Big Data
Utilization
Domain
Expertise
Asking the
right
question
Reporting &
Dashboards
Alerting &
Recommend
ations
Business
Intelligence
Text Analysis
and Search
24/09/2015 6
Data
Centers
Big Data
Management
Scalable
Data
Storage
IaaS
Cloud
Virtualization
Network
Compute
Storage
DBMS
NoSQL
ManagementSecurity
PrivacyGovernance
Data
Value
8. 8
BI/DWH Projects vs. Big Data Projects
$Xm
$Xm
$Xm
Release 1
Release 2
Release 3
3
MAR
5
MAY
7
JUL
9
SEP
11
NOV
13
JAN
15
MAR
17
MAY
19
JUL
21
SEP
23
NOV
3
MAR
5
MAY
7
JUL
9
SEP
11
NOV
13
JAN
15
MAR
17
MAY
19
JUL
21
SEP
23
NOV
BI/DWH Projects
• Highly Planned & Controlled
• Slow Release Schedule
• 3x releases 2 years
• High Central funding cost
• Low Risk / High Success
Big Data Projects
• Small Iterative Projects
• 40+ Discoveries / 2 years
• Low cost per project
• $20k-$50k per project
• BAU funded initiatives
• Project funded
• Central discovery team / BIU for free
thinking
• High Risk / High Fail
• Iterates to a new project
40+ Projects over 2 years
3 Releases Over 2 years
10. 10
BIG DATA IS A
MOVEMENT
MORE ANALYTICS
ON ALL YOUR DATA
11. 11
Big Data – IT business alignment
Provide a business strategy
Involve all business departments
Prioritize projects and build a roadmap
Execute
Provide a technology roadmap
Analyze necessary technologies
Implement a Big Data platform (Data Lake)
Execute projects