This document summarizes a presentation about big data. It discusses what big data is, how it is transforming business intelligence, who is using big data, and how practitioners should proceed. It provides examples of how companies in different industries like media, retail, and healthcare are using big data to drive new revenue opportunities, improve customer experience, and predict equipment failures. The presentation recommends developing a big data strategy that involves evaluating opportunities, engaging stakeholders, planning projects, and continually executing and repeating the process.
The Codex of Business Writing Software for Real-World Solutions 2.pptx
Big Decisions from Big Data
1. Big Data? No. Big Decisions
are What You Want.
Stuart Miniman
Wikibon, Senior Analyst
stu@wikibon.org
@stu
This presentation and more at http://wikibon.org/BigData
2. Big Questions
What is Big Data?
Evolution or Revolution of Business
Intelligence (BI)?
Who is Using Big Data?
How Should Practitioners Proceed?
5. The Old Way
CRM
Data ETL Traditional
ERP Normalized Data Data
Data Data Quality
Warehouse
Finance
Business Analyst
Data Warehouse Administrator
Business User
7. BIG DATA
Process and Analyze ALL Your Data
Ask NEW Questions
Ask MORE Questions
Get Answers FASTER
Get CLEARER Insight
MAKE BETTER BUSINESS
DECISIONS
8. BIT FLIP
Subsets All Data
Historical Near Real-time
Structured (database) Structured/Unstructured
Data growth as a Data as a new source of
burden & challenge competitive opportunity
9. Two NEW APPROACHES to BIG DATA
Hadoop is is open source framework for
processing and analyzing massive
amounts of distributed data.
Next Generation Data Warehouses use
massively parallel processing, columnar
architectures and data compression to analyze
not-quite-so-massive data in close to real-time.
These two approaches overlap in some areas
and compliment one another in other areas.
10. Data Scientists
10/90 rule for magnificent data success
Over-invest in people, because
without that investment big data
will absolutely, positively, be a big
disappointment for your
company. Computers and
artificial intelligence are simply
not there yet. Hence your BFF is
natural intelligence.
-AvinashKaushik
http://www.kaushik.net/avinash/big-data-imperative-driving-big-action/
11. BIG MONEY in BIG DATA
CAGR of 58%
Revenue mix today: 44% services, 31% hardware, 25% software
12. Recommendation Engine
Use Hadoop to match and recommend
users to one another or to products and
services based on analysis of user profile
and behavioral data
14. Large Media Company:
BIG DATA + WAN
Site 1: Advertising Site 2: Content
Analysis Customization
10
Hadoop GbpsHadoop Hadoop
Clusters Traffic Clusters
DC1 DC2
7PB 7PB
1 2 3
10 TB’s/day of source 5 TB’s/day for inter- 1 TB/day of
data: browsing pattern, cluster sync results sent for
click throughs, server logs integrated analysis with
structured data
16. New Revenue from Data
The Associated Press is combining a mix
of decades of historical news releases with
real-time additions to create new
monetization opportunities for it’s data
using a document-oriented database
(rather than traditional relational
database).
NYSE is delivering analytics on data that
is seeing massive growth that adds up to
Petabytes of information that can be
offered as a cloud service to traders.
17. BIG DATA Infrastructure
Network optimization (low latency)
Share-nothing storage
– Bring the computation to the data
Massive compute requirements
– Emerging opportunity in the cloud
18. BIG DATA Organization
Broad cross-silo impact
– Tight coordination needed between business
decision makers and technology/analyst
Organize for selling/buying data within
organization and IT
– Next-generation “chargeback”
19. What’s Your BIG DATA Strategy?
Enterprises should …
EVALUATE
ENGAGE
PLAN
CULTIVATE
EXECUTE
REPEAT
20. Creating a BIG DATA IT Plan
• Understand IO-centric technologies that
allow near real-time big data processing
• Select key vendor partnerships
• Start with small projects of integrated
design
• Investigate opportunities to deliver big
data services for your industry
21. What’s Your BIG DATA Strategy?
Vendors should …
LISTEN
EDUCATE
INNOVATE
SELL
SUPPORT
REPEAT
22. Now Is the Era of
BIG DATA
Big Data is the new definitive source of
competitive advantage across all industries.
Special Thanks to David Floyer and Jeff Kelly
This presentation and more at http://wikibon.org/BigData
Editor's Notes
Resources:http://wikibon.org/BigData
Abstract: Everyone talks about big data, but big data isn’t really useful unless you can use it. What you need are big decisions. In this session, you will learn what constitutes big data, best practices to store it for retrieval, and how to use it to make business decisions. We will include a few case studies illustrating key points and provide a starting point on how to use big data to make big decisions
Gigabytes to Petabytes to Exabytes to ZettabytesToday’s “Big Storage” is tomorrow’s ”Little Storage”
Tools to understand data have been around for a long time – even in the 90’s we were learning how to “read the matrix”TRYING to do this isn’t new
Structured, well defined questions, typically not agile
Hadoop distributions include Cloudera, Hortonworks, MapRNGDW = EMC Greenplum, HP Vertica, Teradata Aster, IBM Netezza
High demand for new skills – gap in the workforce
Big names include IBM, Intel, Oracle, HP and “pure plays” like the vendors discussed on NGDW + Hadoop distribution slide
Everyone is familiar with websites that are crunching massive amounts of data to help provide connections/insight
Here’s an example from a large IT player who is “dogfooding” Big Data.
All your data – all sources – all locations
Understand your customers (ad placement, customer retention and much more)