Contenu connexe
Similaire à Big Data in Oil and Gas (20)
Big Data in Oil and Gas
- 1. 1
BIG DATA IN OIL &
GAS
BERT BEALS
CHIEF TECHNOLOGIST – ENERGY INDUSTRIES
BJORN ANDERSSON
SOLUTIONS MARKETING DIRECTOR – ENERGY
INDUSTRIES
- 2. 2
DEFINING BIG DATA AND ANALYTICS
Data Volume
‒ Terabytes to Petabytes and beyond
Data Variety
‒ Many sources, structured data and more unstructured data
Data Velocity
‒ Streaming from sensors, generated secondary data
Value
‒ Derived business value
‒ Quicker and more accurate decisions
© Hitachi Data Systems 2013
- 3. 3
BUSINESS
PROCESS
DATABASE DATA
HUMAN
ENTERPRISE CONTENT,
EXTERNAL SOURCES
MACHINE
SENSOR DATA, COMPLEX DATA
SOURCES OF BIG DATA GROWTH
THE DATA MULTIPLIER EFFECT
More Data with More Complex Relationships…in Real Time and At Scale
To manage, govern and analyze
1X 10X 100XOLTP
EMAIL
DOCUMENTS
WEB LOGS SOCIAL
SENSORS M2M LOG
FILES
RECORDING
VIDEO
SATELLITE
IMAGING BIO-
INFORMATICS
VARIETY
VOLUME
VARIETY
VOLUME
VELOCITY VOLUME
© Hitachi Data Systems 2013
- 4. 4
BIG DATA – THE PROMISE
The Hype
Turning data flood into transformative
insight
Exploration without preconceived
notions
The Reality
Big Data application stack is complex
Data is highly fragmented
New skill sets
Difficult to know where to start
SORTING THE REALITY FROM THE HYPE
Unstructured
Structured
Semi-structured
Video
WebLogs
HTML
Clickstream
Text
Audio
NoSQL
Hadoop
Machine Data
Database
Analytics
Machine Learning
Visualization
ETL
Business Process
Model
Stream Processing
In Memory DB
Connectors
Virtualization
Search
FederationMPP
MetaData
Social Media
Dark Data
Real Time
NAS
How does Big Data help my Business?
How much will it cost?
What’s the ROI? How risky is it? When will I see results?
© Hitachi Data Systems 2013
- 5. BIG DATA DRIVING BIG INNOVATION TODAY
Hitachi
Transportation:
Bullet Trains
• Track/train sensors
• Keep trains on schedule
• Proactive maintenance
• Telemetry from seismic sensors
• Time series data
• Operational data from sensors
• Insight for fleet managers
Hitachi Power:
Power Stations
Hitachi
Construction:
Excavators
Hitachi, Ltd.:
Tokyo Stock
Exchange
• High-speed index service
• 1/100th faster
© Hitachi Data Systems 2013
- 6. 6
#1 INDUSTRY MEGA DRIVER –
SIMPLY STATED: WE NEED MORE ENERGY
INCREASE PRODUCTION AND KNOWN ENERGY RESERVES
Dramatic increase in demand
from emerging economies
(non-OECD)
Discover new reserves now:
75% of today’s oil was
discovered before 1980
© ExxonMobil 2012© BP 2011
Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011
© ExxonMobil 2012
© Hitachi Data Systems 2013
- 7. 7
OIL&GAS REPRESENT THE MAJORITY OF
THE ENERGY INDUSTRY
60% of Global Energy demand fulfilled by Oil&Gas
‒ Natural Gas is the fastest growing fuel source
©BP2011
Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011
©ExxonMobil2012
© Hitachi Data Systems 2013
- 8. 8
MORE BIG DATA
More Volume
‒ New sensor and acquisition technology: Isometrix, WAZ
‒ More data being integrated: Drilling, Production
More Velocity
‒ Real time data from operations, sensors
‒ Streaming vs batch processing
More Variety
‒ Structured, Unstructured, semi-structured
‒ Complexity involving multiple disciplines
Potential Value
‒ Clearer view, better understanding by combining data sources
‒ Capitalizing on opportunities
‒ Lower risk for failures
VOLUME, VELOCITY AND VARIETY
© Hitachi Data Systems 2013
- 9. BIG DATA IN ACTION IN OIL&GAS
Exploration
Production
Refining
Distribution
Marketing and retail
Geo-technical applications
Resource planning
Business intelligence
Databases
Office applications
Seismic data
Bore hole sensors
Environmental sensors
Weather data
Production utilization
Storage capacities
Spot pricing (trading)
Transportation
Inventory levels
Demand & forecast
Location data
Big Data Analysis = Value
Business Decisions
E&P Investments
Inventory locations
Production planning
Safety
© Hitachi Data Systems 2013
- 10. • Growing data
> 300 MB / Km2 early 90s
> 25 GB / km2 in 2006
> Growing… to PBs / km2
Yesterday: 20 – 25,000 sensors, 500MB/s – 2GB/s, 50 –
200,000 shots, 50 – 200TB data
Now: Full 3D acquisition, 8GB/s – 20GB/s, 250TB – 1 PB
Tomorrow: 50GB/s
Sources, Grid Computing Ahmar Abbas:
1 Luigi Salvador, High Performance Computing for the Oil and Gas Industry
2 ML Geovision www.alkorinternational.com
VELOCITY – INGEST MORE DATA FASTER
© Hitachi Data Systems 2013
- 11. VOLUME - INSATIABLE APPETITE FOR INFORMATION
Technology as a
competitive weapon
‒ Pushing technology
boundaries
‒ Never resting, methods
ready for anticipated
technology advances
Big Data in use
‒ A different scale, PB file
systems as caches
‒ Live in-feed from sensors
from sites world wide
IT STARTS WITH THE DATA,
THEN IT NEEDS TO BE ANALYZED
TO EXTRACT INFORMATION
Source:HenriCalandra,JohnEtgen,
ScottMorton–RiceUniversity
Realtime drilling
operation center, a fully
integrated part of the
Valhall drilling operations
in Norway.
© Hitachi Data Systems 2013
- 12. VARIETY: FIND AND PRODUCE FASTER,
SAFER, AND MORE EFFICIENTLY
Upstream Oil&Gas:
Many interconnected, increasingly complex
and rapidly changing workflows
Exponential growth in the volume of data
Computational demands increasing by orders of magnitude
Manage complexity and increase efficiency
Facilitate collaborative computing and secure access to data
Increase efficiency and accelerate the TOTAL workflow
Data
Acquisition
Visual
Interpretation
Modeling
Automation
SimulationSeismic
Processing
Property
Modeling
Data
Management
Petrophysical
Analysis
Increase Reserves - Capacity scaling, changing workloads
© Hitachi Data Systems 2013
- 13. UNIFIED STORAGE FOR UPSTREAM OIL AND
GAS ORGANIZATIONS
Accelerated exploration with optimized file storage
‒ Highest per-node IOPs for unpredictable I/O
‒ Ideal for mixed workflows requiring performance for
throughput-oriented and also for random data flows
‒ Easy scalability and high availability
‒ Open file system standards:
‒ CIFS, NFS, iSCSI, Lustre, Hadoop
One storage platform for E&P and
the entire oil and gas enterprise
‒ Single architecture for file and block
‒ Comprehensive data management
across technologies
‒ No compromise of performance versus control
Structured
Unstructured
Technical
Enterprise
Unified
Reduce Cost - Reduced complexity, higher efficiency
© Hitachi Data Systems 2013