SlideShare une entreprise Scribd logo
1  sur  14
1
BIG DATA IN OIL &
GAS
BERT BEALS
CHIEF TECHNOLOGIST – ENERGY INDUSTRIES
BJORN ANDERSSON
SOLUTIONS MARKETING DIRECTOR – ENERGY
INDUSTRIES
2
DEFINING BIG DATA AND ANALYTICS
 Data Volume
‒ Terabytes to Petabytes and beyond
 Data Variety
‒ Many sources, structured data and more unstructured data
 Data Velocity
‒ Streaming from sensors, generated secondary data
 Value
‒ Derived business value
‒ Quicker and more accurate decisions
© Hitachi Data Systems 2013
3
BUSINESS
PROCESS
DATABASE DATA
HUMAN
ENTERPRISE CONTENT,
EXTERNAL SOURCES
MACHINE
SENSOR DATA, COMPLEX DATA
SOURCES OF BIG DATA GROWTH
THE DATA MULTIPLIER EFFECT
More Data with More Complex Relationships…in Real Time and At Scale
To manage, govern and analyze
1X 10X 100XOLTP
EMAIL
DOCUMENTS
WEB LOGS SOCIAL
SENSORS M2M LOG
FILES
RECORDING
VIDEO
SATELLITE
IMAGING BIO-
INFORMATICS
VARIETY
VOLUME
VARIETY
VOLUME
VELOCITY VOLUME
© Hitachi Data Systems 2013
4
BIG DATA – THE PROMISE
The Hype
 Turning data flood into transformative
insight
 Exploration without preconceived
notions
The Reality
 Big Data application stack is complex
 Data is highly fragmented
 New skill sets
 Difficult to know where to start
SORTING THE REALITY FROM THE HYPE
Unstructured
Structured
Semi-structured
Video
WebLogs
HTML
Clickstream
Text
Audio
NoSQL
Hadoop
Machine Data
Database
Analytics
Machine Learning
Visualization
ETL
Business Process
Model
Stream Processing
In Memory DB
Connectors
Virtualization
Search
FederationMPP
MetaData
Social Media
Dark Data
Real Time
NAS
How does Big Data help my Business?
How much will it cost?
What’s the ROI? How risky is it? When will I see results?
© Hitachi Data Systems 2013
BIG DATA DRIVING BIG INNOVATION TODAY
Hitachi
Transportation:
Bullet Trains
• Track/train sensors
• Keep trains on schedule
• Proactive maintenance
• Telemetry from seismic sensors
• Time series data
• Operational data from sensors
• Insight for fleet managers
Hitachi Power:
Power Stations
Hitachi
Construction:
Excavators
Hitachi, Ltd.:
Tokyo Stock
Exchange
• High-speed index service
• 1/100th faster
© Hitachi Data Systems 2013
6
#1 INDUSTRY MEGA DRIVER –
SIMPLY STATED: WE NEED MORE ENERGY
INCREASE PRODUCTION AND KNOWN ENERGY RESERVES
Dramatic increase in demand
from emerging economies
(non-OECD)
Discover new reserves now:
75% of today’s oil was
discovered before 1980
© ExxonMobil 2012© BP 2011
Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011
© ExxonMobil 2012
© Hitachi Data Systems 2013
7
OIL&GAS REPRESENT THE MAJORITY OF
THE ENERGY INDUSTRY
 60% of Global Energy demand fulfilled by Oil&Gas
‒ Natural Gas is the fastest growing fuel source
©BP2011
Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011
©ExxonMobil2012
© Hitachi Data Systems 2013
8
MORE BIG DATA
 More Volume
‒ New sensor and acquisition technology: Isometrix, WAZ
‒ More data being integrated: Drilling, Production
 More Velocity
‒ Real time data from operations, sensors
‒ Streaming vs batch processing
 More Variety
‒ Structured, Unstructured, semi-structured
‒ Complexity involving multiple disciplines
 Potential Value
‒ Clearer view, better understanding by combining data sources
‒ Capitalizing on opportunities
‒ Lower risk for failures
VOLUME, VELOCITY AND VARIETY
© Hitachi Data Systems 2013
BIG DATA IN ACTION IN OIL&GAS
Exploration
Production
Refining
Distribution
Marketing and retail
Geo-technical applications
Resource planning
Business intelligence
Databases
Office applications
Seismic data
Bore hole sensors
Environmental sensors
Weather data
Production utilization
Storage capacities
Spot pricing (trading)
Transportation
Inventory levels
Demand & forecast
Location data
Big Data Analysis = Value
Business Decisions
E&P Investments
Inventory locations
Production planning
Safety
© Hitachi Data Systems 2013
• Growing data
> 300 MB / Km2 early 90s
> 25 GB / km2 in 2006
> Growing… to PBs / km2
 Yesterday: 20 – 25,000 sensors, 500MB/s – 2GB/s, 50 –
200,000 shots, 50 – 200TB data
 Now: Full 3D acquisition, 8GB/s – 20GB/s, 250TB – 1 PB
 Tomorrow: 50GB/s
Sources, Grid Computing Ahmar Abbas:
1 Luigi Salvador, High Performance Computing for the Oil and Gas Industry
2 ML Geovision www.alkorinternational.com
VELOCITY – INGEST MORE DATA FASTER
© Hitachi Data Systems 2013
VOLUME - INSATIABLE APPETITE FOR INFORMATION
 Technology as a
competitive weapon
‒ Pushing technology
boundaries
‒ Never resting, methods
ready for anticipated
technology advances
 Big Data in use
‒ A different scale, PB file
systems as caches
‒ Live in-feed from sensors
from sites world wide
IT STARTS WITH THE DATA,
THEN IT NEEDS TO BE ANALYZED
TO EXTRACT INFORMATION
Source:HenriCalandra,JohnEtgen,
ScottMorton–RiceUniversity
Realtime drilling
operation center, a fully
integrated part of the
Valhall drilling operations
in Norway.
© Hitachi Data Systems 2013
VARIETY: FIND AND PRODUCE FASTER,
SAFER, AND MORE EFFICIENTLY
Upstream Oil&Gas:
 Many interconnected, increasingly complex
and rapidly changing workflows
 Exponential growth in the volume of data
 Computational demands increasing by orders of magnitude
 Manage complexity and increase efficiency
 Facilitate collaborative computing and secure access to data
Increase efficiency and accelerate the TOTAL workflow
Data
Acquisition
Visual
Interpretation
Modeling
Automation
SimulationSeismic
Processing
Property
Modeling
Data
Management
Petrophysical
Analysis
Increase Reserves - Capacity scaling, changing workloads
© Hitachi Data Systems 2013
UNIFIED STORAGE FOR UPSTREAM OIL AND
GAS ORGANIZATIONS
 Accelerated exploration with optimized file storage
‒ Highest per-node IOPs for unpredictable I/O
‒ Ideal for mixed workflows requiring performance for
throughput-oriented and also for random data flows
‒ Easy scalability and high availability
‒ Open file system standards:
‒ CIFS, NFS, iSCSI, Lustre, Hadoop
 One storage platform for E&P and
the entire oil and gas enterprise
‒ Single architecture for file and block
‒ Comprehensive data management
across technologies
‒ No compromise of performance versus control
Structured
Unstructured
Technical
Enterprise
Unified
Reduce Cost - Reduced complexity, higher efficiency
© Hitachi Data Systems 2013
THANK YOU

Contenu connexe

Tendances

OilGasDigitalTransformationWhitePaper
OilGasDigitalTransformationWhitePaperOilGasDigitalTransformationWhitePaper
OilGasDigitalTransformationWhitePaper
Andre Vieira
 
Solution in detail oil and gas hydrocarbon accounting for oil and gas
Solution in detail  oil and gas  hydrocarbon accounting for oil and gasSolution in detail  oil and gas  hydrocarbon accounting for oil and gas
Solution in detail oil and gas hydrocarbon accounting for oil and gas
Murali Venkatesh
 

Tendances (20)

Digital transformation, innovation, & inspiration in the mining industry
Digital transformation, innovation, & inspiration in the mining industryDigital transformation, innovation, & inspiration in the mining industry
Digital transformation, innovation, & inspiration in the mining industry
 
OilGasDigitalTransformationWhitePaper
OilGasDigitalTransformationWhitePaperOilGasDigitalTransformationWhitePaper
OilGasDigitalTransformationWhitePaper
 
Introduction to Oil and Gas Industry - Upstream Midstream Downstream
Introduction to Oil and Gas Industry - Upstream Midstream DownstreamIntroduction to Oil and Gas Industry - Upstream Midstream Downstream
Introduction to Oil and Gas Industry - Upstream Midstream Downstream
 
Forrester - Process Mining: Your Compass for Digital Transformation - The Cus...
Forrester - Process Mining: Your Compass for Digital Transformation - The Cus...Forrester - Process Mining: Your Compass for Digital Transformation - The Cus...
Forrester - Process Mining: Your Compass for Digital Transformation - The Cus...
 
Four Steps Toward a Digital Oilfield Future
Four Steps Toward a Digital Oilfield FutureFour Steps Toward a Digital Oilfield Future
Four Steps Toward a Digital Oilfield Future
 
Oil 101 - What is Midstream?
Oil 101 - What is Midstream?Oil 101 - What is Midstream?
Oil 101 - What is Midstream?
 
Guidelines for field development plan
Guidelines for field development planGuidelines for field development plan
Guidelines for field development plan
 
Digging deep - the digital transformation of mining
Digging deep - the digital transformation of miningDigging deep - the digital transformation of mining
Digging deep - the digital transformation of mining
 
Challenges in the oil and gas sector overview and outlook
Challenges in the oil and gas sector  overview and outlookChallenges in the oil and gas sector  overview and outlook
Challenges in the oil and gas sector overview and outlook
 
The vital role of AIOps in overcoming IT operational challenges - DEM07-SR - ...
The vital role of AIOps in overcoming IT operational challenges - DEM07-SR - ...The vital role of AIOps in overcoming IT operational challenges - DEM07-SR - ...
The vital role of AIOps in overcoming IT operational challenges - DEM07-SR - ...
 
Top 5 Benefits of Digitalization in Mining
Top 5 Benefits of Digitalization in MiningTop 5 Benefits of Digitalization in Mining
Top 5 Benefits of Digitalization in Mining
 
Digital Transformation Strategy PowerPoint Presentation Slides
Digital Transformation Strategy PowerPoint Presentation Slides Digital Transformation Strategy PowerPoint Presentation Slides
Digital Transformation Strategy PowerPoint Presentation Slides
 
Material MDM in the Oil & Gas Industry - A Verdantis Case Study
Material MDM in the Oil & Gas Industry - A Verdantis Case StudyMaterial MDM in the Oil & Gas Industry - A Verdantis Case Study
Material MDM in the Oil & Gas Industry - A Verdantis Case Study
 
A Head Start in Getting Value from Machine Learning
A Head Start in Getting Value from Machine LearningA Head Start in Getting Value from Machine Learning
A Head Start in Getting Value from Machine Learning
 
Introduction into Oil and Gas Industry. OIL: Part 1
Introduction into Oil and Gas Industry. OIL: Part 1Introduction into Oil and Gas Industry. OIL: Part 1
Introduction into Oil and Gas Industry. OIL: Part 1
 
PENNGLEN FIELD Development Plan (GULF of MEXICO)
PENNGLEN FIELD Development Plan (GULF of MEXICO)PENNGLEN FIELD Development Plan (GULF of MEXICO)
PENNGLEN FIELD Development Plan (GULF of MEXICO)
 
Reservoir characterization
Reservoir characterizationReservoir characterization
Reservoir characterization
 
Jade Global Digital Transformation & Cloud Consulting Partner - Overview
Jade Global Digital Transformation & Cloud Consulting Partner - OverviewJade Global Digital Transformation & Cloud Consulting Partner - Overview
Jade Global Digital Transformation & Cloud Consulting Partner - Overview
 
Oil and gas industry ppt
Oil and gas industry pptOil and gas industry ppt
Oil and gas industry ppt
 
Solution in detail oil and gas hydrocarbon accounting for oil and gas
Solution in detail  oil and gas  hydrocarbon accounting for oil and gasSolution in detail  oil and gas  hydrocarbon accounting for oil and gas
Solution in detail oil and gas hydrocarbon accounting for oil and gas
 

En vedette

Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...
Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...
Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...
Lora Cecere
 

En vedette (7)

Imagine the Digital Supply Chain
Imagine the Digital Supply ChainImagine the Digital Supply Chain
Imagine the Digital Supply Chain
 
Big Data in Oil and Gas: How to Tap Its Full Potential
Big Data in Oil and Gas: How to Tap Its Full PotentialBig Data in Oil and Gas: How to Tap Its Full Potential
Big Data in Oil and Gas: How to Tap Its Full Potential
 
Import - Export Policy of India (EXIM POLICY)
Import - Export Policy of  India(EXIM POLICY)Import - Export Policy of  India(EXIM POLICY)
Import - Export Policy of India (EXIM POLICY)
 
Digital transformation of supply chain
Digital transformation of supply chainDigital transformation of supply chain
Digital transformation of supply chain
 
Oil & Gas Big Data use cases
Oil & Gas Big Data use casesOil & Gas Big Data use cases
Oil & Gas Big Data use cases
 
Creating a Digital Supply Chain: Monsanto's Journey
Creating a Digital Supply Chain:  Monsanto's JourneyCreating a Digital Supply Chain:  Monsanto's Journey
Creating a Digital Supply Chain: Monsanto's Journey
 
Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...
Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...
Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...
 

Similaire à Big Data in Oil and Gas

Similaire à Big Data in Oil and Gas (20)

Big Data - Applications and Technologies Overview
Big Data - Applications and Technologies OverviewBig Data - Applications and Technologies Overview
Big Data - Applications and Technologies Overview
 
Guest Lecture: Introduction to Big Data at Indian Institute of Technology
Guest Lecture: Introduction to Big Data at Indian Institute of TechnologyGuest Lecture: Introduction to Big Data at Indian Institute of Technology
Guest Lecture: Introduction to Big Data at Indian Institute of Technology
 
The New Age of the Industrial Internet
The New Age of the Industrial InternetThe New Age of the Industrial Internet
The New Age of the Industrial Internet
 
Innovating With Data and Analytics
Innovating With Data and AnalyticsInnovating With Data and Analytics
Innovating With Data and Analytics
 
Capitalize on Big Data Through Hitachi Innovation
Capitalize on Big Data Through Hitachi InnovationCapitalize on Big Data Through Hitachi Innovation
Capitalize on Big Data Through Hitachi Innovation
 
The Evolution of Data Architecture
The Evolution of Data ArchitectureThe Evolution of Data Architecture
The Evolution of Data Architecture
 
Building Confidence in Big Data - IBM Smarter Business 2013
Building Confidence in Big Data - IBM Smarter Business 2013 Building Confidence in Big Data - IBM Smarter Business 2013
Building Confidence in Big Data - IBM Smarter Business 2013
 
Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...
Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...
Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...
 
The ABCs of Big Data
The ABCs of Big DataThe ABCs of Big Data
The ABCs of Big Data
 
Big data ppt
Big data pptBig data ppt
Big data ppt
 
Aws keynote oil and gas calgary industry day - jon guidroz
Aws keynote oil and gas calgary industry day -  jon guidrozAws keynote oil and gas calgary industry day -  jon guidroz
Aws keynote oil and gas calgary industry day - jon guidroz
 
Smarter planet and mega trends presentation 2012
Smarter planet and mega trends presentation 2012Smarter planet and mega trends presentation 2012
Smarter planet and mega trends presentation 2012
 
Kaushal Amin & Big 5 IT trends in the world
Kaushal Amin & Big 5 IT trends in the worldKaushal Amin & Big 5 IT trends in the world
Kaushal Amin & Big 5 IT trends in the world
 
Technology Trends and Big Data in 2013-2014
Technology Trends and Big Data in 2013-2014Technology Trends and Big Data in 2013-2014
Technology Trends and Big Data in 2013-2014
 
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
 
Adam wray 945
Adam wray   945Adam wray   945
Adam wray 945
 
Ab cs of big data
Ab cs of big dataAb cs of big data
Ab cs of big data
 
Big Data Techcon 2014
Big Data Techcon 2014Big Data Techcon 2014
Big Data Techcon 2014
 
Pouring the Foundation: Data Management in the Energy Industry
Pouring the Foundation: Data Management in the Energy IndustryPouring the Foundation: Data Management in the Energy Industry
Pouring the Foundation: Data Management in the Energy Industry
 
Big Data - A Real Life Revolution
Big Data - A Real Life RevolutionBig Data - A Real Life Revolution
Big Data - A Real Life Revolution
 

Dernier

Dernier (20)

presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of Brazil
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 

Big Data in Oil and Gas

  • 1. 1 BIG DATA IN OIL & GAS BERT BEALS CHIEF TECHNOLOGIST – ENERGY INDUSTRIES BJORN ANDERSSON SOLUTIONS MARKETING DIRECTOR – ENERGY INDUSTRIES
  • 2. 2 DEFINING BIG DATA AND ANALYTICS  Data Volume ‒ Terabytes to Petabytes and beyond  Data Variety ‒ Many sources, structured data and more unstructured data  Data Velocity ‒ Streaming from sensors, generated secondary data  Value ‒ Derived business value ‒ Quicker and more accurate decisions © Hitachi Data Systems 2013
  • 3. 3 BUSINESS PROCESS DATABASE DATA HUMAN ENTERPRISE CONTENT, EXTERNAL SOURCES MACHINE SENSOR DATA, COMPLEX DATA SOURCES OF BIG DATA GROWTH THE DATA MULTIPLIER EFFECT More Data with More Complex Relationships…in Real Time and At Scale To manage, govern and analyze 1X 10X 100XOLTP EMAIL DOCUMENTS WEB LOGS SOCIAL SENSORS M2M LOG FILES RECORDING VIDEO SATELLITE IMAGING BIO- INFORMATICS VARIETY VOLUME VARIETY VOLUME VELOCITY VOLUME © Hitachi Data Systems 2013
  • 4. 4 BIG DATA – THE PROMISE The Hype  Turning data flood into transformative insight  Exploration without preconceived notions The Reality  Big Data application stack is complex  Data is highly fragmented  New skill sets  Difficult to know where to start SORTING THE REALITY FROM THE HYPE Unstructured Structured Semi-structured Video WebLogs HTML Clickstream Text Audio NoSQL Hadoop Machine Data Database Analytics Machine Learning Visualization ETL Business Process Model Stream Processing In Memory DB Connectors Virtualization Search FederationMPP MetaData Social Media Dark Data Real Time NAS How does Big Data help my Business? How much will it cost? What’s the ROI? How risky is it? When will I see results? © Hitachi Data Systems 2013
  • 5. BIG DATA DRIVING BIG INNOVATION TODAY Hitachi Transportation: Bullet Trains • Track/train sensors • Keep trains on schedule • Proactive maintenance • Telemetry from seismic sensors • Time series data • Operational data from sensors • Insight for fleet managers Hitachi Power: Power Stations Hitachi Construction: Excavators Hitachi, Ltd.: Tokyo Stock Exchange • High-speed index service • 1/100th faster © Hitachi Data Systems 2013
  • 6. 6 #1 INDUSTRY MEGA DRIVER – SIMPLY STATED: WE NEED MORE ENERGY INCREASE PRODUCTION AND KNOWN ENERGY RESERVES Dramatic increase in demand from emerging economies (non-OECD) Discover new reserves now: 75% of today’s oil was discovered before 1980 © ExxonMobil 2012© BP 2011 Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011 © ExxonMobil 2012 © Hitachi Data Systems 2013
  • 7. 7 OIL&GAS REPRESENT THE MAJORITY OF THE ENERGY INDUSTRY  60% of Global Energy demand fulfilled by Oil&Gas ‒ Natural Gas is the fastest growing fuel source ©BP2011 Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011 ©ExxonMobil2012 © Hitachi Data Systems 2013
  • 8. 8 MORE BIG DATA  More Volume ‒ New sensor and acquisition technology: Isometrix, WAZ ‒ More data being integrated: Drilling, Production  More Velocity ‒ Real time data from operations, sensors ‒ Streaming vs batch processing  More Variety ‒ Structured, Unstructured, semi-structured ‒ Complexity involving multiple disciplines  Potential Value ‒ Clearer view, better understanding by combining data sources ‒ Capitalizing on opportunities ‒ Lower risk for failures VOLUME, VELOCITY AND VARIETY © Hitachi Data Systems 2013
  • 9. BIG DATA IN ACTION IN OIL&GAS Exploration Production Refining Distribution Marketing and retail Geo-technical applications Resource planning Business intelligence Databases Office applications Seismic data Bore hole sensors Environmental sensors Weather data Production utilization Storage capacities Spot pricing (trading) Transportation Inventory levels Demand & forecast Location data Big Data Analysis = Value Business Decisions E&P Investments Inventory locations Production planning Safety © Hitachi Data Systems 2013
  • 10. • Growing data > 300 MB / Km2 early 90s > 25 GB / km2 in 2006 > Growing… to PBs / km2  Yesterday: 20 – 25,000 sensors, 500MB/s – 2GB/s, 50 – 200,000 shots, 50 – 200TB data  Now: Full 3D acquisition, 8GB/s – 20GB/s, 250TB – 1 PB  Tomorrow: 50GB/s Sources, Grid Computing Ahmar Abbas: 1 Luigi Salvador, High Performance Computing for the Oil and Gas Industry 2 ML Geovision www.alkorinternational.com VELOCITY – INGEST MORE DATA FASTER © Hitachi Data Systems 2013
  • 11. VOLUME - INSATIABLE APPETITE FOR INFORMATION  Technology as a competitive weapon ‒ Pushing technology boundaries ‒ Never resting, methods ready for anticipated technology advances  Big Data in use ‒ A different scale, PB file systems as caches ‒ Live in-feed from sensors from sites world wide IT STARTS WITH THE DATA, THEN IT NEEDS TO BE ANALYZED TO EXTRACT INFORMATION Source:HenriCalandra,JohnEtgen, ScottMorton–RiceUniversity Realtime drilling operation center, a fully integrated part of the Valhall drilling operations in Norway. © Hitachi Data Systems 2013
  • 12. VARIETY: FIND AND PRODUCE FASTER, SAFER, AND MORE EFFICIENTLY Upstream Oil&Gas:  Many interconnected, increasingly complex and rapidly changing workflows  Exponential growth in the volume of data  Computational demands increasing by orders of magnitude  Manage complexity and increase efficiency  Facilitate collaborative computing and secure access to data Increase efficiency and accelerate the TOTAL workflow Data Acquisition Visual Interpretation Modeling Automation SimulationSeismic Processing Property Modeling Data Management Petrophysical Analysis Increase Reserves - Capacity scaling, changing workloads © Hitachi Data Systems 2013
  • 13. UNIFIED STORAGE FOR UPSTREAM OIL AND GAS ORGANIZATIONS  Accelerated exploration with optimized file storage ‒ Highest per-node IOPs for unpredictable I/O ‒ Ideal for mixed workflows requiring performance for throughput-oriented and also for random data flows ‒ Easy scalability and high availability ‒ Open file system standards: ‒ CIFS, NFS, iSCSI, Lustre, Hadoop  One storage platform for E&P and the entire oil and gas enterprise ‒ Single architecture for file and block ‒ Comprehensive data management across technologies ‒ No compromise of performance versus control Structured Unstructured Technical Enterprise Unified Reduce Cost - Reduced complexity, higher efficiency © Hitachi Data Systems 2013