SlideShare une entreprise Scribd logo
1  sur  87
THE BIG DATA CON
Why Big Data is a Problem Not a Solution



           #TheBigDataCon
IAN PLOSKER
Director, Technical Operations, EMEA
          Basho Technologies
           @dstroyallmodels
WHO IS




basho
   ?
WE MAKE
DISCLAIMERS
ALL OPINIONS EXPRESSED HEREIN
ARE MY OWN AND NOT THOSE OF
 MY EMPLOYER OR ANYONE ELSE
I’M NOT TROLLING
I’M NOT FUD RAKING
WELL, MAYBE JUST A LITTLE
          BIT
LET’S GET STARTED
WHAT IS BIG DATA?
HOW BIG IS BIG?
GIGABYTES, TERABYTES,
PETABYTES, EXABYTES?
IF THERE’S BIG DATA,
SHOULDN’T THERE ALSO BE
MEDIUM AND SMALL DATA
BIG DATA IS MORE DATA
THAN YOU KNOW WHAT TO
        DO WITH
BIG DATA IS THE DATA THAT
YOU DON’T KNOW WHAT TO
         DO WITH
THE PROMISE OF BIG DATA
IS TO STORE THE REAMS
YOU DON’T KNOW HOW TO
          USE
SO YOU CAN EXTRACT
VALUE FROM IT IN THE
      FUTURE
LET’S BE HONEST
THE PEOPLE WHO ARE
MAKING MONEY OFF OF BIG
         DATA
ARE THE PEOPLE
EXTRACTING VALUE FROM IT
         TODAY
I.E. THE PEOPLE SELLING BIG
      DATA SOLUTIONS
EVERYONE AND THEIR
GRANDMA ARE TRYING TO
 GET IN ON THE ACTION
VENDORS ARE REPACKAGING
   THE SAME OLD THING
AND TRYING TO TRICK US
INTO THINKING ITS THE NEW
         HOTNESS
LET’S NOT BE FOOLED BY
       MARKETING
WORDS ARE IMPORTANT
MARKETING WORKS TO
SEPARATE WORDS FROM
    THEIR MEANING
FROM THEIR ORIGINAL
      INTENT
TO GET YOU TO ASSOCIATE
        WORDS
WITH PARTICULAR
PRODUCTS
BRANDS
AND VENDORS
</RANT>
LET’S TRY TO IMPROVE THE
  STATE OF DISCOURSE
SO LET’S BRING SOME NEW
CATCHPHRASES TO THE TABLE
SO WE DON’T HAVE TO TALK
ABOUT BIG DATA ANYMORE
INSTEAD LET’S TALK ABOUT
     CRITICAL DATA
WHAT IS CRITICAL DATA?
Is your data really
    that critical,
       dude?
IT’S MISSION CRITICAL DATA
IT’S DATA WHOSE
 UNAVAILABILITY
COSTS YOU MONEY
CRED
OR LIVES
IT IS THE DATA NEEDED NOW
NOT AT SOME DISTANT
POINT IN THE FUTURE
IT IS THE DATA THAT YOU
YOUR CUSTOMERS
OR SOCIETY
CAN CAPITALIZE ON TODAY
ITS VALUE IS CAPTURED BY
THE OWNERS OF THE DATA
RATHER THAN A THIRD PARTY
HOW DO YOU IDENTIFY
 YOUR CRITICAL DATA?
LATENCY AT SOME MARGIN
    APPEARS SIMPLY AS
     UNAVAILABILITY
Who cares about latency?




Sometimes high latency looks like an outage
             to the end user.
FOR AMAZON:
       100MS LATENCY
    DECREASES SALES BY 1%


Source: http://sites.google.com/site/glinden/Home/StanfordDataMining.2006-11-28.ppt
FOR GOOGLE:
    A 500MS INCREASE IN LATENCY
          REDUCED TRAFFIC
           BY 20 PERCENT



Source: http://sites.google.com/site/glinden/Home/StanfordDataMining.2006-11-28.ppt
WHAT DOES A SYSTEM FOR
CRITICAL DATA LOOK LIKE?
STREAMING PROCESSING
STORM
RIAK_PIPE
EXAMPLES OF DYNAMO
      SYSTEMS
VOLDEMORT
THESE SYSTEMS SACRIFICE
 CONSISTENCY FOR HIGH
AVAILABILITY/LOW LATENCY
I'M NOT MAKING A SALES
         PITCH
DON'T USE MY DATABASE
SERIOUSLY, DON'T
UNLESS
YOU ARE WILLING TO
    SACRIFICE
FAMILIAR DATA AND QUERY
         MODELS
FAMILIAR HIRING PATTERNS
KNOWN OPERATIONAL
     ISSUES
FOR
PREDICTABLE LATENCY
AVAILABILITY
PREDICTABLE OPERATIONS
OR IF DATA UNAVAILABILITY
 COSTS YOU $$$ OR MORE
THANKS
ian@basho.com

  @dstroyallmodels

github.com/ian-plosker

Contenu connexe

Similaire à The Big Data Con: Why Big Data is a Problem, not a Solution - Ian Plosker

Scott Thomson, Darren Drew. getting data fit
Scott Thomson, Darren Drew. getting data fitScott Thomson, Darren Drew. getting data fit
Scott Thomson, Darren Drew. getting data fit
betterbigdata
 
Big data big_ruse
Big data big_ruseBig data big_ruse
Big data big_ruse
shoshi107
 

Similaire à The Big Data Con: Why Big Data is a Problem, not a Solution - Ian Plosker (20)

Scott Thomson, Darren Drew. getting data fit
Scott Thomson, Darren Drew. getting data fitScott Thomson, Darren Drew. getting data fit
Scott Thomson, Darren Drew. getting data fit
 
ie - presentation Application Master
ie - presentation Application Masterie - presentation Application Master
ie - presentation Application Master
 
Data is the New Gold
Data is the New GoldData is the New Gold
Data is the New Gold
 
Big data big_ruse
Big data big_ruseBig data big_ruse
Big data big_ruse
 
WiDS - Unleashing the promises of big data
WiDS - Unleashing the promises of big dataWiDS - Unleashing the promises of big data
WiDS - Unleashing the promises of big data
 
Want a Data-Driven Culture? Start Sorting Out the BI and Big Data Myths Now
Want a Data-Driven Culture? Start Sorting Out the BI and Big Data Myths NowWant a Data-Driven Culture? Start Sorting Out the BI and Big Data Myths Now
Want a Data-Driven Culture? Start Sorting Out the BI and Big Data Myths Now
 
Big Data: Evolution? Game Changer? Definitely
Big Data: Evolution? Game Changer? DefinitelyBig Data: Evolution? Game Changer? Definitely
Big Data: Evolution? Game Changer? Definitely
 
Big Data for the Retail Business I Swan Insights I Solvay Business School
Big Data for the Retail Business I Swan Insights I Solvay Business SchoolBig Data for the Retail Business I Swan Insights I Solvay Business School
Big Data for the Retail Business I Swan Insights I Solvay Business School
 
All About the Data and How to Use It
All About the Data and How to Use ItAll About the Data and How to Use It
All About the Data and How to Use It
 
Big data-analytics-ebook
Big data-analytics-ebookBig data-analytics-ebook
Big data-analytics-ebook
 
Dataiku - Big data paris 2015 - A Hybrid Platform, a Hybrid Team
Dataiku -  Big data paris 2015 - A Hybrid Platform, a Hybrid Team Dataiku -  Big data paris 2015 - A Hybrid Platform, a Hybrid Team
Dataiku - Big data paris 2015 - A Hybrid Platform, a Hybrid Team
 
Suburbia Sales Booklet (2019)
Suburbia Sales Booklet (2019)Suburbia Sales Booklet (2019)
Suburbia Sales Booklet (2019)
 
Data driven marketing: wat zijn de kenmerkende verschillen tussen succesvolle...
Data driven marketing: wat zijn de kenmerkende verschillen tussen succesvolle...Data driven marketing: wat zijn de kenmerkende verschillen tussen succesvolle...
Data driven marketing: wat zijn de kenmerkende verschillen tussen succesvolle...
 
What do we do with all this big
What do we do with all this big What do we do with all this big
What do we do with all this big
 
Bidata
BidataBidata
Bidata
 
MindSEO Pitch [EN - 2017]
MindSEO Pitch [EN - 2017]MindSEO Pitch [EN - 2017]
MindSEO Pitch [EN - 2017]
 
Whitepaper: Thriving in the Big Data era Manage Data before Data Manages you
Whitepaper: Thriving in the Big Data era Manage Data before Data Manages you Whitepaper: Thriving in the Big Data era Manage Data before Data Manages you
Whitepaper: Thriving in the Big Data era Manage Data before Data Manages you
 
The Myths of Big Data
The Myths of Big DataThe Myths of Big Data
The Myths of Big Data
 
Presentation: IXN Webinar, CFOs and Big Data. Why they should care and what t...
Presentation: IXN Webinar, CFOs and Big Data. Why they should care and what t...Presentation: IXN Webinar, CFOs and Big Data. Why they should care and what t...
Presentation: IXN Webinar, CFOs and Big Data. Why they should care and what t...
 
AWS Transformation Day - Minneapolis 2018
AWS Transformation Day - Minneapolis 2018AWS Transformation Day - Minneapolis 2018
AWS Transformation Day - Minneapolis 2018
 

Plus de JAX London

Everything I know about software in spaghetti bolognese: managing complexity
Everything I know about software in spaghetti bolognese: managing complexityEverything I know about software in spaghetti bolognese: managing complexity
Everything I know about software in spaghetti bolognese: managing complexity
JAX London
 

Plus de JAX London (20)

Everything I know about software in spaghetti bolognese: managing complexity
Everything I know about software in spaghetti bolognese: managing complexityEverything I know about software in spaghetti bolognese: managing complexity
Everything I know about software in spaghetti bolognese: managing complexity
 
Devops with the S for Sharing - Patrick Debois
Devops with the S for Sharing - Patrick DeboisDevops with the S for Sharing - Patrick Debois
Devops with the S for Sharing - Patrick Debois
 
Busy Developer's Guide to Windows 8 HTML/JavaScript Apps
Busy Developer's Guide to Windows 8 HTML/JavaScript AppsBusy Developer's Guide to Windows 8 HTML/JavaScript Apps
Busy Developer's Guide to Windows 8 HTML/JavaScript Apps
 
It's code but not as we know: Infrastructure as Code - Patrick Debois
It's code but not as we know: Infrastructure as Code - Patrick DeboisIt's code but not as we know: Infrastructure as Code - Patrick Debois
It's code but not as we know: Infrastructure as Code - Patrick Debois
 
Locks? We Don't Need No Stinkin' Locks - Michael Barker
Locks? We Don't Need No Stinkin' Locks - Michael BarkerLocks? We Don't Need No Stinkin' Locks - Michael Barker
Locks? We Don't Need No Stinkin' Locks - Michael Barker
 
Worse is better, for better or for worse - Kevlin Henney
Worse is better, for better or for worse - Kevlin HenneyWorse is better, for better or for worse - Kevlin Henney
Worse is better, for better or for worse - Kevlin Henney
 
Java performance: What's the big deal? - Trisha Gee
Java performance: What's the big deal? - Trisha GeeJava performance: What's the big deal? - Trisha Gee
Java performance: What's the big deal? - Trisha Gee
 
Clojure made-simple - John Stevenson
Clojure made-simple - John StevensonClojure made-simple - John Stevenson
Clojure made-simple - John Stevenson
 
HTML alchemy: the secrets of mixing JavaScript and Java EE - Matthias Wessendorf
HTML alchemy: the secrets of mixing JavaScript and Java EE - Matthias WessendorfHTML alchemy: the secrets of mixing JavaScript and Java EE - Matthias Wessendorf
HTML alchemy: the secrets of mixing JavaScript and Java EE - Matthias Wessendorf
 
Play framework 2 : Peter Hilton
Play framework 2 : Peter HiltonPlay framework 2 : Peter Hilton
Play framework 2 : Peter Hilton
 
Complexity theory and software development : Tim Berglund
Complexity theory and software development : Tim BerglundComplexity theory and software development : Tim Berglund
Complexity theory and software development : Tim Berglund
 
Why FLOSS is a Java developer's best friend: Dave Gruber
Why FLOSS is a Java developer's best friend: Dave GruberWhy FLOSS is a Java developer's best friend: Dave Gruber
Why FLOSS is a Java developer's best friend: Dave Gruber
 
Akka in Action: Heiko Seeburger
Akka in Action: Heiko SeeburgerAkka in Action: Heiko Seeburger
Akka in Action: Heiko Seeburger
 
NoSQL Smackdown 2012 : Tim Berglund
NoSQL Smackdown 2012 : Tim BerglundNoSQL Smackdown 2012 : Tim Berglund
NoSQL Smackdown 2012 : Tim Berglund
 
Closures, the next "Big Thing" in Java: Russel Winder
Closures, the next "Big Thing" in Java: Russel WinderClosures, the next "Big Thing" in Java: Russel Winder
Closures, the next "Big Thing" in Java: Russel Winder
 
Java and the machine - Martijn Verburg and Kirk Pepperdine
Java and the machine - Martijn Verburg and Kirk PepperdineJava and the machine - Martijn Verburg and Kirk Pepperdine
Java and the machine - Martijn Verburg and Kirk Pepperdine
 
Mongo DB on the JVM - Brendan McAdams
Mongo DB on the JVM - Brendan McAdamsMongo DB on the JVM - Brendan McAdams
Mongo DB on the JVM - Brendan McAdams
 
New opportunities for connected data - Ian Robinson
New opportunities for connected data - Ian RobinsonNew opportunities for connected data - Ian Robinson
New opportunities for connected data - Ian Robinson
 
HTML5 Websockets and Java - Arun Gupta
HTML5 Websockets and Java - Arun GuptaHTML5 Websockets and Java - Arun Gupta
HTML5 Websockets and Java - Arun Gupta
 
Bluffers guide to elitist jargon - Martijn Verburg, Richard Warburton, James ...
Bluffers guide to elitist jargon - Martijn Verburg, Richard Warburton, James ...Bluffers guide to elitist jargon - Martijn Verburg, Richard Warburton, James ...
Bluffers guide to elitist jargon - Martijn Verburg, Richard Warburton, James ...
 

Dernier

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Dernier (20)

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 

The Big Data Con: Why Big Data is a Problem, not a Solution - Ian Plosker