SlideShare une entreprise Scribd logo
1  sur  7
Télécharger pour lire hors ligne
Big Data – a Little Analysis

         Chris Swan
         @cpswan
Overview
Simple Problems
Low data volume, simple algorithm(s)
Quant Problems
Any data volume, complex algorithm(s)
Big Data Problems
Large data volume, simple algorithm(s)


                      Types of Big Data Problem:

                      1. Inherent

                      2. More data gives better
                      result than more complex
                      algorithm
The good and bad of big data
Good
  – Lots of new tools, mostly open source



Bad
  – Term being abused by marketing departments
  – Can easily lead to over reliance on systems that
    lack transparency and ignore specific data points
       'Computer says no', but nobody can explain why
Whoever thinks his problem is
      solved by big data,
doesn’t understand his problem
and doesn’t understand big data
   (With apologies to Roger Needham)

    Original blog post at is.gd/swbdla

Contenu connexe

Similaire à Chris swan big data - a little analysis - cloud camp london 24.10.12

IET harnessing big data tools in financial services
IET harnessing big data tools in financial servicesIET harnessing big data tools in financial services
IET harnessing big data tools in financial servicesChris Swan
 
Everything has changed except us
Everything has changed except usEverything has changed except us
Everything has changed except usmark madsen
 
The math behind big systems analysis.
The math behind big systems analysis.The math behind big systems analysis.
The math behind big systems analysis.Theo Schlossnagle
 
Daniel Abadi: VLDB 2009 Panel
Daniel Abadi: VLDB 2009 PanelDaniel Abadi: VLDB 2009 Panel
Daniel Abadi: VLDB 2009 PanelDaniel Abadi
 
Introduction to Big Data
Introduction to Big DataIntroduction to Big Data
Introduction to Big DataKaran Desai
 
Wake up and smell the data
Wake up and smell the dataWake up and smell the data
Wake up and smell the datamark madsen
 
Thinkful DC - Intro to Data Science
Thinkful DC - Intro to Data Science Thinkful DC - Intro to Data Science
Thinkful DC - Intro to Data Science TJ Stalcup
 
Practical Tips On Handling Big Data
Practical Tips On Handling Big DataPractical Tips On Handling Big Data
Practical Tips On Handling Big DataBrian Spiering
 
Big Data: Are you ready for it? Can you handle it?
Big Data: Are you ready for it? Can you handle it? Big Data: Are you ready for it? Can you handle it?
Big Data: Are you ready for it? Can you handle it? ScaleFocus
 
Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)
Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)
Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)Daniel Austin
 
Big Data By Vijay Bhaskar Semwal
Big Data By Vijay Bhaskar SemwalBig Data By Vijay Bhaskar Semwal
Big Data By Vijay Bhaskar SemwalIIIT Allahabad
 
[243] turning data into value
[243] turning data into value[243] turning data into value
[243] turning data into valueNAVER D2
 
Reasoning over big data
Reasoning over big dataReasoning over big data
Reasoning over big dataOSTHUS
 

Similaire à Chris swan big data - a little analysis - cloud camp london 24.10.12 (20)

IET harnessing big data tools in financial services
IET harnessing big data tools in financial servicesIET harnessing big data tools in financial services
IET harnessing big data tools in financial services
 
Everything has changed except us
Everything has changed except usEverything has changed except us
Everything has changed except us
 
The math behind big systems analysis.
The math behind big systems analysis.The math behind big systems analysis.
The math behind big systems analysis.
 
Daniel Abadi: VLDB 2009 Panel
Daniel Abadi: VLDB 2009 PanelDaniel Abadi: VLDB 2009 Panel
Daniel Abadi: VLDB 2009 Panel
 
Grandata
GrandataGrandata
Grandata
 
Introduction to Big Data
Introduction to Big DataIntroduction to Big Data
Introduction to Big Data
 
Big Data
Big DataBig Data
Big Data
 
Wake up and smell the data
Wake up and smell the dataWake up and smell the data
Wake up and smell the data
 
Big Data.pptx
Big Data.pptxBig Data.pptx
Big Data.pptx
 
Thinkful DC - Intro to Data Science
Thinkful DC - Intro to Data Science Thinkful DC - Intro to Data Science
Thinkful DC - Intro to Data Science
 
Practical Tips On Handling Big Data
Practical Tips On Handling Big DataPractical Tips On Handling Big Data
Practical Tips On Handling Big Data
 
Big Data
Big DataBig Data
Big Data
 
Data mining with big data
Data mining with big dataData mining with big data
Data mining with big data
 
Big Data: Are you ready for it? Can you handle it?
Big Data: Are you ready for it? Can you handle it? Big Data: Are you ready for it? Can you handle it?
Big Data: Are you ready for it? Can you handle it?
 
Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)
Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)
Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)
 
Big Data By Vijay Bhaskar Semwal
Big Data By Vijay Bhaskar SemwalBig Data By Vijay Bhaskar Semwal
Big Data By Vijay Bhaskar Semwal
 
Data mining with big data
Data mining with big dataData mining with big data
Data mining with big data
 
Big Data and Analytics - 2016 CFO
Big Data and Analytics - 2016 CFOBig Data and Analytics - 2016 CFO
Big Data and Analytics - 2016 CFO
 
[243] turning data into value
[243] turning data into value[243] turning data into value
[243] turning data into value
 
Reasoning over big data
Reasoning over big dataReasoning over big data
Reasoning over big data
 

Plus de Chris Purrington

PaulJohnston CloudCamp London Ethics Climate Change Nov 2019
PaulJohnston CloudCamp London Ethics Climate Change Nov 2019PaulJohnston CloudCamp London Ethics Climate Change Nov 2019
PaulJohnston CloudCamp London Ethics Climate Change Nov 2019Chris Purrington
 
Lucy Craddock CloudCampLondon - AI Ethics - Bias in Data
Lucy Craddock CloudCampLondon -   AI Ethics - Bias in DataLucy Craddock CloudCampLondon -   AI Ethics - Bias in Data
Lucy Craddock CloudCampLondon - AI Ethics - Bias in DataChris Purrington
 
Dr Caitlin McDonald CloudCamp London - Sustainable Digital Ethics through Evo...
Dr Caitlin McDonald CloudCamp London - Sustainable Digital Ethics through Evo...Dr Caitlin McDonald CloudCamp London - Sustainable Digital Ethics through Evo...
Dr Caitlin McDonald CloudCamp London - Sustainable Digital Ethics through Evo...Chris Purrington
 
Chris Swan Intro CloudCamp London November 2019
Chris Swan Intro CloudCamp London November 2019Chris Swan Intro CloudCamp London November 2019
Chris Swan Intro CloudCamp London November 2019Chris Purrington
 
@cpswan on what is hybridcloud and shouldn't you have hybridstrategy
@cpswan on what is hybridcloud and shouldn't you have hybridstrategy@cpswan on what is hybridcloud and shouldn't you have hybridstrategy
@cpswan on what is hybridcloud and shouldn't you have hybridstrategyChris Purrington
 
CloudCamp. Rhys Sharp Applications & PaaS
CloudCamp. Rhys Sharp   Applications & PaaSCloudCamp. Rhys Sharp   Applications & PaaS
CloudCamp. Rhys Sharp Applications & PaaSChris Purrington
 
CloudCamp. Paul Hopton, @relayr_cloud - 'The WunderBar - Bootstrapping the In...
CloudCamp. Paul Hopton, @relayr_cloud - 'The WunderBar - Bootstrapping the In...CloudCamp. Paul Hopton, @relayr_cloud - 'The WunderBar - Bootstrapping the In...
CloudCamp. Paul Hopton, @relayr_cloud - 'The WunderBar - Bootstrapping the In...Chris Purrington
 
CloudCamp. Julian Fischer Anynines - migrating a cloud foundry from vm war...
CloudCamp.  Julian Fischer   Anynines - migrating a cloud foundry from vm war...CloudCamp.  Julian Fischer   Anynines - migrating a cloud foundry from vm war...
CloudCamp. Julian Fischer Anynines - migrating a cloud foundry from vm war...Chris Purrington
 
CloudCamp. Richard Weerasinghe, ElasticBox - 'Cloud-Enabling Enterprise Appli...
CloudCamp. Richard Weerasinghe, ElasticBox - 'Cloud-Enabling Enterprise Appli...CloudCamp. Richard Weerasinghe, ElasticBox - 'Cloud-Enabling Enterprise Appli...
CloudCamp. Richard Weerasinghe, ElasticBox - 'Cloud-Enabling Enterprise Appli...Chris Purrington
 
CloudCamp. Anthony Stanley - 'The Anatomy of an App.. Everything but the App...
CloudCamp. Anthony Stanley -  'The Anatomy of an App.. Everything but the App...CloudCamp. Anthony Stanley -  'The Anatomy of an App.. Everything but the App...
CloudCamp. Anthony Stanley - 'The Anatomy of an App.. Everything but the App...Chris Purrington
 
CloudCamp. Philip Carey: 'Grey Cloud' do you pass the Yorkshire Test. A lig...
CloudCamp.  Philip Carey:  'Grey Cloud' do you pass the Yorkshire Test. A lig...CloudCamp.  Philip Carey:  'Grey Cloud' do you pass the Yorkshire Test. A lig...
CloudCamp. Philip Carey: 'Grey Cloud' do you pass the Yorkshire Test. A lig...Chris Purrington
 
CloudCamp. Danile Power - It's All About Managing the App
CloudCamp. Danile Power -  It's All About Managing the AppCloudCamp. Danile Power -  It's All About Managing the App
CloudCamp. Danile Power - It's All About Managing the AppChris Purrington
 
CloudCamp justin cormack hypervise my app!
CloudCamp   justin cormack    hypervise my app! CloudCamp   justin cormack    hypervise my app!
CloudCamp justin cormack hypervise my app! Chris Purrington
 
Steve chambers cloud psychopaths- cloud camplondon 24.10.12
Steve chambers   cloud psychopaths- cloud camplondon 24.10.12Steve chambers   cloud psychopaths- cloud camplondon 24.10.12
Steve chambers cloud psychopaths- cloud camplondon 24.10.12Chris Purrington
 
Phil wainewright risks of eu clopud strategy cloudcamp london 24.10.12
Phil wainewright  risks of eu clopud strategy   cloudcamp london 24.10.12Phil wainewright  risks of eu clopud strategy   cloudcamp london 24.10.12
Phil wainewright risks of eu clopud strategy cloudcamp london 24.10.12Chris Purrington
 
Ali khajeh hosseini -plan forcloud - cloudcamp london 24.10.12
Ali khajeh hosseini -plan forcloud - cloudcamp london 24.10.12Ali khajeh hosseini -plan forcloud - cloudcamp london 24.10.12
Ali khajeh hosseini -plan forcloud - cloudcamp london 24.10.12Chris Purrington
 
Joe baguley cloudcamp london intro 24.10.12
Joe baguley   cloudcamp london intro 24.10.12Joe baguley   cloudcamp london intro 24.10.12
Joe baguley cloudcamp london intro 24.10.12Chris Purrington
 
5. shanley cloudcamplondon
5. shanley cloudcamplondon5. shanley cloudcamplondon
5. shanley cloudcamplondonChris Purrington
 
4. james Governor cloud camp july 4 2012
4. james Governor cloud camp july 4 20124. james Governor cloud camp july 4 2012
4. james Governor cloud camp july 4 2012Chris Purrington
 
1. fran bennett 2012 07 04_cloudcamp
1. fran bennett 2012 07 04_cloudcamp1. fran bennett 2012 07 04_cloudcamp
1. fran bennett 2012 07 04_cloudcampChris Purrington
 

Plus de Chris Purrington (20)

PaulJohnston CloudCamp London Ethics Climate Change Nov 2019
PaulJohnston CloudCamp London Ethics Climate Change Nov 2019PaulJohnston CloudCamp London Ethics Climate Change Nov 2019
PaulJohnston CloudCamp London Ethics Climate Change Nov 2019
 
Lucy Craddock CloudCampLondon - AI Ethics - Bias in Data
Lucy Craddock CloudCampLondon -   AI Ethics - Bias in DataLucy Craddock CloudCampLondon -   AI Ethics - Bias in Data
Lucy Craddock CloudCampLondon - AI Ethics - Bias in Data
 
Dr Caitlin McDonald CloudCamp London - Sustainable Digital Ethics through Evo...
Dr Caitlin McDonald CloudCamp London - Sustainable Digital Ethics through Evo...Dr Caitlin McDonald CloudCamp London - Sustainable Digital Ethics through Evo...
Dr Caitlin McDonald CloudCamp London - Sustainable Digital Ethics through Evo...
 
Chris Swan Intro CloudCamp London November 2019
Chris Swan Intro CloudCamp London November 2019Chris Swan Intro CloudCamp London November 2019
Chris Swan Intro CloudCamp London November 2019
 
@cpswan on what is hybridcloud and shouldn't you have hybridstrategy
@cpswan on what is hybridcloud and shouldn't you have hybridstrategy@cpswan on what is hybridcloud and shouldn't you have hybridstrategy
@cpswan on what is hybridcloud and shouldn't you have hybridstrategy
 
CloudCamp. Rhys Sharp Applications & PaaS
CloudCamp. Rhys Sharp   Applications & PaaSCloudCamp. Rhys Sharp   Applications & PaaS
CloudCamp. Rhys Sharp Applications & PaaS
 
CloudCamp. Paul Hopton, @relayr_cloud - 'The WunderBar - Bootstrapping the In...
CloudCamp. Paul Hopton, @relayr_cloud - 'The WunderBar - Bootstrapping the In...CloudCamp. Paul Hopton, @relayr_cloud - 'The WunderBar - Bootstrapping the In...
CloudCamp. Paul Hopton, @relayr_cloud - 'The WunderBar - Bootstrapping the In...
 
CloudCamp. Julian Fischer Anynines - migrating a cloud foundry from vm war...
CloudCamp.  Julian Fischer   Anynines - migrating a cloud foundry from vm war...CloudCamp.  Julian Fischer   Anynines - migrating a cloud foundry from vm war...
CloudCamp. Julian Fischer Anynines - migrating a cloud foundry from vm war...
 
CloudCamp. Richard Weerasinghe, ElasticBox - 'Cloud-Enabling Enterprise Appli...
CloudCamp. Richard Weerasinghe, ElasticBox - 'Cloud-Enabling Enterprise Appli...CloudCamp. Richard Weerasinghe, ElasticBox - 'Cloud-Enabling Enterprise Appli...
CloudCamp. Richard Weerasinghe, ElasticBox - 'Cloud-Enabling Enterprise Appli...
 
CloudCamp. Anthony Stanley - 'The Anatomy of an App.. Everything but the App...
CloudCamp. Anthony Stanley -  'The Anatomy of an App.. Everything but the App...CloudCamp. Anthony Stanley -  'The Anatomy of an App.. Everything but the App...
CloudCamp. Anthony Stanley - 'The Anatomy of an App.. Everything but the App...
 
CloudCamp. Philip Carey: 'Grey Cloud' do you pass the Yorkshire Test. A lig...
CloudCamp.  Philip Carey:  'Grey Cloud' do you pass the Yorkshire Test. A lig...CloudCamp.  Philip Carey:  'Grey Cloud' do you pass the Yorkshire Test. A lig...
CloudCamp. Philip Carey: 'Grey Cloud' do you pass the Yorkshire Test. A lig...
 
CloudCamp. Danile Power - It's All About Managing the App
CloudCamp. Danile Power -  It's All About Managing the AppCloudCamp. Danile Power -  It's All About Managing the App
CloudCamp. Danile Power - It's All About Managing the App
 
CloudCamp justin cormack hypervise my app!
CloudCamp   justin cormack    hypervise my app! CloudCamp   justin cormack    hypervise my app!
CloudCamp justin cormack hypervise my app!
 
Steve chambers cloud psychopaths- cloud camplondon 24.10.12
Steve chambers   cloud psychopaths- cloud camplondon 24.10.12Steve chambers   cloud psychopaths- cloud camplondon 24.10.12
Steve chambers cloud psychopaths- cloud camplondon 24.10.12
 
Phil wainewright risks of eu clopud strategy cloudcamp london 24.10.12
Phil wainewright  risks of eu clopud strategy   cloudcamp london 24.10.12Phil wainewright  risks of eu clopud strategy   cloudcamp london 24.10.12
Phil wainewright risks of eu clopud strategy cloudcamp london 24.10.12
 
Ali khajeh hosseini -plan forcloud - cloudcamp london 24.10.12
Ali khajeh hosseini -plan forcloud - cloudcamp london 24.10.12Ali khajeh hosseini -plan forcloud - cloudcamp london 24.10.12
Ali khajeh hosseini -plan forcloud - cloudcamp london 24.10.12
 
Joe baguley cloudcamp london intro 24.10.12
Joe baguley   cloudcamp london intro 24.10.12Joe baguley   cloudcamp london intro 24.10.12
Joe baguley cloudcamp london intro 24.10.12
 
5. shanley cloudcamplondon
5. shanley cloudcamplondon5. shanley cloudcamplondon
5. shanley cloudcamplondon
 
4. james Governor cloud camp july 4 2012
4. james Governor cloud camp july 4 20124. james Governor cloud camp july 4 2012
4. james Governor cloud camp july 4 2012
 
1. fran bennett 2012 07 04_cloudcamp
1. fran bennett 2012 07 04_cloudcamp1. fran bennett 2012 07 04_cloudcamp
1. fran bennett 2012 07 04_cloudcamp
 

Chris swan big data - a little analysis - cloud camp london 24.10.12

  • 1. Big Data – a Little Analysis Chris Swan @cpswan
  • 3. Simple Problems Low data volume, simple algorithm(s)
  • 4. Quant Problems Any data volume, complex algorithm(s)
  • 5. Big Data Problems Large data volume, simple algorithm(s) Types of Big Data Problem: 1. Inherent 2. More data gives better result than more complex algorithm
  • 6. The good and bad of big data Good – Lots of new tools, mostly open source Bad – Term being abused by marketing departments – Can easily lead to over reliance on systems that lack transparency and ignore specific data points 'Computer says no', but nobody can explain why
  • 7. Whoever thinks his problem is solved by big data, doesn’t understand his problem and doesn’t understand big data (With apologies to Roger Needham) Original blog post at is.gd/swbdla