SlideShare une entreprise Scribd logo
1  sur  40
Big Data. New Physics. And Why Geospatial Data is Analytic SuperFood Jeff Jonas,  IBM Distinguished Engineer Chief Scientist, IBM Entity Analytics [email_address] March 23rd, 2011
Big Data.  New Physics. ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Background ,[object Object],[object Object],[object Object],[object Object],[object Object]
Trend: Organizations Are Getting Dumber Time Computing Power Growth Sensemaking Algorithms Available Observation Space Context Every two days now we create as much information as we did from the dawn of civilization up until 2003.”  ~ Eric Schmidt, CEO Google Enterprise Amnesia
Trend: Organizations Are Getting Dumber Time Computing Power Growth Sensemaking Algorithms Available Observation Space Context WHY?
Algorithms at Dead End.  You Can’t  Squeeze Knowledge  Out of a Pixel.
No Context [email_address]
[object Object],[object Object]
Information in Context … and Accumulating  Top 200 Customer Job  Applicant Identity Thief  Criminal Investigation [email_address]
From Pixels to Pictures to Insight  Observations Contextualization Information in Context Relevance Consumer (An analyst, a system,  the sensor itself, etc.)
The Puzzle Metaphor ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
How Context Accumulates ,[object Object],[object Object],[object Object],[object Object],[object Object]
Overstated Population Observations Unique Identities True Population
Counting Is Difficult Mark Smith 6/12/1978 443-43-0000 Mark R Smith (707) 433-0000 DL: 00001234 File 1 File 2
The Bigger, The More Accurate, The Faster Observations Unique Identities True Population
Data Triangulation  Mark Smith 6/12/1978 443-43-0000 Mark R Smith (707) 433-0000 DL: 00001234 File 1 File 2 Mark Randy Smith 443-43-0000 DL: 00001234 New Record
Big Data … pile of … Big Data … in context
One Form of Context is “Expert Counting” ,[object Object],[object Object],[object Object],[object Object]
“Key Features” Enable Expert Counting ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Consider Lying Identical Twins #123 Sue 3/3/84 Uberstan Exp 2011 PASSPORT #123 Sue 3/3/84 Uberstan Exp 2011 PASSPORT Fingerprint DNA Most Trusted Authority “ Same person –  trust me.” Most Trusted Authority
[object Object],[object Object]
Space & Time Enables  Absolute  Disambiguation ,[object Object],Name Make Device ID Address Model Make Date of Birth Year Model Phone License Plate No. Firmware Vers. Passport VIN Asset ID Nationality Owner Etc. Biometric Etc. Etc. When When When Where Where Where
“Life Arcs” Are Also Telling Bill Smith 4/13/67 Salem, Oregon Bill Smith 4/13/67 Seattle, Washington Address History Tampa, FL 2008-2008 Biloxi, MS 2005-2008 NY, NY 1996-2005 Tampa, FL 1984-1996 Address History San Diego, CA 2005-2009 San Fran, CA 2005-2005 Phoenix, AZ 1990-2005 San Jose, CA 1982-1990
OMG
Space-Time-Travel ,[object Object],[object Object],[object Object],[object Object]
Space-Time-Travel is Prediction Super-Food ,[object Object],[object Object],[object Object],[object Object]
Consequences ,[object Object],[object Object],[object Object],[object Object],[object Object]
Surveillance society is irresistible. And you are doing it. Location-based services (GPS), free email, Facebook, etc.
2 Big Data Trends
Trend: Time Is Of The Essence Willingness to Wait The better the predictions … the faster they will be wanted.  “ Why did we have to wait until the end of the day for the smart answer?” Relevance  (Iffy) (Totally) Day Hour 200ms Batch Real-Time
Trend: Growing Tolerance for Non-Repeatability Accountable and Repeatable It appears the market is becoming more tolerant of one-time results that cannot be  easily  repeated or substantiated Facebook Going Forward Yesterday Payroll Now Google
Trend: Be Careful What You Wish For Accountable and Repeatable 6:34pm  Recommendation  Shoot it 6:35pm  Action Taken  Bang.Dead 6:36pm  Recommendation  Oops.Send Flowers Going Forward Yesterday Now
Closing Thoughts
Wish This On The Adversary Time Computing Power Growth Sensemaking Algorithms Available Observation Space Context
Context Accumulation: The Way Forward Time Computing Power Growth Sensemaking Algorithms Available Observation Space Context Context  Accumulation
Related Blog Posts ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Big Data. New Physics. And Why Geospatial Data is Analytic SuperFood Jeff Jonas,  IBM Distinguished Engineer Chief Scientist, IBM Entity Analytics [email_address] March 23rd, 2011
“ G2” My R&D Skunk Works Project
My G2 Goals ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Big Data. New Physics. And Why Geospatial Data is Analytic SuperFood Jeff Jonas,  IBM Distinguished Engineer Chief Scientist, IBM Entity Analytics [email_address] March 23rd, 2011

Contenu connexe

Similaire à Big data new physics giga om structure conference ny - march 2011

Yo. big data. understanding data science in the era of big data.
Yo. big data. understanding data science in the era of big data.Yo. big data. understanding data science in the era of big data.
Yo. big data. understanding data science in the era of big data.
Natalino Busa
 

Similaire à Big data new physics giga om structure conference ny - march 2011 (20)

Roelof Temmingh FIRST07 slides
Roelof Temmingh FIRST07 slidesRoelof Temmingh FIRST07 slides
Roelof Temmingh FIRST07 slides
 
Qualitative Legal Prediction - Prof. Daniel Katz
Qualitative Legal Prediction - Prof. Daniel KatzQualitative Legal Prediction - Prof. Daniel Katz
Qualitative Legal Prediction - Prof. Daniel Katz
 
Big Data Past, Present and Future – Where are we Headed? - StampedeCon 2014
Big Data Past, Present and Future – Where are we Headed? - StampedeCon 2014Big Data Past, Present and Future – Where are we Headed? - StampedeCon 2014
Big Data Past, Present and Future – Where are we Headed? - StampedeCon 2014
 
Jdb code biology and ai final
Jdb code biology and ai finalJdb code biology and ai final
Jdb code biology and ai final
 
Into the next dimension
Into the next dimensionInto the next dimension
Into the next dimension
 
Ntegra 20231003 v3.pptx
Ntegra 20231003 v3.pptxNtegra 20231003 v3.pptx
Ntegra 20231003 v3.pptx
 
Yo. big data. understanding data science in the era of big data.
Yo. big data. understanding data science in the era of big data.Yo. big data. understanding data science in the era of big data.
Yo. big data. understanding data science in the era of big data.
 
The Three Forms of (Legal) Prediction: Experts, Crowds and Algorithms -- Prof...
The Three Forms of (Legal) Prediction: Experts, Crowds and Algorithms -- Prof...The Three Forms of (Legal) Prediction: Experts, Crowds and Algorithms -- Prof...
The Three Forms of (Legal) Prediction: Experts, Crowds and Algorithms -- Prof...
 
TCS Point of View Session - Analyze by Dr. Gautam Shroff, VP and Chief Scient...
TCS Point of View Session - Analyze by Dr. Gautam Shroff, VP and Chief Scient...TCS Point of View Session - Analyze by Dr. Gautam Shroff, VP and Chief Scient...
TCS Point of View Session - Analyze by Dr. Gautam Shroff, VP and Chief Scient...
 
Data science innovations
Data science innovations Data science innovations
Data science innovations
 
Researchers, Discovery and the Internet: What Next?
Researchers, Discovery and the Internet: What Next?Researchers, Discovery and the Internet: What Next?
Researchers, Discovery and the Internet: What Next?
 
Data Science Innovations : Democratisation of Data and Data Science
Data Science Innovations : Democratisation of Data and Data Science  Data Science Innovations : Democratisation of Data and Data Science
Data Science Innovations : Democratisation of Data and Data Science
 
Big Data Analytics - The New Cold War
Big Data Analytics - The New Cold WarBig Data Analytics - The New Cold War
Big Data Analytics - The New Cold War
 
Big Human Data
Big Human DataBig Human Data
Big Human Data
 
Big Data and the Art of Data Science
Big Data and the Art of Data ScienceBig Data and the Art of Data Science
Big Data and the Art of Data Science
 
Chatbots in 2017 -- Ithaca Talk Dec 6
Chatbots in 2017 -- Ithaca Talk Dec 6Chatbots in 2017 -- Ithaca Talk Dec 6
Chatbots in 2017 -- Ithaca Talk Dec 6
 
A Primer on Big Data taken by the book: "Big Data" by Schoenberger and Cukier
A Primer on Big Data taken by the book: "Big Data" by Schoenberger and CukierA Primer on Big Data taken by the book: "Big Data" by Schoenberger and Cukier
A Primer on Big Data taken by the book: "Big Data" by Schoenberger and Cukier
 
PPT - Steps For Writing An Essay PowerPoint
PPT - Steps For Writing An Essay PowerPointPPT - Steps For Writing An Essay PowerPoint
PPT - Steps For Writing An Essay PowerPoint
 
Accessible Next Level Visualizations
Accessible Next Level VisualizationsAccessible Next Level Visualizations
Accessible Next Level Visualizations
 
2019 June 27 - Big data and data science
2019 June 27 - Big data and data science2019 June 27 - Big data and data science
2019 June 27 - Big data and data science
 

Dernier

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Dernier (20)

Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 

Big data new physics giga om structure conference ny - march 2011

  • 1. Big Data. New Physics. And Why Geospatial Data is Analytic SuperFood Jeff Jonas, IBM Distinguished Engineer Chief Scientist, IBM Entity Analytics [email_address] March 23rd, 2011
  • 2.
  • 3.
  • 4. Trend: Organizations Are Getting Dumber Time Computing Power Growth Sensemaking Algorithms Available Observation Space Context Every two days now we create as much information as we did from the dawn of civilization up until 2003.” ~ Eric Schmidt, CEO Google Enterprise Amnesia
  • 5. Trend: Organizations Are Getting Dumber Time Computing Power Growth Sensemaking Algorithms Available Observation Space Context WHY?
  • 6. Algorithms at Dead End. You Can’t Squeeze Knowledge Out of a Pixel.
  • 8.
  • 9. Information in Context … and Accumulating Top 200 Customer Job Applicant Identity Thief Criminal Investigation [email_address]
  • 10. From Pixels to Pictures to Insight Observations Contextualization Information in Context Relevance Consumer (An analyst, a system, the sensor itself, etc.)
  • 11.
  • 12.
  • 13. Overstated Population Observations Unique Identities True Population
  • 14. Counting Is Difficult Mark Smith 6/12/1978 443-43-0000 Mark R Smith (707) 433-0000 DL: 00001234 File 1 File 2
  • 15. The Bigger, The More Accurate, The Faster Observations Unique Identities True Population
  • 16. Data Triangulation Mark Smith 6/12/1978 443-43-0000 Mark R Smith (707) 433-0000 DL: 00001234 File 1 File 2 Mark Randy Smith 443-43-0000 DL: 00001234 New Record
  • 17. Big Data … pile of … Big Data … in context
  • 18.
  • 19.
  • 20. Consider Lying Identical Twins #123 Sue 3/3/84 Uberstan Exp 2011 PASSPORT #123 Sue 3/3/84 Uberstan Exp 2011 PASSPORT Fingerprint DNA Most Trusted Authority “ Same person – trust me.” Most Trusted Authority
  • 21.
  • 22.
  • 23. “Life Arcs” Are Also Telling Bill Smith 4/13/67 Salem, Oregon Bill Smith 4/13/67 Seattle, Washington Address History Tampa, FL 2008-2008 Biloxi, MS 2005-2008 NY, NY 1996-2005 Tampa, FL 1984-1996 Address History San Diego, CA 2005-2009 San Fran, CA 2005-2005 Phoenix, AZ 1990-2005 San Jose, CA 1982-1990
  • 24. OMG
  • 25.
  • 26.
  • 27.
  • 28. Surveillance society is irresistible. And you are doing it. Location-based services (GPS), free email, Facebook, etc.
  • 29. 2 Big Data Trends
  • 30. Trend: Time Is Of The Essence Willingness to Wait The better the predictions … the faster they will be wanted. “ Why did we have to wait until the end of the day for the smart answer?” Relevance (Iffy) (Totally) Day Hour 200ms Batch Real-Time
  • 31. Trend: Growing Tolerance for Non-Repeatability Accountable and Repeatable It appears the market is becoming more tolerant of one-time results that cannot be easily repeated or substantiated Facebook Going Forward Yesterday Payroll Now Google
  • 32. Trend: Be Careful What You Wish For Accountable and Repeatable 6:34pm Recommendation Shoot it 6:35pm Action Taken Bang.Dead 6:36pm Recommendation Oops.Send Flowers Going Forward Yesterday Now
  • 34. Wish This On The Adversary Time Computing Power Growth Sensemaking Algorithms Available Observation Space Context
  • 35. Context Accumulation: The Way Forward Time Computing Power Growth Sensemaking Algorithms Available Observation Space Context Context Accumulation
  • 36.
  • 37. Big Data. New Physics. And Why Geospatial Data is Analytic SuperFood Jeff Jonas, IBM Distinguished Engineer Chief Scientist, IBM Entity Analytics [email_address] March 23rd, 2011
  • 38. “ G2” My R&D Skunk Works Project
  • 39.
  • 40. Big Data. New Physics. And Why Geospatial Data is Analytic SuperFood Jeff Jonas, IBM Distinguished Engineer Chief Scientist, IBM Entity Analytics [email_address] March 23rd, 2011