SlideShare une entreprise Scribd logo
1  sur  21
BIG DATA COMES IN SMALL PACKAGES
How the Internet of Things Will Change Big Data’s Future
Daniel Austin
GRIN Technologies, Inc.
The Connected Life Company
daniel.austin@grintech.net
NoSQL Now!
August 21st, 2014
V1.1
ABOUT GRIN TECHNOLOGIES, INC.
• Founded July 4th 2014
• “The Connected Life Company”
• Developing Systemsware at the Intersection of Big Data and the Internet of Things
• Smart People Working Hard to Solve Real Problems
• Coming in Q3 2015: The Connected Life Server ™
• A Platform for Connecting People, Places, and Things
Soft launching today at NoSQL Now!
FOUR BIG IDEAS FOR TODAY’S TALK
1. No “Internet of Things”, only disjoint Networks of Things
2. The IoT is an “iceberg” Big Data problem
3. Things are dumb, systems are smart
4. The “Witnesses” principle
WHY THERE WILL BE NO “INTERNET OF THINGS”
• No clients; no servers
• No network that connects them all
• No protocols that make sense
• Intermittent, Transient, Low Value, Connectionless
Many of Our Current Assumptions About the Internet Simply Don’t Apply!
INSTEAD, DISJOINT NETWORKS OF THINGS
• Disjoint – for Security and Privacy
• Functional and Context-Specific
• Mesh-based Peering Architectures
Peer 1
Peer 2
Peer3
Peer 4
Peer 1
Peer 2
Peer3
Peer 4
Public
Internet
Gateway Gateway
LAYER 8 HYPOTHESIS
• You are a Node on the Internet!
• The Internet Connects People, Not
Computers
• Humans are Machines that Turn
Data into Information
THE CONVERGENCE OF THE IOT AND BIG DATA
It’s not an accident that these
technologies are coming together at
the same time; the IoT wasn’t possible
before we had solutions to Big Data
problems.
Things
Big Data
Big Metadata
METADATA EXPLOSION
• “Big Metadata” is a bigger problem
than Big Data
• Austin’s Law: “The Amount of Data
to be Crunched Will Always Exceed
the Computing Power Available.”
• What are these companies’ data
retention policies?
ARE YOU A BIG DATA PROBLEM?
• Each person will generate roughly 25 petabytes of data over the course of a lifetime
• Users have little control over collection and storage
• Email, documents, receipts, bills (!), your car, music, books…
• Pervasive computing multiplies the problem
• Majority of data valueless out of context
• Security & privacy risks may outweigh the benefits ?!
LET’S TALK LIGHT BULBS
• Invented in 1879 by Edison and Swan
• Many others before had failed
• One of humanity’s most important inventions
• More than 400 distinct types are manufactured
• Streets, Airplanes, Neon (Still 82%
Incandescent!)
• The Eiffel Tower uses 20,376 light bulbs
• Many Lighting Systems Are Extremely Complex!
• Not a simple on/off state machine
• Critical for many life-and-death situations
• Unsustainable and unmanageable at scale
• Arrogant, disposable “dumb” design
• 2013: First light bulb on the Internet
IMAGINING THE IOLB
What If…
Every light bulb was connected to the IoT?
What Would the Architecture Look Like?
Could We Manage the Data Usefully?
Could We Build it?
LIGHT BULBS ARE DUMB; SYSTEMS ARE SMART
• We can’t design the IoLB by only changing the light bulbs; it’s a system
• It’s necessary for the system to evolve, not just the bulbs
• Bulbs will change to meet new conditions, become smarter
• Sockets, power lines, power generators and coal mines
• Every part of the system will evolve at a different rate
• While building the IoT, we will need to consider how to build smart systems
that help ordinary users, requiring compromise (and patience)
SYSTEMS THINKING AND LIGHT BULB ARCHITECTURE
WHICH COMES FIRST? THE SOCKET OR THE BULB?
• Problem: Do we want smart light bulbs or smart sockets?
• Light bulbs are easy to change, sockets are not
• But in an ideal world, most of the architectural ‘smarts’ of the IoLB
would be in the socket
• This is a classic architectural trade-off
• It’s too expensive to upgrade every part of the
system at the same time!
• Our light bulbs will be smarter than their sockets
• For some time; this will have wider implications
• For the IoLB (and IoT)
THE IOLB AND BIG DATA
12x10^9 light bulbs x (365 state changes/day) x 2 x 22 bytes = Big Data
A more realistic estimate would be 3 orders of magnitude larger! Plus the history, maintenance, etc.
SECURITY AND PRIVACY
ON THE IOT
• Security Is Protection from Harm
• Privacy is Filtering Data Based on Context
• The Separation of the Self from the Group
• Persona v. Identity
THE “WITNESSES” PRINCIPLE
• Cellphones are “things”, so are security cameras…
• “When There’s a Witness to Every Act…”
By 2020 everyone, everything and
everywhere will be connected in real
time. More than 50 billion connected
devices will be used in the
Networked Society.
Source: http://www.ericsson.com/thinkingahead/networked_society
IN A WORLD OF
TEN BILLION PEOPLE
AND THEIR THINGS…
• Everyone will be connected – to each other
• Privacy will disappear
• Security (and civility) will increase
• Witnesses are a good thing ™
A SPECIES AND ITS DATA: THE LONG VIEW
• We can’t build to scale exponentially.
Period.
• We are all part of the network
• The purpose of evolution is
computation
Will humanity merge with it’s data?
The Age of Big
Metadata
The Age of
Big Data
THANKS!
“When everyone’s life is connected, that’s when the
Singularity will happen.”
Daniel Austin
GRIN Technologies, Inc.
The Connected Life Company
daniel.austin@grintech.net
http://www.grintech.net
@daniel_b_Austin
@GRINTechInc

Contenu connexe

Tendances

Energy and The Internet of Things
Energy and The Internet of ThingsEnergy and The Internet of Things
Energy and The Internet of ThingsEenovators Limited
 
Living Online: Anytime, Anywhere, Any Device- NFAIS 2012
Living Online: Anytime, Anywhere, Any Device- NFAIS 2012Living Online: Anytime, Anywhere, Any Device- NFAIS 2012
Living Online: Anytime, Anywhere, Any Device- NFAIS 2012hratner
 
The Digital Revolution Keeps on Giving (and Takig)
The Digital Revolution Keeps on Giving (and Takig)The Digital Revolution Keeps on Giving (and Takig)
The Digital Revolution Keeps on Giving (and Takig)Robin Raskin
 
Designing for an internet of things
Designing for an internet of thingsDesigning for an internet of things
Designing for an internet of thingsTimo Arnall
 
Internet of things
Internet of thingsInternet of things
Internet of thingsAnnie Thomas
 
Location: Trends, Ethics & Diversity
Location: Trends, Ethics & DiversityLocation: Trends, Ethics & Diversity
Location: Trends, Ethics & DiversityPLACE
 
Alexandra Deschamps-Sonsino - The next 5 years of the internet of things
Alexandra Deschamps-Sonsino - The next 5 years of the internet of thingsAlexandra Deschamps-Sonsino - The next 5 years of the internet of things
Alexandra Deschamps-Sonsino - The next 5 years of the internet of thingsMobile Monday Amsterdam
 
Design beyond the glowing rectangle - EuroIA2010
Design beyond the glowing rectangle - EuroIA2010Design beyond the glowing rectangle - EuroIA2010
Design beyond the glowing rectangle - EuroIA2010Claire Rowland
 
A Quick Guide for Internet of Things - Apptunix
A Quick Guide for Internet of Things - ApptunixA Quick Guide for Internet of Things - Apptunix
A Quick Guide for Internet of Things - ApptunixApptunix
 

Tendances (20)

Energy and The Internet of Things
Energy and The Internet of ThingsEnergy and The Internet of Things
Energy and The Internet of Things
 
Widetag @ QU-ID
Widetag @ QU-IDWidetag @ QU-ID
Widetag @ QU-ID
 
Living Online: Anytime, Anywhere, Any Device- NFAIS 2012
Living Online: Anytime, Anywhere, Any Device- NFAIS 2012Living Online: Anytime, Anywhere, Any Device- NFAIS 2012
Living Online: Anytime, Anywhere, Any Device- NFAIS 2012
 
Io t an insight
Io t an insightIo t an insight
Io t an insight
 
Ete 107
Ete 107Ete 107
Ete 107
 
The Digital Revolution Keeps on Giving (and Takig)
The Digital Revolution Keeps on Giving (and Takig)The Digital Revolution Keeps on Giving (and Takig)
The Digital Revolution Keeps on Giving (and Takig)
 
Computer
ComputerComputer
Computer
 
Designing for an internet of things
Designing for an internet of thingsDesigning for an internet of things
Designing for an internet of things
 
Internet of things
Internet of thingsInternet of things
Internet of things
 
Technology Then And Now
Technology Then And NowTechnology Then And Now
Technology Then And Now
 
Sss14green Iotic Labs
Sss14green Iotic LabsSss14green Iotic Labs
Sss14green Iotic Labs
 
Location: Trends, Ethics & Diversity
Location: Trends, Ethics & DiversityLocation: Trends, Ethics & Diversity
Location: Trends, Ethics & Diversity
 
Iot chap i
Iot chap iIot chap i
Iot chap i
 
Alexandra Deschamps-Sonsino - The next 5 years of the internet of things
Alexandra Deschamps-Sonsino - The next 5 years of the internet of thingsAlexandra Deschamps-Sonsino - The next 5 years of the internet of things
Alexandra Deschamps-Sonsino - The next 5 years of the internet of things
 
Social impact of computers
Social impact of computersSocial impact of computers
Social impact of computers
 
Design beyond the glowing rectangle - EuroIA2010
Design beyond the glowing rectangle - EuroIA2010Design beyond the glowing rectangle - EuroIA2010
Design beyond the glowing rectangle - EuroIA2010
 
Designing chocolate, not aspirin
Designing chocolate, not aspirinDesigning chocolate, not aspirin
Designing chocolate, not aspirin
 
A Quick Guide for Internet of Things - Apptunix
A Quick Guide for Internet of Things - ApptunixA Quick Guide for Internet of Things - Apptunix
A Quick Guide for Internet of Things - Apptunix
 
The road is wider than long
The road is wider than longThe road is wider than long
The road is wider than long
 
Shubham hatzade
Shubham hatzadeShubham hatzade
Shubham hatzade
 

En vedette

Next generation web protocols
Next generation web protocolsNext generation web protocols
Next generation web protocolsDaniel Austin
 
Web Performance BootCamp 2013
Web Performance BootCamp 2013Web Performance BootCamp 2013
Web Performance BootCamp 2013Daniel Austin
 
Performance: How Fast is Fast Enough?
Performance: How Fast is Fast Enough?Performance: How Fast is Fast Enough?
Performance: How Fast is Fast Enough?Daniel Austin
 
Big Data and the Future of Money 2014
Big Data and the Future of Money 2014Big Data and the Future of Money 2014
Big Data and the Future of Money 2014Daniel Austin
 
JavaOne 2013 CON7370: Java Interprocess Communication Challenges in Low-Laten...
JavaOne 2013 CON7370: Java Interprocess Communication Challenges in Low-Laten...JavaOne 2013 CON7370: Java Interprocess Communication Challenges in Low-Laten...
JavaOne 2013 CON7370: Java Interprocess Communication Challenges in Low-Laten...0xdaryl
 
Always Offline: Delay-Tolerant Networking for the Internet of Things
Always Offline: Delay-Tolerant Networking for the Internet of ThingsAlways Offline: Delay-Tolerant Networking for the Internet of Things
Always Offline: Delay-Tolerant Networking for the Internet of ThingsDaniel Austin
 

En vedette (6)

Next generation web protocols
Next generation web protocolsNext generation web protocols
Next generation web protocols
 
Web Performance BootCamp 2013
Web Performance BootCamp 2013Web Performance BootCamp 2013
Web Performance BootCamp 2013
 
Performance: How Fast is Fast Enough?
Performance: How Fast is Fast Enough?Performance: How Fast is Fast Enough?
Performance: How Fast is Fast Enough?
 
Big Data and the Future of Money 2014
Big Data and the Future of Money 2014Big Data and the Future of Money 2014
Big Data and the Future of Money 2014
 
JavaOne 2013 CON7370: Java Interprocess Communication Challenges in Low-Laten...
JavaOne 2013 CON7370: Java Interprocess Communication Challenges in Low-Laten...JavaOne 2013 CON7370: Java Interprocess Communication Challenges in Low-Laten...
JavaOne 2013 CON7370: Java Interprocess Communication Challenges in Low-Laten...
 
Always Offline: Delay-Tolerant Networking for the Internet of Things
Always Offline: Delay-Tolerant Networking for the Internet of ThingsAlways Offline: Delay-Tolerant Networking for the Internet of Things
Always Offline: Delay-Tolerant Networking for the Internet of Things
 

Similaire à BIG DATA AND IOT WILL MERGE

Recent developments in data analytics and big data
Recent developments in data analytics and big dataRecent developments in data analytics and big data
Recent developments in data analytics and big dataDez Blanchfield
 
Speaking at John Carrol University on the Internet of Things
Speaking at John Carrol University on the Internet of ThingsSpeaking at John Carrol University on the Internet of Things
Speaking at John Carrol University on the Internet of ThingsJustin Grammens
 
Internet of Things in Logistics
Internet of Things in LogisticsInternet of Things in Logistics
Internet of Things in LogisticsJeff Risley
 
Internet of things and nanothings workshop may 2014
Internet of things and nanothings workshop may 2014Internet of things and nanothings workshop may 2014
Internet of things and nanothings workshop may 2014Marios Kyriazis
 
Some thoughts on IoT, HKNOG 4.0
Some thoughts on IoT, HKNOG 4.0Some thoughts on IoT, HKNOG 4.0
Some thoughts on IoT, HKNOG 4.0APNIC
 
Internet of Things - IoT
Internet of Things - IoTInternet of Things - IoT
Internet of Things - IoTFarjad Noor
 
What hope for privacy in an IoT world?
What hope for privacy in an IoT world? What hope for privacy in an IoT world?
What hope for privacy in an IoT world? kotahinet
 
SGNOG 5: Some thoughts on IoT
SGNOG 5: Some thoughts on IoTSGNOG 5: Some thoughts on IoT
SGNOG 5: Some thoughts on IoTAPNIC
 
Internet of Things, Connected Infrastructure & The Modern Supply Chain
Internet of Things, Connected Infrastructure & The Modern Supply ChainInternet of Things, Connected Infrastructure & The Modern Supply Chain
Internet of Things, Connected Infrastructure & The Modern Supply ChainJeff Risley
 
AusNOG 2017: Some thoughts on IoT
AusNOG 2017: Some thoughts on IoTAusNOG 2017: Some thoughts on IoT
AusNOG 2017: Some thoughts on IoTAPNIC
 
Internet of things
Internet of thingsInternet of things
Internet of thingsSanoj Kumar
 
IoT Development - Opportunities and Challenges
IoT Development - Opportunities and ChallengesIoT Development - Opportunities and Challenges
IoT Development - Opportunities and ChallengesAsim Rais Siddiqui
 
IOT Internet of things New Version 2017
IOT Internet of things New Version 2017IOT Internet of things New Version 2017
IOT Internet of things New Version 2017Ajith Kumar Ravi
 
Internet of Things: Its Applications Future and Problems
Internet of Things: Its Applications Future and ProblemsInternet of Things: Its Applications Future and Problems
Internet of Things: Its Applications Future and ProblemsRiten Debnath
 

Similaire à BIG DATA AND IOT WILL MERGE (20)

Recent developments in data analytics and big data
Recent developments in data analytics and big dataRecent developments in data analytics and big data
Recent developments in data analytics and big data
 
Internet of things
Internet of thingsInternet of things
Internet of things
 
Internet of things
Internet of thingsInternet of things
Internet of things
 
Speaking at John Carrol University on the Internet of Things
Speaking at John Carrol University on the Internet of ThingsSpeaking at John Carrol University on the Internet of Things
Speaking at John Carrol University on the Internet of Things
 
Internet of Things in Logistics
Internet of Things in LogisticsInternet of Things in Logistics
Internet of Things in Logistics
 
Internet of things and nanothings workshop may 2014
Internet of things and nanothings workshop may 2014Internet of things and nanothings workshop may 2014
Internet of things and nanothings workshop may 2014
 
The Dawn of a new era: Internet of Things
The Dawn of a new era: Internet of ThingsThe Dawn of a new era: Internet of Things
The Dawn of a new era: Internet of Things
 
New technology
New technologyNew technology
New technology
 
Some thoughts on IoT, HKNOG 4.0
Some thoughts on IoT, HKNOG 4.0Some thoughts on IoT, HKNOG 4.0
Some thoughts on IoT, HKNOG 4.0
 
IOT.pptx
IOT.pptxIOT.pptx
IOT.pptx
 
What is IoT?
What is IoT? What is IoT?
What is IoT?
 
Internet of Things - IoT
Internet of Things - IoTInternet of Things - IoT
Internet of Things - IoT
 
What hope for privacy in an IoT world?
What hope for privacy in an IoT world? What hope for privacy in an IoT world?
What hope for privacy in an IoT world?
 
SGNOG 5: Some thoughts on IoT
SGNOG 5: Some thoughts on IoTSGNOG 5: Some thoughts on IoT
SGNOG 5: Some thoughts on IoT
 
Internet of Things, Connected Infrastructure & The Modern Supply Chain
Internet of Things, Connected Infrastructure & The Modern Supply ChainInternet of Things, Connected Infrastructure & The Modern Supply Chain
Internet of Things, Connected Infrastructure & The Modern Supply Chain
 
AusNOG 2017: Some thoughts on IoT
AusNOG 2017: Some thoughts on IoTAusNOG 2017: Some thoughts on IoT
AusNOG 2017: Some thoughts on IoT
 
Internet of things
Internet of thingsInternet of things
Internet of things
 
IoT Development - Opportunities and Challenges
IoT Development - Opportunities and ChallengesIoT Development - Opportunities and Challenges
IoT Development - Opportunities and Challenges
 
IOT Internet of things New Version 2017
IOT Internet of things New Version 2017IOT Internet of things New Version 2017
IOT Internet of things New Version 2017
 
Internet of Things: Its Applications Future and Problems
Internet of Things: Its Applications Future and ProblemsInternet of Things: Its Applications Future and Problems
Internet of Things: Its Applications Future and Problems
 

Plus de Daniel Austin

Designing Delay-tolerant Data Services for the Network of Things
Designing Delay-tolerant Data Services for the Network of ThingsDesigning Delay-tolerant Data Services for the Network of Things
Designing Delay-tolerant Data Services for the Network of ThingsDaniel Austin
 
Web Performance Bootcamp 2014
Web Performance Bootcamp 2014Web Performance Bootcamp 2014
Web Performance Bootcamp 2014Daniel Austin
 
HTML5, HTTP2, and You 1.1
HTML5, HTTP2, and You 1.1HTML5, HTTP2, and You 1.1
HTML5, HTTP2, and You 1.1Daniel Austin
 
Managing Performance Globally with MySQL
Managing Performance Globally with MySQLManaging Performance Globally with MySQL
Managing Performance Globally with MySQLDaniel Austin
 
Perspectives on the Evolution of HTML
Perspectives on the Evolution of HTMLPerspectives on the Evolution of HTML
Perspectives on the Evolution of HTMLDaniel Austin
 
The Fastest Possible Search Algorithm: Grover's Search and the World of Quant...
The Fastest Possible Search Algorithm: Grover's Search and the World of Quant...The Fastest Possible Search Algorithm: Grover's Search and the World of Quant...
The Fastest Possible Search Algorithm: Grover's Search and the World of Quant...Daniel Austin
 
Quantum Computing in a Nutshell: Grover's Search and the World of Quantum Com...
Quantum Computing in a Nutshell: Grover's Search and the World of Quantum Com...Quantum Computing in a Nutshell: Grover's Search and the World of Quantum Com...
Quantum Computing in a Nutshell: Grover's Search and the World of Quantum Com...Daniel Austin
 
Reconceiving the Web as a Distributed (NoSQL) Data System
Reconceiving the Web as a Distributed (NoSQL) Data SystemReconceiving the Web as a Distributed (NoSQL) Data System
Reconceiving the Web as a Distributed (NoSQL) Data SystemDaniel Austin
 
Big data and the Future of Money (World Big Data Congress 2013)
Big data and the Future of Money (World Big Data Congress 2013)Big data and the Future of Money (World Big Data Congress 2013)
Big data and the Future of Money (World Big Data Congress 2013)Daniel Austin
 
Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)
Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)
Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)Daniel Austin
 
Performance analysisclass
Performance analysisclassPerformance analysisclass
Performance analysisclassDaniel Austin
 
Yes sql08 inmemorydb
Yes sql08 inmemorydbYes sql08 inmemorydb
Yes sql08 inmemorydbDaniel Austin
 
The Fastest Possible Search Algorithm
The Fastest Possible Search AlgorithmThe Fastest Possible Search Algorithm
The Fastest Possible Search AlgorithmDaniel Austin
 
A Global In-memory Data System for MySQL
A Global In-memory Data System for MySQLA Global In-memory Data System for MySQL
A Global In-memory Data System for MySQLDaniel Austin
 
Notes on a High-Performance JSON Protocol
Notes on a High-Performance JSON ProtocolNotes on a High-Performance JSON Protocol
Notes on a High-Performance JSON ProtocolDaniel Austin
 
Wrestling Large Data Volumes to the Ground
Wrestling Large Data Volumes to the GroundWrestling Large Data Volumes to the Ground
Wrestling Large Data Volumes to the GroundDaniel Austin
 

Plus de Daniel Austin (16)

Designing Delay-tolerant Data Services for the Network of Things
Designing Delay-tolerant Data Services for the Network of ThingsDesigning Delay-tolerant Data Services for the Network of Things
Designing Delay-tolerant Data Services for the Network of Things
 
Web Performance Bootcamp 2014
Web Performance Bootcamp 2014Web Performance Bootcamp 2014
Web Performance Bootcamp 2014
 
HTML5, HTTP2, and You 1.1
HTML5, HTTP2, and You 1.1HTML5, HTTP2, and You 1.1
HTML5, HTTP2, and You 1.1
 
Managing Performance Globally with MySQL
Managing Performance Globally with MySQLManaging Performance Globally with MySQL
Managing Performance Globally with MySQL
 
Perspectives on the Evolution of HTML
Perspectives on the Evolution of HTMLPerspectives on the Evolution of HTML
Perspectives on the Evolution of HTML
 
The Fastest Possible Search Algorithm: Grover's Search and the World of Quant...
The Fastest Possible Search Algorithm: Grover's Search and the World of Quant...The Fastest Possible Search Algorithm: Grover's Search and the World of Quant...
The Fastest Possible Search Algorithm: Grover's Search and the World of Quant...
 
Quantum Computing in a Nutshell: Grover's Search and the World of Quantum Com...
Quantum Computing in a Nutshell: Grover's Search and the World of Quantum Com...Quantum Computing in a Nutshell: Grover's Search and the World of Quantum Com...
Quantum Computing in a Nutshell: Grover's Search and the World of Quantum Com...
 
Reconceiving the Web as a Distributed (NoSQL) Data System
Reconceiving the Web as a Distributed (NoSQL) Data SystemReconceiving the Web as a Distributed (NoSQL) Data System
Reconceiving the Web as a Distributed (NoSQL) Data System
 
Big data and the Future of Money (World Big Data Congress 2013)
Big data and the Future of Money (World Big Data Congress 2013)Big data and the Future of Money (World Big Data Congress 2013)
Big data and the Future of Money (World Big Data Congress 2013)
 
Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)
Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)
Big Data is a Big Scam Most of the Time! (MySQL Connect Keynote 2012)
 
Performance analysisclass
Performance analysisclassPerformance analysisclass
Performance analysisclass
 
Yes sql08 inmemorydb
Yes sql08 inmemorydbYes sql08 inmemorydb
Yes sql08 inmemorydb
 
The Fastest Possible Search Algorithm
The Fastest Possible Search AlgorithmThe Fastest Possible Search Algorithm
The Fastest Possible Search Algorithm
 
A Global In-memory Data System for MySQL
A Global In-memory Data System for MySQLA Global In-memory Data System for MySQL
A Global In-memory Data System for MySQL
 
Notes on a High-Performance JSON Protocol
Notes on a High-Performance JSON ProtocolNotes on a High-Performance JSON Protocol
Notes on a High-Performance JSON Protocol
 
Wrestling Large Data Volumes to the Ground
Wrestling Large Data Volumes to the GroundWrestling Large Data Volumes to the Ground
Wrestling Large Data Volumes to the Ground
 

Dernier

Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝soniya singh
 
GDG Cloud Southlake 32: Kyle Hettinger: Demystifying the Dark Web
GDG Cloud Southlake 32: Kyle Hettinger: Demystifying the Dark WebGDG Cloud Southlake 32: Kyle Hettinger: Demystifying the Dark Web
GDG Cloud Southlake 32: Kyle Hettinger: Demystifying the Dark WebJames Anderson
 
Russian Call girls in Dubai +971563133746 Dubai Call girls
Russian  Call girls in Dubai +971563133746 Dubai  Call girlsRussian  Call girls in Dubai +971563133746 Dubai  Call girls
Russian Call girls in Dubai +971563133746 Dubai Call girlsstephieert
 
Low Rate Call Girls Kolkata Avani 🤌 8250192130 🚀 Vip Call Girls Kolkata
Low Rate Call Girls Kolkata Avani 🤌  8250192130 🚀 Vip Call Girls KolkataLow Rate Call Girls Kolkata Avani 🤌  8250192130 🚀 Vip Call Girls Kolkata
Low Rate Call Girls Kolkata Avani 🤌 8250192130 🚀 Vip Call Girls Kolkataanamikaraghav4
 
Call Now ☎ 8264348440 !! Call Girls in Shahpur Jat Escort Service Delhi N.C.R.
Call Now ☎ 8264348440 !! Call Girls in Shahpur Jat Escort Service Delhi N.C.R.Call Now ☎ 8264348440 !! Call Girls in Shahpur Jat Escort Service Delhi N.C.R.
Call Now ☎ 8264348440 !! Call Girls in Shahpur Jat Escort Service Delhi N.C.R.soniya singh
 
VIP 7001035870 Find & Meet Hyderabad Call Girls LB Nagar high-profile Call Girl
VIP 7001035870 Find & Meet Hyderabad Call Girls LB Nagar high-profile Call GirlVIP 7001035870 Find & Meet Hyderabad Call Girls LB Nagar high-profile Call Girl
VIP 7001035870 Find & Meet Hyderabad Call Girls LB Nagar high-profile Call Girladitipandeya
 
Hot Call Girls |Delhi |Hauz Khas ☎ 9711199171 Book Your One night Stand
Hot Call Girls |Delhi |Hauz Khas ☎ 9711199171 Book Your One night StandHot Call Girls |Delhi |Hauz Khas ☎ 9711199171 Book Your One night Stand
Hot Call Girls |Delhi |Hauz Khas ☎ 9711199171 Book Your One night Standkumarajju5765
 
Call Girls Service Chandigarh Lucky ❤️ 7710465962 Independent Call Girls In C...
Call Girls Service Chandigarh Lucky ❤️ 7710465962 Independent Call Girls In C...Call Girls Service Chandigarh Lucky ❤️ 7710465962 Independent Call Girls In C...
Call Girls Service Chandigarh Lucky ❤️ 7710465962 Independent Call Girls In C...Sheetaleventcompany
 
VIP Call Girls Kolkata Ananya 🤌 8250192130 🚀 Vip Call Girls Kolkata
VIP Call Girls Kolkata Ananya 🤌  8250192130 🚀 Vip Call Girls KolkataVIP Call Girls Kolkata Ananya 🤌  8250192130 🚀 Vip Call Girls Kolkata
VIP Call Girls Kolkata Ananya 🤌 8250192130 🚀 Vip Call Girls Kolkataanamikaraghav4
 
Russian Call Girls in Kolkata Samaira 🤌 8250192130 🚀 Vip Call Girls Kolkata
Russian Call Girls in Kolkata Samaira 🤌  8250192130 🚀 Vip Call Girls KolkataRussian Call Girls in Kolkata Samaira 🤌  8250192130 🚀 Vip Call Girls Kolkata
Russian Call Girls in Kolkata Samaira 🤌 8250192130 🚀 Vip Call Girls Kolkataanamikaraghav4
 
DDoS In Oceania and the Pacific, presented by Dave Phelan at NZNOG 2024
DDoS In Oceania and the Pacific, presented by Dave Phelan at NZNOG 2024DDoS In Oceania and the Pacific, presented by Dave Phelan at NZNOG 2024
DDoS In Oceania and the Pacific, presented by Dave Phelan at NZNOG 2024APNIC
 
₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...
₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...
₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...Diya Sharma
 
Moving Beyond Twitter/X and Facebook - Social Media for local news providers
Moving Beyond Twitter/X and Facebook - Social Media for local news providersMoving Beyond Twitter/X and Facebook - Social Media for local news providers
Moving Beyond Twitter/X and Facebook - Social Media for local news providersDamian Radcliffe
 
Call Girls In Pratap Nagar Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Pratap Nagar Delhi 💯Call Us 🔝8264348440🔝Call Girls In Pratap Nagar Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Pratap Nagar Delhi 💯Call Us 🔝8264348440🔝soniya singh
 
Best VIP Call Girls Noida Sector 75 Call Me: 8448380779
Best VIP Call Girls Noida Sector 75 Call Me: 8448380779Best VIP Call Girls Noida Sector 75 Call Me: 8448380779
Best VIP Call Girls Noida Sector 75 Call Me: 8448380779Delhi Call girls
 
Russian Call Girls in Kolkata Ishita 🤌 8250192130 🚀 Vip Call Girls Kolkata
Russian Call Girls in Kolkata Ishita 🤌  8250192130 🚀 Vip Call Girls KolkataRussian Call Girls in Kolkata Ishita 🤌  8250192130 🚀 Vip Call Girls Kolkata
Russian Call Girls in Kolkata Ishita 🤌 8250192130 🚀 Vip Call Girls Kolkataanamikaraghav4
 

Dernier (20)

Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Saket Delhi 💯Call Us 🔝8264348440🔝
 
GDG Cloud Southlake 32: Kyle Hettinger: Demystifying the Dark Web
GDG Cloud Southlake 32: Kyle Hettinger: Demystifying the Dark WebGDG Cloud Southlake 32: Kyle Hettinger: Demystifying the Dark Web
GDG Cloud Southlake 32: Kyle Hettinger: Demystifying the Dark Web
 
Russian Call girls in Dubai +971563133746 Dubai Call girls
Russian  Call girls in Dubai +971563133746 Dubai  Call girlsRussian  Call girls in Dubai +971563133746 Dubai  Call girls
Russian Call girls in Dubai +971563133746 Dubai Call girls
 
Low Rate Call Girls Kolkata Avani 🤌 8250192130 🚀 Vip Call Girls Kolkata
Low Rate Call Girls Kolkata Avani 🤌  8250192130 🚀 Vip Call Girls KolkataLow Rate Call Girls Kolkata Avani 🤌  8250192130 🚀 Vip Call Girls Kolkata
Low Rate Call Girls Kolkata Avani 🤌 8250192130 🚀 Vip Call Girls Kolkata
 
Call Now ☎ 8264348440 !! Call Girls in Shahpur Jat Escort Service Delhi N.C.R.
Call Now ☎ 8264348440 !! Call Girls in Shahpur Jat Escort Service Delhi N.C.R.Call Now ☎ 8264348440 !! Call Girls in Shahpur Jat Escort Service Delhi N.C.R.
Call Now ☎ 8264348440 !! Call Girls in Shahpur Jat Escort Service Delhi N.C.R.
 
VIP 7001035870 Find & Meet Hyderabad Call Girls LB Nagar high-profile Call Girl
VIP 7001035870 Find & Meet Hyderabad Call Girls LB Nagar high-profile Call GirlVIP 7001035870 Find & Meet Hyderabad Call Girls LB Nagar high-profile Call Girl
VIP 7001035870 Find & Meet Hyderabad Call Girls LB Nagar high-profile Call Girl
 
Hot Call Girls |Delhi |Hauz Khas ☎ 9711199171 Book Your One night Stand
Hot Call Girls |Delhi |Hauz Khas ☎ 9711199171 Book Your One night StandHot Call Girls |Delhi |Hauz Khas ☎ 9711199171 Book Your One night Stand
Hot Call Girls |Delhi |Hauz Khas ☎ 9711199171 Book Your One night Stand
 
Call Girls Service Chandigarh Lucky ❤️ 7710465962 Independent Call Girls In C...
Call Girls Service Chandigarh Lucky ❤️ 7710465962 Independent Call Girls In C...Call Girls Service Chandigarh Lucky ❤️ 7710465962 Independent Call Girls In C...
Call Girls Service Chandigarh Lucky ❤️ 7710465962 Independent Call Girls In C...
 
Dwarka Sector 26 Call Girls | Delhi | 9999965857 🫦 Vanshika Verma More Our Se...
Dwarka Sector 26 Call Girls | Delhi | 9999965857 🫦 Vanshika Verma More Our Se...Dwarka Sector 26 Call Girls | Delhi | 9999965857 🫦 Vanshika Verma More Our Se...
Dwarka Sector 26 Call Girls | Delhi | 9999965857 🫦 Vanshika Verma More Our Se...
 
VIP Call Girls Kolkata Ananya 🤌 8250192130 🚀 Vip Call Girls Kolkata
VIP Call Girls Kolkata Ananya 🤌  8250192130 🚀 Vip Call Girls KolkataVIP Call Girls Kolkata Ananya 🤌  8250192130 🚀 Vip Call Girls Kolkata
VIP Call Girls Kolkata Ananya 🤌 8250192130 🚀 Vip Call Girls Kolkata
 
Russian Call Girls in Kolkata Samaira 🤌 8250192130 🚀 Vip Call Girls Kolkata
Russian Call Girls in Kolkata Samaira 🤌  8250192130 🚀 Vip Call Girls KolkataRussian Call Girls in Kolkata Samaira 🤌  8250192130 🚀 Vip Call Girls Kolkata
Russian Call Girls in Kolkata Samaira 🤌 8250192130 🚀 Vip Call Girls Kolkata
 
DDoS In Oceania and the Pacific, presented by Dave Phelan at NZNOG 2024
DDoS In Oceania and the Pacific, presented by Dave Phelan at NZNOG 2024DDoS In Oceania and the Pacific, presented by Dave Phelan at NZNOG 2024
DDoS In Oceania and the Pacific, presented by Dave Phelan at NZNOG 2024
 
₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...
₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...
₹5.5k {Cash Payment}New Friends Colony Call Girls In [Delhi NIHARIKA] 🔝|97111...
 
Moving Beyond Twitter/X and Facebook - Social Media for local news providers
Moving Beyond Twitter/X and Facebook - Social Media for local news providersMoving Beyond Twitter/X and Facebook - Social Media for local news providers
Moving Beyond Twitter/X and Facebook - Social Media for local news providers
 
Call Girls In South Ex 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SERVICE
Call Girls In South Ex 📱  9999965857  🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SERVICECall Girls In South Ex 📱  9999965857  🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SERVICE
Call Girls In South Ex 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SERVICE
 
Rohini Sector 6 Call Girls Delhi 9999965857 @Sabina Saikh No Advance
Rohini Sector 6 Call Girls Delhi 9999965857 @Sabina Saikh No AdvanceRohini Sector 6 Call Girls Delhi 9999965857 @Sabina Saikh No Advance
Rohini Sector 6 Call Girls Delhi 9999965857 @Sabina Saikh No Advance
 
Call Girls In Pratap Nagar Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Pratap Nagar Delhi 💯Call Us 🔝8264348440🔝Call Girls In Pratap Nagar Delhi 💯Call Us 🔝8264348440🔝
Call Girls In Pratap Nagar Delhi 💯Call Us 🔝8264348440🔝
 
Best VIP Call Girls Noida Sector 75 Call Me: 8448380779
Best VIP Call Girls Noida Sector 75 Call Me: 8448380779Best VIP Call Girls Noida Sector 75 Call Me: 8448380779
Best VIP Call Girls Noida Sector 75 Call Me: 8448380779
 
Rohini Sector 26 Call Girls Delhi 9999965857 @Sabina Saikh No Advance
Rohini Sector 26 Call Girls Delhi 9999965857 @Sabina Saikh No AdvanceRohini Sector 26 Call Girls Delhi 9999965857 @Sabina Saikh No Advance
Rohini Sector 26 Call Girls Delhi 9999965857 @Sabina Saikh No Advance
 
Russian Call Girls in Kolkata Ishita 🤌 8250192130 🚀 Vip Call Girls Kolkata
Russian Call Girls in Kolkata Ishita 🤌  8250192130 🚀 Vip Call Girls KolkataRussian Call Girls in Kolkata Ishita 🤌  8250192130 🚀 Vip Call Girls Kolkata
Russian Call Girls in Kolkata Ishita 🤌 8250192130 🚀 Vip Call Girls Kolkata
 

BIG DATA AND IOT WILL MERGE

  • 1. BIG DATA COMES IN SMALL PACKAGES How the Internet of Things Will Change Big Data’s Future Daniel Austin GRIN Technologies, Inc. The Connected Life Company daniel.austin@grintech.net NoSQL Now! August 21st, 2014 V1.1
  • 2. ABOUT GRIN TECHNOLOGIES, INC. • Founded July 4th 2014 • “The Connected Life Company” • Developing Systemsware at the Intersection of Big Data and the Internet of Things • Smart People Working Hard to Solve Real Problems • Coming in Q3 2015: The Connected Life Server ™ • A Platform for Connecting People, Places, and Things Soft launching today at NoSQL Now!
  • 3. FOUR BIG IDEAS FOR TODAY’S TALK 1. No “Internet of Things”, only disjoint Networks of Things 2. The IoT is an “iceberg” Big Data problem 3. Things are dumb, systems are smart 4. The “Witnesses” principle
  • 4. WHY THERE WILL BE NO “INTERNET OF THINGS” • No clients; no servers • No network that connects them all • No protocols that make sense • Intermittent, Transient, Low Value, Connectionless Many of Our Current Assumptions About the Internet Simply Don’t Apply!
  • 5. INSTEAD, DISJOINT NETWORKS OF THINGS • Disjoint – for Security and Privacy • Functional and Context-Specific • Mesh-based Peering Architectures Peer 1 Peer 2 Peer3 Peer 4 Peer 1 Peer 2 Peer3 Peer 4 Public Internet Gateway Gateway
  • 6. LAYER 8 HYPOTHESIS • You are a Node on the Internet! • The Internet Connects People, Not Computers • Humans are Machines that Turn Data into Information
  • 7. THE CONVERGENCE OF THE IOT AND BIG DATA It’s not an accident that these technologies are coming together at the same time; the IoT wasn’t possible before we had solutions to Big Data problems. Things Big Data Big Metadata
  • 8. METADATA EXPLOSION • “Big Metadata” is a bigger problem than Big Data • Austin’s Law: “The Amount of Data to be Crunched Will Always Exceed the Computing Power Available.” • What are these companies’ data retention policies?
  • 9. ARE YOU A BIG DATA PROBLEM? • Each person will generate roughly 25 petabytes of data over the course of a lifetime • Users have little control over collection and storage • Email, documents, receipts, bills (!), your car, music, books… • Pervasive computing multiplies the problem • Majority of data valueless out of context • Security & privacy risks may outweigh the benefits ?!
  • 10. LET’S TALK LIGHT BULBS • Invented in 1879 by Edison and Swan • Many others before had failed • One of humanity’s most important inventions • More than 400 distinct types are manufactured • Streets, Airplanes, Neon (Still 82% Incandescent!) • The Eiffel Tower uses 20,376 light bulbs • Many Lighting Systems Are Extremely Complex! • Not a simple on/off state machine • Critical for many life-and-death situations • Unsustainable and unmanageable at scale • Arrogant, disposable “dumb” design • 2013: First light bulb on the Internet
  • 11. IMAGINING THE IOLB What If… Every light bulb was connected to the IoT? What Would the Architecture Look Like? Could We Manage the Data Usefully? Could We Build it?
  • 12. LIGHT BULBS ARE DUMB; SYSTEMS ARE SMART • We can’t design the IoLB by only changing the light bulbs; it’s a system • It’s necessary for the system to evolve, not just the bulbs • Bulbs will change to meet new conditions, become smarter • Sockets, power lines, power generators and coal mines • Every part of the system will evolve at a different rate • While building the IoT, we will need to consider how to build smart systems that help ordinary users, requiring compromise (and patience)
  • 13. SYSTEMS THINKING AND LIGHT BULB ARCHITECTURE
  • 14. WHICH COMES FIRST? THE SOCKET OR THE BULB? • Problem: Do we want smart light bulbs or smart sockets? • Light bulbs are easy to change, sockets are not • But in an ideal world, most of the architectural ‘smarts’ of the IoLB would be in the socket • This is a classic architectural trade-off • It’s too expensive to upgrade every part of the system at the same time! • Our light bulbs will be smarter than their sockets • For some time; this will have wider implications • For the IoLB (and IoT)
  • 15. THE IOLB AND BIG DATA 12x10^9 light bulbs x (365 state changes/day) x 2 x 22 bytes = Big Data A more realistic estimate would be 3 orders of magnitude larger! Plus the history, maintenance, etc.
  • 16. SECURITY AND PRIVACY ON THE IOT • Security Is Protection from Harm • Privacy is Filtering Data Based on Context • The Separation of the Self from the Group • Persona v. Identity
  • 17. THE “WITNESSES” PRINCIPLE • Cellphones are “things”, so are security cameras… • “When There’s a Witness to Every Act…”
  • 18. By 2020 everyone, everything and everywhere will be connected in real time. More than 50 billion connected devices will be used in the Networked Society. Source: http://www.ericsson.com/thinkingahead/networked_society
  • 19. IN A WORLD OF TEN BILLION PEOPLE AND THEIR THINGS… • Everyone will be connected – to each other • Privacy will disappear • Security (and civility) will increase • Witnesses are a good thing ™
  • 20. A SPECIES AND ITS DATA: THE LONG VIEW • We can’t build to scale exponentially. Period. • We are all part of the network • The purpose of evolution is computation Will humanity merge with it’s data? The Age of Big Metadata The Age of Big Data
  • 21. THANKS! “When everyone’s life is connected, that’s when the Singularity will happen.” Daniel Austin GRIN Technologies, Inc. The Connected Life Company daniel.austin@grintech.net http://www.grintech.net @daniel_b_Austin @GRINTechInc

Notes de l'éditeur

  1. Kurt Vonnegut: No Cat, No Cradle – of course we call it a cat’s cradle!
  2. Health and school records