SlideShare une entreprise Scribd logo
1  sur  12
Télécharger pour lire hors ligne
GIS On The Web: Location, location, location
NOAA Environmental Visualization Lab
Tim.loomis@noaa.gov
Security, Data Management, Tech
An Idiot Foretells the Future
• Energy-neutral computing
• Place-as-Node: every construct passing
data
• Graphene economy
• GIS – Follow the Trail
Prognostication!
www.nnvl.noaa.gov
• NOAA vs. NASA
• Origins
• Data Flow
1999 – And so it begins…
A day in my life….
• Coffee
• Check on data flow: http://www.nnvl.noaa.gov/Dashboard/Panel.html
• Tomcat, apache, Geoserver administration
• Check for events, monitor satellites
• Ongoing edits to databases, PHP, javascript, REST, IDL, McIDAS scripting
• Answer questions to Vizlab webmaster
• Answer questions, provide products to media, NOAA comms, DOC comms
• Plan upgrades to systems; code migration
• Projection systems consults: museums, Science on a Sphere, 4K
• Documentation, Adobe Ae Ps Ai, Maya
the Assumptions
I need information about the place I’m in, fast and comprehensive
GIS location data is permanent, information only has a certain lifespan
I don’t want to wait!
2 way street: You will come up with more interesting uses for GIS data
Technology stack for NOAA View
• Linux
• Apache Tomcat
• PostgreSQL – PostGIS
• Oracle JRE, JAI, ICE policy
• Geoserver
• OpenLayers, JQueryUI, Jcrop, css, etc.
Internet of Things
• ID each thing to geospatial
• What’s the limit to data gathering?
• Informed consent
• Aggregate data collection useless if people opt out of IoT participation
• What does ownership mean? Computing products blurring the line
• Does the thing we own report on us or itself?
• Evolution to rental model for stuff; separate the human from the data collection?
• Gov’t vs. commerce vs. law enforcement vs. media vs. finance vs. P2P
Security
• Source origination – super-important to follow the citation ( what does
that mean in context of geospatial data?)
• Efficiency of Identity
• Opt out, opt in… - user takes control; no way opt out will be default
• Securing the router
– Security by proximity
– Broad distribution
– Each router constantly checking fidelity. Hash-passing nightmare or opportunity for
geospatial root servers?
• Web Mapping Service – tiled images
– Copy compressed binary file to the end of an image
– 10K image tiles; 10K variations of hacker tools?
Geospatial routers
• Commercial: Solace
• Open source: OGC OpenLS, pgRouting
• Layering over IP network, process coordinates instead of IP addresses
• Build your own! Make some money!
• Oh yeah…Filtering…
Big Data
• Geospatial is the biggest of the big
• Sensed data – do we build a model of the earth?
– Darth Vader’s Death Star just a big hard drive
• Personal location data – every day, volume larger than social-generated data
• We need to analyze shape relationships on a massive scale
• The best big data platform for analyzing geospatial, sensor and location data IS:
– Doesn’t exist; Hadoop? Spark? PostgreSQL? Don’t incorporate spatiotemporal analytics (large scale)
– Built for the virtual world; assign unique numbers to web transactions, words, etc., and analyze for
relationships.
Big Data
• Database engine – needs to continuously index and store high-velocity sensor data
at speed while being queried in real time
• Geometry engine – (to compute mathematical relationships between shapes)
– Correctness, precision, performance suitable for large-scale analytics, not just making maps
– Time becomes a huge factor
– SpaceCurve rolled their own. No open source platform; database, disk, math not trivial
Attend the Meetup on Geospatial
Rectification of Web Transactions and
Data Security | February 10
OR

Contenu connexe

En vedette

Data visualization - Graphics & arts
Data visualization - Graphics & artsData visualization - Graphics & arts
Data visualization - Graphics & arts
Dogstudio
 

En vedette (20)

Data visualization short v1.1
Data visualization short v1.1Data visualization short v1.1
Data visualization short v1.1
 
Quote for Life
Quote for LifeQuote for Life
Quote for Life
 
Data visualization - Graphics & arts
Data visualization - Graphics & artsData visualization - Graphics & arts
Data visualization - Graphics & arts
 
Security Visualization - Let's Take A Step Back
Security Visualization - Let's Take A Step BackSecurity Visualization - Let's Take A Step Back
Security Visualization - Let's Take A Step Back
 
IBM's four key steps to security and privacy for big data
IBM's four key steps to security and privacy for big dataIBM's four key steps to security and privacy for big data
IBM's four key steps to security and privacy for big data
 
Security Management | System Administration
Security Management | System AdministrationSecurity Management | System Administration
Security Management | System Administration
 
( Big ) Data Management - Collect - Global concepts in 5 slides
( Big ) Data Management - Collect - Global concepts in 5 slides( Big ) Data Management - Collect - Global concepts in 5 slides
( Big ) Data Management - Collect - Global concepts in 5 slides
 
Big Data Security Intelligence and Analytics for Advanced Threat Protection
Big Data Security Intelligence and Analytics for Advanced Threat ProtectionBig Data Security Intelligence and Analytics for Advanced Threat Protection
Big Data Security Intelligence and Analytics for Advanced Threat Protection
 
Cyber Security Visualization
Cyber Security VisualizationCyber Security Visualization
Cyber Security Visualization
 
Security Intelligence: Finding and Stopping Attackers with Big Data Analytics
Security Intelligence: Finding and Stopping Attackers with Big Data AnalyticsSecurity Intelligence: Finding and Stopping Attackers with Big Data Analytics
Security Intelligence: Finding and Stopping Attackers with Big Data Analytics
 
Knowledge management for professionals
Knowledge management for professionalsKnowledge management for professionals
Knowledge management for professionals
 
Why is Security Management So Hard?
Why is Security Management So Hard?Why is Security Management So Hard?
Why is Security Management So Hard?
 
Livre Blanc SAS - EBG 30 cas concrets de Datavisualisation / Dataviz
Livre Blanc SAS - EBG 30 cas concrets de Datavisualisation / DatavizLivre Blanc SAS - EBG 30 cas concrets de Datavisualisation / Dataviz
Livre Blanc SAS - EBG 30 cas concrets de Datavisualisation / Dataviz
 
A brief history of "big data"
A brief history of "big data"A brief history of "big data"
A brief history of "big data"
 
Workshop: Big Data Visualization for Security
Workshop: Big Data Visualization for SecurityWorkshop: Big Data Visualization for Security
Workshop: Big Data Visualization for Security
 
Trivadis TechEvent 2016 Big Data Privacy and Security Fundamentals by Florian...
Trivadis TechEvent 2016 Big Data Privacy and Security Fundamentals by Florian...Trivadis TechEvent 2016 Big Data Privacy and Security Fundamentals by Florian...
Trivadis TechEvent 2016 Big Data Privacy and Security Fundamentals by Florian...
 
Predictive analysis can help you combat Employee Attrition ! Learn how?
Predictive analysis can help you combat Employee Attrition ! Learn how?Predictive analysis can help you combat Employee Attrition ! Learn how?
Predictive analysis can help you combat Employee Attrition ! Learn how?
 
Big Data, Security Intelligence, (And Why I Hate This Title)
Big Data, Security Intelligence, (And Why I Hate This Title) Big Data, Security Intelligence, (And Why I Hate This Title)
Big Data, Security Intelligence, (And Why I Hate This Title)
 
A Short History of Big Data
A Short History of Big DataA Short History of Big Data
A Short History of Big Data
 
Big Data and Security - Where are we now? (2015)
Big Data and Security - Where are we now? (2015)Big Data and Security - Where are we now? (2015)
Big Data and Security - Where are we now? (2015)
 

Similaire à Geospatial Rectification of Web Transactions and Data Security

Big Data Analytics Strategy and Roadmap
Big Data Analytics Strategy and RoadmapBig Data Analytics Strategy and Roadmap
Big Data Analytics Strategy and Roadmap
Srinath Perera
 
TrueReusableCode-BigDataCodeCamp2016
TrueReusableCode-BigDataCodeCamp2016TrueReusableCode-BigDataCodeCamp2016
TrueReusableCode-BigDataCodeCamp2016
Eduard Lazar
 
Accumulo Nutch/GORA, Storm, and Pig
Accumulo Nutch/GORA, Storm, and PigAccumulo Nutch/GORA, Storm, and Pig
Accumulo Nutch/GORA, Storm, and Pig
Jason Trost
 
The Benefits of Publicly-Accessible Data - SNODAS
The Benefits of Publicly-Accessible Data - SNODASThe Benefits of Publicly-Accessible Data - SNODAS
The Benefits of Publicly-Accessible Data - SNODAS
Thomas Horner
 

Similaire à Geospatial Rectification of Web Transactions and Data Security (20)

InfiniteGraph Presentation from Oct 21, 2010 DBTA Webcast
InfiniteGraph Presentation from Oct 21, 2010 DBTA WebcastInfiniteGraph Presentation from Oct 21, 2010 DBTA Webcast
InfiniteGraph Presentation from Oct 21, 2010 DBTA Webcast
 
Bertenthal
BertenthalBertenthal
Bertenthal
 
Bring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science WorkflowsBring Satellite and Drone Imagery into your Data Science Workflows
Bring Satellite and Drone Imagery into your Data Science Workflows
 
Big Data Analysis : Deciphering the haystack
Big Data Analysis : Deciphering the haystack Big Data Analysis : Deciphering the haystack
Big Data Analysis : Deciphering the haystack
 
Big Data Analytics Strategy and Roadmap
Big Data Analytics Strategy and RoadmapBig Data Analytics Strategy and Roadmap
Big Data Analytics Strategy and Roadmap
 
Data Science At Zillow
Data Science At ZillowData Science At Zillow
Data Science At Zillow
 
Big Data & Hadoop Introduction
Big Data & Hadoop IntroductionBig Data & Hadoop Introduction
Big Data & Hadoop Introduction
 
Big Data : Bits of History, Words of Advice
Big Data : Bits of History, Words of AdviceBig Data : Bits of History, Words of Advice
Big Data : Bits of History, Words of Advice
 
Liferay & Big Data Dev Con 2014
Liferay & Big Data Dev Con 2014Liferay & Big Data Dev Con 2014
Liferay & Big Data Dev Con 2014
 
Rack Cluster Deployment for SDSC Supercomputer
Rack Cluster Deployment for SDSC SupercomputerRack Cluster Deployment for SDSC Supercomputer
Rack Cluster Deployment for SDSC Supercomputer
 
Budapest Big Data Meetup Real-time stream processing
Budapest Big Data Meetup Real-time stream processingBudapest Big Data Meetup Real-time stream processing
Budapest Big Data Meetup Real-time stream processing
 
Tugdual Grall - Real World Use Cases: Hadoop and NoSQL in Production
Tugdual Grall - Real World Use Cases: Hadoop and NoSQL in ProductionTugdual Grall - Real World Use Cases: Hadoop and NoSQL in Production
Tugdual Grall - Real World Use Cases: Hadoop and NoSQL in Production
 
Hadoop/MapReduce/HDFS
Hadoop/MapReduce/HDFSHadoop/MapReduce/HDFS
Hadoop/MapReduce/HDFS
 
WebServices_Grid.ppt
WebServices_Grid.pptWebServices_Grid.ppt
WebServices_Grid.ppt
 
Chirp 2010: Scaling Twitter
Chirp 2010: Scaling TwitterChirp 2010: Scaling Twitter
Chirp 2010: Scaling Twitter
 
Introduction to Big Data
Introduction to Big Data Introduction to Big Data
Introduction to Big Data
 
TrueReusableCode-BigDataCodeCamp2016
TrueReusableCode-BigDataCodeCamp2016TrueReusableCode-BigDataCodeCamp2016
TrueReusableCode-BigDataCodeCamp2016
 
Accumulo Nutch/GORA, Storm, and Pig
Accumulo Nutch/GORA, Storm, and PigAccumulo Nutch/GORA, Storm, and Pig
Accumulo Nutch/GORA, Storm, and Pig
 
The Benefits of Publicly-Accessible Data - SNODAS
The Benefits of Publicly-Accessible Data - SNODASThe Benefits of Publicly-Accessible Data - SNODAS
The Benefits of Publicly-Accessible Data - SNODAS
 
BW Tech Meetup: Hadoop and The rise of Big Data
BW Tech Meetup: Hadoop and The rise of Big Data BW Tech Meetup: Hadoop and The rise of Big Data
BW Tech Meetup: Hadoop and The rise of Big Data
 

Dernier

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Dernier (20)

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 

Geospatial Rectification of Web Transactions and Data Security

  • 1. GIS On The Web: Location, location, location NOAA Environmental Visualization Lab Tim.loomis@noaa.gov Security, Data Management, Tech
  • 2. An Idiot Foretells the Future • Energy-neutral computing • Place-as-Node: every construct passing data • Graphene economy • GIS – Follow the Trail Prognostication!
  • 3. www.nnvl.noaa.gov • NOAA vs. NASA • Origins • Data Flow 1999 – And so it begins…
  • 4. A day in my life…. • Coffee • Check on data flow: http://www.nnvl.noaa.gov/Dashboard/Panel.html • Tomcat, apache, Geoserver administration • Check for events, monitor satellites • Ongoing edits to databases, PHP, javascript, REST, IDL, McIDAS scripting • Answer questions to Vizlab webmaster • Answer questions, provide products to media, NOAA comms, DOC comms • Plan upgrades to systems; code migration • Projection systems consults: museums, Science on a Sphere, 4K • Documentation, Adobe Ae Ps Ai, Maya
  • 5. the Assumptions I need information about the place I’m in, fast and comprehensive GIS location data is permanent, information only has a certain lifespan I don’t want to wait! 2 way street: You will come up with more interesting uses for GIS data
  • 6. Technology stack for NOAA View • Linux • Apache Tomcat • PostgreSQL – PostGIS • Oracle JRE, JAI, ICE policy • Geoserver • OpenLayers, JQueryUI, Jcrop, css, etc.
  • 7. Internet of Things • ID each thing to geospatial • What’s the limit to data gathering? • Informed consent • Aggregate data collection useless if people opt out of IoT participation • What does ownership mean? Computing products blurring the line • Does the thing we own report on us or itself? • Evolution to rental model for stuff; separate the human from the data collection? • Gov’t vs. commerce vs. law enforcement vs. media vs. finance vs. P2P
  • 8. Security • Source origination – super-important to follow the citation ( what does that mean in context of geospatial data?) • Efficiency of Identity • Opt out, opt in… - user takes control; no way opt out will be default • Securing the router – Security by proximity – Broad distribution – Each router constantly checking fidelity. Hash-passing nightmare or opportunity for geospatial root servers? • Web Mapping Service – tiled images – Copy compressed binary file to the end of an image – 10K image tiles; 10K variations of hacker tools?
  • 9. Geospatial routers • Commercial: Solace • Open source: OGC OpenLS, pgRouting • Layering over IP network, process coordinates instead of IP addresses • Build your own! Make some money! • Oh yeah…Filtering…
  • 10. Big Data • Geospatial is the biggest of the big • Sensed data – do we build a model of the earth? – Darth Vader’s Death Star just a big hard drive • Personal location data – every day, volume larger than social-generated data • We need to analyze shape relationships on a massive scale • The best big data platform for analyzing geospatial, sensor and location data IS: – Doesn’t exist; Hadoop? Spark? PostgreSQL? Don’t incorporate spatiotemporal analytics (large scale) – Built for the virtual world; assign unique numbers to web transactions, words, etc., and analyze for relationships.
  • 11. Big Data • Database engine – needs to continuously index and store high-velocity sensor data at speed while being queried in real time • Geometry engine – (to compute mathematical relationships between shapes) – Correctness, precision, performance suitable for large-scale analytics, not just making maps – Time becomes a huge factor – SpaceCurve rolled their own. No open source platform; database, disk, math not trivial
  • 12. Attend the Meetup on Geospatial Rectification of Web Transactions and Data Security | February 10 OR