SlideShare a Scribd company logo
1 of 18
Air Quality Cluster Technology Track   Earth Science Information Partners Data Flow & Interoperability in DataFed  Service-based AQ Analysis System R. B. Husar, S. R. Falke and K. Höijärvi Washington University, St. Louis, MO ESIP Federation Winter Meeting 2006 Washington, DC, January 4, 2006 Partners ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
DataFed in a Nutshell DataFed Vision Aid air quality analysis by effective use of relevant data   DataFed Goals Facilitate access and flow of AQ data from provider to users  Support user-driven data processing value chains Participate in specific application projects    Approach: Mediation Between Users and Data Providers DataFed assumes spontaneous, autonomous data providers Non-intrusively  wraps  datasets for access by web services Mediates, homogenizes data views. e.g. geo-spatial, time...   Applications Browsers and analysis tools for distributed monitoring data     Serve as data gateway for user programs; GIS, science tools DataFed is focused on the mediation of air quality data
Typical DataFed AQ Analysis Tools Consoles :  Data from diverse sources are displayed to create a rich context for exploration and analysis CATT :  Combined Aerosol Trajectory  Tool  for the browsing backtrajectories for specified chemical conditions  Viewer:   General purpose spatio-temporal data browser and view editor applicable for all DataFed datasets
Web Services:  Building Blocks of DataFed Programming   Access, Process, Render Data by Service Chaining [Station] [Monitor] Clickable monitor locations layer Map boundary layer
Single Data Model for All AQ Data ,[object Object],Multidimensional Data Cube
OGC Abstract Specification –  Coverage (00-106) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
OGC Web Coverage Service (WCS) Specification ,[object Object],[object Object],[object Object],[object Object],OGC WCS getCoverage Schema Suitable for wrapping with SOAP envelope, WSDL access, loose coupling WCS is for "coverages" – information representing space -time- varying phenomena  WCS describes, requests and delivers   coverages in spatio-temporal domain WCS version 1.1 is limited to grids/"simple” coverages with homogeneous range sets
 
Data Access through Adapters through DataFed  SOAP,HTTP Get OGC WCS   HTTP Get, Post OGC WMS   HTTP Get Station-Point  SQL Server, Files… Sequence   Image, file nDim Grid   OpenDAP   NetCDF, … Other  Traject., Event, Pic Sources  Diverse formats Many data models Data Wrapper   Data into geo-cubes Queries to views Virtual Data Cube  Global geo-cube data model Makes queries data-neutral Others?  e.g. OpenDAP   Output  Protocol dependent User specified  GeoTable  CSV,XLS,GML GeoGrid  GML,NetCDF.. GeoImage  GeoTIFF, PNG.. Other  MS Dataset.. Query Adapter   Maps query to protocol  User selects protocols
OGC WCS Demonstration:  AirNOW   Station Dataset Map View Services                   WCS Query   http://webapps.datafed.net/dvoy_services/ogc.wsfl?SERVICE=wcs&REQUEST=GetCoverage&VERSION=1.0.0&CRS=EPSG:4326&COVERAGE=AIRNOW.pmfine&FORMAT=CSV&BBOX=-125.3889,22.55111,-61.40667,51.20889,0,0&TIME=2005-06-26T15:00:00Z&WIDTH=999&HEIGHT=999&DEPTH=999 Formats: CSV, NetCDF-table, etc Time View Services     http://webapps.datafed.net/dvoy_services/ogc.wsfl?SERVICE=wcs&REQUEST=GetCoverage&VERSION=1.0.0&CRS=EPSG:4326&COVERAGE=AIRNOW.pmfine&FORMAT=CSV&BBOX=-90.16028,38.61222,-90.16028,38.61222,0,0&TIME=2005-06-20T00:00:00Z/2005-06-30T00:00:00Z&WIDTH=999&HEIGHT=999&DEPTH=999 Formats: CSV, NetCDF-table, etc
Data Access Services 1. Click Services Button 4. Set Output Format 3. Access Settings 2. Select Data Access Protocol 4. Execute WCS Query  in Browser or in Program 5. Consume data by program, service or viewer
GALEON Interoperability Experiment ,[object Object],[object Object],[object Object],[object Object],Unify Earth Science & GIS Data Flows B. Domenico B. Domenico GALEON UNIDATA
GALEON: Earth Science – GIS Interoperability Shared Data Model
OGC WCS Demonstration:  THREDDS_GFS  4Dim Dataset ,[object Object],[object Object],[object Object],[object Object],The form of the WCS query is the same for all slices through the data cube (views) The only difference in the views is the thickness of the slices in each dimension Return grid is in multiple formats (NetCDF, CSV, GML, PNG, … )  Map View Services                WCS Query   Time View Services    WCS Query   Elevation View Services  WCS Query
OGC WCS Demonstration:  Grid, Image, Station Data Types ,[object Object],[object Object],[object Object],[object Object],UNIDATA –  THREDDS/GALEON WCS DataFed GALEON WCS U Florence, It GALEON WCS DataFed GALEON WCS Grid Grid Image Station Services                WCS Query  Services               WCS Query  Services               WCS Query  Services               WCS Query
Benefits of WMS Compatibility: Geospatial One-Stop   Provides Access to DataFed spatial layers through WMS Problem: No Time Dim! http:// www.datafed.net/DataLinks/OGC/OGC.htm DataFed/VIEWS  Asian Dust Concentration (circles) S. Falke
Summary ,[object Object],Suitable for most data view queries BBOX, TIME Station-Point  SQL Server, Files… Sequence   Image, file nDim Grid   OpenDAP   NetCDF, … Applicable to most data types Station, Image, Grid ,[object Object],[object Object],[object Object],[object Object]
Table 17 — Parts of  SpatialDomain  data structure Zero or more  Include one for each point needed gml:Point Unordered list of points whose union covers spatial domain of this coverage offering c Point Zero or more (optional) Include one for each polygon needed gml:Polygon Unordered list of polygons whose union covers spatial domain of this coverage offering c Polygon Zero or more (optional) Include one for each different grid used (TBR) gml:Grid  OR gml:RectifiedGrid Unordered (TBR) list of grids that describe internal grid structure of this coverage offering b Grid One or more (mandatory) ows:BoundingBox Unordered list of bounding boxes whose union covers spatial domain of this coverage offering a Bounding‌Box Multiplicity and use Data type Definition Name

More Related Content

What's hot

2004-09-12 Data and Tools for Air Quality Management:
2004-09-12 Data and Tools for Air Quality Management:2004-09-12 Data and Tools for Air Quality Management:
2004-09-12 Data and Tools for Air Quality Management:
Rudolf Husar
 
2006-03-21 Work Group Meeting on IT Techniques, Tools and Philosophies for Mo...
2006-03-21 Work Group Meeting on IT Techniques, Tools and Philosophies for Mo...2006-03-21 Work Group Meeting on IT Techniques, Tools and Philosophies for Mo...
2006-03-21 Work Group Meeting on IT Techniques, Tools and Philosophies for Mo...
Rudolf Husar
 
Network Analysis in ArcGIS
Network Analysis in ArcGISNetwork Analysis in ArcGIS
Network Analysis in ArcGIS
John Reiser
 
2004-09-12 Data and Tools for Web-Based Monitoring and Analysis
2004-09-12 Data and Tools for Web-Based Monitoring and Analysis2004-09-12 Data and Tools for Web-Based Monitoring and Analysis
2004-09-12 Data and Tools for Web-Based Monitoring and Analysis
Rudolf Husar
 
AGU_Iguassu_Brazil_AUG
AGU_Iguassu_Brazil_AUGAGU_Iguassu_Brazil_AUG
AGU_Iguassu_Brazil_AUG
Jordan Alpert
 

What's hot (20)

Godiva2 Overview
Godiva2 OverviewGodiva2 Overview
Godiva2 Overview
 
Seeds Poster
Seeds PosterSeeds Poster
Seeds Poster
 
2004-09-12 Data and Tools for Air Quality Management:
2004-09-12 Data and Tools for Air Quality Management:2004-09-12 Data and Tools for Air Quality Management:
2004-09-12 Data and Tools for Air Quality Management:
 
2006-03-21 Work Group Meeting on IT Techniques, Tools and Philosophies for Mo...
2006-03-21 Work Group Meeting on IT Techniques, Tools and Philosophies for Mo...2006-03-21 Work Group Meeting on IT Techniques, Tools and Philosophies for Mo...
2006-03-21 Work Group Meeting on IT Techniques, Tools and Philosophies for Mo...
 
Network Analysis in ArcGIS
Network Analysis in ArcGISNetwork Analysis in ArcGIS
Network Analysis in ArcGIS
 
ESRI DevMeetup 201100607
ESRI DevMeetup 201100607ESRI DevMeetup 201100607
ESRI DevMeetup 201100607
 
3D Analyst - Watershed
3D Analyst - Watershed3D Analyst - Watershed
3D Analyst - Watershed
 
Improvement of Spatial Data Quality Using the Data Conflation
Improvement of Spatial Data Quality Using the Data ConflationImprovement of Spatial Data Quality Using the Data Conflation
Improvement of Spatial Data Quality Using the Data Conflation
 
Iccsa stankuteha180611
Iccsa stankuteha180611Iccsa stankuteha180611
Iccsa stankuteha180611
 
2004-09-12 Data and Tools for Web-Based Monitoring and Analysis
2004-09-12 Data and Tools for Web-Based Monitoring and Analysis2004-09-12 Data and Tools for Web-Based Monitoring and Analysis
2004-09-12 Data and Tools for Web-Based Monitoring and Analysis
 
Watershed Delineation Using ArcMap
Watershed Delineation Using ArcMapWatershed Delineation Using ArcMap
Watershed Delineation Using ArcMap
 
What to do with the existing spatial data in planning
What to do with the existing spatial data in planningWhat to do with the existing spatial data in planning
What to do with the existing spatial data in planning
 
Spatial data mining
Spatial data miningSpatial data mining
Spatial data mining
 
Contextualizing the Visualization of Climate Data
Contextualizing the Visualization of Climate DataContextualizing the Visualization of Climate Data
Contextualizing the Visualization of Climate Data
 
Linked Sensor Data cube
Linked Sensor Data cubeLinked Sensor Data cube
Linked Sensor Data cube
 
Using the Data Cube vocabulary for Publishing Environmental Linked Data on la...
Using the Data Cube vocabulary for Publishing Environmental Linked Data on la...Using the Data Cube vocabulary for Publishing Environmental Linked Data on la...
Using the Data Cube vocabulary for Publishing Environmental Linked Data on la...
 
Statistical data in RDF
Statistical data in RDFStatistical data in RDF
Statistical data in RDF
 
Presentation for OGRS 2016 at Peruggia, Italy
Presentation for OGRS 2016 at Peruggia, ItalyPresentation for OGRS 2016 at Peruggia, Italy
Presentation for OGRS 2016 at Peruggia, Italy
 
3D Analyst - Watershed, Tomohon
3D Analyst - Watershed, Tomohon3D Analyst - Watershed, Tomohon
3D Analyst - Watershed, Tomohon
 
AGU_Iguassu_Brazil_AUG
AGU_Iguassu_Brazil_AUGAGU_Iguassu_Brazil_AUG
AGU_Iguassu_Brazil_AUG
 

Similar to 060128 Galeon Rept

2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...
2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...
2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...
Rudolf Husar
 
2006-03-14 WG on HTAP-Relevant IT Techniques, Tools and Philosophies: DataFed...
2006-03-14 WG on HTAP-Relevant IT Techniques, Tools and Philosophies: DataFed...2006-03-14 WG on HTAP-Relevant IT Techniques, Tools and Philosophies: DataFed...
2006-03-14 WG on HTAP-Relevant IT Techniques, Tools and Philosophies: DataFed...
Rudolf Husar
 
Bryan lawrence
Bryan lawrenceBryan lawrence
Bryan lawrence
vinunag99
 
2004-11-13 Supersite Relational Database Project: (Data Portal?)
2004-11-13 Supersite Relational Database Project: (Data Portal?)2004-11-13 Supersite Relational Database Project: (Data Portal?)
2004-11-13 Supersite Relational Database Project: (Data Portal?)
Rudolf Husar
 
Microsoft SQL Server - StreamInsight Overview Presentation
Microsoft SQL Server - StreamInsight Overview PresentationMicrosoft SQL Server - StreamInsight Overview Presentation
Microsoft SQL Server - StreamInsight Overview Presentation
Microsoft Private Cloud
 

Similar to 060128 Galeon Rept (20)

0603 Esip Fed Wash Dc Tech Pres 060103 Esip Aq Tech Track
0603 Esip Fed Wash Dc Tech Pres 060103 Esip Aq Tech Track0603 Esip Fed Wash Dc Tech Pres 060103 Esip Aq Tech Track
0603 Esip Fed Wash Dc Tech Pres 060103 Esip Aq Tech Track
 
2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...
2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...
2006-01-11 Data Flow & Interoperability in DataFed Service-based AQ Analysis ...
 
060314 Ispra Htap Presentations Husar 060314 Ispra
060314 Ispra Htap Presentations Husar 060314 Ispra060314 Ispra Htap Presentations Husar 060314 Ispra
060314 Ispra Htap Presentations Husar 060314 Ispra
 
2006-03-14 WG on HTAP-Relevant IT Techniques, Tools and Philosophies: DataFed...
2006-03-14 WG on HTAP-Relevant IT Techniques, Tools and Philosophies: DataFed...2006-03-14 WG on HTAP-Relevant IT Techniques, Tools and Philosophies: DataFed...
2006-03-14 WG on HTAP-Relevant IT Techniques, Tools and Philosophies: DataFed...
 
Design Pattern of HBase Configuration
Design Pattern of HBase ConfigurationDesign Pattern of HBase Configuration
Design Pattern of HBase Configuration
 
Reporting Summary Information of Spatial Datasets and Non-Compliance Issues U...
Reporting Summary Information of Spatial Datasets and Non-Compliance Issues U...Reporting Summary Information of Spatial Datasets and Non-Compliance Issues U...
Reporting Summary Information of Spatial Datasets and Non-Compliance Issues U...
 
State of the Art Web Mapping with Open Source
State of the Art Web Mapping with Open SourceState of the Art Web Mapping with Open Source
State of the Art Web Mapping with Open Source
 
Bryan lawrence
Bryan lawrenceBryan lawrence
Bryan lawrence
 
20090701 Climate Data Staging
20090701 Climate Data Staging20090701 Climate Data Staging
20090701 Climate Data Staging
 
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
 
20100512 Workflow Ramage
20100512 Workflow Ramage20100512 Workflow Ramage
20100512 Workflow Ramage
 
2004-11-13 Supersite Relational Database Project: (Data Portal?)
2004-11-13 Supersite Relational Database Project: (Data Portal?)2004-11-13 Supersite Relational Database Project: (Data Portal?)
2004-11-13 Supersite Relational Database Project: (Data Portal?)
 
Srds Pres011120
Srds Pres011120Srds Pres011120
Srds Pres011120
 
Geoint2017 training open interfaces - luis bermudez
Geoint2017 training   open interfaces - luis bermudezGeoint2017 training   open interfaces - luis bermudez
Geoint2017 training open interfaces - luis bermudez
 
Spatiotemporal Raster Improvements in GeoServer
Spatiotemporal Raster Improvements in GeoServerSpatiotemporal Raster Improvements in GeoServer
Spatiotemporal Raster Improvements in GeoServer
 
Distributed Systems: How to connect your real-time applications
Distributed Systems: How to connect your real-time applicationsDistributed Systems: How to connect your real-time applications
Distributed Systems: How to connect your real-time applications
 
Lambda Data Grid
Lambda Data GridLambda Data Grid
Lambda Data Grid
 
DDS Advanced Tutorial - OMG June 2013 Berlin Meeting
DDS Advanced Tutorial - OMG June 2013 Berlin MeetingDDS Advanced Tutorial - OMG June 2013 Berlin Meeting
DDS Advanced Tutorial - OMG June 2013 Berlin Meeting
 
Tim Hall [InfluxData] | InfluxDB Roadmap | InfluxDays Virtual Experience Lond...
Tim Hall [InfluxData] | InfluxDB Roadmap | InfluxDays Virtual Experience Lond...Tim Hall [InfluxData] | InfluxDB Roadmap | InfluxDays Virtual Experience Lond...
Tim Hall [InfluxData] | InfluxDB Roadmap | InfluxDays Virtual Experience Lond...
 
Microsoft SQL Server - StreamInsight Overview Presentation
Microsoft SQL Server - StreamInsight Overview PresentationMicrosoft SQL Server - StreamInsight Overview Presentation
Microsoft SQL Server - StreamInsight Overview Presentation
 

More from Rudolf Husar

100528 satellite obs_china_husar
100528 satellite obs_china_husar100528 satellite obs_china_husar
100528 satellite obs_china_husar
Rudolf Husar
 
2013-04-30 EE DSS Approach and Demo
2013-04-30 EE DSS Approach and Demo2013-04-30 EE DSS Approach and Demo
2013-04-30 EE DSS Approach and Demo
Rudolf Husar
 
130205 epa exc_event_seminar
130205 epa exc_event_seminar130205 epa exc_event_seminar
130205 epa exc_event_seminar
Rudolf Husar
 
130205 epa ee_presentation_subm
130205 epa ee_presentation_subm130205 epa ee_presentation_subm
130205 epa ee_presentation_subm
Rudolf Husar
 
111018 geo sif_aq_interop
111018 geo sif_aq_interop111018 geo sif_aq_interop
111018 geo sif_aq_interop
Rudolf Husar
 
110823 solta11 intro
110823 solta11 intro110823 solta11 intro
110823 solta11 intro
Rudolf Husar
 
110823 data fed_solta11
110823 data fed_solta11110823 data fed_solta11
110823 data fed_solta11
Rudolf Husar
 
110510 aq co_p_network
110510 aq co_p_network110510 aq co_p_network
110510 aq co_p_network
Rudolf Husar
 
110509 aq co_p_solta
110509 aq co_p_solta110509 aq co_p_solta
110509 aq co_p_solta
Rudolf Husar
 
110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views
110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views
110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views
Rudolf Husar
 
110410 aq user_req_methodology_sydney_subm
110410 aq user_req_methodology_sydney_subm110410 aq user_req_methodology_sydney_subm
110410 aq user_req_methodology_sydney_subm
Rudolf Husar
 
110408 aq co_p_uic_sydney_husar
110408 aq co_p_uic_sydney_husar110408 aq co_p_uic_sydney_husar
110408 aq co_p_uic_sydney_husar
Rudolf Husar
 
110105 htap pilot_aqco_p_esip_dc
110105 htap pilot_aqco_p_esip_dc110105 htap pilot_aqco_p_esip_dc
110105 htap pilot_aqco_p_esip_dc
Rudolf Husar
 
100615 htap network_brussels
100615 htap network_brussels100615 htap network_brussels
100615 htap network_brussels
Rudolf Husar
 
121117 eedss briefing_nasa_epa
121117 eedss briefing_nasa_epa121117 eedss briefing_nasa_epa
121117 eedss briefing_nasa_epa
Rudolf Husar
 
120910 nasa satellite_outline
120910 nasa satellite_outline120910 nasa satellite_outline
120910 nasa satellite_outline
Rudolf Husar
 
120612 geia closure_ofeo_ms_soa_subm
120612 geia closure_ofeo_ms_soa_subm120612 geia closure_ofeo_ms_soa_subm
120612 geia closure_ofeo_ms_soa_subm
Rudolf Husar
 
110414 extreme dustsmokesulfate
110414 extreme dustsmokesulfate110414 extreme dustsmokesulfate
110414 extreme dustsmokesulfate
Rudolf Husar
 
Aq Gci Infrastructure
Aq Gci InfrastructureAq Gci Infrastructure
Aq Gci Infrastructure
Rudolf Husar
 

More from Rudolf Husar (20)

100528 satellite obs_china_husar
100528 satellite obs_china_husar100528 satellite obs_china_husar
100528 satellite obs_china_husar
 
2013-04-30 EE DSS Approach and Demo
2013-04-30 EE DSS Approach and Demo2013-04-30 EE DSS Approach and Demo
2013-04-30 EE DSS Approach and Demo
 
Exceptional Event Decision Support System Description
Exceptional Event Decision Support System DescriptionExceptional Event Decision Support System Description
Exceptional Event Decision Support System Description
 
130205 epa exc_event_seminar
130205 epa exc_event_seminar130205 epa exc_event_seminar
130205 epa exc_event_seminar
 
130205 epa ee_presentation_subm
130205 epa ee_presentation_subm130205 epa ee_presentation_subm
130205 epa ee_presentation_subm
 
111018 geo sif_aq_interop
111018 geo sif_aq_interop111018 geo sif_aq_interop
111018 geo sif_aq_interop
 
110823 solta11 intro
110823 solta11 intro110823 solta11 intro
110823 solta11 intro
 
110823 data fed_solta11
110823 data fed_solta11110823 data fed_solta11
110823 data fed_solta11
 
110510 aq co_p_network
110510 aq co_p_network110510 aq co_p_network
110510 aq co_p_network
 
110509 aq co_p_solta
110509 aq co_p_solta110509 aq co_p_solta
110509 aq co_p_solta
 
110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views
110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views
110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views
 
110410 aq user_req_methodology_sydney_subm
110410 aq user_req_methodology_sydney_subm110410 aq user_req_methodology_sydney_subm
110410 aq user_req_methodology_sydney_subm
 
110408 aq co_p_uic_sydney_husar
110408 aq co_p_uic_sydney_husar110408 aq co_p_uic_sydney_husar
110408 aq co_p_uic_sydney_husar
 
110105 htap pilot_aqco_p_esip_dc
110105 htap pilot_aqco_p_esip_dc110105 htap pilot_aqco_p_esip_dc
110105 htap pilot_aqco_p_esip_dc
 
100615 htap network_brussels
100615 htap network_brussels100615 htap network_brussels
100615 htap network_brussels
 
121117 eedss briefing_nasa_epa
121117 eedss briefing_nasa_epa121117 eedss briefing_nasa_epa
121117 eedss briefing_nasa_epa
 
120910 nasa satellite_outline
120910 nasa satellite_outline120910 nasa satellite_outline
120910 nasa satellite_outline
 
120612 geia closure_ofeo_ms_soa_subm
120612 geia closure_ofeo_ms_soa_subm120612 geia closure_ofeo_ms_soa_subm
120612 geia closure_ofeo_ms_soa_subm
 
110414 extreme dustsmokesulfate
110414 extreme dustsmokesulfate110414 extreme dustsmokesulfate
110414 extreme dustsmokesulfate
 
Aq Gci Infrastructure
Aq Gci InfrastructureAq Gci Infrastructure
Aq Gci Infrastructure
 

Recently uploaded

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 

Recently uploaded (20)

DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 

060128 Galeon Rept

  • 1.
  • 2. DataFed in a Nutshell DataFed Vision Aid air quality analysis by effective use of relevant data   DataFed Goals Facilitate access and flow of AQ data from provider to users Support user-driven data processing value chains Participate in specific application projects   Approach: Mediation Between Users and Data Providers DataFed assumes spontaneous, autonomous data providers Non-intrusively wraps datasets for access by web services Mediates, homogenizes data views. e.g. geo-spatial, time...   Applications Browsers and analysis tools for distributed monitoring data    Serve as data gateway for user programs; GIS, science tools DataFed is focused on the mediation of air quality data
  • 3. Typical DataFed AQ Analysis Tools Consoles : Data from diverse sources are displayed to create a rich context for exploration and analysis CATT : Combined Aerosol Trajectory Tool for the browsing backtrajectories for specified chemical conditions Viewer: General purpose spatio-temporal data browser and view editor applicable for all DataFed datasets
  • 4. Web Services: Building Blocks of DataFed Programming Access, Process, Render Data by Service Chaining [Station] [Monitor] Clickable monitor locations layer Map boundary layer
  • 5.
  • 6.
  • 7.
  • 8.  
  • 9. Data Access through Adapters through DataFed SOAP,HTTP Get OGC WCS HTTP Get, Post OGC WMS HTTP Get Station-Point SQL Server, Files… Sequence Image, file nDim Grid OpenDAP NetCDF, … Other Traject., Event, Pic Sources Diverse formats Many data models Data Wrapper Data into geo-cubes Queries to views Virtual Data Cube Global geo-cube data model Makes queries data-neutral Others? e.g. OpenDAP Output Protocol dependent User specified GeoTable CSV,XLS,GML GeoGrid GML,NetCDF.. GeoImage GeoTIFF, PNG.. Other MS Dataset.. Query Adapter Maps query to protocol User selects protocols
  • 10. OGC WCS Demonstration: AirNOW Station Dataset Map View Services WCS Query http://webapps.datafed.net/dvoy_services/ogc.wsfl?SERVICE=wcs&REQUEST=GetCoverage&VERSION=1.0.0&CRS=EPSG:4326&COVERAGE=AIRNOW.pmfine&FORMAT=CSV&BBOX=-125.3889,22.55111,-61.40667,51.20889,0,0&TIME=2005-06-26T15:00:00Z&WIDTH=999&HEIGHT=999&DEPTH=999 Formats: CSV, NetCDF-table, etc Time View Services http://webapps.datafed.net/dvoy_services/ogc.wsfl?SERVICE=wcs&REQUEST=GetCoverage&VERSION=1.0.0&CRS=EPSG:4326&COVERAGE=AIRNOW.pmfine&FORMAT=CSV&BBOX=-90.16028,38.61222,-90.16028,38.61222,0,0&TIME=2005-06-20T00:00:00Z/2005-06-30T00:00:00Z&WIDTH=999&HEIGHT=999&DEPTH=999 Formats: CSV, NetCDF-table, etc
  • 11. Data Access Services 1. Click Services Button 4. Set Output Format 3. Access Settings 2. Select Data Access Protocol 4. Execute WCS Query in Browser or in Program 5. Consume data by program, service or viewer
  • 12.
  • 13. GALEON: Earth Science – GIS Interoperability Shared Data Model
  • 14.
  • 15.
  • 16. Benefits of WMS Compatibility: Geospatial One-Stop Provides Access to DataFed spatial layers through WMS Problem: No Time Dim! http:// www.datafed.net/DataLinks/OGC/OGC.htm DataFed/VIEWS Asian Dust Concentration (circles) S. Falke
  • 17.
  • 18. Table 17 — Parts of SpatialDomain data structure Zero or more Include one for each point needed gml:Point Unordered list of points whose union covers spatial domain of this coverage offering c Point Zero or more (optional) Include one for each polygon needed gml:Polygon Unordered list of polygons whose union covers spatial domain of this coverage offering c Polygon Zero or more (optional) Include one for each different grid used (TBR) gml:Grid OR gml:RectifiedGrid Unordered (TBR) list of grids that describe internal grid structure of this coverage offering b Grid One or more (mandatory) ows:BoundingBox Unordered list of bounding boxes whose union covers spatial domain of this coverage offering a Bounding‌Box Multiplicity and use Data type Definition Name