2004-09-12 Data and Tools for Web-Based Monitoring and Analysis
100615 htap network_brussels
1. REASoN Project to link NASA's data, modeling and systems to users in research, education and applications
Application of NASA ESE Data and Tools
to
Air Quality Management
Stefan Falke and Rudolf Husar (Co-PIs)
Washington University in St. Louis
Project Period: Nov 04 – Oct 09
NASA Applied Sciences Program Air Quality Team Meeting
October 27-29, Washington, DC
2.
3.
4.
5.
6. Hurdles
“The user cannot find the data;
If he can find it, cannot access it;
If he can access it, he doesn't know how good they are;
if he finds them good, he can not merge them with other data”
The Users View of IT, NAS 1989
7. Service Orientation Interoperability Stack
GEOSS
Clearinghouse People-People
Extended Structured Metadata
ISO 19115
Publish Find Core Discovery Metadata/
Machine
Metadata
OGC W*S Capabilities
Bind User
Provider
8. Refined Search for AQ Data in uFIND
GEOSS
Clearinghouse
Coarse Filter
Refined Search
Provider
Community
Portal
AQ uFIND
AQ uFIND
11. Observing Systems
Satellite
Surf. Obs. Population
Emission Model
Informing Enforcing Hemispheri Atmospheri
the Public Standards c Transport c
Real-time Regulatory Policy Compositio
Science &
Service Analysis Assessment n
Education
Air Quality & Health Applications
13. How you can contribute and benefit
Community Building
• Share your interests and project contributions (like this meeting)
• Use ESIP for advancing your project objectives (e.g., ‘built-in’ testers, users…)
• Help define the GEOSS GCI and/or Community of Practice
Enhance the Information Infrastructure
• Become a ‘node’ on the air quality interoperability network
• Learn best practices in implementing standards for sharing your project data and tools
• Participate in (and influence) the GEOSS Architecture Implementation Pilot
• Use the AQ Community Information Architecture (register your services in GEOSS, find
information resources useful for your project)
• Participate in the development of air quality information networks
Collaborate on AQ Science and Research Projects
15. Interested in participating in the HTAP Network?
Want to Help Have AQ Info Have Data or
Building Network? Need? Model
Participate in the AQ Make your need be Register them in
Community of known to CoP the HTAP Catalog
Practice
16. Loosely Coupled Data Access through Standard Protocols
Obs. & Models Decision Support System
Control
Data Reports
eca r e n . d S
eca r e n . d S
f t I t
f t I t
Data Sharing Gen. Processing Domain Processing Reporting
The next three slides describe the key technologies used in the creation of an
adaptable and responsive air quality information system.
Server GetCapabilities Client OGC data access protocols and standard formats facilitate loose coupling
between data on the internet and processing services.
Capabilities, ‘Profile’
Where? When? What? For air quality, the Web Coverage Service (WCS), provides a universal simple
Back Front
Which Format? query language for requesting data as where, when, what. That is: geographic
End End (3D bounding box), time range and parameter.
GetData
The Web Map Service (WMS) and Web Feature Service (WFS) are also useful.
eca r e n . d S
e ca r e n . d S
Data
f t I t
f t I t
The use of standard data physical data formats and naming conventions
elevates the syntactic and semantic interoperability.
Query GetData Standards
Where? BBOX OGC, ISO Within DataFed all data access services are implemented as WCS or WMS and
optionally WFS. General format adapter components permit data request in a
variety of standard formats.
When? Time T1 T2 OGC, ISO
What? Temperature CF
Format netCDF, HDF.. CF, EOS, OGC
17. GEOSS Framework
Air Quality Info System
Users (Classes)
Links (Types) Info
(Flow)
User/Act Data Mgr Proc/Med ‘Informer’ Dec Maker
or Class
HTAP Science Data Atm. Science LRTP Lead Foreign
Manager Assessors Taskforce Ministers
GEOSS Core
Except Portal Manager Sate Agency Fed. Agency EPA Reg. Dec.
Event Analyst Regulator Maker
Real
Automatic Data Forecaster Media Public, Public
Time
Analyst Private Individual
Editor's Notes
The metadata has the primary purpose to facilitate finding and accessing the data in order to help dealing with first two hurdles that the users face. Clearly, the air quality specific metadata such as sampling platform, data domain and measured parameters etc. need to be defined by air quality users. Dealing with the hurdles of data quality and multi-sensory data integration are topics of future efforts.
The finding of air quality data is accomplished in two stages. the data are filtered through the generic discovery mechanism of the clearinghouse then air quality specific filters such as sampling platform and data structure are applied
There are numerous Earth Observations that are available and in principle useful for air quality applications such as informing the public and enforcing AQ standards. However, connecting a user to the right observations or models is accompanied by an array of hurdles. The GEOSS Common Infrastructure allows the reuse of observations and models for multiple purposes Even in the narrow application of Wildfire smoke, observations and models can be reused.
The next three slides describe the key technologies used in the creation of an adaptable and responsive air quality information system. OGC data access protocols and standard formats facilitate loose coupling between data on the internet and processing services. For air quality, the Web Coverage Service (WCS), provides a universal simple query language for requesting data as where, when, what. That is: geographic (3D bounding box), time range and parameter. The Web Map Service (WMS) and Web Feature Service (WFS) are also useful. The use of standard data physical data formats and naming conventions elevates the syntactic and semantic interoperability. Within DataFed all data access services are implemented as WCS or WMS and optionally WFS. General format adapter components permit data request in a variety of standard formats.
Beyond qualitative information, air quality managers need more quantitative data and analyses to justify their decisions and actions. Such support is provided by the decision support system. A typical air quality decision support system consists of several active participants: The models and the observations are interpreted by experienced Technical Analysts who summarize their findings in 'just in time’ reports. Often these reports are also evaluated and augmented by Regulatory Analysts who then inform the decision-making m anagers. With actionable knowledge in hand, decision makers act in response to the pollution situation. While the arrows indicate unidirectional flow of information, each interaction generally involves considerable iteration. For example, analysts explore and choose from numerous candidate datasets. Also most reports are finalized after considerable feedback. Note that the key users of formal information systems are the technical analysts. Hence, the system needs to be tailored primarily to the analysts needs.
