SlideShare a Scribd company logo
1 of 12
Web Services-Based Mediator of Distributed Data Flow and Processing Project Coordinators: Software Architecture:  R. Husar Software Implementation:  K. Höijärvi Data and Applications:  S. Falke, R. Husar Center for Air Pollution Impact and Trend Analysis (CAPITA) Washington University, St. Louis, MO 63130
DataFed Description ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
DataFed Multidimensional Data Model 4 D Geo-Environmental  Data Cube (X, Y, Z, T) ,[object Object],[object Object],[object Object]
Data Flow & Processing in Air Quality Management AQ DATA EPA Networks IMPROVE Visibility  Satellite-PM Pattern  METEOROLOGY Met. Data  Satellite-Transport  Forecast model EMISSIONS National Emissions  Local Inventory  Satellite Fire Locs Status and Trends AQ Compliance Exposure Assess. Network Assess. Tracking Progress AQ  Management  Reports ‘ Knowledge’ Derived from Data Primary Data  Diverse Providers Data ‘Refining’ Processes  Filtering, Aggregation, Fusion
Mediator-Based Integration Architecture   (Wiederhold, 1992)   ,[object Object],[object Object],[object Object],[object Object],Wrapper Wrapper Service Service User Query Views Heterogeneous Data
Generic Data Flow and Processing in DataFed DataView 1 Data Processed Data Portrayed Data Process Data Portrayal/ Render Abstract Data Access View Wrapper Physical Data Abstract Data Physical Data Resides in autonomous servers; accessed by view-specific  wrappers  which   yield abstract data ‘slices’ Abstract Data Abstract data slices are requested by viewers; uniform data are delivered by  wrapper  services DataView 2 DataView 3 View Data Processed data are delivered to the user as multi-layer views by portrayal and overlay  web services Processed Data Data passed through filtering, aggregation, fusion and other  web  services
Anatomy of a Wrapper Service: TOMS Satellite Image Data ,[object Object],[object Object],src_img_width src_img_height src_margin_right src_margin_left src_margin_top src_margin_bottom src_lon_min src_lat_max src_lat_min src_lon_max Image Description for Data Access: src_image_width=502 src_image_height=329 src_margin_bottom=105 src_margin_left=69 src_margin_right=69 src_margin_top=46 src_lat_min=-70 src_lat_max=70 src_lon_min=-180 src_lon_max=180 The daily TOMS images reside on the FTP archive, e.g.  ftp://toms.gsfc.nasa.gov/pub/eptoms/images/aerosol/y2000/ea000820.gif URL template:  ftp://toms.gsfc.nasa.gov/pub/eptoms/images/aerosol/y[yyyy]/ea[yy][mm][dd].gif Transparent colors for overlays RGB(89,140,255) RGB(41,117,41) RGB(23,23,23) RGB(0,0,0)
An Application Program: Voyager Data Browser ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Data Sources Controls Displays I/O Layer Device Drivers Wrappers App State Data Flow Interpreter Core Web Services WSDL Ports
[object Object],SeaWiFS Satellite Aerosol Chemical Air Trajectory Map Boarder VIEW by Web Service Composition
Air Quality  Datasets ,[object Object],[object Object],[object Object],Near Real Time Data Integration Delayed Data Integration Surface Air Quality  AIRNOW O3, PM25  ASOS_STI Visibility, 300 sites METAR Visibility, 1200 sites VIEWS_OL 40+ Aerosol Parameters Satellite MODIS_AOT AOT, Idea Project GASP Reflectance, AOT TOMS Absorption Indx, Refl. SEAW_US Reflectance, AOT Model Output NAAPS Dust, Smoke, Sulfate, AOT WRF Sulfate Fire Data HMS_Fire Fire Pixels MODIS_Fire Fire Pixels Surface Meteorology RADAR NEXTRAD SURF_MET Temp, Dewp, Humidity… SURF_WIND Wind vectors ATAD Trajectory, VIEWS locs.
Some of the Tools of DataFed Consoles:  Data from diverse sources are displayed to create a rich context for exploration and analysis CATT:  Combined Aerosol Trajectory Tool for the browsing backtrajectories for specified chemical conditions  Viewer:  General purpose spatio-temporal data browser and view editor applicable for all DataFed datasets
Sulfate in the Northeast Sahara Dust in the Gulf Fires in the Southeast Time Series Console: Southeast Analyst Console Applications: Sulfate Episode: 8/27/04

More Related Content

More from Rudolf Husar

2013-04-30 EE DSS Approach and Demo
2013-04-30 EE DSS Approach and Demo2013-04-30 EE DSS Approach and Demo
2013-04-30 EE DSS Approach and DemoRudolf Husar
 
Exceptional Event Decision Support System Description
Exceptional Event Decision Support System DescriptionExceptional Event Decision Support System Description
Exceptional Event Decision Support System DescriptionRudolf Husar
 
130205 epa exc_event_seminar
130205 epa exc_event_seminar130205 epa exc_event_seminar
130205 epa exc_event_seminarRudolf Husar
 
130205 epa ee_presentation_subm
130205 epa ee_presentation_subm130205 epa ee_presentation_subm
130205 epa ee_presentation_submRudolf Husar
 
111018 geo sif_aq_interop
111018 geo sif_aq_interop111018 geo sif_aq_interop
111018 geo sif_aq_interopRudolf Husar
 
110823 solta11 intro
110823 solta11 intro110823 solta11 intro
110823 solta11 introRudolf Husar
 
110823 data fed_solta11
110823 data fed_solta11110823 data fed_solta11
110823 data fed_solta11Rudolf Husar
 
110510 aq co_p_network
110510 aq co_p_network110510 aq co_p_network
110510 aq co_p_networkRudolf Husar
 
110509 aq co_p_solta
110509 aq co_p_solta110509 aq co_p_solta
110509 aq co_p_soltaRudolf Husar
 
110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views
110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views
110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_viewsRudolf Husar
 
110410 aq user_req_methodology_sydney_subm
110410 aq user_req_methodology_sydney_subm110410 aq user_req_methodology_sydney_subm
110410 aq user_req_methodology_sydney_submRudolf Husar
 
110408 aq co_p_uic_sydney_husar
110408 aq co_p_uic_sydney_husar110408 aq co_p_uic_sydney_husar
110408 aq co_p_uic_sydney_husarRudolf Husar
 
110105 htap pilot_aqco_p_esip_dc
110105 htap pilot_aqco_p_esip_dc110105 htap pilot_aqco_p_esip_dc
110105 htap pilot_aqco_p_esip_dcRudolf Husar
 
100615 htap network_brussels
100615 htap network_brussels100615 htap network_brussels
100615 htap network_brusselsRudolf Husar
 
121117 eedss briefing_nasa_epa
121117 eedss briefing_nasa_epa121117 eedss briefing_nasa_epa
121117 eedss briefing_nasa_epaRudolf Husar
 
120910 nasa satellite_outline
120910 nasa satellite_outline120910 nasa satellite_outline
120910 nasa satellite_outlineRudolf Husar
 
120612 geia closure_ofeo_ms_soa_subm
120612 geia closure_ofeo_ms_soa_subm120612 geia closure_ofeo_ms_soa_subm
120612 geia closure_ofeo_ms_soa_submRudolf Husar
 
110414 extreme dustsmokesulfate
110414 extreme dustsmokesulfate110414 extreme dustsmokesulfate
110414 extreme dustsmokesulfateRudolf Husar
 
Aq Gci Infrastructure
Aq Gci InfrastructureAq Gci Infrastructure
Aq Gci InfrastructureRudolf Husar
 
AQ GCI Infrastructure
AQ GCI InfrastructureAQ GCI Infrastructure
AQ GCI InfrastructureRudolf Husar
 

More from Rudolf Husar (20)

2013-04-30 EE DSS Approach and Demo
2013-04-30 EE DSS Approach and Demo2013-04-30 EE DSS Approach and Demo
2013-04-30 EE DSS Approach and Demo
 
Exceptional Event Decision Support System Description
Exceptional Event Decision Support System DescriptionExceptional Event Decision Support System Description
Exceptional Event Decision Support System Description
 
130205 epa exc_event_seminar
130205 epa exc_event_seminar130205 epa exc_event_seminar
130205 epa exc_event_seminar
 
130205 epa ee_presentation_subm
130205 epa ee_presentation_subm130205 epa ee_presentation_subm
130205 epa ee_presentation_subm
 
111018 geo sif_aq_interop
111018 geo sif_aq_interop111018 geo sif_aq_interop
111018 geo sif_aq_interop
 
110823 solta11 intro
110823 solta11 intro110823 solta11 intro
110823 solta11 intro
 
110823 data fed_solta11
110823 data fed_solta11110823 data fed_solta11
110823 data fed_solta11
 
110510 aq co_p_network
110510 aq co_p_network110510 aq co_p_network
110510 aq co_p_network
 
110509 aq co_p_solta
110509 aq co_p_solta110509 aq co_p_solta
110509 aq co_p_solta
 
110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views
110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views
110421 exploration of_pm_networks_and_data_over_the_us-_aqs_and_views
 
110410 aq user_req_methodology_sydney_subm
110410 aq user_req_methodology_sydney_subm110410 aq user_req_methodology_sydney_subm
110410 aq user_req_methodology_sydney_subm
 
110408 aq co_p_uic_sydney_husar
110408 aq co_p_uic_sydney_husar110408 aq co_p_uic_sydney_husar
110408 aq co_p_uic_sydney_husar
 
110105 htap pilot_aqco_p_esip_dc
110105 htap pilot_aqco_p_esip_dc110105 htap pilot_aqco_p_esip_dc
110105 htap pilot_aqco_p_esip_dc
 
100615 htap network_brussels
100615 htap network_brussels100615 htap network_brussels
100615 htap network_brussels
 
121117 eedss briefing_nasa_epa
121117 eedss briefing_nasa_epa121117 eedss briefing_nasa_epa
121117 eedss briefing_nasa_epa
 
120910 nasa satellite_outline
120910 nasa satellite_outline120910 nasa satellite_outline
120910 nasa satellite_outline
 
120612 geia closure_ofeo_ms_soa_subm
120612 geia closure_ofeo_ms_soa_subm120612 geia closure_ofeo_ms_soa_subm
120612 geia closure_ofeo_ms_soa_subm
 
110414 extreme dustsmokesulfate
110414 extreme dustsmokesulfate110414 extreme dustsmokesulfate
110414 extreme dustsmokesulfate
 
Aq Gci Infrastructure
Aq Gci InfrastructureAq Gci Infrastructure
Aq Gci Infrastructure
 
AQ GCI Infrastructure
AQ GCI InfrastructureAQ GCI Infrastructure
AQ GCI Infrastructure
 

Recently uploaded

CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGSujit Pal
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 

Recently uploaded (20)

CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAG
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 

051207 Agu Sna Frncisco Data Fed Web Services Based Mediator Of Distributed Data Flow And Processing Files Data Fed 051207 Agu

  • 1. Web Services-Based Mediator of Distributed Data Flow and Processing Project Coordinators: Software Architecture: R. Husar Software Implementation: K. Höijärvi Data and Applications: S. Falke, R. Husar Center for Air Pollution Impact and Trend Analysis (CAPITA) Washington University, St. Louis, MO 63130
  • 2.
  • 3.
  • 4. Data Flow & Processing in Air Quality Management AQ DATA EPA Networks IMPROVE Visibility Satellite-PM Pattern METEOROLOGY Met. Data Satellite-Transport Forecast model EMISSIONS National Emissions Local Inventory Satellite Fire Locs Status and Trends AQ Compliance Exposure Assess. Network Assess. Tracking Progress AQ Management Reports ‘ Knowledge’ Derived from Data Primary Data Diverse Providers Data ‘Refining’ Processes Filtering, Aggregation, Fusion
  • 5.
  • 6. Generic Data Flow and Processing in DataFed DataView 1 Data Processed Data Portrayed Data Process Data Portrayal/ Render Abstract Data Access View Wrapper Physical Data Abstract Data Physical Data Resides in autonomous servers; accessed by view-specific wrappers which yield abstract data ‘slices’ Abstract Data Abstract data slices are requested by viewers; uniform data are delivered by wrapper services DataView 2 DataView 3 View Data Processed data are delivered to the user as multi-layer views by portrayal and overlay web services Processed Data Data passed through filtering, aggregation, fusion and other web services
  • 7.
  • 8.
  • 9.
  • 10.
  • 11. Some of the Tools of DataFed Consoles: Data from diverse sources are displayed to create a rich context for exploration and analysis CATT: Combined Aerosol Trajectory Tool for the browsing backtrajectories for specified chemical conditions Viewer: General purpose spatio-temporal data browser and view editor applicable for all DataFed datasets
  • 12. Sulfate in the Northeast Sahara Dust in the Gulf Fires in the Southeast Time Series Console: Southeast Analyst Console Applications: Sulfate Episode: 8/27/04