Ce diaporama a bien été signalé.
Le téléchargement de votre SlideShare est en cours. ×

SFScon22 - Peter Zellner - The Alpine Drought Observatory Platform An alpine wide CICD Pipeline in Action.pdf

Publicité
Publicité
Publicité
Publicité
Publicité
Publicité
Publicité
Publicité
Publicité
Publicité
Publicité
Publicité

Consultez-les par la suite

1 sur 22 Publicité

SFScon22 - Peter Zellner - The Alpine Drought Observatory Platform An alpine wide CICD Pipeline in Action.pdf

Télécharger pour lire hors ligne

From Operational Data Production to Web Based Visualization

Today European scale research projects are not only limited to collaborative scientific advancements. They require joint cross-border, interdisciplinary development and operationalization of results following the principles of open source and FAIR data. The ADO Project (Alpine Drought Observatory, https://www.alpine-space.org/projects/ado/) is led by Eurac Research and relies on collaboration within research institutes of six alpine countries for creating a scientifically sound operational drought information web platform aiding decision makers on an alpine to regional level in managing water resources and drought impacts. Collaboratively creating and maintaining the ADO web platform (https://ado.eurac.edu/) that feeds on big data satellite and climate archives on the input side and shows curated drought information through an interactive web platform for stakeholders and decision makers calls for automated workflow management. (..)

From Operational Data Production to Web Based Visualization

Today European scale research projects are not only limited to collaborative scientific advancements. They require joint cross-border, interdisciplinary development and operationalization of results following the principles of open source and FAIR data. The ADO Project (Alpine Drought Observatory, https://www.alpine-space.org/projects/ado/) is led by Eurac Research and relies on collaboration within research institutes of six alpine countries for creating a scientifically sound operational drought information web platform aiding decision makers on an alpine to regional level in managing water resources and drought impacts. Collaboratively creating and maintaining the ADO web platform (https://ado.eurac.edu/) that feeds on big data satellite and climate archives on the input side and shows curated drought information through an interactive web platform for stakeholders and decision makers calls for automated workflow management. (..)

Publicité
Publicité

Plus De Contenu Connexe

Plus par South Tyrol Free Software Conference (20)

Plus récents (20)

Publicité

SFScon22 - Peter Zellner - The Alpine Drought Observatory Platform An alpine wide CICD Pipeline in Action.pdf

  1. 1. The Alpine Drought Observatory Platform - An alpine wide CI/CD Pipeline in Action From Operational Data Production to Web Based Visualization P.J. Zellner, L. Cattani, T. Iacopino, M. Claus, M. Alasawedah, Daniela Quintero, B. Ventura, A. Vianello, Z. Vlahovic, K. Mayer, A. Jacob South Tyrol Free Software Conference (SFSCon) 2022, Bolzano, Italy, 11.11.2022
  2. 2. “The Alpine Drought Observatory (ADO) aims to create an online drought monitoring platform and develop policy implementation guidelines for proactive drought management in the Alpine Space region” https://www.alpine-space.org/projects/ado/en/home ADO Alpine Drought Observatory
  3. 3. Outline • Design goals of the Web Portal and Data Access Tools • Infrastructure • Operational Processing • Web Portal • OpenEO • Available Data • Drought Indices • Hydrological Stations • Impacts • Vulnerability • Metadata & Citation ADO Webplatform Science Data Production Dissemination Open-Source Solutions FAIR Data Access
  4. 4. The ADO Platform Production Docker GitLab Kubernetes Access Rasdaman/ODC openEO Env. Data Platform Metadata Fact Sheets STAC DOI FAIR Data Drought Indices Hydro Stations Impacts Vulnerability Web platform
  5. 5. Design Phase – Thinking about users…
  6. 6. 16 Cores 128 GB RAM 32 Cores 150 GB RAM 8 Cores 16 GB RAM 4 Cores 8 GB RAM VMs for ADO partners 20 Cores 96 GB RAM Pre-processing EO 16 Cores 128 GB RAM https://openeo.org/ Infrastructure
  7. 7. https://gitlab.inf.unibz.it/ado ADO on git – Open Source
  8. 8. • Docker • CI/CD • Kubernetes • Triggering • Codes producing Data • Environment Files • Documentation • (Docker Image) Changes are directly integrated to pipeline Modules of the pipelines can be triggered by different events Results are directly integrated into web-portal Development of Code ADO Production Pipelines
  9. 9. ADO Pipelines
  10. 10. Pipeline Jobs Schedule API Key etc. Success Mail Error Mail Pipeline Operations
  11. 11. 1. Precipitation Anomalies (%) ✔ 2. Standardised Precipitation Index (SPI) ✔ 3. Standardised Precipitation- Evapotranspiration Index (SPEI) ✔ 4. Soil Moisture Anomalies ✔ 5. Normalized Difference Vegetation Index (NDVI) ✔ 6. Vegetation Health Index (VHI) ✔ 7. Standardised Snowpack Index (SSPI) ✔ 8. Hydrological Indices (SDI, SGI, …) … ATMOSPHERE TOP-SOIL VEGETATION HEALTH SURFACE WATER GROUNDWATER + combined drought index – COMBINING 2 OR MORE TOPICS + integration of impacts List of Production Indices
  12. 12. http://saocompute.eurac.edu/rasdaman/ows#/services Current List of Production Indices
  13. 13. 13 https://edp-portal.eurac.edu/cdb_doc/ado/ Country Runoff stations Austria 567 Italy 242 Switzerland 235 Slovenia 185 Germany 129 France 65 TOTAL 1423 Alpine-wide dataset: discharge, water level, groundwater level, metadata Problems: different data providers, real time data availability Hydrological Data
  14. 14. • Substantial update of EDII database • Various German and Italian text-reports • Unwetterchronik ZAMG • Drought.ch • DMCSEE • Propluvia.fr • Filtered to the Alpine Space → First version of EDIIALPS allows various analyses Drought Impacts Stephan, R. et al. An inventory of Alpine drought impact reports to explore past droughts in a mountain region. Nat Hazard Earth Sys 21, 2485–2501 (2021). https://nhess.copernicus.org/articles/21/2485/2021/
  15. 15. https://edp-portal.eurac.edu/geonetwork/ Meta Data https://doi.org/10.48784/16006b70-534a-11ec-809b-02000a08f41d. Findable on GEOSS -> STAC Digital Object Identifiers DOI Findable on EDP Environmental Data Platform
  16. 16. ADO Portal (Current Status Map) https://ado.eurac.edu/ Web Platform https://ado.eurac.edu/
  17. 17. ADO Portal (Current Status Map) https://ado.eurac.edu/ https://ado.eurac.edu/ Web Platform
  18. 18. Drought Impacts on the Portal
  19. 19. Hydrology on the Portal
  20. 20. Hydrology on the Portal
  21. 21. Conclusion & Outlook • Web and Data Portal following FAIR data principles • Combining data from all relevant sources • Catering to the needs of different target user groups • Portal aiming to be fully operational within the next month. • Framework is a blueprint for further drought monitoring platforms (Regional Drought Observatories/JRC) • Open Source, deployable in other institutes/regions/countries! • Great Collaboration
  22. 22. Thank you for your kind attention! http://ado.eurac.edu https://gitlab.inf.unibz.it/ado https://www.alpine-space.eu/projects/ado/en/home peterjames.zellner@eurac.edu

×