SlideShare une entreprise Scribd logo
1  sur  29
Télécharger pour lire hors ligne
How FAIR is GEOSS
S. Nativi (1), J. Van Bemmelen (2), M. Santoro (1), G. Colangeli (2)
O. Ochiai (3), P. De Salvo (3)
(1) Institute of Atmospheric Pollution Research,
National Research Council of Italy
(2) European Space Agency
(3) GEO Secretariat
BlueBRIDGE Workshop
3 April, 2017
GEO AND GEOSS
Group on Earth Observation and Global Earth Observation system
of systems
GEO AND GEOSS
Group on Earth Observation and Global Earth Observation system
of systems
GEO AND GEOSS
Group on Earth Observation and Global Earth Observation system
of systems
Global Earth Observation System of
Systems (GEOSS)
Together, the GEO community is creating a Global Earth
Observation System of Systems (GEOSS).
Earth observations from diverse sources, including satellite,
airborne, in-situ platforms, and citizen observatories, when
integrated together, provide powerful tools for understanding the
past and present conditions of Earth systems, as well as the
interplay between them.
GEOSS aims to better integrate observing systems and share data
by connecting existing infrastructures.
There are more than 200 million open data resources in GEOSS
from more than 150 national and regional providers such as NASA
and ESA; international organizations such as WMO and the
commercial sector such as Digital Globe.
IMPLEMENTING GEOSS
GEOSS Common Infrastructure (GCI)
GEOSS Applications
GEOSS Providers
GEOSS Application
Developers
(intermediate Users)
GEOSS
end-Users
GEOSS Applications
GEOSS ApplicationsGEOSS Applications
Enterprise
System j
… .
Enterprise
System 1
System
4Enterprise
System 3
Enterprise
System 2
… .
… .
… .
SBA 1 SBA 2
SBA 8
Enterpris
e System
K
Enterprise
System 3
System
4
Enterpris
e System
1
Enterprise
System 2 Enterprise
System Z
Enterprise
System 1
System
4Enterprise
System 2
Enterprise
System 3
GEOSS Portal
DOWNSTREAM
UPSTREAM
MIDSTREAM
GEOSS Common Infrastructure
APIs
Mediation modules
Societal Benefit Areas
Data Providers
> 200 million data resources
spanning all SBAs
GCI
M2M
Registration
GEOSS Common Infrastructure (GCI)
Enhanced GEOSS Portal - Overview
• Enhanced during 2016
• Accessible from www.geoportal.org
• Coordinated with ESA, CNR-IIA, DG-RTD, DG-JRC and
GeoSec
• Focus on engagement, delivery and advocating
• Structured in 3 phases
• 1st phase – 2016: interface restyling: completed
• 2nd phase – 2017/18: deployment of major upgrades
• 3rd phase – 2019 onwards – operations and evolutions
GEO Discovery and Access Broker (DAB)
GEO DAB is a brokering framework that interconnects hundreds
of heterogeneous and autonomous supply systems (the enterprise
systems constituting the GEO metasystem) by providing mediation,
harmonization and transformation capabilities.
GEOSS FAIRNESS
How GEOSS addresses FAIR Principles
FINDABLE
How GEOSS addresses FAIR Principles
Discovery in GEOSS
• GEOSS has to deal with the large amount of datasets
provided by the end systems, e.g. millions of (small to
medium size) products, and long EO time/space
series.
• GEOSS has to collect metadata (at least for
harvested catalogs) and provide effective
discoverability.
Adopted Solutions
• Dealing with such numbers, normally constrained
queries commonly match a large number of datasets.
• GCI addresses this challenge by returning a smaller
and/or an ordered result sets.
Views
Ranking and Paging
Ranking and Paging
No-SQL DB
Good performances on
large stores
No preliminary constraint
on data structure
Need to preliminarily
index queryable elements GEO DAB Internal
Metadata Model
Pre-calculated in batch,
based on:
Metadata Quality
Accessibility
Etc.
Calculated on-the-fly,
based on:
Query Constraints
Applied to scores
(configurable)
GEOSS View
• Definition:
– Subset of the whole GEOSS resources defined by applying,
via the DAB, a set of clauses
• Discovery clauses (e.g. spatial envelope, keywords,
sources, etc.)
• Access clauses (e.g. data format, access protocol, CRS,
etc.)
– Defined “View” exposed on the GEOSS Portal
Consumer-defined View – i.e. Client-side These
views are available only for the client application which
defined the view.
Provider-defined View –i.e. Server-side These
views are available for all client applications.
ACCESSIBLE
How GEOSS addresses FAIR Principles
Accessibility in GEOSS
• In GEOSS, main Access related challenges include:
– Visualization of data previews
• provide a fast preview service allowing users
quickly to evaluate discovered data before
deciding the download.
– Basic Transformations
• provide users with an easy (i.e. transparent)
access to the discovered data along with a set
of basic data transformations to make them
more easily processed
Accessibility in GEOSS - Visualization
• GEO DAB provides a fast preview service allowing to get data preview:
– Metadata record is augmented by adding a reference to data preview;
preview tiles at different zoom levels are generated in a batch mode.
– To store and retrieve single tiles in an efficient way, GEO DAB utilizes
a NoSQL key-value DB.
– When available, GEO DAB utilizes data provider fast preview services
by implementing the required mediation.
• GEOSS Portal uses allows Users to quickly evaluate discovered data
before deciding the download.
Accessibility in GEOSS – Basic
Transformations
• In an environment such as GEOSS, no matter which
technique is implemented there will always be cases
in which the required processing is consuming too
much time for a click-and-get pattern.
• The DAB + GEOSS Portal access transformation
allows to deliver discovered datasets according to a
common grid: format, Coordinate Reference System,
spatial and temporal extent and resolution.
• Where this transformation workflow requires a long
processing time, Users are allowed to opt for an
asynchronous version of the same services.
INTEROPERABLE
How GEOSS addresses FAIR Principles
Interoperability in GEOSS
More than 155 Brokered
Systems
About 200 M granules
Adopted Solutions – GEO DAB
• Introduction of a brokering tier (GEO DAB) dedicated
to mediation of service interfaces and metadata
models harmonization in a transparent way for both
users and data providers.
• The GEO DAB maps the diverse models onto its own
internal model, which is general enough to comprise
all the necessary concepts.
• The key features of the GEO DAB internal data and
metadata models are flexibility and extensibility
allowing adding new concepts and related attributes.
OGC CSW 2.0.2 AP ISO 1.0 INPE
OGC CSW 2.0.2 ebRIM EO CKAN
OGC CSW 2.0.2 ebRIM CIM DCAT
ESRI GEOPORTAL 10 GI-cat
OAI-PMH 2.0 ESRI GEOPORTAL 10
OpenSearch 1.1 NCML-OD
OpenSearch 1.1 ESIP BCODMO
OpenSearch GENESI DR NCML-CF
CKAN NetCDF-CF 1.4
CUAHSI HIS-Central FTP populated with supported metadata types
ESRI REST API 10.3 WAF Web Accessible Folders
OGC WCS GeoNetwork (2.2.0 or greater)
OGC WMS Ecological Markup Language2.1.1
OGC WFS 1.0.0, 1.1.0, 2.0.0 NERRS (National EstuarineResearch Reserve System)
OGC WMTS HMA CSW 2.0.2 ebRIM/CIM
OGC SOS 1.0.0, 2.0.0, 2.0.0 Hydro Profile HDF
OGC WPS 1.0.0 IADC DB (MySQL)
OGC CSW 2.0.0 Core GrADS-DS
OGC CSW 2.0.2 AP ISO 1.0 FedEO
OGC CSW 2.0.2 ebRIM/EO AP ARPA DB (based on Microsoft SQL)
OGC CSW 2.0.2 ebRIM/CIM AP ESRI Map Server
IRIS Station SHAPE files (FTP)
IRIS Event KISTERS Web - Environment ofCanada
HYRAX THREDDS SERVER 1.9 Environment Canada Hydrometric data (FTP)
OAI-PMH 2.0 - Harvesting OpenSearch 1.1
GBIF Earth Engine
DIF RASAQM
HYDRO EGASKRO
UNAVCO SITAD (Sistema Informativo TerritorialeAmbientaleDiffuso)
CDI 1.04, 1.3, 1.4 FileSystem
ISO19115-2 GDACS
THREDDS 1.0.1, 1.0.2 GeoRSS 2.0
THREDDS-NCISO 1.0.1, 1.0.2 Degree catalog service2.2
THREDDS-NCISO-PLUS 1.0.1, 1.0.2 OpenSearch GENESI DR
RE-USABLE
How GEOSS addresses FAIR Principles
Re-usability in GEOSS
• In GEOSS, challenges related to Re-usability mainly
stem from datasets heterogeneity.
• In addition, GEOSS needs to address the
requirement to support diverse (cross-)disciplinary
applications targeting different Communities and
User categories which have different needs, as for
data discovery and presentation in an informative and
significant way.
Adopted Solutions – GEOSS Portal
• User-centric, considering various user communities:
• GEO Flagships and Global initiatives
• ESA Thematic Exploitation Platforms
• SBA/Thematic Customization of search and results visualization:
– Satellite: includes smart filters for imagery (Landsat, Sentinel 2)
and SAR-type
(Sentinel 1) satellite data;
– Disater Resilience SBA: Earthquake events filters
• Focusing on providing resuable Portlets (for integration in external
Community Applications)
Adopted solutions – GEO DAB APIs
Different APIs for serving diverse Application development use cases (environments)
A set of standard Web service interfaces:
• e.g. OGC service interfaces, CKAN, OAI-PMH, FTP, etc.
A set of APIs for software developers:
• Client side APIs:
– (high-level) JavaScript library
– … . (Python)
• Server side APIs:
– REST/JSON APIs
– OpenSearch APIs
– … .
GEOSS Applications
GEOSS Application
Developers
(intermediate Users)
GEOSS
end-Users
GEOSS Applications
GEOSS ApplicationsGEOSS Applications
GEOSS Portal
DOWNSTREAM
MIDSTREAM
GEOSS Common Infrastructure
APIs
Mediation modules
Conclusions
• In the past 10 years GEOSS has developed a truly
Global and multidisciplinary System-of Systems
• A valuable framework to experiment and learn how to
deal Milti-disciplinary Interoperability challenges..
• The new GEOSS Portal + DAB platform signifcantly
improved the discoverability and accessibility of
sahred GEOSS resources, addressing more and
more User requirements.
Thank you

Contenu connexe

Similaire à How FAIR is GEOSS

Validation of services, data and metadata
Validation of services, data and metadataValidation of services, data and metadata
Validation of services, data and metadataLuis Bermudez
 
MataNui - Building a Grid Data Infrastructure that "doesn't suck!"
MataNui - Building a Grid Data Infrastructure that "doesn't suck!"MataNui - Building a Grid Data Infrastructure that "doesn't suck!"
MataNui - Building a Grid Data Infrastructure that "doesn't suck!"Guy K. Kloss
 
remotesensing-12-01253.pdf
remotesensing-12-01253.pdfremotesensing-12-01253.pdf
remotesensing-12-01253.pdfNguyenVanTuan29
 
e-Infrastructure Integration-with gCube
e-Infrastructure Integration-with gCubee-Infrastructure Integration-with gCube
e-Infrastructure Integration-with gCubeFAO
 
Analysis Ready Data workshop - OGC presentation
Analysis Ready Data workshop - OGC presentation Analysis Ready Data workshop - OGC presentation
Analysis Ready Data workshop - OGC presentation George Percivall
 
A Reconfigurable Component-Based Problem Solving Environment
A Reconfigurable Component-Based Problem Solving EnvironmentA Reconfigurable Component-Based Problem Solving Environment
A Reconfigurable Component-Based Problem Solving EnvironmentSheila Sinclair
 
Geonetwork for Spatial Data
Geonetwork for Spatial DataGeonetwork for Spatial Data
Geonetwork for Spatial DataNizam GIS
 
Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...
Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...
Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...Paolo Corti
 
IEEE SIGHT Bombay section webinar talk on GIS & Remote Sensing-Introduction t...
IEEE SIGHT Bombay section webinar talk on GIS & Remote Sensing-Introduction t...IEEE SIGHT Bombay section webinar talk on GIS & Remote Sensing-Introduction t...
IEEE SIGHT Bombay section webinar talk on GIS & Remote Sensing-Introduction t...AdityaAllamraju1
 
Geospatial Metadata and Spatial Data: It's all Greek to me!
Geospatial Metadata and Spatial Data: It's all Greek to me!Geospatial Metadata and Spatial Data: It's all Greek to me!
Geospatial Metadata and Spatial Data: It's all Greek to me!EDINA, University of Edinburgh
 
Big Geo Data: Open Source and Open Standards
Big Geo Data: Open Source and Open StandardsBig Geo Data: Open Source and Open Standards
Big Geo Data: Open Source and Open StandardsGeorge Percivall
 
Big Data for Local Context
Big Data for Local ContextBig Data for Local Context
Big Data for Local ContextGeorge Percivall
 
2008-05-05 GEOSS UIC-ADC AQ Scen W shop Toronto
2008-05-05 GEOSS UIC-ADC AQ Scen W shop Toronto2008-05-05 GEOSS UIC-ADC AQ Scen W shop Toronto
2008-05-05 GEOSS UIC-ADC AQ Scen W shop TorontoRudolf Husar
 
sers, Applications and the Community of Practice for the Air Quality Scenario
sers, Applications and the Community of Practice for the Air Quality Scenariosers, Applications and the Community of Practice for the Air Quality Scenario
sers, Applications and the Community of Practice for the Air Quality ScenarioRudolf Husar
 

Similaire à How FAIR is GEOSS (20)

Metadata in EOSDIS
Metadata in EOSDISMetadata in EOSDIS
Metadata in EOSDIS
 
EPOS GNSS Data and Products TCS - What we do...
EPOS GNSS Data and Products TCS - What we do...EPOS GNSS Data and Products TCS - What we do...
EPOS GNSS Data and Products TCS - What we do...
 
Geos2011 - Lorenzino Vaccari - Keynote speech
Geos2011 - Lorenzino Vaccari - Keynote speechGeos2011 - Lorenzino Vaccari - Keynote speech
Geos2011 - Lorenzino Vaccari - Keynote speech
 
Validation of services, data and metadata
Validation of services, data and metadataValidation of services, data and metadata
Validation of services, data and metadata
 
MataNui - Building a Grid Data Infrastructure that "doesn't suck!"
MataNui - Building a Grid Data Infrastructure that "doesn't suck!"MataNui - Building a Grid Data Infrastructure that "doesn't suck!"
MataNui - Building a Grid Data Infrastructure that "doesn't suck!"
 
remotesensing-12-01253.pdf
remotesensing-12-01253.pdfremotesensing-12-01253.pdf
remotesensing-12-01253.pdf
 
e-Infrastructure Integration-with gCube
e-Infrastructure Integration-with gCubee-Infrastructure Integration-with gCube
e-Infrastructure Integration-with gCube
 
Analysis Ready Data workshop - OGC presentation
Analysis Ready Data workshop - OGC presentation Analysis Ready Data workshop - OGC presentation
Analysis Ready Data workshop - OGC presentation
 
A Reconfigurable Component-Based Problem Solving Environment
A Reconfigurable Component-Based Problem Solving EnvironmentA Reconfigurable Component-Based Problem Solving Environment
A Reconfigurable Component-Based Problem Solving Environment
 
Geonetwork for Spatial Data
Geonetwork for Spatial DataGeonetwork for Spatial Data
Geonetwork for Spatial Data
 
Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...
Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...
Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...
 
THE OPEN SCIENCE GRID Ruth Pordes
THE OPEN SCIENCE GRID Ruth PordesTHE OPEN SCIENCE GRID Ruth Pordes
THE OPEN SCIENCE GRID Ruth Pordes
 
IEEE SIGHT Bombay section webinar talk on GIS & Remote Sensing-Introduction t...
IEEE SIGHT Bombay section webinar talk on GIS & Remote Sensing-Introduction t...IEEE SIGHT Bombay section webinar talk on GIS & Remote Sensing-Introduction t...
IEEE SIGHT Bombay section webinar talk on GIS & Remote Sensing-Introduction t...
 
Geospatial Metadata and Spatial Data: It's all Greek to me!
Geospatial Metadata and Spatial Data: It's all Greek to me!Geospatial Metadata and Spatial Data: It's all Greek to me!
Geospatial Metadata and Spatial Data: It's all Greek to me!
 
Big Geo Data: Open Source and Open Standards
Big Geo Data: Open Source and Open StandardsBig Geo Data: Open Source and Open Standards
Big Geo Data: Open Source and Open Standards
 
Welcome to HDF Workshop V
Welcome to HDF Workshop VWelcome to HDF Workshop V
Welcome to HDF Workshop V
 
Big Data for Local Context
Big Data for Local ContextBig Data for Local Context
Big Data for Local Context
 
Geohosting
GeohostingGeohosting
Geohosting
 
2008-05-05 GEOSS UIC-ADC AQ Scen W shop Toronto
2008-05-05 GEOSS UIC-ADC AQ Scen W shop Toronto2008-05-05 GEOSS UIC-ADC AQ Scen W shop Toronto
2008-05-05 GEOSS UIC-ADC AQ Scen W shop Toronto
 
sers, Applications and the Community of Practice for the Air Quality Scenario
sers, Applications and the Community of Practice for the Air Quality Scenariosers, Applications and the Community of Practice for the Air Quality Scenario
sers, Applications and the Community of Practice for the Air Quality Scenario
 

Plus de Blue BRIDGE

PerformFISH: Consumer Driven Production - Integrating Innovative Approaches f...
PerformFISH: Consumer Driven Production - Integrating Innovative Approaches f...PerformFISH: Consumer Driven Production - Integrating Innovative Approaches f...
PerformFISH: Consumer Driven Production - Integrating Innovative Approaches f...Blue BRIDGE
 
BlueBRIDGE supporting education
BlueBRIDGE supporting educationBlueBRIDGE supporting education
BlueBRIDGE supporting educationBlue BRIDGE
 
LME: LEARN & IOC Capacity Building Activities
LME: LEARN & IOC Capacity Building ActivitiesLME: LEARN & IOC Capacity Building Activities
LME: LEARN & IOC Capacity Building ActivitiesBlue BRIDGE
 
Machine Learning methods to estimate the performance of aquafarms
Machine Learning methods to estimate the performance of aquafarms Machine Learning methods to estimate the performance of aquafarms
Machine Learning methods to estimate the performance of aquafarms Blue BRIDGE
 
Environmental observation data to detect aquaculture structures: merging Cope...
Environmental observation data to detect aquaculture structures: merging Cope...Environmental observation data to detect aquaculture structures: merging Cope...
Environmental observation data to detect aquaculture structures: merging Cope...Blue BRIDGE
 
Application of Earth Observation (EO) Data for Detection, Characterization an...
Application of Earth Observation (EO) Data for Detection, Characterization an...Application of Earth Observation (EO) Data for Detection, Characterization an...
Application of Earth Observation (EO) Data for Detection, Characterization an...Blue BRIDGE
 
Capacity building, validation and repeatability
Capacity building, validation and repeatabilityCapacity building, validation and repeatability
Capacity building, validation and repeatabilityBlue BRIDGE
 
Fostering global data management with public tuna fisheries data
Fostering global data management with public tuna fisheries dataFostering global data management with public tuna fisheries data
Fostering global data management with public tuna fisheries dataBlue BRIDGE
 
Understanding biodiversity features in marine protected areas
Understanding biodiversity features in marine protected areasUnderstanding biodiversity features in marine protected areas
Understanding biodiversity features in marine protected areasBlue BRIDGE
 
Panel discussion on Global Repositories of Merged Public Data
Panel discussion on Global Repositories of Merged Public DataPanel discussion on Global Repositories of Merged Public Data
Panel discussion on Global Repositories of Merged Public DataBlue BRIDGE
 
Invasive species and climate change
Invasive species and climate changeInvasive species and climate change
Invasive species and climate changeBlue BRIDGE
 
The BIG picture - Advanced data visualization for SDG, basic stock assessment...
The BIG picture - Advanced data visualization for SDG, basic stock assessment...The BIG picture - Advanced data visualization for SDG, basic stock assessment...
The BIG picture - Advanced data visualization for SDG, basic stock assessment...Blue BRIDGE
 
Global Record of Stocks and Fisheries (GRFS)
Global Record of Stocks and Fisheries (GRFS)Global Record of Stocks and Fisheries (GRFS)
Global Record of Stocks and Fisheries (GRFS)Blue BRIDGE
 
Projecting global fish stocks and catches up to 2100
Projecting global fish stocks and catches up to 2100Projecting global fish stocks and catches up to 2100
Projecting global fish stocks and catches up to 2100Blue BRIDGE
 
BlueBRIDGE: Major Achievements & future vision
BlueBRIDGE: Major Achievements & future visionBlueBRIDGE: Major Achievements & future vision
BlueBRIDGE: Major Achievements & future visionBlue BRIDGE
 
Managing tuna fisheries data at a global scale: the Tuna Atlas VRE
Managing tuna fisheries data at a global scale: the Tuna Atlas VREManaging tuna fisheries data at a global scale: the Tuna Atlas VRE
Managing tuna fisheries data at a global scale: the Tuna Atlas VREBlue BRIDGE
 
SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...
SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...
SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...Blue BRIDGE
 
The BlueBRIDGE Project - Pasquale Pagano
The BlueBRIDGE Project - Pasquale PaganoThe BlueBRIDGE Project - Pasquale Pagano
The BlueBRIDGE Project - Pasquale PaganoBlue BRIDGE
 
Thematic clouds for EOSC : The Food Cloud and the Blue Cloud
Thematic clouds for EOSC: The Food Cloud and the Blue Cloud�Thematic clouds for EOSC: The Food Cloud and the Blue Cloud�
Thematic clouds for EOSC : The Food Cloud and the Blue CloudBlue BRIDGE
 

Plus de Blue BRIDGE (20)

PerformFISH: Consumer Driven Production - Integrating Innovative Approaches f...
PerformFISH: Consumer Driven Production - Integrating Innovative Approaches f...PerformFISH: Consumer Driven Production - Integrating Innovative Approaches f...
PerformFISH: Consumer Driven Production - Integrating Innovative Approaches f...
 
BlueBRIDGE supporting education
BlueBRIDGE supporting educationBlueBRIDGE supporting education
BlueBRIDGE supporting education
 
LME: LEARN & IOC Capacity Building Activities
LME: LEARN & IOC Capacity Building ActivitiesLME: LEARN & IOC Capacity Building Activities
LME: LEARN & IOC Capacity Building Activities
 
Machine Learning methods to estimate the performance of aquafarms
Machine Learning methods to estimate the performance of aquafarms Machine Learning methods to estimate the performance of aquafarms
Machine Learning methods to estimate the performance of aquafarms
 
Environmental observation data to detect aquaculture structures: merging Cope...
Environmental observation data to detect aquaculture structures: merging Cope...Environmental observation data to detect aquaculture structures: merging Cope...
Environmental observation data to detect aquaculture structures: merging Cope...
 
Application of Earth Observation (EO) Data for Detection, Characterization an...
Application of Earth Observation (EO) Data for Detection, Characterization an...Application of Earth Observation (EO) Data for Detection, Characterization an...
Application of Earth Observation (EO) Data for Detection, Characterization an...
 
Capacity building, validation and repeatability
Capacity building, validation and repeatabilityCapacity building, validation and repeatability
Capacity building, validation and repeatability
 
Fostering global data management with public tuna fisheries data
Fostering global data management with public tuna fisheries dataFostering global data management with public tuna fisheries data
Fostering global data management with public tuna fisheries data
 
Understanding biodiversity features in marine protected areas
Understanding biodiversity features in marine protected areasUnderstanding biodiversity features in marine protected areas
Understanding biodiversity features in marine protected areas
 
Panel discussion on Global Repositories of Merged Public Data
Panel discussion on Global Repositories of Merged Public DataPanel discussion on Global Repositories of Merged Public Data
Panel discussion on Global Repositories of Merged Public Data
 
Invasive species and climate change
Invasive species and climate changeInvasive species and climate change
Invasive species and climate change
 
Blue Skills
Blue SkillsBlue Skills
Blue Skills
 
The BIG picture - Advanced data visualization for SDG, basic stock assessment...
The BIG picture - Advanced data visualization for SDG, basic stock assessment...The BIG picture - Advanced data visualization for SDG, basic stock assessment...
The BIG picture - Advanced data visualization for SDG, basic stock assessment...
 
Global Record of Stocks and Fisheries (GRFS)
Global Record of Stocks and Fisheries (GRFS)Global Record of Stocks and Fisheries (GRFS)
Global Record of Stocks and Fisheries (GRFS)
 
Projecting global fish stocks and catches up to 2100
Projecting global fish stocks and catches up to 2100Projecting global fish stocks and catches up to 2100
Projecting global fish stocks and catches up to 2100
 
BlueBRIDGE: Major Achievements & future vision
BlueBRIDGE: Major Achievements & future visionBlueBRIDGE: Major Achievements & future vision
BlueBRIDGE: Major Achievements & future vision
 
Managing tuna fisheries data at a global scale: the Tuna Atlas VRE
Managing tuna fisheries data at a global scale: the Tuna Atlas VREManaging tuna fisheries data at a global scale: the Tuna Atlas VRE
Managing tuna fisheries data at a global scale: the Tuna Atlas VRE
 
SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...
SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...
SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...
 
The BlueBRIDGE Project - Pasquale Pagano
The BlueBRIDGE Project - Pasquale PaganoThe BlueBRIDGE Project - Pasquale Pagano
The BlueBRIDGE Project - Pasquale Pagano
 
Thematic clouds for EOSC : The Food Cloud and the Blue Cloud
Thematic clouds for EOSC: The Food Cloud and the Blue Cloud�Thematic clouds for EOSC: The Food Cloud and the Blue Cloud�
Thematic clouds for EOSC : The Food Cloud and the Blue Cloud
 

Dernier

A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI AgeCprime
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityIES VE
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Farhan Tariq
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demoHarshalMandlekar2
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfpanagenda
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPathCommunity
 

Dernier (20)

A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI Age
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a reality
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to HeroUiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
 

How FAIR is GEOSS

  • 1. How FAIR is GEOSS S. Nativi (1), J. Van Bemmelen (2), M. Santoro (1), G. Colangeli (2) O. Ochiai (3), P. De Salvo (3) (1) Institute of Atmospheric Pollution Research, National Research Council of Italy (2) European Space Agency (3) GEO Secretariat BlueBRIDGE Workshop 3 April, 2017
  • 2. GEO AND GEOSS Group on Earth Observation and Global Earth Observation system of systems
  • 3. GEO AND GEOSS Group on Earth Observation and Global Earth Observation system of systems
  • 4. GEO AND GEOSS Group on Earth Observation and Global Earth Observation system of systems
  • 5. Global Earth Observation System of Systems (GEOSS) Together, the GEO community is creating a Global Earth Observation System of Systems (GEOSS). Earth observations from diverse sources, including satellite, airborne, in-situ platforms, and citizen observatories, when integrated together, provide powerful tools for understanding the past and present conditions of Earth systems, as well as the interplay between them. GEOSS aims to better integrate observing systems and share data by connecting existing infrastructures. There are more than 200 million open data resources in GEOSS from more than 150 national and regional providers such as NASA and ESA; international organizations such as WMO and the commercial sector such as Digital Globe.
  • 6. IMPLEMENTING GEOSS GEOSS Common Infrastructure (GCI)
  • 7. GEOSS Applications GEOSS Providers GEOSS Application Developers (intermediate Users) GEOSS end-Users GEOSS Applications GEOSS ApplicationsGEOSS Applications Enterprise System j … . Enterprise System 1 System 4Enterprise System 3 Enterprise System 2 … . … . … . SBA 1 SBA 2 SBA 8 Enterpris e System K Enterprise System 3 System 4 Enterpris e System 1 Enterprise System 2 Enterprise System Z Enterprise System 1 System 4Enterprise System 2 Enterprise System 3 GEOSS Portal DOWNSTREAM UPSTREAM MIDSTREAM GEOSS Common Infrastructure APIs Mediation modules
  • 8. Societal Benefit Areas Data Providers > 200 million data resources spanning all SBAs GCI M2M Registration GEOSS Common Infrastructure (GCI)
  • 9. Enhanced GEOSS Portal - Overview • Enhanced during 2016 • Accessible from www.geoportal.org • Coordinated with ESA, CNR-IIA, DG-RTD, DG-JRC and GeoSec • Focus on engagement, delivery and advocating • Structured in 3 phases • 1st phase – 2016: interface restyling: completed • 2nd phase – 2017/18: deployment of major upgrades • 3rd phase – 2019 onwards – operations and evolutions
  • 10. GEO Discovery and Access Broker (DAB) GEO DAB is a brokering framework that interconnects hundreds of heterogeneous and autonomous supply systems (the enterprise systems constituting the GEO metasystem) by providing mediation, harmonization and transformation capabilities.
  • 11. GEOSS FAIRNESS How GEOSS addresses FAIR Principles
  • 12. FINDABLE How GEOSS addresses FAIR Principles
  • 13. Discovery in GEOSS • GEOSS has to deal with the large amount of datasets provided by the end systems, e.g. millions of (small to medium size) products, and long EO time/space series. • GEOSS has to collect metadata (at least for harvested catalogs) and provide effective discoverability.
  • 14. Adopted Solutions • Dealing with such numbers, normally constrained queries commonly match a large number of datasets. • GCI addresses this challenge by returning a smaller and/or an ordered result sets. Views Ranking and Paging
  • 15. Ranking and Paging No-SQL DB Good performances on large stores No preliminary constraint on data structure Need to preliminarily index queryable elements GEO DAB Internal Metadata Model Pre-calculated in batch, based on: Metadata Quality Accessibility Etc. Calculated on-the-fly, based on: Query Constraints Applied to scores (configurable)
  • 16. GEOSS View • Definition: – Subset of the whole GEOSS resources defined by applying, via the DAB, a set of clauses • Discovery clauses (e.g. spatial envelope, keywords, sources, etc.) • Access clauses (e.g. data format, access protocol, CRS, etc.) – Defined “View” exposed on the GEOSS Portal Consumer-defined View – i.e. Client-side These views are available only for the client application which defined the view. Provider-defined View –i.e. Server-side These views are available for all client applications.
  • 18. Accessibility in GEOSS • In GEOSS, main Access related challenges include: – Visualization of data previews • provide a fast preview service allowing users quickly to evaluate discovered data before deciding the download. – Basic Transformations • provide users with an easy (i.e. transparent) access to the discovered data along with a set of basic data transformations to make them more easily processed
  • 19. Accessibility in GEOSS - Visualization • GEO DAB provides a fast preview service allowing to get data preview: – Metadata record is augmented by adding a reference to data preview; preview tiles at different zoom levels are generated in a batch mode. – To store and retrieve single tiles in an efficient way, GEO DAB utilizes a NoSQL key-value DB. – When available, GEO DAB utilizes data provider fast preview services by implementing the required mediation. • GEOSS Portal uses allows Users to quickly evaluate discovered data before deciding the download.
  • 20. Accessibility in GEOSS – Basic Transformations • In an environment such as GEOSS, no matter which technique is implemented there will always be cases in which the required processing is consuming too much time for a click-and-get pattern. • The DAB + GEOSS Portal access transformation allows to deliver discovered datasets according to a common grid: format, Coordinate Reference System, spatial and temporal extent and resolution. • Where this transformation workflow requires a long processing time, Users are allowed to opt for an asynchronous version of the same services.
  • 22. Interoperability in GEOSS More than 155 Brokered Systems About 200 M granules
  • 23. Adopted Solutions – GEO DAB • Introduction of a brokering tier (GEO DAB) dedicated to mediation of service interfaces and metadata models harmonization in a transparent way for both users and data providers. • The GEO DAB maps the diverse models onto its own internal model, which is general enough to comprise all the necessary concepts. • The key features of the GEO DAB internal data and metadata models are flexibility and extensibility allowing adding new concepts and related attributes. OGC CSW 2.0.2 AP ISO 1.0 INPE OGC CSW 2.0.2 ebRIM EO CKAN OGC CSW 2.0.2 ebRIM CIM DCAT ESRI GEOPORTAL 10 GI-cat OAI-PMH 2.0 ESRI GEOPORTAL 10 OpenSearch 1.1 NCML-OD OpenSearch 1.1 ESIP BCODMO OpenSearch GENESI DR NCML-CF CKAN NetCDF-CF 1.4 CUAHSI HIS-Central FTP populated with supported metadata types ESRI REST API 10.3 WAF Web Accessible Folders OGC WCS GeoNetwork (2.2.0 or greater) OGC WMS Ecological Markup Language2.1.1 OGC WFS 1.0.0, 1.1.0, 2.0.0 NERRS (National EstuarineResearch Reserve System) OGC WMTS HMA CSW 2.0.2 ebRIM/CIM OGC SOS 1.0.0, 2.0.0, 2.0.0 Hydro Profile HDF OGC WPS 1.0.0 IADC DB (MySQL) OGC CSW 2.0.0 Core GrADS-DS OGC CSW 2.0.2 AP ISO 1.0 FedEO OGC CSW 2.0.2 ebRIM/EO AP ARPA DB (based on Microsoft SQL) OGC CSW 2.0.2 ebRIM/CIM AP ESRI Map Server IRIS Station SHAPE files (FTP) IRIS Event KISTERS Web - Environment ofCanada HYRAX THREDDS SERVER 1.9 Environment Canada Hydrometric data (FTP) OAI-PMH 2.0 - Harvesting OpenSearch 1.1 GBIF Earth Engine DIF RASAQM HYDRO EGASKRO UNAVCO SITAD (Sistema Informativo TerritorialeAmbientaleDiffuso) CDI 1.04, 1.3, 1.4 FileSystem ISO19115-2 GDACS THREDDS 1.0.1, 1.0.2 GeoRSS 2.0 THREDDS-NCISO 1.0.1, 1.0.2 Degree catalog service2.2 THREDDS-NCISO-PLUS 1.0.1, 1.0.2 OpenSearch GENESI DR
  • 24. RE-USABLE How GEOSS addresses FAIR Principles
  • 25. Re-usability in GEOSS • In GEOSS, challenges related to Re-usability mainly stem from datasets heterogeneity. • In addition, GEOSS needs to address the requirement to support diverse (cross-)disciplinary applications targeting different Communities and User categories which have different needs, as for data discovery and presentation in an informative and significant way.
  • 26. Adopted Solutions – GEOSS Portal • User-centric, considering various user communities: • GEO Flagships and Global initiatives • ESA Thematic Exploitation Platforms • SBA/Thematic Customization of search and results visualization: – Satellite: includes smart filters for imagery (Landsat, Sentinel 2) and SAR-type (Sentinel 1) satellite data; – Disater Resilience SBA: Earthquake events filters • Focusing on providing resuable Portlets (for integration in external Community Applications)
  • 27. Adopted solutions – GEO DAB APIs Different APIs for serving diverse Application development use cases (environments) A set of standard Web service interfaces: • e.g. OGC service interfaces, CKAN, OAI-PMH, FTP, etc. A set of APIs for software developers: • Client side APIs: – (high-level) JavaScript library – … . (Python) • Server side APIs: – REST/JSON APIs – OpenSearch APIs – … . GEOSS Applications GEOSS Application Developers (intermediate Users) GEOSS end-Users GEOSS Applications GEOSS ApplicationsGEOSS Applications GEOSS Portal DOWNSTREAM MIDSTREAM GEOSS Common Infrastructure APIs Mediation modules
  • 28. Conclusions • In the past 10 years GEOSS has developed a truly Global and multidisciplinary System-of Systems • A valuable framework to experiment and learn how to deal Milti-disciplinary Interoperability challenges.. • The new GEOSS Portal + DAB platform signifcantly improved the discoverability and accessibility of sahred GEOSS resources, addressing more and more User requirements.