SlideShare une entreprise Scribd logo
1  sur  19
Télécharger pour lire hors ligne
EarthGrid
      Sharing data across networks


                  Ben Leinfelder

National Center for Ecological Analysis and Synthesis,
       University of California Santa Barbara


                       JAM 2008
                    October 22th, 2008
“Provide access to disparate
data on different networks.”
Knowledge Network for Biocomplexity
Metacat Data Repository



• Distributed data system

• Archive data and metadata

                              attr1 | attr2
                                attr1 | | attr2
                              ....      ....
                                .... | | | attr2
                              ....attr1 ....
                                          ....
                                .... | | | ....
                              ........ ....
                                          ....
                                .... | | | ....
                              ........ ....
                                          ....
                   <eml>        .... | | | ....
                              ........ ....
                                          ....
                       <dataset> .... | | ....
                     <eml>      ....      ....
                       <eml>
                         <dataset>....    | ....
                       ..........
                           <dataset>
                         ..........
                       </dataset>
                           ..........
                         </dataset>
                   </eml>
                     </eml></dataset>
                       </eml>
Global Metacat Deployments
Marine Cluster           South     Savannah Cluster
                            African
   Addo                      Data
                            Network
 Tsitsikama   Grahamstown             Phalabora


   Karoo




                                                   Mapungubwe
Cape Town U

               Cape Town
                             SAEON     Kruger        Marakele
Wilderness     San Parks


                                                   Mozambique




   AND                                            PISCO


   GCE           LTER        KNB II   KNB 1                ESA


 ... (26)                                         NCEAS



                    Knowledge Network for         OBFS
                     Biocomplexity (KNB)
KNB Global Data Distribution
Diverse Data Systems


• KNB Repository
  – Experimental data, survey data, spatial
    raster and vector data
  – Ecological Metadata Language (EML)


• KU DiGIR
  – Museum specimen collection and
    taxonomic information
  – Darwin Core

                           http://www.specifysoftware.org/Informatics/informaticsdigir
Synthetic Data Analysis


                            Publish specimen data


     Store specimen data




         Identify species
                                                  !
     Store observation data
                                        attr1 | attr2
                                          attr1 | | attr2
                                        ....      ....
                                          .... | | | attr2
                                        ....attr1 ....
                                                    ....
                                            .... | | ....
                                          .... | ....
                                        ....        ....
                                            .... | | ....
                                          .... | ....
                                        ....        ....

          Document data       <eml>
                               <eml>
                                 <eml>
                                            .... | | ....
                                          .... | ....
                                        ....
                                 <dataset>  .... | | ....
                                          ....
                                  <dataset> ....
                                                    ....
                                                    ....
                                                    | ....
                                                             Publish datasets
                                 ..........
                                     <dataset>
                                  ..........
                                 </dataset>
Morpho
                                     ..........
                                  </dataset>
                              </eml>
                               </eml></dataset>
                                 </eml>
EarthGrid Data Providers



• Light-weight interface to
  underlying systems                         a




                                 EarthGrid
• Hide complexity

• Low threshold for                          b

  implementation

                                             c
EarthGrid Data Consumers



• Standard communication protocol
• Common methods across systems

                  EarthGrid
 x                                           z


                         y

• Allows simplified data access by clients
• Exposes data to more software
The Usual Suspects



✓ Search
                                 EarthGrid
                                 Provider

✓ Authenticate

✓ Read

✓ Write
KNB Software Suite
<attribute id=quot;att.5quot;>
        <attributeName>avesr91</attributeName>
        <attributeLabel>Average Species Richness for 1991</attributeLabel>
        <attributeDefinition>The average species richness for the field in 1991
        </attributeDefinition>




                                                                                          Data Storage
                                 Metadata
        <storageType>float</storageType>
        <measurementScale>
          <ratio>


                                              <eml/>
            <unit><standardUnit>dimensionless</standardUnit></unit>
            <precision>0.1</precision>
            <numericDomain id=quot;nd.5quot;>
              <numberType>real</numberType>
              <bounds>
                <minimum exclusive=quot;truequot;>0</minimum>
              </bounds>
            </numericDomain>
          </ratio>
        </measurementScale>
      </attribute>




                                                                                                         You are here
                            Data Management




                                                                                  Data Analysis

                                              Morpho
EarthGrid Search in Kepler
Species Distribution Modeling
Distribution Predictions



Current           2020               2050
DataNetONE
             (Observation Network for Earth)



• ‘New institution’ for data preservation
DataNetONE
             (Observation Network for Earth)



• Scalable. Flexible. Sustainable.
Current        30+ years horizon               ????
Acknowledgements


• This material is based upon work supported by:
   – The National Science Foundation under Grant Numbers
     9980154 (KDI), 0618501 (FIRST) and 0225676 (SEEK).
   – The National Center for Ecological Analysis and Synthesis, a
     Center funded by NSF (Grant Number 0072909), the
     University of California, and the UC Santa Barbara campus.
   – The Andrew W. Mellon Foundation.
• Resources
   – http://www.nceas.ucsb.edu/ecoinfo
   – http://seek.ecoinformatics.org
   – http://knb.ecoinformatics.org
   – http://lno.lternet.edu/projects/pasta
   – http://sbc.lternet.edu
   –

Contenu connexe

Similaire à Leinfelder Earth Grid Jam2008

Resource scheduling algorithm
Resource scheduling algorithmResource scheduling algorithm
Resource scheduling algorithm
Shilpa Damor
 
Porting aodv uu implementation to ns-2
Porting aodv uu implementation to ns-2Porting aodv uu implementation to ns-2
Porting aodv uu implementation to ns-2
Xaris1985
 
NS-2 Manual
NS-2 ManualNS-2 Manual
NS-2 Manual
code453
 
Enhancing intelligence with the Internet of Things
Enhancing intelligence with the Internet of ThingsEnhancing intelligence with the Internet of Things
Enhancing intelligence with the Internet of Things
The Marketing Distillery
 
Unstructured Data and the Enterprise
Unstructured Data and the EnterpriseUnstructured Data and the Enterprise
Unstructured Data and the Enterprise
DATAVERSITY
 
Routing Protocols for Wireless Sensor Networks
Routing Protocols for Wireless Sensor NetworksRouting Protocols for Wireless Sensor Networks
Routing Protocols for Wireless Sensor Networks
Darpan Dekivadiya
 
Migrating to netcool precision for ip networks --best practices for migrating...
Migrating to netcool precision for ip networks --best practices for migrating...Migrating to netcool precision for ip networks --best practices for migrating...
Migrating to netcool precision for ip networks --best practices for migrating...
Banking at Ho Chi Minh city
 
XAdES Specification based on the Apache XMLSec Project
XAdES Specification based on the Apache XMLSec Project XAdES Specification based on the Apache XMLSec Project
XAdES Specification based on the Apache XMLSec Project
Krassen Deltchev
 
disertation_Pavel_Prochazka_A1
disertation_Pavel_Prochazka_A1disertation_Pavel_Prochazka_A1
disertation_Pavel_Prochazka_A1
Pavel Prochazka
 
&lt;img src="../i/r_14.png" />
&lt;img src="../i/r_14.png" />&lt;img src="../i/r_14.png" />
&lt;img src="../i/r_14.png" />
tutorialsruby
 
Perl &lt;b>5 Tutorial&lt;/b>, First Edition
Perl &lt;b>5 Tutorial&lt;/b>, First EditionPerl &lt;b>5 Tutorial&lt;/b>, First Edition
Perl &lt;b>5 Tutorial&lt;/b>, First Edition
tutorialsruby
 

Similaire à Leinfelder Earth Grid Jam2008 (20)

Resource scheduling algorithm
Resource scheduling algorithmResource scheduling algorithm
Resource scheduling algorithm
 
Porting aodv uu implementation to ns-2
Porting aodv uu implementation to ns-2Porting aodv uu implementation to ns-2
Porting aodv uu implementation to ns-2
 
NS-2 Manual
NS-2 ManualNS-2 Manual
NS-2 Manual
 
Data over dab
Data over dabData over dab
Data over dab
 
Enhancing intelligence with the Internet of Things
Enhancing intelligence with the Internet of ThingsEnhancing intelligence with the Internet of Things
Enhancing intelligence with the Internet of Things
 
Big data technologies : A survey
Big data technologies : A survey Big data technologies : A survey
Big data technologies : A survey
 
Hadoop as an extension of DW
Hadoop as an extension of DWHadoop as an extension of DW
Hadoop as an extension of DW
 
Unstructured Data and the Enterprise
Unstructured Data and the EnterpriseUnstructured Data and the Enterprise
Unstructured Data and the Enterprise
 
Routing Protocols for Wireless Sensor Networks
Routing Protocols for Wireless Sensor NetworksRouting Protocols for Wireless Sensor Networks
Routing Protocols for Wireless Sensor Networks
 
iGUARD: An Intelligent Way To Secure - Report
iGUARD: An Intelligent Way To Secure - ReportiGUARD: An Intelligent Way To Secure - Report
iGUARD: An Intelligent Way To Secure - Report
 
Master's Thesis
Master's ThesisMaster's Thesis
Master's Thesis
 
Migrating to netcool precision for ip networks --best practices for migrating...
Migrating to netcool precision for ip networks --best practices for migrating...Migrating to netcool precision for ip networks --best practices for migrating...
Migrating to netcool precision for ip networks --best practices for migrating...
 
report
reportreport
report
 
XAdES Specification based on the Apache XMLSec Project
XAdES Specification based on the Apache XMLSec Project XAdES Specification based on the Apache XMLSec Project
XAdES Specification based on the Apache XMLSec Project
 
disertation_Pavel_Prochazka_A1
disertation_Pavel_Prochazka_A1disertation_Pavel_Prochazka_A1
disertation_Pavel_Prochazka_A1
 
Sona project
Sona projectSona project
Sona project
 
Perl 5 guide
Perl 5 guidePerl 5 guide
Perl 5 guide
 
&lt;img src="../i/r_14.png" />
&lt;img src="../i/r_14.png" />&lt;img src="../i/r_14.png" />
&lt;img src="../i/r_14.png" />
 
Perl &lt;b>5 Tutorial&lt;/b>, First Edition
Perl &lt;b>5 Tutorial&lt;/b>, First EditionPerl &lt;b>5 Tutorial&lt;/b>, First Edition
Perl &lt;b>5 Tutorial&lt;/b>, First Edition
 
perltut
perltutperltut
perltut
 

Dernier

Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 

Dernier (20)

Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the Classroom
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 

Leinfelder Earth Grid Jam2008

  • 1. EarthGrid Sharing data across networks Ben Leinfelder National Center for Ecological Analysis and Synthesis, University of California Santa Barbara JAM 2008 October 22th, 2008
  • 2. “Provide access to disparate data on different networks.”
  • 3. Knowledge Network for Biocomplexity
  • 4. Metacat Data Repository • Distributed data system • Archive data and metadata attr1 | attr2 attr1 | | attr2 .... .... .... | | | attr2 ....attr1 .... .... .... | | | .... ........ .... .... .... | | | .... ........ .... .... <eml> .... | | | .... ........ .... .... <dataset> .... | | .... <eml> .... .... <eml> <dataset>.... | .... .......... <dataset> .......... </dataset> .......... </dataset> </eml> </eml></dataset> </eml>
  • 6. Marine Cluster South Savannah Cluster African Addo Data Network Tsitsikama Grahamstown Phalabora Karoo Mapungubwe Cape Town U Cape Town SAEON Kruger Marakele Wilderness San Parks Mozambique AND PISCO GCE LTER KNB II KNB 1 ESA ... (26) NCEAS Knowledge Network for OBFS Biocomplexity (KNB)
  • 7. KNB Global Data Distribution
  • 8. Diverse Data Systems • KNB Repository – Experimental data, survey data, spatial raster and vector data – Ecological Metadata Language (EML) • KU DiGIR – Museum specimen collection and taxonomic information – Darwin Core http://www.specifysoftware.org/Informatics/informaticsdigir
  • 9. Synthetic Data Analysis Publish specimen data Store specimen data Identify species ! Store observation data attr1 | attr2 attr1 | | attr2 .... .... .... | | | attr2 ....attr1 .... .... .... | | .... .... | .... .... .... .... | | .... .... | .... .... .... Document data <eml> <eml> <eml> .... | | .... .... | .... .... <dataset> .... | | .... .... <dataset> .... .... .... | .... Publish datasets .......... <dataset> .......... </dataset> Morpho .......... </dataset> </eml> </eml></dataset> </eml>
  • 10. EarthGrid Data Providers • Light-weight interface to underlying systems a EarthGrid • Hide complexity • Low threshold for b implementation c
  • 11. EarthGrid Data Consumers • Standard communication protocol • Common methods across systems EarthGrid x z y • Allows simplified data access by clients • Exposes data to more software
  • 12. The Usual Suspects ✓ Search EarthGrid Provider ✓ Authenticate ✓ Read ✓ Write
  • 13. KNB Software Suite <attribute id=quot;att.5quot;> <attributeName>avesr91</attributeName> <attributeLabel>Average Species Richness for 1991</attributeLabel> <attributeDefinition>The average species richness for the field in 1991 </attributeDefinition> Data Storage Metadata <storageType>float</storageType> <measurementScale> <ratio> <eml/> <unit><standardUnit>dimensionless</standardUnit></unit> <precision>0.1</precision> <numericDomain id=quot;nd.5quot;> <numberType>real</numberType> <bounds> <minimum exclusive=quot;truequot;>0</minimum> </bounds> </numericDomain> </ratio> </measurementScale> </attribute> You are here Data Management Data Analysis Morpho
  • 17. DataNetONE (Observation Network for Earth) • ‘New institution’ for data preservation
  • 18. DataNetONE (Observation Network for Earth) • Scalable. Flexible. Sustainable. Current 30+ years horizon ????
  • 19. Acknowledgements • This material is based upon work supported by: – The National Science Foundation under Grant Numbers 9980154 (KDI), 0618501 (FIRST) and 0225676 (SEEK). – The National Center for Ecological Analysis and Synthesis, a Center funded by NSF (Grant Number 0072909), the University of California, and the UC Santa Barbara campus. – The Andrew W. Mellon Foundation. • Resources – http://www.nceas.ucsb.edu/ecoinfo – http://seek.ecoinformatics.org – http://knb.ecoinformatics.org – http://lno.lternet.edu/projects/pasta – http://sbc.lternet.edu –