SlideShare une entreprise Scribd logo
1  sur  10
Télécharger pour lire hors ligne
TERN is supported by the Australian Government through the National Collaborative Research Infrastructure Strategy.
Australian Ecosystems
Science Cloud
overview
Presentation by Siddeswara Guru
Director, Data Science
Ecosystem science
• Inter-relationship among the living organisms, physical features, bio-chemical
processes, natural phenomena, and human activities in ecological communtiies1
• Focusing on Terrestrial Ecosystem
– Terrestrial Ecosystem Research Network
– Atlas of Living Australia
• Data is heterogeneous: wide variety from different domain
– Observation (human, in-situ sensors and satellite remote sensing)
– Variety of scale: spatial and temporal
– Different data formats used in the community
Data Use
• Conventional data access
– Need to find data
– Access via services
– copy from source to destination for further for
large datasets
Image from internet
Storage and Compute
• Advent of NeCTAR and RDS
– Researchers are moving data and computation to
cloud.
– Building tools (Virtual labs, research tools and
platforms)
– However, easy accessibility of data is still an issue
• Multiple interfaces to search for data
• No clear access mechanism from different nodes
Goal
• Offer open data platform: harmonised cloud-enabled data
infrastructure for data interoperability with simplified service
model
• Offer compute next to data to minimise data movement
• Data accessibility to different research platforms and virtual
labs from common platform
• Offer scalable managed computing environment with access
to distributed and data-intensive computation technologies
• develop a support system for a cross-discipline use of data
User Stories
• As an ecosystem science continental-scale gridded data user, I wants to query a dataset, perform
spatial and temporal sub-setting of data, access and use that data from a cloud platform as a local
file so that I can work on further analyses.
• As an application developer, I need enough compute and storage for short period of time to run a
distributed large-scale data intensive application so that the output of the analyses are available in
decent amount of time.
• As a regular ecology data user, I need a easily accessible cloud compute platform with common
tools (Rstudio, Jupyter Python, NetCDF viewer, spatial data viewer, CSV file viewer) attached with
the TERN ecology and biophysical data collection so that I can build applications for analysis and
synthesis.
• As a data intensive application developer, I need a flexible approach to create and access to Hadoop
cluster so that I can distribute my computation.
• As a data user, I want an easy access to reference datasets with compute resources so that I can use
them in my analysis and research work.
• As a ecosystem data user, I want a one stop-shop to search, query and access ecosystem data and
use in my analysis so that I don't have to go through multiple portals to access and use data.
• As an application developer, I want a cloud platform to run my simulation with a local access to data
so that I don't move data around or download into my desktop.
High-level conceptual Architecture
Current status
• Setup a Technical Advisory Group advice on the scoping and
implementation of the project.
• In the first iteration: reference datasets will be made available
– Remote sensing reference data (fractional Cover)
– Long-term ecological monitoring data
– Climate variables
• Scoping the mediation layer and overall architecture
• Building a coalition of willing for partnership and collaboration
Contributions
• NeCTAR – Major project sponsor
• TERN, ALA – NCRIS Domain Projects, partners
• QCIF - implementation partner
• NCI – collaborator, partners
contact
Siddeswara Guru: s.guru@uq.edu.au
Hamish Holewa : hholewa@quadrant.edu.au

Contenu connexe

Tendances

Unlocking the geospatial potential of survey data
Unlocking the geospatial potential of survey dataUnlocking the geospatial potential of survey data
Unlocking the geospatial potential of survey datatomensom
 
How to use NCI's national repository of big spatial data collections
How to use NCI's national repository of big spatial data collectionsHow to use NCI's national repository of big spatial data collections
How to use NCI's national repository of big spatial data collectionsARDC
 
Drones in the Earth Sciences - Opportunities and issues
Drones in the Earth Sciences - Opportunities and issuesDrones in the Earth Sciences - Opportunities and issues
Drones in the Earth Sciences - Opportunities and issuesARDC
 
EcoTas13 BradEvans e-MAST framework
EcoTas13 BradEvans e-MAST frameworkEcoTas13 BradEvans e-MAST framework
EcoTas13 BradEvans e-MAST frameworkTERN Australia
 
Metadata Standards in CKAN for Biodiversity Pilot in NextGEOSS
Metadata Standards in CKAN for Biodiversity Pilot in NextGEOSSMetadata Standards in CKAN for Biodiversity Pilot in NextGEOSS
Metadata Standards in CKAN for Biodiversity Pilot in NextGEOSSplan4all
 
GRASP 2-page Overview - June 2016
GRASP 2-page Overview - June 2016GRASP 2-page Overview - June 2016
GRASP 2-page Overview - June 2016David Jarvis
 
Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...
Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...
Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...lleonardSlideShare
 
AURIN - Overview
AURIN - OverviewAURIN - Overview
AURIN - OverviewARDC
 
AusCover portal presentation
AusCover portal presentationAusCover portal presentation
AusCover portal presentationTERN Australia
 
Remote sensing of biophysical parameters: linking field, airborne and contine...
Remote sensing of biophysical parameters: linking field, airborne and contine...Remote sensing of biophysical parameters: linking field, airborne and contine...
Remote sensing of biophysical parameters: linking field, airborne and contine...TERN Australia
 
Ncris and the virtual labs
Ncris and the virtual labsNcris and the virtual labs
Ncris and the virtual labsARDC
 
K venkata reddy
K venkata reddyK venkata reddy
K venkata reddyClimDev15
 
Aus cover perth 6 june 2016
Aus cover perth 6 june 2016Aus cover perth 6 june 2016
Aus cover perth 6 june 2016bensparrowau
 
Apha - David Fouracre - Asian Hornet - Bee Prepared
Apha - David Fouracre - Asian Hornet - Bee PreparedApha - David Fouracre - Asian Hornet - Bee Prepared
Apha - David Fouracre - Asian Hornet - Bee PreparedEsri UK
 
Esri Scotland Conf 2016 - Atmos
Esri Scotland Conf 2016 - AtmosEsri Scotland Conf 2016 - Atmos
Esri Scotland Conf 2016 - AtmosEsri UK
 
TERN Facility Portals - Stuart Phinn
TERN Facility Portals - Stuart PhinnTERN Facility Portals - Stuart Phinn
TERN Facility Portals - Stuart PhinnTERN Australia
 

Tendances (20)

Unlocking the geospatial potential of survey data
Unlocking the geospatial potential of survey dataUnlocking the geospatial potential of survey data
Unlocking the geospatial potential of survey data
 
How to use NCI's national repository of big spatial data collections
How to use NCI's national repository of big spatial data collectionsHow to use NCI's national repository of big spatial data collections
How to use NCI's national repository of big spatial data collections
 
Drones in the Earth Sciences - Opportunities and issues
Drones in the Earth Sciences - Opportunities and issuesDrones in the Earth Sciences - Opportunities and issues
Drones in the Earth Sciences - Opportunities and issues
 
EcoTas13 BradEvans e-MAST framework
EcoTas13 BradEvans e-MAST frameworkEcoTas13 BradEvans e-MAST framework
EcoTas13 BradEvans e-MAST framework
 
Cool Tools Esri ArcGIS
Cool Tools Esri ArcGISCool Tools Esri ArcGIS
Cool Tools Esri ArcGIS
 
Metadata Standards in CKAN for Biodiversity Pilot in NextGEOSS
Metadata Standards in CKAN for Biodiversity Pilot in NextGEOSSMetadata Standards in CKAN for Biodiversity Pilot in NextGEOSS
Metadata Standards in CKAN for Biodiversity Pilot in NextGEOSS
 
GRASP 2-page Overview - June 2016
GRASP 2-page Overview - June 2016GRASP 2-page Overview - June 2016
GRASP 2-page Overview - June 2016
 
Conservation Innovation - Tools and Trends in GIS
Conservation Innovation - Tools and Trends in GISConservation Innovation - Tools and Trends in GIS
Conservation Innovation - Tools and Trends in GIS
 
Terra Populus Overview Poster
Terra Populus Overview PosterTerra Populus Overview Poster
Terra Populus Overview Poster
 
Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...
Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...
Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...
 
EcoTas13 Turner AEKOS
EcoTas13 Turner AEKOSEcoTas13 Turner AEKOS
EcoTas13 Turner AEKOS
 
AURIN - Overview
AURIN - OverviewAURIN - Overview
AURIN - Overview
 
AusCover portal presentation
AusCover portal presentationAusCover portal presentation
AusCover portal presentation
 
Remote sensing of biophysical parameters: linking field, airborne and contine...
Remote sensing of biophysical parameters: linking field, airborne and contine...Remote sensing of biophysical parameters: linking field, airborne and contine...
Remote sensing of biophysical parameters: linking field, airborne and contine...
 
Ncris and the virtual labs
Ncris and the virtual labsNcris and the virtual labs
Ncris and the virtual labs
 
K venkata reddy
K venkata reddyK venkata reddy
K venkata reddy
 
Aus cover perth 6 june 2016
Aus cover perth 6 june 2016Aus cover perth 6 june 2016
Aus cover perth 6 june 2016
 
Apha - David Fouracre - Asian Hornet - Bee Prepared
Apha - David Fouracre - Asian Hornet - Bee PreparedApha - David Fouracre - Asian Hornet - Bee Prepared
Apha - David Fouracre - Asian Hornet - Bee Prepared
 
Esri Scotland Conf 2016 - Atmos
Esri Scotland Conf 2016 - AtmosEsri Scotland Conf 2016 - Atmos
Esri Scotland Conf 2016 - Atmos
 
TERN Facility Portals - Stuart Phinn
TERN Facility Portals - Stuart PhinnTERN Facility Portals - Stuart Phinn
TERN Facility Portals - Stuart Phinn
 

En vedette

Indigenous Land Management - Dean Yibarbuk
Indigenous Land Management - Dean YibarbukIndigenous Land Management - Dean Yibarbuk
Indigenous Land Management - Dean YibarbukTERN Australia
 
Supersite field survey protocol development
Supersite field survey protocol developmentSupersite field survey protocol development
Supersite field survey protocol developmentTERN Australia
 
TERN: Data infrastructure that enables fire management
TERN: Data infrastructure that enables fire managementTERN: Data infrastructure that enables fire management
TERN: Data infrastructure that enables fire managementTERN Australia
 
TERN Australian Transect Network ATBC 2014
TERN Australian Transect Network ATBC 2014TERN Australian Transect Network ATBC 2014
TERN Australian Transect Network ATBC 2014TERN Australia
 
Taylor neon pheno_cam_2014_aceas
Taylor neon pheno_cam_2014_aceasTaylor neon pheno_cam_2014_aceas
Taylor neon pheno_cam_2014_aceasaceas13tern
 
Matt Bradford_Error and precision in rainforest biomass estimations
Matt Bradford_Error and precision in rainforest biomass estimationsMatt Bradford_Error and precision in rainforest biomass estimations
Matt Bradford_Error and precision in rainforest biomass estimationsTERN Australia
 
Developing an Australian phenology monitoring network, Tim Brown, ACEAS Grand...
Developing an Australian phenology monitoring network, Tim Brown, ACEAS Grand...Developing an Australian phenology monitoring network, Tim Brown, ACEAS Grand...
Developing an Australian phenology monitoring network, Tim Brown, ACEAS Grand...aceas13tern
 
Swana E Session Invasives Web
Swana E Session Invasives WebSwana E Session Invasives Web
Swana E Session Invasives WebBrian Tippetts
 
David Lindenmayer_Successful delivery of critical ecosystem research infrastr...
David Lindenmayer_Successful delivery of critical ecosystem research infrastr...David Lindenmayer_Successful delivery of critical ecosystem research infrastr...
David Lindenmayer_Successful delivery of critical ecosystem research infrastr...TERN Australia
 
Alan Andersen_Subcontinental-scale transects for assessing and monitoring eco...
Alan Andersen_Subcontinental-scale transects for assessing and monitoring eco...Alan Andersen_Subcontinental-scale transects for assessing and monitoring eco...
Alan Andersen_Subcontinental-scale transects for assessing and monitoring eco...TERN Australia
 
Monitoring Ecological Restoration: Measuring Change and Seeing Results
Monitoring Ecological Restoration: Measuring Change and Seeing ResultsMonitoring Ecological Restoration: Measuring Change and Seeing Results
Monitoring Ecological Restoration: Measuring Change and Seeing ResultsRolf Gersonde
 
Dan Metcalfe_Long-term monitoring of tropical rainforests of eastern Australia
Dan Metcalfe_Long-term monitoring of tropical rainforests of eastern AustraliaDan Metcalfe_Long-term monitoring of tropical rainforests of eastern Australia
Dan Metcalfe_Long-term monitoring of tropical rainforests of eastern AustraliaTERN Australia
 
Fire is not fire: the next generation of TERN fire remote sensing datasets
Fire is not fire: the next generation of TERN fire remote sensing datasetsFire is not fire: the next generation of TERN fire remote sensing datasets
Fire is not fire: the next generation of TERN fire remote sensing datasetsTERN Australia
 
Restrepo Huete phenocams ACEAS 140311
Restrepo Huete phenocams ACEAS 140311Restrepo Huete phenocams ACEAS 140311
Restrepo Huete phenocams ACEAS 140311Alison Specht
 
Ian Grant_An improved satellite-based long record of Australian vegetation dy...
Ian Grant_An improved satellite-based long record of Australian vegetation dy...Ian Grant_An improved satellite-based long record of Australian vegetation dy...
Ian Grant_An improved satellite-based long record of Australian vegetation dy...TERN Australia
 
Estimación de superficie zafra 2013-2014
Estimación de superficie zafra 2013-2014Estimación de superficie zafra 2013-2014
Estimación de superficie zafra 2013-2014Miguel Rivera
 
Foundations and methods of stochastic simulation
Foundations and methods of stochastic simulationFoundations and methods of stochastic simulation
Foundations and methods of stochastic simulationSpringer
 

En vedette (20)

AusPlots
AusPlotsAusPlots
AusPlots
 
Indigenous Land Management - Dean Yibarbuk
Indigenous Land Management - Dean YibarbukIndigenous Land Management - Dean Yibarbuk
Indigenous Land Management - Dean Yibarbuk
 
Supersite field survey protocol development
Supersite field survey protocol developmentSupersite field survey protocol development
Supersite field survey protocol development
 
TERN: Data infrastructure that enables fire management
TERN: Data infrastructure that enables fire managementTERN: Data infrastructure that enables fire management
TERN: Data infrastructure that enables fire management
 
TERN Australian Transect Network ATBC 2014
TERN Australian Transect Network ATBC 2014TERN Australian Transect Network ATBC 2014
TERN Australian Transect Network ATBC 2014
 
Taylor neon pheno_cam_2014_aceas
Taylor neon pheno_cam_2014_aceasTaylor neon pheno_cam_2014_aceas
Taylor neon pheno_cam_2014_aceas
 
Matt Bradford_Error and precision in rainforest biomass estimations
Matt Bradford_Error and precision in rainforest biomass estimationsMatt Bradford_Error and precision in rainforest biomass estimations
Matt Bradford_Error and precision in rainforest biomass estimations
 
Science Seminar Series 10 Andrew Lowe
Science Seminar Series 10 Andrew LoweScience Seminar Series 10 Andrew Lowe
Science Seminar Series 10 Andrew Lowe
 
Developing an Australian phenology monitoring network, Tim Brown, ACEAS Grand...
Developing an Australian phenology monitoring network, Tim Brown, ACEAS Grand...Developing an Australian phenology monitoring network, Tim Brown, ACEAS Grand...
Developing an Australian phenology monitoring network, Tim Brown, ACEAS Grand...
 
Swana E Session Invasives Web
Swana E Session Invasives WebSwana E Session Invasives Web
Swana E Session Invasives Web
 
David Lindenmayer_Successful delivery of critical ecosystem research infrastr...
David Lindenmayer_Successful delivery of critical ecosystem research infrastr...David Lindenmayer_Successful delivery of critical ecosystem research infrastr...
David Lindenmayer_Successful delivery of critical ecosystem research infrastr...
 
Alan Andersen_Subcontinental-scale transects for assessing and monitoring eco...
Alan Andersen_Subcontinental-scale transects for assessing and monitoring eco...Alan Andersen_Subcontinental-scale transects for assessing and monitoring eco...
Alan Andersen_Subcontinental-scale transects for assessing and monitoring eco...
 
Monitoring Ecological Restoration: Measuring Change and Seeing Results
Monitoring Ecological Restoration: Measuring Change and Seeing ResultsMonitoring Ecological Restoration: Measuring Change and Seeing Results
Monitoring Ecological Restoration: Measuring Change and Seeing Results
 
Dan Metcalfe_Long-term monitoring of tropical rainforests of eastern Australia
Dan Metcalfe_Long-term monitoring of tropical rainforests of eastern AustraliaDan Metcalfe_Long-term monitoring of tropical rainforests of eastern Australia
Dan Metcalfe_Long-term monitoring of tropical rainforests of eastern Australia
 
Fire is not fire: the next generation of TERN fire remote sensing datasets
Fire is not fire: the next generation of TERN fire remote sensing datasetsFire is not fire: the next generation of TERN fire remote sensing datasets
Fire is not fire: the next generation of TERN fire remote sensing datasets
 
Huete Training Phenology Kku
Huete Training Phenology KkuHuete Training Phenology Kku
Huete Training Phenology Kku
 
Restrepo Huete phenocams ACEAS 140311
Restrepo Huete phenocams ACEAS 140311Restrepo Huete phenocams ACEAS 140311
Restrepo Huete phenocams ACEAS 140311
 
Ian Grant_An improved satellite-based long record of Australian vegetation dy...
Ian Grant_An improved satellite-based long record of Australian vegetation dy...Ian Grant_An improved satellite-based long record of Australian vegetation dy...
Ian Grant_An improved satellite-based long record of Australian vegetation dy...
 
Estimación de superficie zafra 2013-2014
Estimación de superficie zafra 2013-2014Estimación de superficie zafra 2013-2014
Estimación de superficie zafra 2013-2014
 
Foundations and methods of stochastic simulation
Foundations and methods of stochastic simulationFoundations and methods of stochastic simulation
Foundations and methods of stochastic simulation
 

Similaire à Australian Ecosystems Science Cloud

IPRES 2014 paper presentation: significant environment information for LTDP
IPRES 2014 paper presentation: significant environment information for LTDPIPRES 2014 paper presentation: significant environment information for LTDP
IPRES 2014 paper presentation: significant environment information for LTDPFabio Corubolo
 
Australia's Environmental Predictive Capability
Australia's Environmental Predictive CapabilityAustralia's Environmental Predictive Capability
Australia's Environmental Predictive CapabilityTERN Australia
 
E research attachment survey
E research attachment surveyE research attachment survey
E research attachment surveyRiri Kusumarani
 
High Performance Data Analytics and a Java Grande Run Time
High Performance Data Analytics and a Java Grande Run TimeHigh Performance Data Analytics and a Java Grande Run Time
High Performance Data Analytics and a Java Grande Run TimeGeoffrey Fox
 
Research methods group accelarating impact by sharing data
Research methods group  accelarating impact by sharing dataResearch methods group  accelarating impact by sharing data
Research methods group accelarating impact by sharing dataWorld Agroforestry (ICRAF)
 
Open Source and Science at the National Science Foundation (NSF)
Open Source and Science at the National Science Foundation (NSF)Open Source and Science at the National Science Foundation (NSF)
Open Source and Science at the National Science Foundation (NSF)Daniel S. Katz
 
Analyzing Big Data in Medicine with Virtual Research Environments and Microse...
Analyzing Big Data in Medicine with Virtual Research Environments and Microse...Analyzing Big Data in Medicine with Virtual Research Environments and Microse...
Analyzing Big Data in Medicine with Virtual Research Environments and Microse...Ola Spjuth
 
Virtual research environments for implementing long tail open science
Virtual research environments for implementing long tail open scienceVirtual research environments for implementing long tail open science
Virtual research environments for implementing long tail open scienceBlue BRIDGE
 
Adoption of Cloud Computing in Scientific Research
Adoption of Cloud Computing in Scientific ResearchAdoption of Cloud Computing in Scientific Research
Adoption of Cloud Computing in Scientific ResearchYehia El-khatib
 
160905 tryggve-at-eccb pursula
160905 tryggve-at-eccb pursula160905 tryggve-at-eccb pursula
160905 tryggve-at-eccb pursulaanttipursula
 
Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...
Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...
Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...SEAD
 
Interoperability and scalability with microservices in science
Interoperability and scalability with microservices in scienceInteroperability and scalability with microservices in science
Interoperability and scalability with microservices in scienceOla Spjuth
 
e-infrastructural needs to support informatics
e-infrastructural needs to support informaticse-infrastructural needs to support informatics
e-infrastructural needs to support informaticsDavid Wallom
 
A Method to Select e-Infrastructure Components to Sustain
A Method to Select e-Infrastructure Components to SustainA Method to Select e-Infrastructure Components to Sustain
A Method to Select e-Infrastructure Components to SustainDaniel S. Katz
 
Synergy 2014 - Syn122 Moving Australian National Research into the Cloud
Synergy 2014 - Syn122 Moving Australian National Research into the CloudSynergy 2014 - Syn122 Moving Australian National Research into the Cloud
Synergy 2014 - Syn122 Moving Australian National Research into the CloudCitrix
 
Utilising Cloud Computing for Research through Infrastructure, Software and D...
Utilising Cloud Computing for Research through Infrastructure, Software and D...Utilising Cloud Computing for Research through Infrastructure, Software and D...
Utilising Cloud Computing for Research through Infrastructure, Software and D...David Wallom
 
Why we need PIDs for Structural Biology - EOSC Symposium, Budapest, 2019
Why we need PIDs for Structural Biology - EOSC Symposium, Budapest, 2019Why we need PIDs for Structural Biology - EOSC Symposium, Budapest, 2019
Why we need PIDs for Structural Biology - EOSC Symposium, Budapest, 2019Marcus Povey
 

Similaire à Australian Ecosystems Science Cloud (20)

IPRES 2014 paper presentation: significant environment information for LTDP
IPRES 2014 paper presentation: significant environment information for LTDPIPRES 2014 paper presentation: significant environment information for LTDP
IPRES 2014 paper presentation: significant environment information for LTDP
 
Australia's Environmental Predictive Capability
Australia's Environmental Predictive CapabilityAustralia's Environmental Predictive Capability
Australia's Environmental Predictive Capability
 
E research attachment survey
E research attachment surveyE research attachment survey
E research attachment survey
 
Shifting the Burden from the User to the Data Provider
Shifting the Burden from the User to the Data ProviderShifting the Burden from the User to the Data Provider
Shifting the Burden from the User to the Data Provider
 
High Performance Data Analytics and a Java Grande Run Time
High Performance Data Analytics and a Java Grande Run TimeHigh Performance Data Analytics and a Java Grande Run Time
High Performance Data Analytics and a Java Grande Run Time
 
Research methods group accelarating impact by sharing data
Research methods group  accelarating impact by sharing dataResearch methods group  accelarating impact by sharing data
Research methods group accelarating impact by sharing data
 
Open Source and Science at the National Science Foundation (NSF)
Open Source and Science at the National Science Foundation (NSF)Open Source and Science at the National Science Foundation (NSF)
Open Source and Science at the National Science Foundation (NSF)
 
Analyzing Big Data in Medicine with Virtual Research Environments and Microse...
Analyzing Big Data in Medicine with Virtual Research Environments and Microse...Analyzing Big Data in Medicine with Virtual Research Environments and Microse...
Analyzing Big Data in Medicine with Virtual Research Environments and Microse...
 
Sgci esip-7-20-18
Sgci esip-7-20-18Sgci esip-7-20-18
Sgci esip-7-20-18
 
Virtual research environments for implementing long tail open science
Virtual research environments for implementing long tail open scienceVirtual research environments for implementing long tail open science
Virtual research environments for implementing long tail open science
 
Adoption of Cloud Computing in Scientific Research
Adoption of Cloud Computing in Scientific ResearchAdoption of Cloud Computing in Scientific Research
Adoption of Cloud Computing in Scientific Research
 
160905 tryggve-at-eccb pursula
160905 tryggve-at-eccb pursula160905 tryggve-at-eccb pursula
160905 tryggve-at-eccb pursula
 
Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...
Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...
Changing the Curation Equation: A Data Lifecycle Approach to Lowering Costs a...
 
Interoperability and scalability with microservices in science
Interoperability and scalability with microservices in scienceInteroperability and scalability with microservices in science
Interoperability and scalability with microservices in science
 
e-infrastructural needs to support informatics
e-infrastructural needs to support informaticse-infrastructural needs to support informatics
e-infrastructural needs to support informatics
 
A Method to Select e-Infrastructure Components to Sustain
A Method to Select e-Infrastructure Components to SustainA Method to Select e-Infrastructure Components to Sustain
A Method to Select e-Infrastructure Components to Sustain
 
FAIR play?
FAIR play? FAIR play?
FAIR play?
 
Synergy 2014 - Syn122 Moving Australian National Research into the Cloud
Synergy 2014 - Syn122 Moving Australian National Research into the CloudSynergy 2014 - Syn122 Moving Australian National Research into the Cloud
Synergy 2014 - Syn122 Moving Australian National Research into the Cloud
 
Utilising Cloud Computing for Research through Infrastructure, Software and D...
Utilising Cloud Computing for Research through Infrastructure, Software and D...Utilising Cloud Computing for Research through Infrastructure, Software and D...
Utilising Cloud Computing for Research through Infrastructure, Software and D...
 
Why we need PIDs for Structural Biology - EOSC Symposium, Budapest, 2019
Why we need PIDs for Structural Biology - EOSC Symposium, Budapest, 2019Why we need PIDs for Structural Biology - EOSC Symposium, Budapest, 2019
Why we need PIDs for Structural Biology - EOSC Symposium, Budapest, 2019
 

Plus de TERN Australia

Careers Grounded in Soils
Careers Grounded in SoilsCareers Grounded in Soils
Careers Grounded in SoilsTERN Australia
 
TERN Australia Soil & Herbarium Collection Brochure
TERN Australia Soil & Herbarium Collection BrochureTERN Australia Soil & Herbarium Collection Brochure
TERN Australia Soil & Herbarium Collection BrochureTERN Australia
 
Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021
Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021
Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021TERN Australia
 
Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021
Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021
Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021TERN Australia
 
MER Pilot Network flyer 2020
MER Pilot Network flyer 2020MER Pilot Network flyer 2020
MER Pilot Network flyer 2020TERN Australia
 
Biodiversity Management in Tasmania's Temperate Native Forests
Biodiversity Management in Tasmania's Temperate Native ForestsBiodiversity Management in Tasmania's Temperate Native Forests
Biodiversity Management in Tasmania's Temperate Native ForestsTERN Australia
 
Observing Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for SustainabilityObserving Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for SustainabilityTERN Australia
 
Observing Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for SustainabilityObserving Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for SustainabilityTERN Australia
 
Dr Michael Mirtl (ILTER Chair) presenting at the AusLTER Forum 2018
Dr Michael Mirtl  (ILTER Chair) presenting at the AusLTER Forum 2018Dr Michael Mirtl  (ILTER Chair) presenting at the AusLTER Forum 2018
Dr Michael Mirtl (ILTER Chair) presenting at the AusLTER Forum 2018TERN Australia
 
Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...
Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...
Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...TERN Australia
 
Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...
Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...
Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...TERN Australia
 
Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...
Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...
Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...TERN Australia
 
Yuxia Liu Phenology 2018 poster on tracking grass phenology
Yuxia Liu Phenology 2018 poster on tracking grass phenologyYuxia Liu Phenology 2018 poster on tracking grass phenology
Yuxia Liu Phenology 2018 poster on tracking grass phenologyTERN Australia
 
Qiaoyun Xie Phenology 2018 presentation on agricultural phenology
Qiaoyun Xie Phenology 2018 presentation on agricultural phenologyQiaoyun Xie Phenology 2018 presentation on agricultural phenology
Qiaoyun Xie Phenology 2018 presentation on agricultural phenologyTERN Australia
 
Ha Nguyen Phenology 2018 presentation on Melbourne pollen trends
Ha Nguyen Phenology 2018 presentation on Melbourne pollen trendsHa Nguyen Phenology 2018 presentation on Melbourne pollen trends
Ha Nguyen Phenology 2018 presentation on Melbourne pollen trendsTERN Australia
 
Paul Beggs Phenology 2018 presentation on AusPollen
Paul Beggs Phenology 2018 presentation on AusPollenPaul Beggs Phenology 2018 presentation on AusPollen
Paul Beggs Phenology 2018 presentation on AusPollenTERN Australia
 
GEOSS Ecosystem Mapping for Australia
GEOSS Ecosystem Mapping for AustraliaGEOSS Ecosystem Mapping for Australia
GEOSS Ecosystem Mapping for AustraliaTERN Australia
 
TERN Ecosystem Surveillance Plots Roy Hill Station
TERN Ecosystem Surveillance Plots Roy Hill StationTERN Ecosystem Surveillance Plots Roy Hill Station
TERN Ecosystem Surveillance Plots Roy Hill StationTERN Australia
 
TERN Ecosystem Surveillance Plots Kakadu National Park
TERN Ecosystem Surveillance Plots Kakadu National ParkTERN Ecosystem Surveillance Plots Kakadu National Park
TERN Ecosystem Surveillance Plots Kakadu National ParkTERN Australia
 
TERN Ecosystem Surveillance Plots South Australian Murray Darling Basin NRM R...
TERN Ecosystem Surveillance Plots South Australian Murray Darling Basin NRM R...TERN Ecosystem Surveillance Plots South Australian Murray Darling Basin NRM R...
TERN Ecosystem Surveillance Plots South Australian Murray Darling Basin NRM R...TERN Australia
 

Plus de TERN Australia (20)

Careers Grounded in Soils
Careers Grounded in SoilsCareers Grounded in Soils
Careers Grounded in Soils
 
TERN Australia Soil & Herbarium Collection Brochure
TERN Australia Soil & Herbarium Collection BrochureTERN Australia Soil & Herbarium Collection Brochure
TERN Australia Soil & Herbarium Collection Brochure
 
Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021
Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021
Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021
 
Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021
Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021
Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021
 
MER Pilot Network flyer 2020
MER Pilot Network flyer 2020MER Pilot Network flyer 2020
MER Pilot Network flyer 2020
 
Biodiversity Management in Tasmania's Temperate Native Forests
Biodiversity Management in Tasmania's Temperate Native ForestsBiodiversity Management in Tasmania's Temperate Native Forests
Biodiversity Management in Tasmania's Temperate Native Forests
 
Observing Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for SustainabilityObserving Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for Sustainability
 
Observing Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for SustainabilityObserving Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for Sustainability
 
Dr Michael Mirtl (ILTER Chair) presenting at the AusLTER Forum 2018
Dr Michael Mirtl  (ILTER Chair) presenting at the AusLTER Forum 2018Dr Michael Mirtl  (ILTER Chair) presenting at the AusLTER Forum 2018
Dr Michael Mirtl (ILTER Chair) presenting at the AusLTER Forum 2018
 
Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...
Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...
Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...
 
Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...
Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...
Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...
 
Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...
Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...
Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...
 
Yuxia Liu Phenology 2018 poster on tracking grass phenology
Yuxia Liu Phenology 2018 poster on tracking grass phenologyYuxia Liu Phenology 2018 poster on tracking grass phenology
Yuxia Liu Phenology 2018 poster on tracking grass phenology
 
Qiaoyun Xie Phenology 2018 presentation on agricultural phenology
Qiaoyun Xie Phenology 2018 presentation on agricultural phenologyQiaoyun Xie Phenology 2018 presentation on agricultural phenology
Qiaoyun Xie Phenology 2018 presentation on agricultural phenology
 
Ha Nguyen Phenology 2018 presentation on Melbourne pollen trends
Ha Nguyen Phenology 2018 presentation on Melbourne pollen trendsHa Nguyen Phenology 2018 presentation on Melbourne pollen trends
Ha Nguyen Phenology 2018 presentation on Melbourne pollen trends
 
Paul Beggs Phenology 2018 presentation on AusPollen
Paul Beggs Phenology 2018 presentation on AusPollenPaul Beggs Phenology 2018 presentation on AusPollen
Paul Beggs Phenology 2018 presentation on AusPollen
 
GEOSS Ecosystem Mapping for Australia
GEOSS Ecosystem Mapping for AustraliaGEOSS Ecosystem Mapping for Australia
GEOSS Ecosystem Mapping for Australia
 
TERN Ecosystem Surveillance Plots Roy Hill Station
TERN Ecosystem Surveillance Plots Roy Hill StationTERN Ecosystem Surveillance Plots Roy Hill Station
TERN Ecosystem Surveillance Plots Roy Hill Station
 
TERN Ecosystem Surveillance Plots Kakadu National Park
TERN Ecosystem Surveillance Plots Kakadu National ParkTERN Ecosystem Surveillance Plots Kakadu National Park
TERN Ecosystem Surveillance Plots Kakadu National Park
 
TERN Ecosystem Surveillance Plots South Australian Murray Darling Basin NRM R...
TERN Ecosystem Surveillance Plots South Australian Murray Darling Basin NRM R...TERN Ecosystem Surveillance Plots South Australian Murray Darling Basin NRM R...
TERN Ecosystem Surveillance Plots South Australian Murray Darling Basin NRM R...
 

Dernier

Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...PrithaVashisht1
 
SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024Becky Burwell
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationGiorgio Carbone
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxVenkatasubramani13
 
Cyclistic Memberships Data Analysis Project
Cyclistic Memberships Data Analysis ProjectCyclistic Memberships Data Analysis Project
Cyclistic Memberships Data Analysis Projectdanielbell861
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Vladislav Solodkiy
 
ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructuresonikadigital1
 
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Guido X Jansen
 
YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.JasonViviers2
 
5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best PracticesDataArchiva
 
MEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptMEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptaigil2
 
Create Data Model & Conduct Visualisation in Power BI Desktop
Create Data Model & Conduct Visualisation in Power BI DesktopCreate Data Model & Conduct Visualisation in Power BI Desktop
Create Data Model & Conduct Visualisation in Power BI DesktopThinkInnovation
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerPavel Šabatka
 

Dernier (13)

Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...Elements of language learning - an analysis of how different elements of lang...
Elements of language learning - an analysis of how different elements of lang...
 
SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024SFBA Splunk Usergroup meeting March 13, 2024
SFBA Splunk Usergroup meeting March 13, 2024
 
Master's Thesis - Data Science - Presentation
Master's Thesis - Data Science - PresentationMaster's Thesis - Data Science - Presentation
Master's Thesis - Data Science - Presentation
 
Mapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptxMapping the pubmed data under different suptopics using NLP.pptx
Mapping the pubmed data under different suptopics using NLP.pptx
 
Cyclistic Memberships Data Analysis Project
Cyclistic Memberships Data Analysis ProjectCyclistic Memberships Data Analysis Project
Cyclistic Memberships Data Analysis Project
 
Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023Cash Is Still King: ATM market research '2023
Cash Is Still King: ATM market research '2023
 
ChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics InfrastructureChistaDATA Real-Time DATA Analytics Infrastructure
ChistaDATA Real-Time DATA Analytics Infrastructure
 
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
Persuasive E-commerce, Our Biased Brain @ Bikkeldag 2024
 
YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.YourView Panel Book.pptx YourView Panel Book.
YourView Panel Book.pptx YourView Panel Book.
 
5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices5 Ds to Define Data Archiving Best Practices
5 Ds to Define Data Archiving Best Practices
 
MEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .pptMEASURES OF DISPERSION I BSc Botany .ppt
MEASURES OF DISPERSION I BSc Botany .ppt
 
Create Data Model & Conduct Visualisation in Power BI Desktop
Create Data Model & Conduct Visualisation in Power BI DesktopCreate Data Model & Conduct Visualisation in Power BI Desktop
Create Data Model & Conduct Visualisation in Power BI Desktop
 
The Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayerThe Universal GTM - how we design GTM and dataLayer
The Universal GTM - how we design GTM and dataLayer
 

Australian Ecosystems Science Cloud

  • 1. TERN is supported by the Australian Government through the National Collaborative Research Infrastructure Strategy. Australian Ecosystems Science Cloud overview Presentation by Siddeswara Guru Director, Data Science
  • 2. Ecosystem science • Inter-relationship among the living organisms, physical features, bio-chemical processes, natural phenomena, and human activities in ecological communtiies1 • Focusing on Terrestrial Ecosystem – Terrestrial Ecosystem Research Network – Atlas of Living Australia • Data is heterogeneous: wide variety from different domain – Observation (human, in-situ sensors and satellite remote sensing) – Variety of scale: spatial and temporal – Different data formats used in the community
  • 3. Data Use • Conventional data access – Need to find data – Access via services – copy from source to destination for further for large datasets Image from internet
  • 4. Storage and Compute • Advent of NeCTAR and RDS – Researchers are moving data and computation to cloud. – Building tools (Virtual labs, research tools and platforms) – However, easy accessibility of data is still an issue • Multiple interfaces to search for data • No clear access mechanism from different nodes
  • 5. Goal • Offer open data platform: harmonised cloud-enabled data infrastructure for data interoperability with simplified service model • Offer compute next to data to minimise data movement • Data accessibility to different research platforms and virtual labs from common platform • Offer scalable managed computing environment with access to distributed and data-intensive computation technologies • develop a support system for a cross-discipline use of data
  • 6. User Stories • As an ecosystem science continental-scale gridded data user, I wants to query a dataset, perform spatial and temporal sub-setting of data, access and use that data from a cloud platform as a local file so that I can work on further analyses. • As an application developer, I need enough compute and storage for short period of time to run a distributed large-scale data intensive application so that the output of the analyses are available in decent amount of time. • As a regular ecology data user, I need a easily accessible cloud compute platform with common tools (Rstudio, Jupyter Python, NetCDF viewer, spatial data viewer, CSV file viewer) attached with the TERN ecology and biophysical data collection so that I can build applications for analysis and synthesis. • As a data intensive application developer, I need a flexible approach to create and access to Hadoop cluster so that I can distribute my computation. • As a data user, I want an easy access to reference datasets with compute resources so that I can use them in my analysis and research work. • As a ecosystem data user, I want a one stop-shop to search, query and access ecosystem data and use in my analysis so that I don't have to go through multiple portals to access and use data. • As an application developer, I want a cloud platform to run my simulation with a local access to data so that I don't move data around or download into my desktop.
  • 8. Current status • Setup a Technical Advisory Group advice on the scoping and implementation of the project. • In the first iteration: reference datasets will be made available – Remote sensing reference data (fractional Cover) – Long-term ecological monitoring data – Climate variables • Scoping the mediation layer and overall architecture • Building a coalition of willing for partnership and collaboration
  • 9. Contributions • NeCTAR – Major project sponsor • TERN, ALA – NCRIS Domain Projects, partners • QCIF - implementation partner • NCI – collaborator, partners
  • 10. contact Siddeswara Guru: s.guru@uq.edu.au Hamish Holewa : hholewa@quadrant.edu.au