SlideShare une entreprise Scribd logo
1  sur  15
Uncertainty in the measurement
and mapping of soil attributes
Estimation and reporting of uncertainty
Presentation by Dr David Clifford (CSIRO)
Uncertainty Quantification
• What is it and how does uncertainty arise
• Why we need to care about it
• Importance / relevance for TERN
• Incorporation as part of TERN infrastructure

Goal: How can we understand, calculate and
      communicate uncertainty of our products
Sources of uncertainty
Positional errors
Field vs lab measurement
Raw data – gold standard or derived quantity
Conversion to standard depths
Models:
       – covariate layers
       – transformation of data
       – structure
       – estimation and prediction
       – multiple outputs & joint uncertainty
Reality Check
Despite our best efforts we don’t know
everything

• We know a lot about some soil processes
• We know a lot about some regions of Australia
• Our knowledge is not uniform
• Our uncertainty estimates should reflect this
The need for quantifying uncertainty
Avoiding the illusion of certainty
Improve the quality of inference based on TERN
products

Help highlight gaps in our knowledge
‘Error Budget’ - relative contributions of sources
Decide where / how to spend future funding
Reporting of uncertainty
Previously reported via a scale – an implicit
map-wide approach
Map our estimates of uncertainty
Different products have different uncertainties

Global Soil Map workshop on uncertainty –
USDA, Nebraska (Aug 2012)
Improving quality of map products
Data from Geosciences Australia
Improving quality of map products
Data from Geosciences Australia
Improving quality of map products
Data from Geosciences Australia
Merging TERN Products
Merging TERN Products
Merging TERN Products
Approaches for merging:
• Picking the most accurate approach
• Bayesian Model Averaging
• Equal weighting of the two predictions
• Variance weighting
Merging TERN Products
Merging TERN Products
Conclusions
Uncertainty is important to quantify
Project raising new challenges in modelling and
   understanding it
Drawing on diverse data resources
Bringing different components of project
   together to form best soil predictions
Strategically improve future products

Contenu connexe

Similaire à David Clifford_Uncertainty of soil attribute estimates based on disaggregation

New Paradigm for Ensuring and Improving Data Quality and Usability
New Paradigm for Ensuring and Improving Data Quality and UsabilityNew Paradigm for Ensuring and Improving Data Quality and Usability
New Paradigm for Ensuring and Improving Data Quality and UsabilityGe Peng
 
Ryan Ripley - The #NoEstimatesMovement
Ryan Ripley - The #NoEstimatesMovementRyan Ripley - The #NoEstimatesMovement
Ryan Ripley - The #NoEstimatesMovementProjectCon
 
Cork big data_analytics-de_puy_synthes_datsci_cit
Cork big data_analytics-de_puy_synthes_datsci_citCork big data_analytics-de_puy_synthes_datsci_cit
Cork big data_analytics-de_puy_synthes_datsci_citDana Brophy
 
Central location testing
Central location testingCentral location testing
Central location testingCompusense Inc.
 
The role of geomodeling in the multi disciplinary team
The role of geomodeling in the multi disciplinary teamThe role of geomodeling in the multi disciplinary team
The role of geomodeling in the multi disciplinary teamPetro Teach
 
Data Collection Preparation
Data Collection PreparationData Collection Preparation
Data Collection PreparationBusiness Student
 
Lowry colorado state address dataset data quality
Lowry colorado state address dataset data qualityLowry colorado state address dataset data quality
Lowry colorado state address dataset data qualityGeCo in the Rockies
 
Jared Wilson - Overview of survey, data collection and data analysis challenges
Jared Wilson - Overview of survey, data collection and data analysis challengesJared Wilson - Overview of survey, data collection and data analysis challenges
Jared Wilson - Overview of survey, data collection and data analysis challengesandronikos1990
 
Prioritizing research for development impact- Eike Luedeling
Prioritizing research for development impact- Eike LuedelingPrioritizing research for development impact- Eike Luedeling
Prioritizing research for development impact- Eike LuedelingWorld Agroforestry (ICRAF)
 
2015 06-03 ti4 agile presented at ncs
2015 06-03 ti4 agile presented at ncs2015 06-03 ti4 agile presented at ncs
2015 06-03 ti4 agile presented at ncsRuud Teunissen
 
Geocoding Best Practices: Taking an Address-Centric Approach
Geocoding Best Practices: Taking an Address-Centric ApproachGeocoding Best Practices: Taking an Address-Centric Approach
Geocoding Best Practices: Taking an Address-Centric ApproachPrecisely
 
Harnessing the Power of Advanced Insurance Analytics Through Property Data
Harnessing the Power of Advanced Insurance Analytics Through Property DataHarnessing the Power of Advanced Insurance Analytics Through Property Data
Harnessing the Power of Advanced Insurance Analytics Through Property DataPrecisely
 
The effect of service environment on demand for and use of injectables in Mal...
The effect of service environment on demand for and use of injectables in Mal...The effect of service environment on demand for and use of injectables in Mal...
The effect of service environment on demand for and use of injectables in Mal...MEASURE Evaluation
 

Similaire à David Clifford_Uncertainty of soil attribute estimates based on disaggregation (20)

New Paradigm for Ensuring and Improving Data Quality and Usability
New Paradigm for Ensuring and Improving Data Quality and UsabilityNew Paradigm for Ensuring and Improving Data Quality and Usability
New Paradigm for Ensuring and Improving Data Quality and Usability
 
Ryan Ripley - The #NoEstimatesMovement
Ryan Ripley - The #NoEstimatesMovementRyan Ripley - The #NoEstimatesMovement
Ryan Ripley - The #NoEstimatesMovement
 
Cork big data_analytics-de_puy_synthes_datsci_cit
Cork big data_analytics-de_puy_synthes_datsci_citCork big data_analytics-de_puy_synthes_datsci_cit
Cork big data_analytics-de_puy_synthes_datsci_cit
 
Central location testing
Central location testingCentral location testing
Central location testing
 
Food waste
Food waste Food waste
Food waste
 
The role of geomodeling in the multi disciplinary team
The role of geomodeling in the multi disciplinary teamThe role of geomodeling in the multi disciplinary team
The role of geomodeling in the multi disciplinary team
 
Data Collection Preparation
Data Collection PreparationData Collection Preparation
Data Collection Preparation
 
Exploratory Spatial Analytics (ESA)
Exploratory Spatial Analytics (ESA)Exploratory Spatial Analytics (ESA)
Exploratory Spatial Analytics (ESA)
 
Lowry colorado state address dataset data quality
Lowry colorado state address dataset data qualityLowry colorado state address dataset data quality
Lowry colorado state address dataset data quality
 
Jared Wilson - Overview of survey, data collection and data analysis challenges
Jared Wilson - Overview of survey, data collection and data analysis challengesJared Wilson - Overview of survey, data collection and data analysis challenges
Jared Wilson - Overview of survey, data collection and data analysis challenges
 
Are you a data driven
Are you a data drivenAre you a data driven
Are you a data driven
 
Prioritizing research for development impact- Eike Luedeling
Prioritizing research for development impact- Eike LuedelingPrioritizing research for development impact- Eike Luedeling
Prioritizing research for development impact- Eike Luedeling
 
1615 plack using our laptop
1615 plack using our laptop1615 plack using our laptop
1615 plack using our laptop
 
Testing Microservices
Testing MicroservicesTesting Microservices
Testing Microservices
 
2015 06-03 ti4 agile presented at ncs
2015 06-03 ti4 agile presented at ncs2015 06-03 ti4 agile presented at ncs
2015 06-03 ti4 agile presented at ncs
 
The Role of Evaluation in Strengthening Agricultural R&D in Sub-Saharan Afric...
The Role of Evaluation in Strengthening Agricultural R&D in Sub-Saharan Afric...The Role of Evaluation in Strengthening Agricultural R&D in Sub-Saharan Afric...
The Role of Evaluation in Strengthening Agricultural R&D in Sub-Saharan Afric...
 
Getting testing right
Getting testing right Getting testing right
Getting testing right
 
Geocoding Best Practices: Taking an Address-Centric Approach
Geocoding Best Practices: Taking an Address-Centric ApproachGeocoding Best Practices: Taking an Address-Centric Approach
Geocoding Best Practices: Taking an Address-Centric Approach
 
Harnessing the Power of Advanced Insurance Analytics Through Property Data
Harnessing the Power of Advanced Insurance Analytics Through Property DataHarnessing the Power of Advanced Insurance Analytics Through Property Data
Harnessing the Power of Advanced Insurance Analytics Through Property Data
 
The effect of service environment on demand for and use of injectables in Mal...
The effect of service environment on demand for and use of injectables in Mal...The effect of service environment on demand for and use of injectables in Mal...
The effect of service environment on demand for and use of injectables in Mal...
 

Plus de TERN Australia

Careers Grounded in Soils
Careers Grounded in SoilsCareers Grounded in Soils
Careers Grounded in SoilsTERN Australia
 
TERN Australia Soil & Herbarium Collection Brochure
TERN Australia Soil & Herbarium Collection BrochureTERN Australia Soil & Herbarium Collection Brochure
TERN Australia Soil & Herbarium Collection BrochureTERN Australia
 
Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021
Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021
Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021TERN Australia
 
Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021
Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021
Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021TERN Australia
 
MER Pilot Network flyer 2020
MER Pilot Network flyer 2020MER Pilot Network flyer 2020
MER Pilot Network flyer 2020TERN Australia
 
Australia's Environmental Predictive Capability
Australia's Environmental Predictive CapabilityAustralia's Environmental Predictive Capability
Australia's Environmental Predictive CapabilityTERN Australia
 
Biodiversity Management in Tasmania's Temperate Native Forests
Biodiversity Management in Tasmania's Temperate Native ForestsBiodiversity Management in Tasmania's Temperate Native Forests
Biodiversity Management in Tasmania's Temperate Native ForestsTERN Australia
 
Observing Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for SustainabilityObserving Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for SustainabilityTERN Australia
 
Observing Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for SustainabilityObserving Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for SustainabilityTERN Australia
 
Dr Michael Mirtl (ILTER Chair) presenting at the AusLTER Forum 2018
Dr Michael Mirtl  (ILTER Chair) presenting at the AusLTER Forum 2018Dr Michael Mirtl  (ILTER Chair) presenting at the AusLTER Forum 2018
Dr Michael Mirtl (ILTER Chair) presenting at the AusLTER Forum 2018TERN Australia
 
Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...
Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...
Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...TERN Australia
 
Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...
Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...
Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...TERN Australia
 
Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...
Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...
Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...TERN Australia
 
Yuxia Liu Phenology 2018 poster on tracking grass phenology
Yuxia Liu Phenology 2018 poster on tracking grass phenologyYuxia Liu Phenology 2018 poster on tracking grass phenology
Yuxia Liu Phenology 2018 poster on tracking grass phenologyTERN Australia
 
Qiaoyun Xie Phenology 2018 presentation on agricultural phenology
Qiaoyun Xie Phenology 2018 presentation on agricultural phenologyQiaoyun Xie Phenology 2018 presentation on agricultural phenology
Qiaoyun Xie Phenology 2018 presentation on agricultural phenologyTERN Australia
 
Ha Nguyen Phenology 2018 presentation on Melbourne pollen trends
Ha Nguyen Phenology 2018 presentation on Melbourne pollen trendsHa Nguyen Phenology 2018 presentation on Melbourne pollen trends
Ha Nguyen Phenology 2018 presentation on Melbourne pollen trendsTERN Australia
 
Paul Beggs Phenology 2018 presentation on AusPollen
Paul Beggs Phenology 2018 presentation on AusPollenPaul Beggs Phenology 2018 presentation on AusPollen
Paul Beggs Phenology 2018 presentation on AusPollenTERN Australia
 
GEOSS Ecosystem Mapping for Australia
GEOSS Ecosystem Mapping for AustraliaGEOSS Ecosystem Mapping for Australia
GEOSS Ecosystem Mapping for AustraliaTERN Australia
 
TERN Ecosystem Surveillance Plots Roy Hill Station
TERN Ecosystem Surveillance Plots Roy Hill StationTERN Ecosystem Surveillance Plots Roy Hill Station
TERN Ecosystem Surveillance Plots Roy Hill StationTERN Australia
 
TERN Ecosystem Surveillance Plots Kakadu National Park
TERN Ecosystem Surveillance Plots Kakadu National ParkTERN Ecosystem Surveillance Plots Kakadu National Park
TERN Ecosystem Surveillance Plots Kakadu National ParkTERN Australia
 

Plus de TERN Australia (20)

Careers Grounded in Soils
Careers Grounded in SoilsCareers Grounded in Soils
Careers Grounded in Soils
 
TERN Australia Soil & Herbarium Collection Brochure
TERN Australia Soil & Herbarium Collection BrochureTERN Australia Soil & Herbarium Collection Brochure
TERN Australia Soil & Herbarium Collection Brochure
 
Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021
Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021
Summary of TERN monitoring plots in the Pilbara WA, Apr2015 - Jun2021
 
Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021
Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021
Summary of TERN plots on Kangaroo Island, SA, Oct 2018 - Oct 2021
 
MER Pilot Network flyer 2020
MER Pilot Network flyer 2020MER Pilot Network flyer 2020
MER Pilot Network flyer 2020
 
Australia's Environmental Predictive Capability
Australia's Environmental Predictive CapabilityAustralia's Environmental Predictive Capability
Australia's Environmental Predictive Capability
 
Biodiversity Management in Tasmania's Temperate Native Forests
Biodiversity Management in Tasmania's Temperate Native ForestsBiodiversity Management in Tasmania's Temperate Native Forests
Biodiversity Management in Tasmania's Temperate Native Forests
 
Observing Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for SustainabilityObserving Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for Sustainability
 
Observing Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for SustainabilityObserving Environmental Change in Australia: Conversations for Sustainability
Observing Environmental Change in Australia: Conversations for Sustainability
 
Dr Michael Mirtl (ILTER Chair) presenting at the AusLTER Forum 2018
Dr Michael Mirtl  (ILTER Chair) presenting at the AusLTER Forum 2018Dr Michael Mirtl  (ILTER Chair) presenting at the AusLTER Forum 2018
Dr Michael Mirtl (ILTER Chair) presenting at the AusLTER Forum 2018
 
Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...
Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...
Prof Bob Scholes (Wits University, South Africa) presenting at the AusLTER Fo...
 
Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...
Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...
Prof Phil Robertson (Michigan State University, USA) presenting at the AusLTE...
 
Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...
Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...
Dr Manuel Maass (National Autonomous University of Mexico) presenting at the ...
 
Yuxia Liu Phenology 2018 poster on tracking grass phenology
Yuxia Liu Phenology 2018 poster on tracking grass phenologyYuxia Liu Phenology 2018 poster on tracking grass phenology
Yuxia Liu Phenology 2018 poster on tracking grass phenology
 
Qiaoyun Xie Phenology 2018 presentation on agricultural phenology
Qiaoyun Xie Phenology 2018 presentation on agricultural phenologyQiaoyun Xie Phenology 2018 presentation on agricultural phenology
Qiaoyun Xie Phenology 2018 presentation on agricultural phenology
 
Ha Nguyen Phenology 2018 presentation on Melbourne pollen trends
Ha Nguyen Phenology 2018 presentation on Melbourne pollen trendsHa Nguyen Phenology 2018 presentation on Melbourne pollen trends
Ha Nguyen Phenology 2018 presentation on Melbourne pollen trends
 
Paul Beggs Phenology 2018 presentation on AusPollen
Paul Beggs Phenology 2018 presentation on AusPollenPaul Beggs Phenology 2018 presentation on AusPollen
Paul Beggs Phenology 2018 presentation on AusPollen
 
GEOSS Ecosystem Mapping for Australia
GEOSS Ecosystem Mapping for AustraliaGEOSS Ecosystem Mapping for Australia
GEOSS Ecosystem Mapping for Australia
 
TERN Ecosystem Surveillance Plots Roy Hill Station
TERN Ecosystem Surveillance Plots Roy Hill StationTERN Ecosystem Surveillance Plots Roy Hill Station
TERN Ecosystem Surveillance Plots Roy Hill Station
 
TERN Ecosystem Surveillance Plots Kakadu National Park
TERN Ecosystem Surveillance Plots Kakadu National ParkTERN Ecosystem Surveillance Plots Kakadu National Park
TERN Ecosystem Surveillance Plots Kakadu National Park
 

David Clifford_Uncertainty of soil attribute estimates based on disaggregation

  • 1. Uncertainty in the measurement and mapping of soil attributes Estimation and reporting of uncertainty Presentation by Dr David Clifford (CSIRO)
  • 2. Uncertainty Quantification • What is it and how does uncertainty arise • Why we need to care about it • Importance / relevance for TERN • Incorporation as part of TERN infrastructure Goal: How can we understand, calculate and communicate uncertainty of our products
  • 3. Sources of uncertainty Positional errors Field vs lab measurement Raw data – gold standard or derived quantity Conversion to standard depths Models: – covariate layers – transformation of data – structure – estimation and prediction – multiple outputs & joint uncertainty
  • 4. Reality Check Despite our best efforts we don’t know everything • We know a lot about some soil processes • We know a lot about some regions of Australia • Our knowledge is not uniform • Our uncertainty estimates should reflect this
  • 5. The need for quantifying uncertainty Avoiding the illusion of certainty Improve the quality of inference based on TERN products Help highlight gaps in our knowledge ‘Error Budget’ - relative contributions of sources Decide where / how to spend future funding
  • 6. Reporting of uncertainty Previously reported via a scale – an implicit map-wide approach Map our estimates of uncertainty Different products have different uncertainties Global Soil Map workshop on uncertainty – USDA, Nebraska (Aug 2012)
  • 7. Improving quality of map products Data from Geosciences Australia
  • 8. Improving quality of map products Data from Geosciences Australia
  • 9. Improving quality of map products Data from Geosciences Australia
  • 12. Merging TERN Products Approaches for merging: • Picking the most accurate approach • Bayesian Model Averaging • Equal weighting of the two predictions • Variance weighting
  • 15. Conclusions Uncertainty is important to quantify Project raising new challenges in modelling and understanding it Drawing on diverse data resources Bringing different components of project together to form best soil predictions Strategically improve future products

Notes de l'éditeur

  1. Presenting on behalf of a number of people on uncertainty. Others involved include the members of the broader TERN soils team and especially Dr M. Dobbie.
  2. Up front message on what this talk will cover – I’ll talk about what UQ is, where U comes from and why we need to care about it and how TERN is addressing UQ in this project
  3. Before talking about why uncertainty is a concern to our project and how we are dealing with it talk about where uncertainty enters into our soil attribute products – the short answer is at each stage of the process. We want a comprehensive accounting of this uncertainty but couple that with a pragmatic approach for handling it. Which sources should be tracked, which can be ignored, which are more important etc.
  4. Highlight how we are learning about the gaps in our knowledge, and that tracking and accounting for the uncertainty highlights some of these gaps.Err don’t want to start off on a downer saying we haven’t a clue – so get the pitch for this slide right.
  5. Why do we need to quantify uncertainty? Introduce an example of someone wanting to run APSIM for a paddock in a particular location. They have measurements of all the key parameters there but lack information on soil moisture. TERN products we are creating – either via digital soil mapping or disaggregation - will provide such an estimate and will in fact give a distribution for what we think the value is at that point. So in places where we are very certain about moisture content the APSIM output can be run with a narrow range of values. For places where we are less certain we would need to consider a broader range of productivity simulations to capture the range of possible scenarios. The TERN infrastructure is for the first time providing us with the capabilities to deliver this kind of explicit quantification of uncertainty, which will available for the broader research community and which will be update-able as more and more soils data is collected in the future.
  6. TERN is funding new science on the understanding of uncertainty. Through our involvement with the Global Soil Map community we have helped define standards of reporting of uncertainty – be it reporting of variances or confidence intervals for particular properties and specific locations and depths – through to summarising how properties co-vary at the same locations, or how one property varies across space or down through the soil depth profile.
  7. If time permits – talk about a non-technical yet concrete example... Data imputation.Because we can’t have a talk about stats without some plots of data – We have seen how uncertainty comes into play with the disaggregation work by Nathan. Here is an example of how we can add to the work RVR is doing by bringing in additional data through imputation, to take advantage of rich data source for the central part of Australia – an area often missed by out other sampling efforts.
  8. Archived samples at two depths. N, P and K values imputed by NMR Spectroscopy – can we impute what values are present at intermediate depths. Drawing on rich data in ACLEP and ASRIS, together with work from Sydney Uni on depth splines we can do this – and we can track uncertainty through the process too.
  9. Archived samples at two depths. N, P and K values imputed by NMR Spectroscopy – can we impute what values are present at intermediate depths. Drawing on rich data in ACLEP and ASRIS, together with work from Sydney Uni on depth splines we can do this – and we can track uncertainty through the process too.
  10. Approaches to be taken depend on the origin of the products – if you have one set of data and two models then one idea is to pick the best – but across these large spatial regions its not likely that one approach will consistently give the best – and anyway if the second best is close you would be wise to take those values into consideration. That’s where Bayesian Model Averaging comes up – averaging across the form of the models, using weights based on how well that model fits the data.When you have independent data sources then you also need to merge the predictions. Equal weights if you have equal faith in both approaches. Better yet – weight them by variance associated with the predictions. Place more weight on the more accurate prediction. You end up with something that will have lower variance.