SAC 25 Final National, Regional & Local Angel Group Investing Insights 2024 0...
Water, Land & Ecosystems Intervention Decisions
1. Where are the high information values?
Keith Shepherd & Doug Hubbard
Nov 2012
Vagen
2. Water, Land & Ecosystems (WLE)
Organizing research around a conceptual framework of basins
and landscapes
3. WLE Decisions
Our strategic objectives = our system level
outcomes:
(i) decrease food insecurity(ii) manage
environmental resources(iii) reduce poverty
among farmers(iv) increase nutrition, health
and wellbeing
We aim to improve stakeholder decisions on
policies, intervention programmes and
intervention designs through research
What information has high value for
improving decisions to achieve these
outcomes?
to achieve these outcomes?
4. •How to prioritize research under uncertainty
Which interventions will reduce risk, increase security, and
improve lives the most? What are the trade-offs between
competing objectives, like agricultural productivity and the
environment? What are the risks of intervention failure?How to
measure and monitor development outcomes
•Potentially huge investments in monitoring but not all metrics
will be of equal value to support intervention decisions. How
should we determine what data gathering costs are justified?
How to show the value of research
How can we show how the expense of research is justified by
better intervention decisions and improved outcomes?
• is justified by better intervention decisions and improved
outcomes?
Challenges Facing Researchers
5. •Development of systems to measure the impact of CGIAR
investments (of relevance to DFID as a significant funder) at the
level of the 4 system outcomes. Mechanisms to analyse the
impacts and trade-offs associated with sustainable
intensification at different scales (sub-national, national,
regional).Value for money metrics for measuring agriculture,
ecosystem and poverty and nutritional outcomes.
s.
Interests of donors
6. Why must quantify uncertainty
•Averages are wrong on average
•Uncertain events (floods, droughts,
erosion, market fluctuations)
•Security is a development outcome
(food/nutritional security; risk is the
complement of security)
•Value of information
Walsh
7. How much information do we need?
What defines whether information is unreasonably expensive?
What is the value of doing one more survey or experiment, or
creating another database?
Organizations often spend 10 times the value of information on
surveys and trials, etc
[Ron Howard]
We need a method to quantify information value
8. How to make preferences explicit
Objective trade-offs
•The trade-offs between productivity, ecosystem and welfare
outcomes
Valuation of outcomes (Preferences, Policy)
•Valuing one outcome relative to another (production vs
environment)
•Time (benefit now versus later)
•Uncertainty (risk aversion)
•Equity (increasing income of poor worth more than non-poor)
Making preferences explicit improves transparency and
multi-stakeholder decision processes
11. The AIE Process
Identify important
metrics for monitoring
implementation
Improve the intervention
design to reduce chance
of negative outcomes
Hubbard
Forecasting intervention
impacts
12. Value of information
Game theory provided a formula for the economic value of
information over 60 years ago:
Expected Opportunity Loss = the chance of being wrong x
the cost of being wrong
Expected Value of Information is the reduction in the EOL as a
result of the additional information.
Expected Value of Information is the reduction in the EOL as a
result of the additional information.
13. AIE Empirical Evidence
• We are not as clear as we think on the decisions we are trying to influence
• Expressing uncertainty dissolves assumptions & allows all benefits, costs and
risks to be included, however intangible (especially environment!)
• We need calibrating to reliably estimate probability distributions
• There are usually only a few variables with high information value
• We are often measuring the variables that have least economic value
• And completely missing the ones that do have value (e.g. tend to measure
costs but ignore benefits, which are typically uncertain).
• Measurement is uncertainty reduction, not a gold standard
• Often need different data than we think
• Often need less data than we think
• Even small reductions in uncertainty can have considerable value
18. Cost-effective Measurement
• Fermi decomposition
Estimate no. of piano tuners in Chicago
= No. households (population/people per household)
x % of households with tuned pianos
x tuning frequency per year / (tunings per day x
work days per year
• Secondary research - measured before? Historic data
• Observation - sampling, tracers, experiment
19. Value of Information
A Probability Management System
Decision modelling defines the metrics
Smart data - Smart decisions