This document outlines a structured approach for measuring progress towards goals established by the ENA FLEG Ministerial Declaration. It proposes a two-part assessment methodology: 1) Evaluate inputs based on actions listed in the Declaration, and 2) Evaluate outcomes using perception surveys. Examples are provided of how inputs and outcomes could be evaluated in Georgia. Preliminary impressions note strengths in high-level commitment and information dissemination, while opportunities exist to increase private sector engagement, reporting, cross-regional cooperation, and anti-corruption tools.
4. A Structured Approach for Measuring Progress towards the ENA FLEG Ministerial Declaration
1. A Structured Approach for
Measuring Progress towards the ENA
FLEG Ministerial Declaration
July 09, 2014, Tbilisi, Georgia
(Joanne Gaskell, Vladislava Nemova, and Nalin Kishor, World Bank)
3. National Affirmations (11) International Affirmations (11)
Policy
Framework
(5)
Legislation
System (6)
Institutions and
Capacity
Building (6)
Sustainable Forest
Management (13)
Rural
Development,
Livelihoods
and Poverty
Alleviation (4)
Trade and
Customs
(1)
Indicative
List of
Actions
Trade and
Customs (6)
Research
(1)
Collaborative
Implementation
Actions (7)
Forest-
related
Policies (1)
4. Causal Pathway: Promoting Legality in Forest
Use
Symptom/Issue Input/Intervention(Indicati
ve List of Actions)
Outputs Intermediate
Outcomes
Impact/Desired
Results/Affirmations
Long-term Goals
Urgent need for
countries to
undertake collective
actions to combat
illegal logging,
associated trade and
corruption
National and international
actions such as those
indicated in the ENA-FLEG
Declaration’s Indicative List
of Actions
e.g.
--Foreign study tours and
practical training for forest
sector staff, researchers
and teachers
-- Preparation and
publication of teaching
plans and programs,
preparation and publication
of relevant study manuals
e.g.
# of study
tours
organized
# of teaching
plans and
study
manuals
prepared.
e.g.
-Better knowledge
about the best
practices of
ensuring legality of
forest use,
conservation of
forest biodiversity
and integrated use
of forest resources
-Improved training
capacity of the key
forest education
establishments.
Affirmation#3
Strengthen, as
needed, inter-
agency cooperation
as well as human
institutional
capacity, particularly
among law
enforcement and
judicial authorities
to enforce forest-
related legislation
Long-term security
of environmental
and ecological
services, and
enhancement of
livelihoods from
the forests .
From Inputs to Impacts
5. Two-Part Assessment Methodology
1. Evaluate inputs based on the
Indicative List of Actions
2. Evaluate outcomes using
perception surveys
?
6. 1. Evaluate Inputs: Example from Georgia
Declaration Aspiration Supporting Activities from Country Work Plan
1. Mobilize high-level political commitment
X (Demonstrated through participation in the program)
2. Review and as needed update forest legislation and
regulations
3. Strengthen, as needed, inter-agency cooperation as well as
human institutional capacity
4. Assess, identify and develop strategies to address the
underlying causes of illegal logging
5. Formulate, within a reasonable timeframe, concrete actions
under clearly defined targets
X (Demonstrated through formulation of country work programs and program
results framework)
6. Recognize the rights of forest dependent communities
7. Engage stakeholders on the formulation of forest laws and
policies and their implementation
8. Develop and implement anti-corruption tools
9. Collect and disseminate transparent information on forest
resources
10. Monitor and disclose data on domestic and international
trade flows of timber and timber products
11. Inform and engage all stakeholders to enhance public
awareness on the scope, scale and significance of illegal logging
7. 1. Evaluate Inputs: Contribution of ENPI-FLEG Program
Declaration Commitment Armenia Azerbaijan Belarus Georgia Moldova Ukraine Russian Fed Regional
1
Mobilize high-level political commitment and establish Forest Law Enforcement and Governance (FLEG) as an area of concern within the broader national governance and development agenda
2
Review and as needed update forest legislation and regulations, ensuring their coherence and harmonize these with legislation and policy in natul resourcemanagement and with relevant obligations under international agreements
3
Strengthen, as needed, inter-agency cooperation as well as human institutional capacity, particularly among law enforcement and judicial authorities to enforce forest-related legislation
4
Assess,identify and develop strategies to address the underlying causes of illegal logging, associated trade and corruption, the unauthorized extraction of wood for local consumption as well as the unauthorized exploitation of protected forest areas,
threatening biodiversity
5
Formulate, within a reasonable timeframe, concrete actions under clearly defined targets, including monitoring of progress in implementation, e.g. by taking into account the recommendations of this Ministerial Declaration and annexed indicative list of
actions in the national forest programmes or equivalent frameworks
6
Recognize the rights of forest dependent communities by taking into consideration customarylaws and practices,and the respect of their traditional knowledge, and encourage and promote the participation of indigenous people and the local
population in the management of forests with the objective of providing for rural socio-economic and cultural development and the protection of their natural resources
7
Engage stakeholders, including indigenous people, local communities, private forestowners, NGOs and the industry, in formulation of forestlaws and policies in their implementation through an open and participatory process, thereby promoting
transparency, reducing coruption, facilitating equity and minimizing undue influence of privileged groups
8
Develop and implement anti-corruption tools dealing with corruption in and impacting on the forest sector in line with general anti-corruption efforts,including codes of conduct and best practices, and professional responsibility, and apply
internationally recognized principles to combat organized crime
9
Collect and disseminate transparent information on forest resources,their allocation and exploitation, in a form readily accessibleto the public
10
Monitor and disclose data on domestic and international trade flows of timber and timber products and promote, as appropriate, the establishment of third party audited traceability systems
11
Inform and engage all stakeholders to enhance public awareness on the scope, scaleand significanceof illegal logging, associated trade and corruption, and their negative impacts on the benefits forests provide to society
12
Strengthen cooperation, using as much as possible existing structures, for forest law enforcement and governance and timely exchange of information and experience among countries, in particular, those involved in exports and imports of timber and
timber products
13
Encourage cooperation and strengthen national capacityin monitoring trade in timber and timber products
14
Support cooperation to combat poaching and illegal trade in wildlife associated with illegal logging, including through cooperation with CITES
15
Integrate within existing mechanisms the systematic monitoring, assessmentand reporting of progress on FLEG
16
Promote and develop cooperation and partnerships with and among the private sector and civil society in order to effectively combat illegal logging, associated trade and corruption
17
Give priority to and strengthen trans-boundary cooperation between countries with border areas which require coordinated actions and effective control in order to combat illegal logging and associated trade
18
Enhance international capacity for monitoring, assessing and reporting on areas such as trade flows and customs data to increasetransparency on trade activities and to promote trade in legally harvested timber
19
Strengthen international cooperation to build and enhance national institutional and human capacity as well as to facilitate technology transfer and information sharing to combat illegal logging and to promote trade in legally harvested timber
20
Enhance awareness of information about legality of products including their origin through means such as voluntary chains of custody and forest certification systems, so as to promote marketing of legally harvested timber
21
Cooperate with civil society including the private sector to inform consumers of the problems caused by illegal logging, associated trade and corruption
22
Work with other regions and with multilateral instruments and processes on FLEG related issues
8. 2. Evaluate Outcomes Using Perception
Surveys: Illustrative Questions
Aspiration #7. Does the legal framework in country X include:
Ways for local communities to share or obtain management authority over some forests?
Formal mechanisms to participate in forest-related planning and decision-making?
Aspiration #8. How far has country X:
Developed and implemented anti-corruption tools dealing with corruption in and impacting on the
forest sector?
Aspiration # 14. How far has country X:
Encouraged cross-border cooperation to control illegal logging and its trade and transport?
Cooperated with CITES to help control illegal logging?
Aspiration #21. In country X:
Does the legal framework support public access to information about forestry?
Are inventory data, management plans, laws, and budgets for government-owned forests easily
accessible to the public in a user-friendly format?
9. 2. Evaluate Outcomes Using Perception
Surveys: Scoring Questions
Aspiration #8. How far has country X developed and implemented anti-corruption
tools dealing with corruption in and impacting on the forest sector?
1 No efforts have been made
2 Some efforts have been made
3 Significant efforts have been made but mostly focused on development
of tools and not on their implementation
4 Significant efforts have been made which are well balanced between
development of tools and their implementation
5 The anti-corruption system for the sector is well-functioning and there is
little scope for further improvement.
1=least progress in achieving the aspiration; 5=maximum progress.
10. Preliminary impressions on strengths and
opportunities
Continue to:
• Mobilize high-level commitment
• Review and as needed update forest legislation and regulations
• Disseminate information dissemination and raise public awareness
• Improve understanding of FLEG issues among policymakers and decision-
makers
Ramp up:
• Private sector engagement
• Mainstreaming of national FLEG reporting
• Cross-regional (i.e. Africa and Central Asia) cooperation
• Development of anti-corruption tools
Objective is to obtain feedback on the methodology before we begin to implement it for the ENPI countries this fall.
Recap of St. Petersburg Declaration
National and international actions (Indicative List of Actions) support the declaration commitments (Affirmations)
Contributions of all 44 signatories have to be collected to construct an accurate picture of progress. (This should not be confused with an assessment of the achievements under the ENPI program).
The diagram describes our theory of change, that implementing the lists of actions will lead to the achievement of our aspirations/commitments. This is a stylized diagram. Reality is much more complex and attribution often difficult.
Indicative List of Actions corresponds to ‘input’
Affirmations correspond to ‘desired results’
Based on this theory of change, we take a 2-part approach to measuring progress.
? We are confident that the proposed actions lead to outcomes but in a real world situation we do not know the strength of the relationships, the time it takes from action to outcome and the influence of supportive and opposing actions.
Next slide uses the example of Georgia, but the methodology could be applied to any ENA country or region.
Georgia example (inputs). For Georgia, many more activities are in support of aspiration#9 than for other aspirations.
Progress on inputs can be recorded through scoring on a 5 point scale, for each input which is identified as important for measuring progress.
These are the current ENPI-FLEG work plans for year 1, as they relate to the 22 affirmations. Dark green implies 4 or more ILs
Note certain gaps on the input side that may or may not need addressing in the Y3, Y4 work plans. Countries that are already making good progress in a given area will need less support from the Program in that area.
#4 Assess, identify and develop strategies to address the underlying causes of illegal logging, associated trade and corruption, the unauthorized extraction of wood for local consumption as well as the unauthorized exploitation of protected forest areas, threatening biodiversity
#7 Engage stakeholders, including indigenous people, local communities, private forest owners, NGOs and the industry, in formulation of forest laws and policies in their implementation through an open and participatory process, thereby promoting transparency, reducing corruption, facilitating equity and minimizing undue influence of privileged groups
#8 Develop and implement anti-corruption tools dealing with corruption in and impacting on the forest sector in line with general anti-corruption efforts, including codes of conduct and best practices, and professional responsibility, and apply internationally recognized principles to combat organized crime
#14 Support cooperation to combat poaching and illegal trade in wildlife associated with illegal logging, including through cooperation with CITES
#21 Cooperate with civil society including the private sector to inform consumers of the problems caused by illegal logging, associated trade and corruption
The survey questions could also be scored on a 5-point scale, as in the example/s above.
These surveys will be carried out in the fall
7-country surveys will allow us to test hypotheses derived from our theory of change and will help us to target our interventions in each country.
Our impressions…. Results of the perception surveys will be useful for refining these impressions.