1. VALUE CHAIN MONITORING
AND EVALUATION GUIDE
MODULE
4
Select Performance Indicators

2. GETTING
STARTED
1
May 22, 2012

3. GETTING
STARTED
Routine Measurement Routine Observation
•Indicators tracked using •Indicators tracked using non-
traditional M&E tools – surveys, traditional M&E tools – staff
focus group discussions, etc. observation, team reflections,
•Traditional M&E timelines – meetings and after action
monthly, quarterly, reviews
beginning/middle/end of project, •Traditional M&E timelines or
etc. whenever staff learn something
Traditional, Rigid important about that indicator.
Flexible, Reactive
2
May 22, 2012

4. GETTING
STARTED
3
May 22, 2012

5. GETTING
STARTED
Routinely Measured Indicators Routinely Observed Indicators
•Specific •Open-ended, indentified through
participatory exercises
•Measurable •Focused on anticipated changes
•Achievable such as impact group attitude and
•Relevant behavior
•Weighted against validity of
•Time-bound ‘killer’ assumptions
•Revised as needed to suit
implementation needs
CONSULT CARE’S UNIVERSAL INDICATORS FOR MARKET
ENGAGEMENT
4
May 22, 2012

6. MATERIALS / INPUTS
RECOMMENDED
Causal model
M&E client map
Donor indicator list
CARE CO program and global indicator lists
Key team members and/or partner
representatives
5
May 22, 2012

7. STEP-BY-STEP GUIDE
• DEFINE YOUR IMPACT INDICATORS
1
• IDENTIFY AND DEFINE THE CRITICAL
ASSUMPTIONS IN YOUR CAUSAL MODEL
2
• DEVELOP INDICATORS FOR YOUR OUTPUTS
AND LEADING AND LAGGING OUTCOMES
3
• REVIEW THE INDICATORS WITH KEY M&E
CLIENTS
4
6
May 22, 2012

8. STEP-BY-STEP GUIDE:
STEP 1
Defining Indicators
•These will ultimately measure
program’s success
•Household, Enterprise and Sectoral
Levels
•Should align with CO, Donor, National
Government and CARE Universal
Indicators
•Again, DO NOT SELECT MORE
7
THAN YOU CAN MEASURE!!!
May 22, 2012

9. STEP-BY-STEP GUIDE
• DEFINE YOUR IMPACT INDICATORS
1
• IDENTIFY AND DEFINE THE CRITICAL
ASSUMPTIONS IN YOUR CAUSAL MODEL
2
• DEVELOP INDICATORS FOR YOUR OUTPUTS
AND LEADING AND LAGGING OUTCOMES
3
• REVIEW THE INDICATORS WITH KEY M&E
CLIENTS
4
8
May 22, 2012

10. STEP-BY-STEP GUIDE:
STEP 2
WORK THROUGH THE CAUSAL
MODEL
•Develop indicators at other levels:
•Outputs
•Leading outcomes
•Lagging outcomes
•To avoid piling up more indicators than we
can measure:
•Focus on priority clients of M&E system
•Prioritize most critical assumptions from
9 causal model
•Use this participatory activity……………..
May 22, 2012

11. STEP-BY-STEP GUIDE:
STEP 2 & Prioritizing Assumptions
Tool: Identifying
Objective: This activity will help key system clients
articulate and identify the most critical assumptions.
Format: A group of 10-15 M&E clients (or more)
broken into groups of 4-5. Ensure plenty of open wall
space and a work table for each group.
Materials: A projector, laptop, flip chart paper, markers
and plenty of small stickers of different colors (for
voting).
Time: Will vary depending on the number of M&E
clients and project complexity but should be no less
than 1 hour for a simple exercise and can be ¾ of a
day or more for a large-scale program.
10
May 22, 2012

12. STEP-BY-STEP GUIDE
• DEFINE YOUR IMPACT INDICATORS
1
• IDENTIFY AND DEFINE THE CRITICAL
ASSUMPTIONS IN YOUR CAUSAL MODEL
2
• DEVELOP INDICATORS FOR YOUR OUTPUTS
AND LEADING AND LAGGING OUTCOMES
3
• REVIEW THE INDICATORS WITH KEY M&E
CLIENTS
4
11
May 22, 2012

13. STEP-BY-STEP GUIDE:
STEP 3
Resources for ID’ing Indicators for
Outputs and Outcomes
•Donor requirements
•Country Office Program Impact Measurement
Frameworks
•CARE’s Universal Indicators for Market Engagement
•Other relevant projects operating within the country
•CARE’s global impact measurement system
12
May 22, 2012
•Government measurement systems.

14. STEP-BY-STEP GUIDE:
STEP 3
COMPLETING STEP 3
•Start with a particular intervention and work
through the causal pathway until you link to
your impact level indicators
•Trace the causal pathway that links
indicator to outputs  leading outcomes 
lagging outcomes
•Choose a second and repeat the process
until you have identified indicators for each
causal pathway
13
May 22, 2012

15. STEP-BY-STEP GUIDE
• DEFINE YOUR IMPACT INDICATORS
1
• IDENTIFY AND DEFINE THE CRITICAL
ASSUMPTIONS IN YOUR CAUSAL MODEL
2
• DEVELOP INDICATORS FOR YOUR OUTPUTS
AND LEADING AND LAGGING OUTCOMES
3
• REVIEW THE INDICATORS WITH KEY M&E
CLIENTS
4
14
May 22, 2012

16. STEP-BY-STEP GUIDE:
STEP 4
Validate Indicators
•Review the selected indicators with
donor, project staff, managers, partner
organizations and target participants
•Group meetings, email reviews and
comments, etc.
•Whatever process you use should be
transparent and M&E clients’ comments
should be fully considered before
15
finalizing your indicator set
May 22, 2012

17. CASE EXAMPLE
SDVC
Insert SDVC pic
16
May 22, 2012

18. COMMON
PITFALLS
•TOO MANY INDICATORS……..Don’t be afraid to negotiate.
•Contradictions between donor requests and the good of the project (what to measure,
approaches, etc.) . Use informed rationale to discuss these disparities with the donor!!!!!!
•Projects are unwilling or unprepared to make difficult choices to weed out ‘nice but not
necessary’ indicators.
•Projects fail to engage the donor in dialogue regarding expectations of the M&E system (high
or low).
•Projects focus too much on output indicators that will not provide insight into what the project
is accomplishing.
•Projects do not use the SMART test on the indicators they plan to track through routine
measurement, leading to indicator lists that are poorly aligned with killer assumptions and/or
difficult or impossible to measure reliably.
•Projects fail to develop a set of indicators that will be tracked through routine observation at
the outset, leading to a lot of information being collected, very little of which can be aggregated
and/or applied to inform project decision making.
17
May 22, 2012

19. TEMPLATES AND SUPPORTING
MATERIALS Engagement Indicator Information
CARE Market
Result Level Domain TableChange
Key Indicator - Indicator - Target Data Users Data Source Collection Collection Responsible
(Women's Emp, (Y/N) Measurement Observation (Clients) Method / Frequency for Collection
Enterprise, Sector) Tool
Impact
Note: At this
stage, you will
Lagging
outcome
not fill in the
information in
these three
columns. You
Leading will do so after
outcome
the next
Chapters in this
guide.
Output
18
May 22, 2012

20. TEMPLATES AND SUPPORTING
MATERIALS
LOGICAL FRAMEWORKS
Narrative Results Indicators Assumptions
Summary
Impacts
Lagging
Outcomes
Leading
Outcomes
Outputs
Interventions
19
May 22, 2012

21. TEMPLATES AND SUPPORTING
MATERIALS Measurement Tools Available by
Poverty
Country Country
PPI PAT (USAID)
Angola
Bangladesh X X+
Benin
Bolivia X X
Cambodia X X
Cote d’Ivoire
Ecuador X X+
El Salvador X X+
Ethiopia X X
Ghana X X+
Guatemala X X
Haiti X X
Honduras X
India X X
Kenya X X+
Liberia X X+
Malawi X X
Mali X
Mozambique
Nepal X X
Nicaragua X
Niger
Pakistan X
Peru X X
Rwanda X
Sierra Leone
Sri Lanka
20
X
Tanzania
May 22, 2012
Uganda X+
Vietnam X X

22. QUESTIONS
?
COMMENTS
?
21
May 22, 2012

23. Want to Learn More?
Multiple ways to continue the discussion
and continue learning:
• Initiate a monthly session on the M&E guide and
case studies from across CARE. Contact
cpennotti@care.org
• Join the Market Engagement Community of
Practice on LinkedIn.
• Join a task force to review and refine the universal
22
indicators. Contact nardi@careinternational.org
May 22, 2012