Presented by Laili Irani, Senior Policy Analyst for the Population Reference Bureau, as part of the Measuring Success Toolkit webinar in September 2012.

1. Two Examples of
Program Planning,
Monitoring and Evaluation
Laili Irani

2. Example 1: Evaluate a Family Planning
Program
 Objective:
– To evaluate the impact of a family planning program
in a rural village in West Africa
 Main goal:
– To increase contraceptive knowledge, fertility
preferences and contraceptive use

3. Q.1) What is the problem and why does it
exist?
 Study recent DHS for evidence on rural area
of interest
– Results show: low contraceptive prevalence,
knowledge and attitudes
See Toolkit for examples of population based surveys
 Review data from formative research
– Results shows: low prevalence of contraceptive
use

4. Q.1) What is the problem and why does it
exist? (cont.)
 Conduct a needs assessment
– Survey village leaders and community members
– In this example, results show:
• Greater need for modern contraceptive methods
• Easier access to wider range of methods
See Toolkit on how to conduct a needs assessment

5. Q. 2) What interventions can work?
 Design an intervention
– A community outreach program in which health
workers visit homes and address the contraceptive
needs of families
 Plan a pilot project
– Carry out the project in one neighborhood of the
village
– Expand to the entire village

6. Q. 3) What are we doing?
 Develop a logic model
– Inputs  outcomes
See Toolkit for description and examples of logic models
 Create an M&E plan
– Include a timeline of program activities
See Toolkit for sample outline & program examples
 Produce a Performance Monitoring Plan (PMP)
– Share proposed activities with stakeholders and donors
– Identify indicators to be collected and analyzed
See Toolkit for compendium of FP indictors
 Engage stakeholders in every step of the program

7. Q. 3) What are we doing? (cont.)
 Monitor the various components of the program
– Inputs
• Finances, staff, training materials, contraceptives
and transportation
– Processes
• Health workers trained to work in the community
• Health workers visit community periodically and
distribute contraceptives
• Program officers meet with village leaders often
 Ensure quality of program is maintained

8. Q. 4) Are we implementing the program as
planned?
 Output monitoring
– Number of first visits made
– Number of follow-up visits
– Types and numbers of contraceptives distributed
 Outcome monitoring
– Change in percentage of contraceptive users over
time
See Toolkit for indicator guides for FP programs

9. Q. 5) Are the interventions working /
making a difference?
 Outcome evaluation
See Toolkit for examples of evaluation designs and resources

10. Q. 6) Is the program sustainable
and scalable?
 Sustainability
– Ensure local government continues the community
outreach program with the aid of health workers
– Build the community’s capacity to encourage voluntary
contraceptive use among families
 Scalability
– Expand the program to other villages and regions within
the country
See Toolkit for means to measure sustainability and scalability

11. Next Steps
 Share findings with all the stakeholders, including
– Village leaders and community members
– Local government and health department
– Funding agency
– Higher levels of government and health leadership
 Disseminate findings widely including through
mass media, research literature and the internet

12. Example 2: Evaluate a Malaria Prevention
Program
 Objective:
– To evaluate the impact of a malaria prevention
program in a district in East Africa
 Main goal:
– To ensure all pregnant women and children <14 years
are sleeping under insecticide treated nets (ITNs) in
all the villages of a district in East Africa

13. Q.1) What is the problem & why does it exist?
 Study recent population based surveys
– DHS, Multiple Indicator Cluster Survey
– Results show: High malaria prevalence and low ITNs
use
 Conduct a needs assessment
– Visit selected homes; interview selected community
members
– In this example, results show: Use of ITNs is low due to
lack of knowledge and cost
See Toolkit for various data sources and assessment designs

14. Q. 2) What interventions can work?
 Review other programs
 Collaborate with more experienced programs
 Plan a pilot project
 Design an intervention
– Use handheld GPS devices to create clusters
– Visit all homes, identify pregnant women and children
<14 years and provide them with vouchers for ITN
– Program staff visit to ensure ITN installed correctly and
teach villagers how to reapply insecticide
See Toolkit for resources, i.e., Roll Back Malaria website

15. Q. 3) What are we doing?
 Develop a logic model
– Inputs  outcomes
 Develop a PMP
 Engage stakeholders in every step of the
program
– Community members and village leaders
– Local government and district officials
– Experts in the field
– Donors and policy makers
See Toolkit for a logic model and draft checklist for developing
PMP plan for malaria program

16. Q. 4) Are we implementing the program as
planned?
 Monitor the various components of the
program
– Ensure quality of program is maintained
See Toolkit for:
– Indicator guides for malaria programs
– References on how to conduct routine monitoring
– Impact evaluation references

17. Q. 5) Are the interventions working /
making a difference?
 Outcome evaluation
See Toolkit for alternative study designs

18. Q. 6) Is the program sustainable
and scalable?
 Sustainability
– Ensure local government continues the voucher program
– Empower community leaders to encourage community
to access ITNs and to use them effectively
 Scalability
– Expand the program to other districts and regions within
the country
See Toolkit for descriptions and examples of how programs can be
sustainable and scalable

19. Thank you!