More Related Content
Similar to Monitoring & evaluation - Yousuf Kasujee (20)
Monitoring & evaluation - Yousuf Kasujee
- 1. Islamic Relief Worldwide Monitoring & Evaluation in Development
Yousuf Kasujee
© Islamic Relief Worldwide
15th March 2014
Tunis
Yousuf Kasujee
Islamic Relief Worldwide
Monitoring & Evaluation
in Development
- 2. Islamic Relief Worldwide Monitoring & Evaluation in Development
Yousuf Kasujee
© Islamic Relief Worldwide
We want to move him from here… … to here …
…with available resources…
…how do we find the most
appropriate solution…
…and how do we know we
have met our
goals/outcomes/ outputs?
M&E
Monitoring & Evaluation in a Nutshel
- 3. Islamic Relief Worldwide Monitoring & Evaluation in Development
Yousuf Kasujee
© Islamic Relief Worldwide
What is Monitoring?
Monitoring is the collection and analysis of information
in order to:
1) Examine progress
2) Track compliance to establish standards
3) Make informed decisions for project management
- 4. Islamic Relief Worldwide Monitoring & Evaluation in Development
Yousuf Kasujee
© Islamic Relief Worldwide
Monitoring addresses the following questions:
1. To what extent are planned activities actually realized? Are we making
progress toward achieving our objectives?
2. What services are provided, to whom, when, how often, for how long,
and in what context?
3. How well are the services provided?
4. What is the quality of the services provided?
5. Is project/programme undertaken consistently with each design or
implementation plan?
6. Is project/programme directed toward the specified target group?
- 5. Islamic Relief Worldwide Monitoring & Evaluation in Development
Yousuf Kasujee
© Islamic Relief Worldwide
Why Monitoring?
Monitoring helps the organisation by:
• Providing constant feedback
• Identifying potential problems
• Showing need for mid-course corrections
• Monitor the accessibility of the project
• Provide guidelines for future projects
• Improve project design
• Incorporate views of stakeholders
- 6. Islamic Relief Worldwide Monitoring & Evaluation in Development
Yousuf Kasujee
© Islamic Relief Worldwide24 March 2014
1. Process (activity) monitoring
- use of inputs and resources
- the progress of activities
- the delivery of outputs.
Example: A water and sanitation project
may monitor that targeted households
receive septic systems according to
schedule
2. Results monitoring
- Determine if the project/ programme is
on target towards its intended results
(outputs, outcomes, impact)
- Determine if there may be any
unintended impact (positive or
negative).
Example: A psychosocial project
may monitor that its community
activities achieve the outputs
that contribute to community
resilience and ability to recover
from a disaster
3. Compliance monitoring
Ensures compliance with
- Donor regulations and expected results
- Grant and contract requirements
- Local governmental regulations and laws
- Ethical standards
Example: A shelter project may
monitor that shelters adhere to
agreed national and international
safety standards in construction
Types of Monitoring
- 7. Islamic Relief Worldwide Monitoring & Evaluation in Development
Yousuf Kasujee
© Islamic Relief Worldwide24 March 2014
3. Context (situation) monitoring
- Tracks the setting in which the project/
programme operates.
- It also tracks unexpected considerations that may
arise. It includes the field as well as the larger
political, institutional, funding, and policy context
that affect the project/programme.
Example: A project in a conflict-
prone area may monitor potential
fighting that could not only affect
project success but endanger
project staff and volunteers
4. Beneficiary monitoring
- Tracks beneficiary perceptions of a
project/programme through complaint and
feedback mechanism.
- It includes beneficiary satisfaction or
complaints with the project/programme,
including their participation, treatment, access
to resources and their overall experience of
change.
Example: A cash-for work programme
assisting community members after a
natural disaster may monitor how they
feel about the selection of programme
participants, the payment of
participants and the contribution the
programme is making to the
community
5. Financial monitoring
- Accounts for costs by input and activity within
predefined categories of expenditure. It is often
conducted in conjunction with compliance and
process monitoring.
Example: A livelihoods project
implementing a series of micro-
enterprises may monitor the money
awarded and repaid, and ensure
implementation is according to the
budget and time frame.
- 8. Islamic Relief Worldwide Monitoring & Evaluation in Development
Yousuf Kasujee
© Islamic Relief Worldwide
What is Evaluation?
Evaluation is a systematic assessment of the strengths
and weaknesses of the design, implementation and
the results of completed or ongoing interventions.
- 9. Islamic Relief Worldwide Monitoring & Evaluation in Development
Yousuf Kasujee
© Islamic Relief Worldwide
Evaluation explores the following issues:
• Does a program bring the expected change,
which won’t happen without it?
• For every 1 TND spent on the program, how
big is the change?
• Are there other, cheaper options with similar
results?
• Does a program bring unintended
consequences?
• Are people happy with the program?
• Is a program being implemented correctly?
24 March 2014
- 10. Islamic Relief Worldwide Monitoring & Evaluation in Development
Yousuf Kasujee
© Islamic Relief Worldwide
Why Evaluation?
Improve our work and ultimately our mission
to help those in need
Contribute to organizational learning
Uphold accountability and transparency
Promote and celebrate our work
- 11. Islamic Relief Worldwide Monitoring & Evaluation in Development
Yousuf Kasujee
© Islamic Relief Worldwide
Dissemination,
use of lessons
and possible
longitudinal
evaluation
ONGOING
REPORTING,
REFLECTION
AND LEARNING
Final evaluation
(endline survey)
Project
Start
Project
Middle
Project
End
M&E Within the Project Cycle
- 12. Islamic Relief Worldwide Monitoring & Evaluation in Development
Yousuf Kasujee
© Islamic Relief Worldwide
Monitoring Questions
24 March 2014
What is causing
delays or unexpected
results?
Is there anything happening
that should lead management
to modify the operation’s
implementation plan?
Are activities being implemented on schedule
and within budget?
Measuring changes at goal-level requires a longer time frame, and is
therefore dealt with by evaluation and not monitoring.
Are finance, personnel and materials available
on time and in the right quantities and quality?
Are outputs leading to achievement of the
outcomes?
How do beneficiaries feel about the work?
Are activities leading to the expected outputs?
GOAL
OUTCOMES
OUTPUTS
ACTIVITIES
INPUTS
LOGFRAME OBJECTIVES
- 13. Islamic Relief Worldwide Monitoring & Evaluation in Development
Yousuf Kasujee
© Islamic Relief Worldwide
Evaluation Questions
24 March 2014
Effectiveness
Were the operation’s objectives
achieved?
Did the outputs lead to the
intended outcomes?
LOGFRAME OBJECTIVES
GOAL
OUTCOMES
OUTPUTS
ACTIVITIES
INPUTS
Efficiency
Were stocks of items available on time and in the right quantities and
quality?
Were activities implemented on schedule and within budget?
Were outputs delivered economically?
Sustainability
Are the benefits likely to be
maintained for an extended period
after assistance ends?
Relevance
Were the operation’s objectives consistent
with beneficiaries’ needs and with IR
policies?
Impact
What changes did the project
bring about?
Were there any unplanned or
unintended changes?
- 14. Islamic Relief Worldwide Monitoring & Evaluation in Development
Yousuf Kasujee
© Islamic Relief Worldwide
Complementary Roles of Monitoring and
Evaluation
Monitoring Evaluation
1 Clarifies program
objectives
1 Analyzes why intended results were
or were not achieved
2 Links activities and their
resources to results
2 Assesses specific causal
contributions of activities to results
3 Translates objectives into
performance indicators
and set targets
3 Examines implementation process
4 Routinely collects data on
these indicators, compares
actual results with targets
4 Explores unintended results
5 Reports progress to
managers and alerts them
to problems
5 Provides lessons, highlights
significant accomplishment or
program potential, and offers
recommendations for improvement
- 15. Islamic Relief Worldwide Monitoring & Evaluation in Development
Yousuf Kasujee
© Islamic Relief Worldwide
Importance of M&E
24 March 2014
- 16. Islamic Relief Worldwide Monitoring & Evaluation in Development
Yousuf Kasujee
© Islamic Relief Worldwide
Words of Wisdom
• If you do not measure results, you cannot tell success
from failure
• If you can not see success, you cannot reward it
• If you cannot reward success, you are probably
rewarding failure
• If you cannot see success, you cannot learn from it
• If you cannot recognise failure, you cannot correct it
• If you can demonstrate results, you can win public
support
24 March 2014