SlideShare une entreprise Scribd logo
1  sur  50
Télécharger pour lire hors ligne
INTRODUCTION TO PARTICIPATORY
    MONITORING-EVALUATION



  A SIMPLIFIED TRAINER’S GUIDE




    PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012   3
Published by West Africa Rural Foundation (WARF)
                N° 10075, Sacre- Cœur III- VDN - C.P. 13 DAKAR-Fann, SENEGAL
                       Tel: (221) 33 865 00 60 - Fax: (221) 33 860 66 89 -
                       E-mail: secretary@frao.org - Web site: www.frao.org




                                       Many thanks to:
    All IFAD funded projects in West and Central Africa for their contribution, WARF staff and
                                          consultants




                               © FRAO/WARF - Dakar, September 2012




                                        Design: creatif@orange.sn




               This publication was made possible by grant from IFAD for the Programme of
        Support for Monitoring and Evaluation Systems of IFAD projects in West and Central Africa.
    Its contents are solely the responsibility of the authors and do not necessarily represent the official
                                                  view of IFAD.




4                       PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
TABLE OF CONTENTS



ACRONYMS AND ABBREVIATIONS                                                 06


FOREWORD                                                                   07


SESSION 1: Introduction to the workshop                                    08


SESSION 2: Brief overview of the participatory approach                    12


SESSION 3: Introduction to participatory monitoring and evaluation (PME)   15

SESSION 4: Importance of PME for IFAD projects                             18

SESSION 5: Stages of the PME process                                       22

SESSION 6: Setting up a pme system                                         24

SESSION 7: Identifying actors and analyzing their needs                    26

SESSION 8: Definition of PME objectives                                    29

SESSION 9: Choice of PME indicators                                        31

SESSION 10: Choice of information gathering methods                        35

SESSION 11: Information gathering and analysis                             37

SESSION 12: Implementing changes                                           45

SESSION 13: Management and consolidation of the PME system                 47

SESSION 14: Monitoring and evaluation of the PME implementation            49




                  PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012          5
ACRONYMS AND ABBREVIATIONS


CAS              Community Assessment Sheet

IFAD             International Fund for Agricultural Development

WARF             West Africa Rural Foundation

IED Afrique      Innovation, Environment and Development in Africa

MFI              Microfinancing institution

NHDI             National Human Development Initiative

OVI              Objectively verifiable indicator

PRA              Participatory Rural Appraisal

MSRE             Micro and Small Rural Enterprises

OP               Organisation of Producers

IAP              Information and Awareness-raising Providers

PROMER           Rural Micro-Enterprises Promotion Project

PME              Participatory Monitoring and Evaluation

SFPO             Success, Failures, Potentials, Obstacles

MES              Monitoring and Evaluation System

RIMS             Results and Impact Management System

PMU              Project Management Unit




6             PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
FOREWORD




T
      his simplified guide is addressed to facilitators who pursued the trainers’ training course held in
      Toubab Dialao, Senegal in April 2008. These trainers will later be required to train officials in charge
      of Monitoring and Evaluation of IFAD projects in Participatory Monitoring and Evaluation (PME).
These skills should enable the latter to assist beneficiaries of their interventions to set up a Participatory
Monitoring and Evaluation system. Thus, the grassroots communities are the final beneficiaries of this
capacity building process. For this reason, the content of this guide has been simplified; with emphasis
essentially placed on the aspects that are of practical relevance for the establishment of the PME system
at local level. Of course, facilitators are strongly encouraged to improve on it by drawing on their own
experience or through documentary research.

The design of the training content and guide are based on two fundamental assumptions.
The first is that the selected trainers sufficiently master participatory research tools (PRA, Participatory
Diagnosis) to be able to adapt and/or improve the proposed tools. The second assumption is that the
trainers have a certain experience in educational activities. The document provides trainers with the
basic elements required to prepare the staff of the concerned projects to assist the communities to set
up a PME system.

The document is organized in such a way as to provide (pedagogical) guidelines on the conduct of train-
ing sessions and content on the PME system’s implementation process. Thus, each session is organized
around two sheets.

The first sheet (referred to, by convention, as learning exercise) proposes a pedagogical approach for
the conduct of the session. To effectively apply these pedagogical indications it must be ensured that all
the necessary logistics (including the availability of rooms for group work) are in place. The pedagogical
proposals are indicative. The facilitators can modify them to ensure that they adapt to the context of
each session. They can also be replaced by other techniques considered more appropriate. Each ses-
sion bears a number.

The second sheet (referred to as content sheet) provides a content summary to which the facilitator
may refer to provide additional information. Of course, these sheets are not exhaustive. Facilitators are
therefore strongly urged to enrich them with their own research and additional documentation in their
possession.




                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                                   7
SESSION 1                    INTRODUCTION TO THE WORKSHOP

                            LEARNING EXERCISE 1
                   PRINCIPLES AND PEDAGOGICAL PROTOCOL

1. Objectives of the session
   • Inform participants about the context of the workshop
   • Identity participants
   • Determine the workshop objectives
   • Define the workshop’s management principles
   • Define the working rules (group contract)

2. Proposed technique: Interaction, brainstorming

3. Material and equipment required:
Required materials and equipment: Padex paper, padex board, markers of different colours, wall
sellotape, index cards of different colours

4. Total duration of session: 60 mn

5. Educational progression
   • Prior to participants’ arrival and installation, the facilitator should check the state of preparation of
     the room, the learning facilitation system and the equipment installed the day before.
   • The room should be arranged in U-form or in staggered rows depending on the space available
   • The tables should be mobile for the organization of group work
   • The order in which participants will intervene is determined before the start of the session

    Expression of expectations:
    • Provide each participant with three index cards on which he/she is required to state what he/she
    expects from this workshop (ex: Achievements to be consolidated, constraints/difficulties to be
    removed, needs to be met).
    • The cards are then collected, analyzed and classified according to category.
    • These expectations are analyzed on the basis of the objectives predefined by the organizers.
    • The workshop agenda is presented to participants, discussed and adopted
    • The draft group contract is presented to participants, amended and validated
    (Content card 1a)

6. Information provided by the facilitator
The facilitator introduces the learning from experience approach which will guide the teaching facilitation
approach (CONTENT CARD1b). The session’s work is summarised.




8                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
SESSION 1                   INTRODUCTION TO THE WORKSHOP

                                    CONTENT CARD 1A

1. Group contract

  • Switch off or set mobile phones on vibration mode
  • Answer telephone calls outside the room
  • Ask for the floor before speaking
  • Listen to one another
  • Avoid repeating what others have already said
  • Be brief to facilitate effective time management
  • Limit going in and out of the room

2. Workshop principle

  • Learning based on experience
  • Allow participants to express their expertise
  • Diversify the interventions
  • Progress together on the basis of consensus

3. Organization of discussion sessions

  • Exchanges and discussions on salient points
  • Diversify teaching techniques
  • Production of ideas or experience acquisition to be listed on an index card
  • Plenary to present the outcome and collective analysis
  • Designation of a rapporteur for the day

4. Management of group work

  • Individual reflection based on past experience
  • Pooling
  • Write the ideas discussed on the index card
  • An idea per card
  • Write legibly, preferably in block letters




                    PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012          9
SESSION 1                   INTRODUCTION TO THE WORKSHOP

                                       CONTENT CARD 1B

Stage 1: Sharing the participant’s experience (or a similar experience)

The facilitator can use different tools or techniques such as case studies, simulation or role playing,
group work, showing a documentary film, brainstorming during which participants talk about their expe-
riences, etc. There is however need to underline that regardless of the technique used by the facilitator,
prior preparation is essential.
This can be very time-consuming. For example, if the facilitator wants to use case studies, he should
gather and organize the information long before the training. He can use case studies already prepared
but should examine them thoroughly himself in order to be able to answer questions that participants
could ask him. In case he wants to introduce a role playing exercise, he should prepare his scenario
beforehand with a clear definition of the different roles, the definition of adapted profiles to play the roles,
etc.

Stage 2: Reflection, conceptualization

After presenting the experience/experiment, the facilitator invites participants to share their views about
this experience. To properly organize the discussions, the facilitator prepares a certain number of key
questions beforehand? For example: What are the key observations? How do they explain them? What
are the lessons learnt? etc. All the ideas are written, as and when required, on the board or cards to be
displayed on a notice board prepared beforehand.

Stage 3: Conclusions, generalization

During the third stage, the facilitator establishes the link between the analyses made by participants
and the concepts or theory he wants to introduce. He will seize this opportunity to introduce any other
idea or concept which had not been mentioned by participants. It will be discovered that most of the
concepts which the facilitator wants to introduce during this session would have been mentioned by par-
ticipants. This stage thus provides the facilitator with the opportunity to show participants that they al-
ready have a real-life experience and an experience with these concepts; since the facilitator’s role is
to help them express their knowledge. In short, help them to discover the knowledge hidden in each of
them. This approach has another advantage because it helps to build the participant’s confidence, since
there is little space for theoretical presentations.




10                     PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
SESSION 1                       INTRODUCTION TO THE WORKSHOP

                                       CONTENT CARD 1C

Application

The last stage consists of the practical application of these new concepts. This application is generally
made after the training, when the participant returns to his/her working environment. It is therefore ex-
tremely important to evaluate the training application. This evaluation is generally done by the trainee’s
structure of origin. But the introduction of a practical application stage in the training provides participants
with the opportunity to test some of the concepts introduced during the training.




                                                  Experience




     Application                                                                         Reflection




                                                   General
                                                  Conclusion




                       PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                                   11
BRIEF OVERVIEW OF THE
     SESSION 2                           PARTICIPATORY APPROACH

                                          WORKSHEET 2

1. Objectives of the session
   • Ensure that all participants have basic knowledge of participatory research principles, techniques
   and tools
   • Provide participants with additional information, if necessary

2. Proposed technique: Show a film on « Question of Differences» : Gender and PRA or another film
(the film is among the distributed resources; the technique can therefore be applied by trainers).

3. Material and equipment required: Television, Cameoscope VHS, portable computer, padex paper,
padex board, DVD/CD or pen drive.

4. Duration of session: 60 mn

5. Educational progression
   • Before showing the film, the facilitator informs participants that they should take note of the different
   parts (the principles, tools, recommendations, etc.)
   • Show the first part of the film on the principles of communication and introduction to PRA.
   • After the film show, open a discussion in plenary to ask participants to share the essential points
   they have identified. It will be appropriate to proceded by theme by theme to facilitate the discussions
   and the organization of information.
   • Ask one of the participants to write the ideas on the padex board as they are given.
   • When the discussion focuses on tools, ask participants whether they are all familiar with these tools
   and/or whether they know others (to be noted on the table).
   • At the end of the discussion, the facilitator can provide documentation sources to participants re-
   quiring additional training. To that end, it will be useful to prepare a small documentation for distribu-
   tion.

6. Information provided by the facilitator
In case the facilitator has no film to show, he may use another teaching method.
For example, he can organize a brainstorming session around the following key questions:
    - What is participation?
    - What are its main principles?
    - What conditions are absolutely necessary for its implementation?.
    - Which participatory tools do you know?
    - What are the constraints and difficulties linked to the implementation of such participation?




     NB : This session is not meant to provide in-depth training on participatory research; since being
     well-versed in the participatory approach principles, techniques and tools is among the criteria on
     which the selection of trainers is based. The purpose of the session is thus to recall these
     principles, techniques and tools.




12                     PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
BRIEF OVERVIEW OF THE
  SESSION 2                               PARTICIPATORY APPROACH

                                       CONTENT CARD 2
                                       ON PARTICIPATION

What is participation?
Participation is an active process in which the initiative is taken or «jointly taken» by the people, guided
by their own ideas and using means and processes over which they have no effective control
(Guèye,1999).

Participation therefore means taking an active and decisive part in decisions concerning what should
be done, how it is done, profit sharing, monitoring and evaluation.

On the effectiveness of participation in development projects
Different projects apply the principles of participation in different ways. Some involve the populations
fully during the identification of problems and the planning of actions; but they quickly return to their old
practices during the implementation stage.

Other projects define their priorities and choose actions without the population’s participation and try to
« catch-up » by entrusting a few responsibilities to beneficiaries.

Others limit themselves with involving the populations in the monitoring and evaluation stage.

Of course, none of these three situations is to be encouraged because the beneficiaries’ participation
should be pursued at all stages of a programme’s life cycle.



                   Question: How do you perceive the effectiveness of
                             participation in your project ?



                                                      Project’s internalfactors The project’s internal
                                                      that encourage the        constraints and limits
                    Poor        Average      High
                                                      populations participation restricting the popula-
                                                                                tions participation
  Planning
 Implementation
 Monitoring and
 Evaluation




                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                                 13
BRIEF OVERVIEW OF THE
     SESSION 2                            PARTICIPATORY APPROACH

                                           WORKSHEET 2B

Conditions of participation

To ensure effective participation, the following three conditions should be simultaneously met:

     • All groups, particularly the so-called vulnerable ones, should be present
     • Such participation should not be limited to physical presence during decision-making; it should
     rather translate into an effective influence on the decisions and the monitoring of their implementation
     • It should not be limited to a specific stage of the project cycle but should be effective at all stages.

Some principles to be respected?

     • The adoption of an interdisciplinary approach to better take into account the diversity of situations
     and perspectives in the analysis of local situations. However, interdisciplinarity supposes the inte-
     gration, in the team, of resource persons from the local community.
     • Making optimum use of local knowledge and capacities in the analysis of problems and the choice
     of solutions. The institution of PME provides a good opportunity for the application of this principle
     since the beneficiaries become key actors of the system while the facilitator/presenter plays the fa-
     cilitating role.
     • The adoption of an iterative approach, which makes it possible to better link the reflection and the
     action and immediately apply, in the field, ideas generated through collective reflection and action
     research.
     • The adoption, by project agents, of attitudes and behaviours that recognize the populations’ central
     position in the analysis, planning, implementation, monitoring-evaluation process and their prepared-
     ness to establish a relationship of partnership and mutual learning with the populations.
     • Emphasis to be placed on visualization tools which facilitate communication and everyone’s partic-
     ipation including those who can neither read or write.




14                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
INTRODUCTION TO PARTICIPATORY
  SESSION 3                     MONITORING AND EVALUATION (PME)

                                         WORKSHEET 3


1. Objectives of the session
   • Define monitoring, evaluation and participatory monitoring and evaluation notions
   • Identify the main characteristics of participatory monitoring and evaluation
   • Analyze the differences between PME and conventional monitoring and evaluation

2. Proposed technique: Group work

3. Material and equipment required: Kraft paper, markers in sufficient
numbers,cards of different colours

4. Duration of the session: 70 mn

5. Educational progression
   • Form groups of 5 to 7 people
   • Give 5 cards of the same colour to each group
   • Ask the following focal question: «What are the main characteristics of participatory monitoring and
   evaluation? »
   • Give 10 mn to groups to identify the main characteristics of participatory monitoring and evaluation
   • Prepare an area (kraft paper pinned on the wall, boards, etc.).
   • Ask the rapporteurs of different groups to present the results of their reflection
   • Classify the cards by regrouping those relating to the same idea in order to obtain a group of key
   points (ask a participant to do this classification)
   • Make a summary of the main characteristics of participatory monitoring and evaluation
   • Get participants to identify the similarities and differences in the definitions and propose a summary
   definition (5 mn).
   • The definition retained is written on padex paper and displayed in the room

6. Additional information provided by the facilitator:
It is at this stage? Which one? that the facilitator may, if necessary, provide additional information, but
if the proposed definitions take into account most of the elements contained in CONTENT CARD N° 3,
it is recommended that emphasis be laid on the quality of the proposed definitions.




                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                               15
INTRODUCTION TO PARTICIPATORY
     SESSION 3                      MONITORING AND EVALUATION (PME)

                                           CONTENT CARD 3

Introduction to PME: Definition of concepts
Basic Concepts (a few definitions drawn from the training)

Monitoring:
  • Thorough and regular appraisal of resources, accomplishments and results of the intervention. Ap-
  proach consisting in ensuring that the planned activities have been carried out
  • Systematic and ongoing process for the collection of information on a programme or an activity to
  observe the changes that occurred and propose measures to guide the decisions to be taken

Evaluation:
  • Specific judgement on the programme process,
  • Assessment of the level of accomplishment of results at the end of the project,
  • Judgement on the value of an intervention with reference to criteria and standards,
  • Reflection on the match between actions undertaken and initial objectives
  • Action of making judgement such as the progress towards meeting the objectives (effectiveness) of
  a programme or an activity, comparing results and costs (efficiency), or the sustainable changes gen-
  erated (impact). The initial objective may be formative to help the programme improve its perform-
  ance. However, other evaluations may lead to more radical decisions: Continue or stop (summative
  evaluation)

Participatory monitoring-evaluation
  • An ongoing and regular process which actively involves stakeholders in all the stages of collecting,
  analyzing and using information on an intervention with a view to assessing the processes and results
  and making recommendations (provide information about decision-making).
  • It is a process to support the implementation of a development project/programme by grassroots
  communities and stakeholders which strengthens appropriation, mutual responsibility, transparency
  and knowledge of interrelations between the results, implementation factors and the environment.


           Differences between conventional monitoring-evaluation and PME

                                           CONVENTIONAL MONITORING           PARTICIPATORY MONITORING
                                              -EVALUATION (CME)                  -EVALUATION (PME)
                                           Generally the projects or      The beneficiaries with projector
     Who designs the system?
                                           programmes                     programme agents and other actors
                                           Indicators often selected       More often criteria than indicators
     When to select indicators?            at the start of the project and which are reviewed as time goes on
                                           generally remains unchanged
                                           Generally the project          The populations participate
     Who analyzes the information?
                                           agents                         actively in the analysis
     What types of information?            Essentially quantitative       Pivotal role of the qualitative analysis
     Taking the different perspectives                                    The diversity of view points is
                                           Poor, standardization
     into account                                                         highlighted
                                           Poor, standardized indicators
     Degree of flexibility                                               Iterative process
                                           and collection tools
     Source : Guèye, B




16                           PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
INTRODUCTION TO PARTICIPATORY
  SESSION 3                    MONITORING AND EVALUATION (PME)

                                          WORKSHEET 3

Importance of the PME

  • The PME contributes to improving transparency in the management of supported programmes sup-
  ported through the beneficiaries’ direct and ongoing control over decisions concerning resource al-
  location and the definition of priorities.

  • At the same time, it contributes to creating a reflex for the accountability reflex and the feeling of re-
  sponsibility towards beneficiaries.

  • It strengthens the relevance of programmes and the performance of actions initiated thanks to the
  populations’ enhanced participation in monitoring their implementation.

  • It strengthens the feeling of ownership of actions initiated among beneficiaries, and can thus en-
  courage them to be more involved.

  • The improvement of transparency in decision-making has led to strengthened confidence between
  beneficiaries and agents in charge of implementing the programmes

  • It strengthens the populations’ negotiation, planning and organizing capacities.

  The effective implementation of PME considerably improves the performance of programmes and
  the creation of longer lasting impacts.




                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                                  17
IMPORTANCE OF PME FOR
     SESSION 4                                  IFAD PROJECTS

                                            WORKSHEET 4

1. Objectives of the session
Show the importance of Participatory Monitoring-Evaluation for IFAD projects

2. Proposed technique: Group work, plenary

3. Material and equipment required:
Padex paper and board, sellotape, markers, video-projector, portable computers,
Well-lit room, rooms for group work

4. Duration of session: 90 mn

5. Educational progression
   • The facilitator introduces group work.

     • Divide participants into 2 groups.

     • Ask the focal question below to which participants should respond: «What improvements could
     the PME bring about in the monitoring-evaluation system being implemented by IFAD
     projects»?

     • Give 40 minutes to the groups.

     • Ask the different groups to present the results of their reflections.

     • Open the discussions by asking speakers to lay emphasis on the contributions that may enrich
     the groups’ proposals.

6. Information provided by the facilitator

The facilitator draws the key lessons based on CONTENT CARD N° 4:




18                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
IMPORTANCE OF PME FOR
  SESSION 4                                  IFAD PROJECTS

                                        CONTENT CARD 4

1. Objectives

Satisfy the needs relative to core functions in the life of a project
  • A sound planning of activities
  • Monitoring results and
  • Evaluating the project’s impact.

These three functions structure the system’s architecture:
  • Planning
  • Monitoring results
  • Evaluating the impact

The discharge of these functions facilitates the project’s supervision, mid-term review and final evalua-
tion.

The key actors of MES at the Branch and Local levels.

At branch level
Two MSE actors are present at this level: Professional organizations and chambers of commerce.

The branch represents the PMU and, in that capacity, constitutes a level of the project’s operational
oversight.

To achieve this, it is actively involved in the design and implementation of the MES through:
   • the validation of teaching materials and methods of the MES;
   • the collection, consolidation of MES data;
   • the use of MES products for monitoring (Trend charts);
   • data transmission at the PMU level;
   • support to MES actors at branch level;

The same activities will be carried out by the SAFIR with respect to component B.

PO and Chambers of commerce
Professional organizations (PO) and chambers of commerce of which the MSRE are members, will pro-
vide information about the support received and transmitted to MSRE within the framework of the proj-
ect.

At local level
At this level, two key actors are present, support service providers and the MSRE which are the project’s
main targets

Support service providers
The project has two categories of providers: information and awareness providers (IAP), specialist/gen-
eralist non-financial service providers.




                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                              19
IMPORTANCE OF PME FOR
     SESSION 4                                IFAD PROJECTS

                                        CONTENT CARD 4

These service providers are involved in the collection, analysis and use of data concerning the services
they provide to MSRE; the said data is then forwarded to the head of PMU monitoring-evaluation through
the branches.

The MSRE (micro, very small and small Enterprises), as well as AGR and PIE in the rural areas),
These MSRE express their needs for support received from the various providers and MFI; they provide
information concerning such support through the various providers. At this level, the type of beneficiaries
(enterprise) makes it fundamental to collect process and use data to ensure better management in order
to maximize the benefits.

Logical Framework
The logical framework is the main source for indicators of the monitoring-evaluation system. It helps to
define the project objectives more clearly, and determine the expected causal connections - the « pro-
gramme logic » - between the various elements of the chain of events that should lead to the achieve-
ment of results: providing resources, implementation terms, outputs, results and impact.

In this logical framework, the objectively verifiable indicators are the key tools for monitoring the progress
registered in the achievement of objectives. The hierarchy of indicators follows that of objectives: The
results achieved by the project and the anticipated effects can be accessed through some indicators,
while other indicators are interested in assessing specific objectives.

The monitoring mechanisms specify the data sources and the publication systems which will be used
to verify the state of each indicator. They should show what has been achieved in terms of input, results,
specific objectives and overall objective. The monitoring mechanisms and information system should
provide evidence that the objectives have been achieved.

The guidelines for a results and impact management system (RIMS) require the monitoring-evaluation
system of IFAD-funded projects to fill in a certain number of key indicators; however, these are not ex-
clusive, since a wider range of indicators (OVI of the logical framework) continue to be filled by the MES,
a range in which the RIMS first and second level performance indicators and impact indicators take an
important position.

The identification report presents the logical framework with indicators per level of objectives (overall
objective, specific objectives) as well as results indicators per component.




20                    PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
IMPORTANCE OF PME FOR
  SESSION 4                                 IFAD PROJECTS

                                       CONTENT CARD 4

Why a Participatory Monitoring and Evaluation System (PME) ?

The purpose of the participatory approach in a monitoring-evaluation system is to guarantee:
  • that all project actors, particularly the direct beneficiaries, take ownership of the results to ensure
  that there are more effects and impacts
  • the involvement of these actors (MSRE, providers of non-financial support services, privileged part-
  ners) as much as other actors in the collection and analysis of results.
  • the facilitation of interaction, the development of synergy and consistency in the implementation of
  activities of the entire IFAD programme. It will therefore take into account the level of IFAD actors,
  projects and programmes in Senegal.
  • take into account the specificity of results and their indicators for the different categories of actors
  • enable direct beneficiaries to generate and participate in collecting data and information on the
  progress of the project and the achievement of results.

Implementing the participatory approach in the monitoring-evaluation system

Considering the need to collect data on the indicators, actors of the system can be classified into two
major groups:
  • illiterates (the majority of RME managers, individual initiative developers) ;
  • literates (other actors)

The collection system should therefore be adapted to the specific or different situation by taking the il-
literate target into account, notably at the MSRE level, without changing the data quality.

There is thus need to provide illiterate beneficiaries with the appropriate collection materials to enable
them to monitor and evaluate their activities and results.

Regardless of its simplicity, this system has to be buttressed by a results collection and analysis capacity
building process. This capacity building process will be continuous and iterative in order to adapt better
to the monitoring-evaluation system.




                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                                21
SESSION 5                          STAGES OF THE PME PROCESS

                                           WORKSHEET 5

1. Objectives of the session
Identify the main stages for the setting up of a results-based PME system.

2. Proposed technique: group work, role playing, plenary

3. Material and equipment required: Padex paper and board, sellotape, markers, video-projector,
portable computers, well-lit room, rooms for group work

4. Duration of session: 90 mn

5. Learning approach

Introduction
Introduce the theme of the session:

     • Divide participants into groups of 5 to 6 people, and ensure that the composition of groups alternates
     to avoid having the same people in the same groups all the time
     • Give a set of 10 cards to each group
     • Explain to the groups that they are required to identify the main stages which, in their views, are
     needed to set a participatory monitoring-evaluation system. They have a maximum of 10 cards. The
     number of stages should not be more than 10.
     • They have 15 minutes to discuss and identify the main PME stages
     • Prepare a space (kraft paper pinned on the wall, ZOPP boards, etc.).
     • At the end of the allowed time, ask the rapporteurs of different groups to present the cards on the
     PME stages
     • Choose a voluntary participant to classify the cards by regrouping those relating to the same stage
     in order to obtain a group of key points
     • Start a discussion to enable participants to draw a picture of the main stages
     • The main stages are written on a padex paper

6. Information provided by the facilitator

At this stage, the facilitator may, if necessary, provide additional information. On the basis of CONTENT
CARD N° 5, he should check whether there are any missing key stages. If any, he can again provoke
the participants’ reflection to get them to identify the missing stage(s).




22                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
SESSION 5                  STAGES OF THE PME PROCESS

                               WORKSHEET 5




                   STAGES OF THE PME PROCESS


                                        1

                                  Decide to set
                                  up the system
                                                                          2


 7   Implement actions
                                                             Identify the actors
        for change

                                Management
                                                          Define the Expectations
                              and consolidation               and Objectives         3
                               of PME system

         Collect and
 6   analyze information


                                                             Identify the Criteria
                                                               and Indicators        4
                                        5

                               Chose the information
                                collection methods
                                     and tools



         Bara Guèye: Introduction to Participatory Monitoring and Evaluation




             PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                        23
SESSION 6                            SETTING UP A PME SYSTEM

                                           WORKSHEET 6

1. Objectives of the session
   • Provide participants with information system, suggestions about the setting up of a PME
     • Share analysis tools in the process for the setting up of a monitoring-evaluation system
     • Provide participants with additional methodological guidance, if necessary

2. Proposed technique: brainstorming

3. Material and equipment required: Cards, padex paper and boards, markers, sellotape,

4. Duration of session: 60 mn

5. Educational progression
   • Organize brainstorming based on the following focal questions:
   In the specific context of your project or organisation, what reasons or factors motivated the decision
   to set up a PME system?
   What are the constraints and opportunities generated by the setting up of PME in your projects
     • The answers are noted on the index cards and then organized and discussed
     • The facilitator then introduces CONTENT CARD N° 7
     • He asks representatives of different projects participating in the workshop to fill aide-mémoire card
     7 (if a project has several representatives, they form a group).
     • At the end of this exercise, the groups present their results.
     • These results are discussed

6. Information provided by the facilitator
At the end of the discussions, the facilitator invites participants to make suggestions and draw conclu-
sions by referring to CONTENT CARD N° 6.




24                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
SESSION 6                           SETTING UP A PME SYSTEM

                         CONTENT CARD 6
        Stage 1: DECIDE TO SET UP THE MONITORING SYSTEM




        ANALYSIS WORKSHEET ON THE CONDITIONS OF PME IN IFAD PROJECTS


What institutional conditions/preconditions            factors     factors   Depending on the
are required to successfully implement the           Favourable Unfavourable    reply, what
PME?                                                                         measures should
                                                                                 be taken?

The PME is perceived by the project as an or-
ganizational need
Within the concerned IFAD project, there is a
decentralized decision-making system which
allows communities to take into account the
results emanating from the application of the
PME

All members of the project have a clear reading
of the change of attitude which the PME
involves and are ready for these changes

Participation is perceived as a democratic and
non extractive process
Groups who need the system most were
identified

There is an institutional context that facilitates
community participation

There are good facilitators within the project,
who can assist the communities

Existence, within the community, of people
(presenters, community facilitators) who
can possibly facilitate the process




                    PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                        25
IDENTIFYING ACTORS AND
     SESSION 7                             ANALYZING THEIR NEEDS

                                          WORKSHEET 7

1. Objectives of the session
• Provide participants with the necessary tools and skills to identify actors

2. Proposed technique: Role playing, brainstorming, presentation, group work,

3. Material and equipment required: Kraft paper, markers in sufficient number, cards of different
colours

4. Duration of session: 90mn

5. Educational progression
   • Choose 2 to 3 IFAD projects whose representatives in the training will act as resource persons. It
   is recommended to select (if possible) projects intervening in different sectors or having different
   components.
   • Divide the rest of the group equitably between the selected projects (group work)
   • The exercise consists in identifying key actors who have an influence on the project or are affected
   by it: The focal question « who are the different actors affected by the project or with direct or indirect
   influence on its functioning ? » (Brainstorming) duration
   • Give 10 minutes to draw up the list of actors
   • At this stage, the facilitator introduces the actors’ analytical grid (see CONTENT CARD N°7)
   • After presenting the tool, the groups are requested to pursue the exercise by filing the grid on the
   basis of the list of identified actors. Duration: 20 minutes
   • At the end of the allocated time, ask each group rapporteur to present the results of its group
   • Open a discussion on the different presentations. Duration: the remaining 50 minutes?
   • The facilitator makes recommendations /gives advice on how to use and take advantage of the grid
   within the framework of their work.

When will the simulation announced in the proposed techniques be made?

6. Information provided by the facilitator
Based on CONTENT CARD N° 7, the facilitator informs participants of the existence of other authors’
analysis tools. He may thus request participants to propose tools which may be listed on padex paper.
The facilitator may request those making proposals to prepare summary sheets for the presentation on
the use of these tools.

These sheets could be improved, if necessary, and distributed to participants
The facilitator can also present the power-interest grid explaining that it is complementary to the actors’
analysis grid presented earlier on. In general, the power-interest grid is applied first to classify actors
according to their interest and power. The actors’ analysis grid can then be applied to better understand
the nature of these interests and powers.




26                    PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
IDENTIFYING ACTORS AND
  SESSION 7                               ANALYZING THEIR NEEDS

                              CONTENT CARD 7
             Stage 2: IDENTIFICATION AND ANALYSIS OF ACTORS

Who are the actors?
The actors are those who have an influence on or are affected by the project or programme concerned
by the participatory monitoring-evaluation.

The identification and analysis of actors are an important phase in the establishment of the PME sys-
tem.

The PME is set up to meet the concerns of these actors, particularly those directly affected by the inter-
vention of the project or programme (direct and indirect beneficiaries).

Some actors are more visible because of the positions they occupy and the roles they play in the com-
munity or project. But there are also less visible actors who generally belong to so-called vulnerable
groups and are most affected by the activities undertaken. These groups, which constitute the primary
beneficiaries of the project, should play a central role in the design and management of the PME sys-
tem.

It is therefore important to have an appropriate approach and tools to identify them and examine their
interests and what they expect from the project, the type of influence they can exert on the project ac-
tivities and the arrangements to be made.

How to conduct the actors’ analysis?
There are several tools for that purpose. They include:

The power-interest grid:
It is used to make a simple mapping of actors by taking into consideration the interest that each of them
could have for the PME system to be set up, as well as the influences (positive or negative) that he/she
could have on the system. To apply it, one should first, identify all the project actors and second, prepare
a typology by placing each actor in one of the 4 spaces of the grid, corresponding to its interest and the
importance of his/her influence. Of course such a classification should be justified. At the end of the
classification, one should examine the actions to be undertaken for each of the 4 categories of actors
identified for the success of the PME system to be set up.

The actors’ analysis grid:
It facilitates the identification of the different actors, their interest for the system, their influence on the
system, and the actions to be taken to improve their participation. As can be observed, this grid makes
it possible to produce the same type of information as those generated by the power-interest grid, the
only difference being that the former is used to classify actors.

The two grids are also complementary since the actors’ analysis grid can be used as a back-up for the
organization of information generated by the reflection which accompanies the preparation of the power-
interest grid. But, for reasons of simplicity, one can choose to use only one of them. One should not
lose sight of the fact that this process is, first and foremost, meant for the local populations and that, as
a result, one should avoid using a variety of tools which would complicate the process even more.




                       PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                                   27
IDENTIFYING ACTORS AND
      SESSION 7                               ANALYZING THEIR NEEDS
                                         CONTENT CARD 7




                                    POWER-INTEREST GRID
 HIGH




                Keep them informed about the                    Important actors!
                 conduct of the programme                 Do everything to maintain this
                                                              group in the process
                                                           Generally key beneficiaries
      POWER




                    People or groups living
                     in the community but                Step up their level of information
                  not directly affected by the                     and training
               Programme. If they are potential           Need for negotiating capacity
              beneficiaries, they should, if possi-
                  ble, be associated in some
               actions in order to prepare them
LOW




                                              INTEREST
                        Low                                                     HIGH


                                THE ACTORS’ ANALYSIS GRID
                                                                   What negative
                          What interest do     What positive                         How to step up
                                                                   influence can
                            this group of    influence can this                     the participation
     Actors                                                       this group have
                           actors have in    group have on the                        of this group
                                                                    on the PME
                              the PME?         PME system ?                            of actors?
                                                                      system?




28                       PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
SESSION 8                        DEFINITION OF PME OBJECTIVES

                                         WORKSHEET 8


1. Objectives of the session
Improve the participants’ knowledge of PME to strengthen their capacity to assist the populations in
identifying PME objectives

2. Proposed technique: Case study, role playing

3. Material and equipment required: Kraft paper, markers in sufficient number, cards of different
colours

4. Duration of session: 90 mn

5. Educational progression
   • Choose 2 IFAD projects whose representatives in the training will simulate the role of direct
   beneficiaries. It is recommended to choose (if possible) projects intervening in different sectors or
   having different components.
   • Train as many groups as selected projects, if the number of participants allows it.
   • Explain that the exercise consists in putting oneself in the shoes of beneficiaries to identify the
   monitoring-evaluation objectives in the selected project. Other members of the group should ensure
   that the objective is clearly stated.
   Ask the following focal question « What are we trying to know or pursue through our participatory
   monitoring-evaluation system? »
   • Ask each group to formulate a maximum of two (2) objectives
   • Give each group a padex paper to list the objectives
   • At the end of the allotted time, ask each group rapporteur to present the objectives set for the IFAD
   project he/she represents
   • Open a discussion on the different presentations. Focal questions to guide the discussions:
      - Are the objectives well formulated?
      - Are they effectively PME objectives?
      - If not, what other reformulations can be proposed?

6. Information provided by the facilitator Drawing inspiration from Content Card N° 8, the facilitator
provides the necessary additional information about the formulation of objectives.




                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                              29
SESSION 8                        DEFINITION OF PME OBJECTIVES

                                CONTENT CARD 8
                Stage 2: DEFINITION OF THE OBJECTIVES OF PME
                             SYSTEM TO BE SET UP
                           Define the monitoring objective.
For simplicity, the objective of PME specifies what the key beneficiaries seek to monitor and evaluate.

Who defines the PME objectives?
Within the framework of PME, the objectives are those of key beneficiaries. The project is meant to
assist the latter to identify the objectives they intend to assign to their PME system. The facilitator should
build on the analysis previously conducted by actors to identify all persons or groups who should par-
ticipate in the identification of objectives.

A few rules
   • Since it is a PME system essentially meant for the communities, one should avoid being dogmatic
   in the formulation of these objectives
     • The populations should be provided with the opportunity to present their ideas (objective) clearly,
     regardless of the method they use. For example, the populations may formulate their PME objectives
     as follows:
        - we would like to know whether women participate effectively in the meetings held by our group-
        ing;
        - we would like to see whether the decisions taken concerning the management of financial re-
        sources allocated to the project are transparent,
        - we would like to see whether the quality of services provided by the project effectively meets
        our expectations
     • Ensure that the populations do not select many PME objectives. The more objectives there are, the
     more indicators one has to pursue. This makes the system more complex and more difficult to man-
     age
     • When the PME is launched for the first time, one should be limited to one or two simple objectives;
     and as the populations understand the system, new objectives can be added
     • For example, in view of the current situation of the project, is the monitoring of service quality the
     most important? Or the participatory monitoring-evaluation of the different actors’ participation? Or
     the PME of the achievement of project objectives?




30                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
SESSION 9                            CHOICE OF PME INDICATORS

                                         WORKSHEET 9

1. Objectives of the session
   • Enable participants to understand what a monitoring-evaluation indicator is
   • Define the main characteristics of the indicator
   • Describe the process for the participatory definition of indicators with target groups

2. Proposed technique: Brainstorming, Group work

3. Material and equipment required: Padex, padex paper, markers, sheets,
video projector, computer

4. Total duration of session: 90 mn

5. Educational progression
   • Ask participants to form pairs
   • Give 3 sheets to each group and ask them to write a key word describing the indicator, on each
   sheet
   • In plenary, ask each group to designate a rapporteur to present their results;
   • The sheets are displayed on the board or on a wide Kraft paper as they are presented;
   • The facilitator asks a participant to classify the sheets in homogenous clusters; • The list of key
   words is written on a padex paper
   • Building on content card n° 9, the facilitator completes the results produced, where relevant
   After this, the facilitator requests the working groups to come together around the PME objectives
   defined during the preceding session (session 8)
   • Ask the groups to define indicators in relation to the objectives defined
   • Ask the groups to present their results
   • Ask participants to discuss the results: question to guide the discussion: are the indicators clearly
   defined?
   • Write down the different comments on paper
   • Then ask in plenary: What characteristics are common to the different criteria defined?
   • The answers are written on padex paper

6. Information provided by the facilitator
The facilitator draws a conclusion on the main characteristics of the indicator

What is an indicator?
  • A revealer,
  • A marker,
  • A set of measures
  • A describer,
  • A simplifier of a more complex reality

What is it used for?
To measure the progress made during a given period of time in relation to a monitoring objective defined
beforehand. Since each indicator provides information concerning only one part of the objective to be
monitored, it is naturally necessary to have several indicators for each objective. For example, if the
members of a grouping participate regularly in meetings, the different indicators should be identified.



                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                              31
SESSION 9                           CHOICE OF PME INDICATORS

                                CONTENT CARD 9
                  Stage 4: CHOICE OF MONITORING INDICATORS

What are the types of indicators

     • Resource indicators concern the budget allocated at every level of the intervention, the human
     resources mobilized, etc. The measurement of these indicators provides information about the
     efficiency of the project’s intervention.
     Example
         • Grants
         • Annual Budget
         • Borrowings
         • Labour
         • Input costs
         • Etc.

     • Activities indicators: to achieve the project objectives, a certain number of activities are
     implemented. The monitoring system may focus on the level of achievement of these activities
        • Meetings
        • Training
        • Visits
        • Etc.

     • Process indicators: They relate to the decision-making process and makes it possible to
     determine, for example, the inclusion and/or participation of actors, the regularity of meetings, the
     regularity of reports, etc.
        • Existence of reporting rules
        • Degree of women’s participation in decisions
        • Frequency of debriefing meetings
        • Etc.

     • Product indicators: When an activity is carried out, it generally generates a tangible or non tangible
     product. For example, at the end of a training, the number of people trained (product) can be
     assessed. The product is the immediate and tangible result of the combination of a resource
     (expenditure) and an activity (training): product: number of trainees
        • Trainees
        • Number of text books produced
        • Number of credit received
        • Etc.

   • The results indicators reflect behaviour. For example, a few months after the training, one can
   assess how many participants have applied what they learnt. Or if a project distributes equipment
   (product) one can assess how many beneficiaries use this equipment.
Results indicators also assess the scaling down of women’s working hours following the introduction of
a new activity or equipment.
      • Number of people who applied the training received
      • Use of credit obtained
      • Number of people who use the text books
      • Etc.



32                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
SESSION 9                             CHOICE OF PME INDICATORS

                               CONTENT CARD 9
                 Stage 4: CHOICE OF MONITORING INDICATORS

  • Impact indicators assess the long-term consequences of an intervention, beyond the immediate
  effects. However, it is very difficult to evaluate an impact and link its cause to a given project.
Actually, the impacts are generally the product of several unrelated interventions in time and space. This
explains why, in PME, emphasis Is particularly laid on the other levels and, in particular, on the effects.

A few principles
   • Avoid being dogmatic: the criteria can also serve as a basis
   • Different groups may have different criteria or monitoring indicators
   • Since the process is iterative, the number and type of indicators may be readjusted as time goes
   on
   • At the beginning, choose a limited number of relevant indicators to foster learning
   • It is essential to have a certain balance between the different levels of criteria/indicators (associate
   criteria related to the activities and others related to the process);

Example



  Our objective                      Indicators

  We would like to know                 • Number of meetings held
  whether women participate             • Number of participants
  effectively in the meetings           • Number of women
  held by our grouping                  • Number of decisions taken

                                        • Types of services offered
                                        • Total number of beneficiaries
  We would like to see                  • Number of female beneficiaries
  whether the quality of                • Number of districts or villages
  services provided by the              • Number of women beneficiaries per
  project effectively meets             district/village
  our expectations
                                        • Number of people expressing satisfaction
                                        • Number of unsatisfied people
                                        • Etc.




                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                                 33
SESSION 9                           CHOICE OF PME INDICATORS

                                CONTENT CARD 9
                  Stage 4: CHOICE OF MONITORING INDICATORS

What characteristics are common to these different indicators?

They are
  • Simple: Each indicator refers to only one thing and is free of ambiguity

     • Measurable: These indicators are formulated in such a way that they would be measurable:
     Thus the changes made can be measured from one participation monitoring-evaluation session
     to another

     • Achievable/accessible: The populations may have access to information required to assess
     the changes

     • Effectively reflect the objective (relevancy): the indicator should measure what it is supposed
     to measure and not another reality

     • Temporally measurable: When a monitoring periodicity is defined, it should be ensured that it
     helps observe the expected developments in the indicator measurement.

It is worth noting that the measurement notion does not necessarily refer to numbers and quantities.
Less tangible indicators like perception can be measured using the appropriate measurement tools.


               Be careful to: Make a distinction between the criterion and the indicator


The criterion refers to general values accepted by the community and serving as a beacon that
guides the community’s view: ex, women’s participation in decision-making, the poor’s access
to services. Very often, in the PME exercises, the populations mention the criteria first. The fa-
cilitator, through probing questions, should be able to get them to identify the indicators. For
example, if the group says it wants to evaluate women’s participation, the facilitator can ask its
members what measures they intend to use for that (number of women participating in meet-
ings, number of women in the office, number of participations at meetings, etc.) and which refer
to indicators.


                  A few steps for the participatory definition of indicators:

     • Bring together all the groups whose participation in the monitoring exercise in necessary
     • Identify what the success of the initiative means for each group, and this results in criteria
     • On the basis of the criteria, define indicators either in plenary, or in small groups
     • Define the units of analysis and the sampling procedure
     • The indicators are likely to change, depending on the progress of the project, the
       context, partners




34                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
CHOICE OF INFORMATION
  SESSION 10                                  GATHERING METHODS

                                          WORKSHEET 10


1. Objectives of the session
Familiarize participants with the PME’s results-based participatory data collection tools and techniques

2. Proposed technique: Brainstorming, group work, presentation, case study

3. Material and equipment required: Kraft paper, padex paper, markers in sufficient number, cards of
different colours

4. Duration: 65 mn

5. Educational progression
   • Brainstorming on participatory monitoring evaluation data analysis tools at the projects’ level (15mn)
   «What data analysis tools do you use in projects? »
   • If necessary, the list of tools is completed by the trainer/ facilitator (5 mn)
   • The participants are divided into small groups of 3 to 4 people and the facilitator assigns to each
   group 1 or 2 tools with which participants are familiar
   • The conditions of use of the listed tools are analyzed (favourable conditions, limits) 30mn
   • The groups present the results of their reflection (15 mn)

6. Information provided by the facilitator
    • Insist on the fact that in a participatory process, data collection and analysis are done simultane-
    ously
   • Based on CONTENT CARD N° 10, the facilitator provides the additional information required
   Before closing this session, he announces the presentation of the video on the use of the Evaluation
   Form by the Community as an example of an appropriate PME tool for the monitoring of qualitative
   indicators.




                       PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                              35
CHOICE OF INFORMATION
     SESSION 10                                GATHERING METHODS

                           CONTENT CARD 10
         Stage 5: CHOICE OF INFORMATION GATHERING METHODS
                               AND TOOLS

Several participatory tools can be used within the PME framework. However, the choice of a specific
tool depends on the system that has been put in place. In fact, the PME application scale, the types of
actors involved, the targeted objectives and the PME indicators influence the choice of tools. However,
regardless of the types of tools chosen, an important principle, namely the demand for PME simplicity
should be taken into consideration. In this perspective, a few rules should be complied with:

     • The tools should be chosen in close collaboration with the local actors entrusted with managing the
     system to be set up;
     • Limit the number of tools as much as possible. The greater their number, the more complex the
     PME system is;
     • To facilitate the involvement of everyone, and make the PME tool more user-friendly, there is need
     to promote visualization, as far as possible. It would be a mistake to believe that visualization is only
     meant to facilitate access to information for illiterates. Today, visualization has become a key dimen-
     sion of modern communication, and it is increasingly preferred to facilitate learning;
     • As regards visualization, illustrations should be chosen by /with the actors themselves (avoid having
     the consultant decide the forms of illustrations) ;
     • Need to translate the key concepts in local languages

Proposed tools: The form for evaluation by the Community Assesment Forum (CAF)


                                           Advantages of the FEC

     • It is a tool that makes it possible to take into account, in an integrated manner, the different PME
     stages
     • Its application is based on the participation of all the groups
     • Its application provides IFAD project managers with immediate feedback on how beneficiaries
     perceive the quality of services and on measures to be taken
     • Actions to be implemented result from a collective reflection that takes the views of all actors into
     consideration
     • It is simple and accessible to all because it is based on visualization
     • The information is generated through focus groups, which facilitates the participation of groups
     with difficulties to express themselves during mixed group discussions
     Source : Guèye, B (INDh, 2008)


                            CONTENT CARD N° 11 describes the Community
                             Assessment Form (FEC) application process




36                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
INFORMATION GATHERING
  SESSION 11
                                             AND ANALYSIS
                                         WORKSHEET 11

1. Objectives of the session
Provide participants with the ability required for data collection

2. Proposed technique: Video projection, group work

3. Material and equipment required: video on the use of the form for evaluation by the community,
Kraft paper, markers in sufficient number, cards of different colours

4. Duration of session: 90 mn

5. Educational progression
   • Introduce the video application context
   • Before starting the projection, ask participants to note the different stages of the Community
   Assessment Form (FEC) application (meaning of the acronym)
   • After the presentation, open a discussion session for a summary of the main stages;
   • The facilitator then proposes to participants to apply the Community Assessment Form (FEC) in
   their evaluation of the application of the participatory approach within IFAD projects
   • To that end, it is proposed that participants be divided into 2 groups representing field workers
   of IFAD projects (group of actors 1) and the populations beneficiaries of IFAD projects (group of
   actors 2). Choose an IFAD project
   • The two groups meet first to identify the indicators that will enable them to assess the
   effectiveness and quality of the application of the participatory approach by IFAD projects
   • Limit the number of criteria to no more than 5 (it is an educational exercise)
   • Follow the stages described in the card for the completion of the exercise
   • Following the presentation of results, the methodological observations are noted (difficulties,
   questions, etc.).

6. Facilitator’s information input
   • On the basis of CONTENT CARD N° 11, the facilitator tries to provide answers to the questions
   asked. He also provides all other necessary information on the use of the form,
   • He should however explain that the Community Assessment Form (FEC) was the tool preferred for
   the training, but that other tools exist. He gives examples of monitoring tools contained in CONTENT
   CARD 11. He may also ask participants to share other tools they know or use. The facilitator lists
   them on a padex paper




                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                               37
INFORMATION GATHERING
     SESSION 11                                  AND ANALYSIS

                             CONTENT CARD 11
              Stage 6: INFORMATION GATHERING AND ANALYSIS

                                     Information gathering
       Presentation of the process on the use of the Community Assessment Form (FEC)

FEC application process
Session for acquaintance, mutual understanding, presentation of the objectives of the visit and the pro-
ceedings of the session. During the presentation session, insist on the importance of the local actors’
commitment as an emerging approach to strengthen the performance of public programmes; but espe-
cially on the need for local actors to acquire the capacities required to ensure monitoring and evaluation.
Such a mechanism should be positively perceived, because the way in which beneficiaries perceive the
services provided by the programme gives signals to officials and grassroots representatives that would
enable them to improve the quality and performance of their services on a daily basis.

Identify the key stakeholder groups. These groups benefit from the actions of the programme, those in
charge of providing these services, or those in charge of controlling the implementation, etc. In reality,
this identification has already been done (see session 8);

Focus groups: division of team members into homogeneous sub-groups whose number is equal to that
of the stakeholder groups. The criteria for the composition of these focus groups may vary from one
PME system to another; it may be a criteria related to gender, residence, types of services received,
etc.

Ensure the proper distribution of skills, profiles and sex. A facilitator will be attached to each group to
assist the latter to evaluate the indicators to be identified. There is need to ensure optimal time man-
agement (moderation, reporting, in particular).

Organize a brainstorming session regrouping all stakeholder groups to discuss and choose the most
relevant monitoring-evaluation indicators. Avoid having too many indicators. In some cases, each stake-
holder group chooses its indicators separately. But the advantage of having the same criteria lies in the
fact that this facilitates comparisons; the evaluations made by through the differences relative to the
same aspects;

Before initiating the following stage, and in the event that the process is applied for the first time, the fa-
cilitator assists the group to design the monitoring-evaluation medium. The latter is composed of a grid
adjusted for the qualitative type indicators. The grid facilitates the measurement of the levels of satis-
faction in relation to services received/rendered, actors’ involvement, management, etc. Below is a model
of the assessment form:




38                     PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
INFORMATION GATHERING
 SESSION 11                                      AND ANALYSIS

                                          CONTENT CARD 11
             Project Village or Zone:
             Nature of the monitored component:
             Stakeholder group:


                                                                                           COMMENTS: jot down
 INDICATOR                                                                                 the reasons justifying
                                                                                           the scores given


               1.Dissatis- 2. Poorly      3.Moderately
                                                    -                   5.Very satisfied
                                                         4. Satisfied
                 fied         satisfied   satisfied

                Ooooooo      Ooooooo Ooooooooooo         Oooooooooo     Ooooooooooo
 INDICATOR       (16%)        (14%)     (24%)              (22%)           (24%)

 INDICATOR

 INDICATOR
 INDICATOR
 INDICATOR
Etc.

  • On the basis of the selected indicators, the different groups work separately to carry out the
  evaluation with the help of the evaluation form. In each group, explain clearly the principle of the
  exercise and the results expected:
     - copy the evaluation grid on padex paper;
     - Explain the grid filling principle and, in particular, the fact that participants vote individually (each
     participant should give a score for each criteria). It is even preferable for each participant to record
     his/her vote directly on the grid;
     - Regardless of the score given, the reasons for such a choice should be well argued and as one
     goes on, scored in the « comments » column by the facilitator;
     -When all the individual scores are recorded next to the corresponding criterion, these scores
     should be converted into percentage. The most significant observations are recorded in the cor-
     responding box (comment)
  • After collecting the scores given for all the evaluation criteria, start a discussion to collect all
  additional observations on the final results of the exercise.
  • Interface between actors. This is an important stage. It consists in regrouping the different
  stakeholder groups to compare the respective analyses. The exercise is not meant to build a
  consensus but to understand the factors that explain the differences in perception. It can be
  structured around key questions like: What are the differences/similarities observed in the
  perceptions and analyses by the different groups? How does the extended group interpret these
  differences and/or similarities ? What are the causes of these differences?
  What are the changes to be made? All this information shall be carefully noted on padex paper. The
  facilitator shall then help the group to organize this information into key thrust areas or themes.
  • Negotiation: On the basis of the results of the interface session, the actors identify the different
  actions to be implemented in order to improve the situation.



                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                                          39
INFORMATION GATHERING
     SESSION 11                                 AND ANALYSIS

                                       CONTENT CARD 11

Move from evaluation to monitoring
To simplify things, monitoring can be considered as a regular succession of evaluation sessions con-
cerning the same objectives and indicators. Thus, the monitoring process entails repeating the sessions
at regular intervals to assess the different indicators that have been identified. After each session, the
results will be recorded in the monitoring table (see model below). However, after recording the results
in the monitoring table, the facilitator should get the group to compare these results with those obtained
during the preceding monitoring session. The grid for the analysis of changes occurring between ses-
sions may be used to gather the various information emanating from this analysis.

Monitoring-evaluation of quantitative indicators
A diverse range of simple tools may be used to monitor quantitative indicators. However, given the spe-
cific situation of each participatory monitoring-evaluation system, the creativity and innovation of local
actors are required to develop suitable tools. This also has the advantage of facilitating the appropriation
of tools by the populations. For this reason, it is always strongly recommended to facilitators working
with the communities- after identifying the indicators- to invite the actors of the system to create simple
tools to measure these indicators by taking into account some principles discussed earlier, namely sim-
plicity and the use of visualization to represent the indicators and quantities. The facilitator should avoid
proposing his own tools from the onset. He should first invite the populations to explore their own cre-
ativity potential before showing them the tool(s) at his disposal. Actually, it might not even be necessary
for him to present his own tools if the populations succeed in developing a simple and efficient tool to
measure the selected indicators.




40                    PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
INFORMATION GATHERING
SESSION 11                                 AND ANALYSIS

                                      CONTENT CARD 11
                               A few examples of PME tools
                Example 1: Labour utilization monitoring form

Type of beneficiary          Period             Period                Period




 Initiative developing RME
 Number of jobs created




  Number of apprentices




     Training received




     Composante B
Number of loans received



    Amount of loans




     Amount repaid




    Composante C




                     PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012      41
INFORMATION GATHERING
     SESSION 11                               AND ANALYSIS

                                       CONTENT CARD 11


                                               Example 2:
                                 Programme CES 2, Burkina Faso.
      This tool may be adjusted to serve as a monitoring-evaluation medium. To
     that end, instead of daily intervals, one can adopt intervals that are more in
         line with the selected indicators (monthly, quarterly monitoring, etc.).


                                                     Farming Activity

     Days in the   Duration of   Labor input    Labor input       Labor input        Exaternal    Cash expenses
       week          work           man           woman              child          labor input   on hired labor


       Day 1
     1 symbol
       Day 1
     1 symbol
       Day 1
     1 symbol

       Day 1
     1 symbol
       Day 1
     1 symbol
       Day 1
     1 symbol

       Day 1
     1 symbol

     LEGEND

      Full                   Half                    Day of the                     Local
                                                 X                              W
      workday                workday                 week                           currency


Source: Hien, Fidèle et Ouédraogo, Ali




42                     PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
INFORMATION GATHERING
  SESSION 11                                           AND ANALYSIS

                                                 CONTENT CARD 11


Example 3: The evaluation wheel used to assess local governance in Fissel (Senegal). The use of this
tool at regular intervals can show the Rural Council and other participants of the process, how the as-
sessment of citizens can change following actions taken after each PME session.

This tool can be used within the framework of any IFAD project to monitor and evaluate other qualitative
indicators.



           DOXINU CONSEY RIIRAL                                  10


                                                                                                 10

                            10                                            Limu jëf yi
                                           Caytub alal ji


                                                                                           Japandik tënku        10
                                                                                           kaayi dogal yi
          10         Jaapandik
                     jumtu
                     kaayi tétëlin



                Jaapandik tasu                                                                   Xeeti kom-kom yi
                kaayi xabaar yi
     10                                                                                                               10



                Dayoob
                jumtukaay
                yi



                     Bookiinu ndaw
           10        ci dogal yi


                                     Limu way                                           Limu ndaje yi
                                     japalé yi      Téewayu
                     10                             ndaw yi ci                                              10
                                                    ndaje yi          Limu dogal yi


                                           10                                            10
                                                             10




Source : Guèye, B (2005)




                        PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                                               43
INFORMATION GATHERING
      SESSION 11                                              AND ANALYSIS

                                                     CONTENT CARD 11

                                                   Monitoring table model
                  Monitoring session of:.............          Monitoring session of:……….                 Monitoring session of:……
                  dissatis-   Poorly Modera- satisfied Very dissa-      Poorly Mode-    Satis-   Very     Dis- Poor- Mode-      Satis- Very
     Criterion    fied        satis- tely              satis- tisfied   satis- rately   fied     satis-   satis- ly   rately    fied satis-
                              fied   satisfied         fied             fied   satis-            fied     fied satis- satisfied        fied
                                                                               fied                              fied

                  1           2      3         4         5     1        2      3        4        5        1     2     3        4      5



                       XX      X         XX        XXx          Xxx      Xxx    XXx      XXx         Xx
                       XX      XX        XX        xxx                          xxx      xxx
     Indicator         XX      X                         0%    15%      15%
                       X               X           30%                          30%     30%       10%
                      35%     20%     15%

     Indicator


     Indicator


     Indicator


     Indicator



                      Grid for the analysis of changes occurring between
                                    two monitoring sessions

     Indicators
                              Compared to the preceding        Factors explaining        Factors explaining         What actions need
                              monitoring session, did the      the positive              the negative               to be taken?
                              evaluation of the indicator      change in the             change in the
                              reveal (1) a positive change,    evaluationof the          evaluationof the
                              (2) a negative change or         criterion                 criterion
                              (3)
                              No change at all?


     Indicators

     Indicators

     Indicators

     Indicators

     Indicators




44                                PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
SESSION 12                           IMPLEMENTING CHANGES

                                        WORKSHEET 12

1. Objectives
   • Provide information about the process for the activation of changes
   • Discuss with participants about tools and techniques for the introduction of changes

2. Proposed technique: Group work, role playing

3. Material and equipment required: Padex, padex paper, wall sellotape, markers,

4. Duration of session: 30mn

5. Educational progression
   • Maintain the same groups as those of the preceding session
   • Ask them to pursue the exercise by identifying and planning, on the basis of the evaluation
   results, the actions to be undertaken with a view to strengthening the resolve to take into
   consideration the participatory approach within IFAD projects
   • Introduce the tool (planning table below) which will be used to organize information:




   Who?           What?             How?            When?          How many?             Who pays?




  • Each group draws its table, fills it and puts it on padex paper
  • The results of the work are presented and discussed in plenary
  • The facilitator provides other clarifications or further details, if necessary (adopting a name)

6. Additional information provided by the facilitator:
The facilitator draws inspiration from the substance of CONTENT CARD N° 12 to conclude the session.




                     PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                              45
SESSION 12                            IMPLEMENTING CHANGES

                                      CONTENT CARD 12


IMPLEMENTING CHANGES

Review the different actions proposed in the cards during preceding stages on the evaluation of indica-
tors. The facilitator should however ensure that the actions scheduled fulfil a certain number criteria:
     • They should be realistic and achievable within reasonable time
     • The capacities and means required to achieve them should be available
     • Actors are firmly committed to implement them.




                       The table below can be used to plan the
                              implementation of actions


                                                                                 How much and
        What?               By whom?            How?            When?            who pays ?




46                     PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
MANAGEMENT AND CONSOLIDATION
  SESSION 13                      OF THE PME SYSTEM

                                       WORKSHEET 13


1. Objectives of the session
   • Identify the key elements of the results-based management of the PME system
  • Determine the measures and actions to be taken to ensure the sustainability of the system

2. Pedagogical approach: Brainstorming, Group work

3. Duration: 60 mn

4. Material and equipment required: Kraft paper, markers in sufficient number, cards of different
colours

5. Educational progression
   • Ask participants to divide themselves into groups of 6 to 8 persons.
  • Explain the purpose of the exercise: It consist in identifying the key elements to be taken into con-
  sideration in the management of a system.
  • Give 5 Bristol cards to each group and ask them to write the results by putting only one idea on
  each card
  • At the end of the allocated time, ask the group rapporteurs to reconstitute the results of their pro-
  ceedings,
  • As they go along, the cards are affixed on a board in an appropriate space prepared beforehand
  • Request a voluntary participant to organize the different cards by putting together those that talk
  about the same idea
  • After this work, write on a padex paper, the key elements of PME management as they emerge
  from the group work

6. Information provided by the facilitator

On the basis of CONTENT CARD N° 13, the facilitator provides any other additional information and
clarifications required.




                     PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                              47
MANAGEMENT AND CONSOLIDATION
     SESSION 13                         OF THE PME SYSTEM

                      CONTENT CARD 13
       MANAGEMENT AND CONSOLIDATION OF THE PME SYSTEM

The management of a PME system consists in:
1. Mobilizing the actors;
   • Inform the populations about the different activities related to the PME system
   • Raise their awareness about the importance of the system and the need for their participation
   • Organize sessions to reconstitute the results of monitoring sessions and collect their feedback
   • Ensure the regular participation of all the groups, particularly the vulnerable groups
   • Etc.
2. Facilitate the PME sessions (Facilitation, Appropriation and Sustainability of the system) :
   • Plan and organize the different PME sessions
   • Prepare the pedagogical materials
   • Organize the different focus groups
   • Facilitate the monitoring and evaluation sessions
   • Organize information emanating from monitoring sessions
   • Prepare reports
   • Disseminate information to the different actors
3. Resource management (media and other resources).
   • Manage the PME medium. It is suggested that the PME grid be reproduced on a solid and detach-
   able medium (Wooden table, for example) and place it in an accessible place (office of the monitoring
   committee)
   To enable everyone to be regularly informed
   • Manage all the reports and documents produced within the framework of the system
3. Follow-up the implementation of recommendations from the PME sessions;
   • Be in contact with the project and other actors to ensure the implementation of recommendations
   from the PME sessions
   • Evaluate the implementation of the PME system itself
   To play these different roles effectively, there is need to institute a simple, flexible but efficient orga-
   nizational mechanism. Generally, a body in charge of managing and coordinating the PME system
   is set up for that purpose. Regardless of the appellation (monitoring committee, PME system coordi-
   nation committee, etc.), the institution of this body should fulfil a certain number of criteria :
   • It should be representative of key stakeholders concerned by the programme on which the PME is
   focussed
   • It should have a reasonable size (between 5 and 8 people) to avoid cumbersomeness
   • The profile of members should be in line with the roles assigned to them and mentioned earlier.
   They should have complementary profiles: Some members have mobilization and/or facilitation skills,
   others are more skilled in management and logistic organization, while others are more comfortable
   in the monitoring of activities, etc.
   • Even though project representatives can be included in the organ responsible for coordinating the
   process, it is important to keep in mind that it is above all, a PME system.
The main beneficiaries should be at the heart of the mechanism and should discharge the different mo-
bilization, leadership and facilitation functions.
Of course, the role played by the project staff at the beginning of the process may be relatively more
significant, but should be progressively reduced as and when the beneficiaries acquire the necessary
skills.


48                     PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
MONITORING AND EVALUATION
  SESSION 14                      OF THE PME IMPLEMENTATION

                               EDUCATIONAL EXERCISE 14


1. Objectives of the session
Define a simple approach to monitor and evaluate the implementation of the PME system

2. Proposed technique: Individual work but in case of a big group (more than 15 people) the partici-
pants can be arranged in groups of two or three.

3. Material and equipment required: Kraft paper, markers in sufficient numbers, cards of different
colours

4. Duration: 45 minutes

5. Pedagogical progression
   • Give 3 cards to each participant
   • Ask each participant to propose 3 monitoring indicators for the PME system based on the following
   focal question: What are the indicators that can provide us with information about the functioning and
   quality of our PME system?
   • Give them 5 minutes to fill the cards. The rule is known to all: a card, a criterion or indicator
   • When all the participants have finished filling their cards, ask a volunteer to collect and display them
   [haphazardly) on the board or on the space provided for that purpose
   • Then ask the volunteer to regroup the different cards according to the key ideas
   • Write these ideas on a Padex paper

6. Information provided by the facilitator

   • Using Content Card N° 14, the facilitator may come up with other criteria. He may propose them
   but lay emphasis on the fact that the criteria defined by the main actors themselves are more
   important. For the record, the facilitator should be prepared to direct and possibly provide some points
   for the discussion on the PME success or failure indicators.

   • The community evaluation sheet may also be used in the evaluation of the results-based PME
   implementation.




                      PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012                                 49
MONITORING AND EVALUATION
     SESSION 14                      OF THE PME IMPLEMENTATION

                        CONTENT CARD 14
           MONITORING AND EVALUATION OF THE PME SYSTEM

The institution of the PME system should be monitored on a continuous and regular basis. This is all
the more important since it is a learning process concerning a tool that is new for most actors.
Methodological and institutional difficulties will emerge at the beginning and will continue to impede
the system for a while. There is thus need to establish a monitoring mechanism in order to correct
these difficulties as and when necessary. The Monitoring and Evaluation of the system may concern
several aspects, including:

The governance of the PME system:
  • Which actors participate?
  • What is their degree of participation?
  • How are the decisions taken?
  • Are the sessions held regularly?
  • Is the generated information shared between the project and the other actors?

Technical knowledge of the System
  • Do all the beneficiary groups have a sound understanding of the system?
  • What do you think about the quality of the sessions’ facilitation?
  • Is the generated information properly collected?
  • Is there a monitoring medium accessible to all?

Effects of the system
   • Are the recommendations emanating from the different sessions implemented?
   • Does the project adequately support the management of these recommendations?
   • Did the system improve the participation of the populations [the vulnerable groups in particular)?
   • Has the populations’ role in the monitoring of activities been effectively stepped up?
   • Etc.

Some quantitative indicators
  • Number of PME sessions held
  • Changes initiated
  • Frequency of sessions
  • Number of participants per session (per sex, village or district, etc.)
  • Duration of monitoring sessions
  • Amounts/ costs of PME sessions
  • Amounts/ costs of initiated changes
  • Etc.

Tools
The Community evaluation sheet may also be used in the evaluation of indicators concerning some
(evaluation) issues raised. However, the sheet can also be combined with other tools like the SFPO
(Success, failures, potentialities, obstacles) analysis grid or the matrix of criteria which can be used in
the form of focus group to see the differences in perspective between the various actors (including the
project staff). Once again, it is up to the facilitator to help beneficiaries develop or find the most adapted
evaluation tools.




50                    PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
Introduction to Participatory Monitoring-Evaluation

Contenu connexe

Tendances

Formulating development projects with people’s participation
Formulating development projects with people’s participationFormulating development projects with people’s participation
Formulating development projects with people’s participationShyam Rathod
 
Results Based Monitoring and Evaluation
Results Based Monitoring and EvaluationResults Based Monitoring and Evaluation
Results Based Monitoring and EvaluationMadhawa Waidyaratna
 
Logical framework approach DR.MADHUR VERMA PGIMS ROHTAK
Logical framework approach DR.MADHUR VERMA PGIMS ROHTAKLogical framework approach DR.MADHUR VERMA PGIMS ROHTAK
Logical framework approach DR.MADHUR VERMA PGIMS ROHTAKMADHUR VERMA
 
Monitoring and Evaluation for Project management.
Monitoring and Evaluation for Project management.Monitoring and Evaluation for Project management.
Monitoring and Evaluation for Project management.Muthuraj K
 
7 M&E: Indicators
7 M&E: Indicators7 M&E: Indicators
7 M&E: IndicatorsTony
 
Sustainable rural development group 7
Sustainable rural development group 7Sustainable rural development group 7
Sustainable rural development group 7Priyank Deshmukh
 
Importance of M&E
Importance of M&EImportance of M&E
Importance of M&Eclearsateam
 
Results-Based Management in UNDP
Results-Based Management in UNDPResults-Based Management in UNDP
Results-Based Management in UNDPUNDP Eurasia
 
Monitoring and evaluation
Monitoring and evaluationMonitoring and evaluation
Monitoring and evaluationmigom doley
 
Monitoring and evaluation (2)
Monitoring and evaluation (2)Monitoring and evaluation (2)
Monitoring and evaluation (2)Dr.RAJEEV KASHYAP
 
Monitoring and impact assessment tools
Monitoring and impact assessment toolsMonitoring and impact assessment tools
Monitoring and impact assessment toolsBrajendra Singh Meena
 
Climate change nepal
Climate change  nepalClimate change  nepal
Climate change nepalARUN GC
 

Tendances (20)

Formulating development projects with people’s participation
Formulating development projects with people’s participationFormulating development projects with people’s participation
Formulating development projects with people’s participation
 
Monitoring and evaluation
Monitoring and evaluationMonitoring and evaluation
Monitoring and evaluation
 
Results Based Monitoring and Evaluation
Results Based Monitoring and EvaluationResults Based Monitoring and Evaluation
Results Based Monitoring and Evaluation
 
Project Monitoring and Evaluation
Project Monitoring and EvaluationProject Monitoring and Evaluation
Project Monitoring and Evaluation
 
M&E Plan
M&E PlanM&E Plan
M&E Plan
 
Logical framework approach DR.MADHUR VERMA PGIMS ROHTAK
Logical framework approach DR.MADHUR VERMA PGIMS ROHTAKLogical framework approach DR.MADHUR VERMA PGIMS ROHTAK
Logical framework approach DR.MADHUR VERMA PGIMS ROHTAK
 
Monitoring and Evaluation for Project management.
Monitoring and Evaluation for Project management.Monitoring and Evaluation for Project management.
Monitoring and Evaluation for Project management.
 
7 M&E: Indicators
7 M&E: Indicators7 M&E: Indicators
7 M&E: Indicators
 
Sustainable rural development group 7
Sustainable rural development group 7Sustainable rural development group 7
Sustainable rural development group 7
 
Importance of M&E
Importance of M&EImportance of M&E
Importance of M&E
 
Monitoring and Evaluation
Monitoring and EvaluationMonitoring and Evaluation
Monitoring and Evaluation
 
Results-Based Management in UNDP
Results-Based Management in UNDPResults-Based Management in UNDP
Results-Based Management in UNDP
 
M&e system
M&e systemM&e system
M&e system
 
Impact evaluation methods: Qualitative Methods
Impact evaluation methods: Qualitative MethodsImpact evaluation methods: Qualitative Methods
Impact evaluation methods: Qualitative Methods
 
Monitoring and evaluation
Monitoring and evaluationMonitoring and evaluation
Monitoring and evaluation
 
Monitoring and evaluation (2)
Monitoring and evaluation (2)Monitoring and evaluation (2)
Monitoring and evaluation (2)
 
Project cycle
Project cycleProject cycle
Project cycle
 
Monitoring and impact assessment tools
Monitoring and impact assessment toolsMonitoring and impact assessment tools
Monitoring and impact assessment tools
 
Climate change nepal
Climate change  nepalClimate change  nepal
Climate change nepal
 
Monitoring indicators
Monitoring indicatorsMonitoring indicators
Monitoring indicators
 

En vedette

La Théorie du Changement, Développement des Capacités et son Suivi - Marie-Jo...
La Théorie du Changement, Développement des Capacités et son Suivi - Marie-Jo...La Théorie du Changement, Développement des Capacités et son Suivi - Marie-Jo...
La Théorie du Changement, Développement des Capacités et son Suivi - Marie-Jo...BTC CTB
 
Participatory Monitoring and Evlaution
Participatory Monitoring and EvlautionParticipatory Monitoring and Evlaution
Participatory Monitoring and EvlautionIwl Pcu
 
Monitoring and Evaluation system for PFES: Key findings and policy recommenda...
Monitoring and Evaluation system for PFES: Key findings and policy recommenda...Monitoring and Evaluation system for PFES: Key findings and policy recommenda...
Monitoring and Evaluation system for PFES: Key findings and policy recommenda...CIFOR-ICRAF
 
Ideas global assembly presentation (april 14, 2011) maram barqawi
Ideas global assembly   presentation (april 14, 2011) maram barqawiIdeas global assembly   presentation (april 14, 2011) maram barqawi
Ideas global assembly presentation (april 14, 2011) maram barqawiMaram Barqawi
 
Outputs, Outcomes, and Logic Models
Outputs, Outcomes, and Logic ModelsOutputs, Outcomes, and Logic Models
Outputs, Outcomes, and Logic ModelsAshley Brundage
 
Developing a web-based monitoring and evaluation system: Crop Goat Project in...
Developing a web-based monitoring and evaluation system: Crop Goat Project in...Developing a web-based monitoring and evaluation system: Crop Goat Project in...
Developing a web-based monitoring and evaluation system: Crop Goat Project in...ILRI
 
Development and implementation of a community based monitoring and evaluation...
Development and implementation of a community based monitoring and evaluation...Development and implementation of a community based monitoring and evaluation...
Development and implementation of a community based monitoring and evaluation...ILRI
 
Capitalisation des Expériences des Projets et Programmes de Développement - G...
Capitalisation des Expériences des Projets et Programmes de Développement - G...Capitalisation des Expériences des Projets et Programmes de Développement - G...
Capitalisation des Expériences des Projets et Programmes de Développement - G...FIDAfrique-IFADAfrica
 
Participatory rural appraisal
Participatory rural appraisalParticipatory rural appraisal
Participatory rural appraisalDeekshit Geddam
 
Participatory rapid appraisal
Participatory rapid appraisalParticipatory rapid appraisal
Participatory rapid appraisalronelcana
 
Participatory project planning
Participatory project planning Participatory project planning
Participatory project planning foreman
 

En vedette (20)

Nairobi DéMarche Cap2 New
Nairobi DéMarche Cap2 NewNairobi DéMarche Cap2 New
Nairobi DéMarche Cap2 New
 
La Théorie du Changement, Développement des Capacités et son Suivi - Marie-Jo...
La Théorie du Changement, Développement des Capacités et son Suivi - Marie-Jo...La Théorie du Changement, Développement des Capacités et son Suivi - Marie-Jo...
La Théorie du Changement, Développement des Capacités et son Suivi - Marie-Jo...
 
Logic models
Logic modelsLogic models
Logic models
 
Participatory Monitoring and Evlaution
Participatory Monitoring and EvlautionParticipatory Monitoring and Evlaution
Participatory Monitoring and Evlaution
 
Monitoring and Evaluation system for PFES: Key findings and policy recommenda...
Monitoring and Evaluation system for PFES: Key findings and policy recommenda...Monitoring and Evaluation system for PFES: Key findings and policy recommenda...
Monitoring and Evaluation system for PFES: Key findings and policy recommenda...
 
Monitoring and Evaluation System for CAADP Implementation_2010
Monitoring and Evaluation System for CAADP Implementation_2010Monitoring and Evaluation System for CAADP Implementation_2010
Monitoring and Evaluation System for CAADP Implementation_2010
 
Ideas global assembly presentation (april 14, 2011) maram barqawi
Ideas global assembly   presentation (april 14, 2011) maram barqawiIdeas global assembly   presentation (april 14, 2011) maram barqawi
Ideas global assembly presentation (april 14, 2011) maram barqawi
 
Outputs, Outcomes, and Logic Models
Outputs, Outcomes, and Logic ModelsOutputs, Outcomes, and Logic Models
Outputs, Outcomes, and Logic Models
 
Agenda Atelier PROPACOM - RCI
Agenda Atelier PROPACOM - RCIAgenda Atelier PROPACOM - RCI
Agenda Atelier PROPACOM - RCI
 
Developing a web-based monitoring and evaluation system: Crop Goat Project in...
Developing a web-based monitoring and evaluation system: Crop Goat Project in...Developing a web-based monitoring and evaluation system: Crop Goat Project in...
Developing a web-based monitoring and evaluation system: Crop Goat Project in...
 
Monitoring and Evaluation (M&E) System for the Comprehensive Africa Agricultu...
Monitoring and Evaluation (M&E) System for the Comprehensive Africa Agricultu...Monitoring and Evaluation (M&E) System for the Comprehensive Africa Agricultu...
Monitoring and Evaluation (M&E) System for the Comprehensive Africa Agricultu...
 
Result based monitoring and evaluation for agriculture june 25 presented
Result based monitoring and evaluation for agriculture june 25 presentedResult based monitoring and evaluation for agriculture june 25 presented
Result based monitoring and evaluation for agriculture june 25 presented
 
Development and implementation of a community based monitoring and evaluation...
Development and implementation of a community based monitoring and evaluation...Development and implementation of a community based monitoring and evaluation...
Development and implementation of a community based monitoring and evaluation...
 
Capitalisation des Expériences des Projets et Programmes de Développement - G...
Capitalisation des Expériences des Projets et Programmes de Développement - G...Capitalisation des Expériences des Projets et Programmes de Développement - G...
Capitalisation des Expériences des Projets et Programmes de Développement - G...
 
Participatory rural appraisal
Participatory rural appraisalParticipatory rural appraisal
Participatory rural appraisal
 
Pra methods
Pra methodsPra methods
Pra methods
 
Participatory rapid appraisal
Participatory rapid appraisalParticipatory rapid appraisal
Participatory rapid appraisal
 
Participatory project planning
Participatory project planning Participatory project planning
Participatory project planning
 
Final ppt
Final pptFinal ppt
Final ppt
 
Pra presentation
Pra presentationPra presentation
Pra presentation
 

Similaire à Introduction to Participatory Monitoring-Evaluation

Monitoring & Evaluation learning and exchange forum
Monitoring & Evaluation learning and exchange forumMonitoring & Evaluation learning and exchange forum
Monitoring & Evaluation learning and exchange forumFIDAfrique-IFADAfrica
 
Senior Leadership Development Case Study
Senior Leadership Development Case Study Senior Leadership Development Case Study
Senior Leadership Development Case Study Abhinandan Chatterjee
 
499401856-LO1-Plan-ICT-Training-System.pdf
499401856-LO1-Plan-ICT-Training-System.pdf499401856-LO1-Plan-ICT-Training-System.pdf
499401856-LO1-Plan-ICT-Training-System.pdfdejene3
 
Arcadia consulting evaluation report besni
Arcadia consulting evaluation report besniArcadia consulting evaluation report besni
Arcadia consulting evaluation report besniEcuisine
 
M3_S0_overview-PFP_180916_KSD.pptx
M3_S0_overview-PFP_180916_KSD.pptxM3_S0_overview-PFP_180916_KSD.pptx
M3_S0_overview-PFP_180916_KSD.pptxNanoSana
 
Leadership and Management CIPD UK Assignment Sheet
Leadership and Management CIPD UK Assignment SheetLeadership and Management CIPD UK Assignment Sheet
Leadership and Management CIPD UK Assignment SheetRodzidah Mohd Rodzi
 
M&E completion training report oct 142012
M&E completion training report oct 142012M&E completion training report oct 142012
M&E completion training report oct 142012dr-ayub
 
Shifting the conversation from cost to value! How to gather the right evidenc...
Shifting the conversation from cost to value! How to gather the right evidenc...Shifting the conversation from cost to value! How to gather the right evidenc...
Shifting the conversation from cost to value! How to gather the right evidenc...Dr. Regis P. Chasse, MBA
 
Dynamics of Monitoring and Evaluation, Lagos
Dynamics of Monitoring and Evaluation, LagosDynamics of Monitoring and Evaluation, Lagos
Dynamics of Monitoring and Evaluation, LagosIfeoma Onyemachi
 
Dynamics of Monitoring and Evaluation agos
Dynamics of Monitoring and Evaluation agosDynamics of Monitoring and Evaluation agos
Dynamics of Monitoring and Evaluation agosIfeoma Onyemachi
 
Jadarat-portfolio
Jadarat-portfolioJadarat-portfolio
Jadarat-portfolioWael Aziz
 
Module 0rev
Module 0revModule 0rev
Module 0revcomesa15
 
MeTA MSP workshop: Introduction to Multi-stakeholder
MeTA MSP workshop: Introduction to Multi-stakeholderMeTA MSP workshop: Introduction to Multi-stakeholder
MeTA MSP workshop: Introduction to Multi-stakeholderMeTApresents
 

Similaire à Introduction to Participatory Monitoring-Evaluation (20)

Monitoring & Evaluation learning and exchange forum
Monitoring & Evaluation learning and exchange forumMonitoring & Evaluation learning and exchange forum
Monitoring & Evaluation learning and exchange forum
 
Daidalos Evaluation ECIME 2007
Daidalos Evaluation  ECIME 2007Daidalos Evaluation  ECIME 2007
Daidalos Evaluation ECIME 2007
 
Senior Leadership Development Case Study
Senior Leadership Development Case Study Senior Leadership Development Case Study
Senior Leadership Development Case Study
 
Mod01
Mod01Mod01
Mod01
 
499401856-LO1-Plan-ICT-Training-System.pdf
499401856-LO1-Plan-ICT-Training-System.pdf499401856-LO1-Plan-ICT-Training-System.pdf
499401856-LO1-Plan-ICT-Training-System.pdf
 
Arcadia consulting evaluation report besni
Arcadia consulting evaluation report besniArcadia consulting evaluation report besni
Arcadia consulting evaluation report besni
 
Learning oriented M&E System
Learning oriented M&E SystemLearning oriented M&E System
Learning oriented M&E System
 
M3_S0_overview-PFP_180916_KSD.pptx
M3_S0_overview-PFP_180916_KSD.pptxM3_S0_overview-PFP_180916_KSD.pptx
M3_S0_overview-PFP_180916_KSD.pptx
 
2nd champions meeting beta version
2nd champions meeting beta version2nd champions meeting beta version
2nd champions meeting beta version
 
Leadership and Management CIPD UK Assignment Sheet
Leadership and Management CIPD UK Assignment SheetLeadership and Management CIPD UK Assignment Sheet
Leadership and Management CIPD UK Assignment Sheet
 
Mafi Work Plan 2013, short version (March 2013)
Mafi Work Plan 2013, short version (March 2013)Mafi Work Plan 2013, short version (March 2013)
Mafi Work Plan 2013, short version (March 2013)
 
Gic2012 aula7-ingles
Gic2012 aula7-inglesGic2012 aula7-ingles
Gic2012 aula7-ingles
 
M&E completion training report oct 142012
M&E completion training report oct 142012M&E completion training report oct 142012
M&E completion training report oct 142012
 
Shifting the conversation from cost to value! How to gather the right evidenc...
Shifting the conversation from cost to value! How to gather the right evidenc...Shifting the conversation from cost to value! How to gather the right evidenc...
Shifting the conversation from cost to value! How to gather the right evidenc...
 
Dynamics of Monitoring and Evaluation, Lagos
Dynamics of Monitoring and Evaluation, LagosDynamics of Monitoring and Evaluation, Lagos
Dynamics of Monitoring and Evaluation, Lagos
 
Dynamics of Monitoring and Evaluation agos
Dynamics of Monitoring and Evaluation agosDynamics of Monitoring and Evaluation agos
Dynamics of Monitoring and Evaluation agos
 
Sena
SenaSena
Sena
 
Jadarat-portfolio
Jadarat-portfolioJadarat-portfolio
Jadarat-portfolio
 
Module 0rev
Module 0revModule 0rev
Module 0rev
 
MeTA MSP workshop: Introduction to Multi-stakeholder
MeTA MSP workshop: Introduction to Multi-stakeholderMeTA MSP workshop: Introduction to Multi-stakeholder
MeTA MSP workshop: Introduction to Multi-stakeholder
 

Plus de FIDAfrique-IFADAfrica

Introduction au Suivi-Evalutation Participatif
Introduction au Suivi-Evalutation ParticipatifIntroduction au Suivi-Evalutation Participatif
Introduction au Suivi-Evalutation ParticipatifFIDAfrique-IFADAfrica
 
Rapport de l'Atelier de Cloture - Programme Facilité Alimentaire (Abuja, Sept...
Rapport de l'Atelier de Cloture - Programme Facilité Alimentaire (Abuja, Sept...Rapport de l'Atelier de Cloture - Programme Facilité Alimentaire (Abuja, Sept...
Rapport de l'Atelier de Cloture - Programme Facilité Alimentaire (Abuja, Sept...FIDAfrique-IFADAfrica
 
Stratégie de communication de waapp sénégal fiara.01pptx
Stratégie de communication de waapp sénégal fiara.01pptxStratégie de communication de waapp sénégal fiara.01pptx
Stratégie de communication de waapp sénégal fiara.01pptxFIDAfrique-IFADAfrica
 
Impact des ta enjeux sur les céréales locales
Impact des ta enjeux sur les céréales localesImpact des ta enjeux sur les céréales locales
Impact des ta enjeux sur les céréales localesFIDAfrique-IFADAfrica
 
Report on the Training of Monitoring and Evaluation staff of IFAD Projects in...
Report on the Training of Monitoring and Evaluation staff of IFAD Projects in...Report on the Training of Monitoring and Evaluation staff of IFAD Projects in...
Report on the Training of Monitoring and Evaluation staff of IFAD Projects in...FIDAfrique-IFADAfrica
 
ASPRODEB-Senegal: The management of certified groundnut seeds production by c...
ASPRODEB-Senegal: The management of certified groundnut seeds production by c...ASPRODEB-Senegal: The management of certified groundnut seeds production by c...
ASPRODEB-Senegal: The management of certified groundnut seeds production by c...FIDAfrique-IFADAfrica
 
La promotion des micro et petites entreprises rurales : un moyen efficace pou...
La promotion des micro et petites entreprises rurales : un moyen efficace pou...La promotion des micro et petites entreprises rurales : un moyen efficace pou...
La promotion des micro et petites entreprises rurales : un moyen efficace pou...FIDAfrique-IFADAfrica
 
Le FIDA en RDC - Echos dans la presse
Le FIDA en RDC - Echos dans la presseLe FIDA en RDC - Echos dans la presse
Le FIDA en RDC - Echos dans la presseFIDAfrique-IFADAfrica
 
Atelier de partage sur le pratique de suivi évaluation des projets FIDA
Atelier de partage sur le pratique de suivi évaluation des projets FIDAAtelier de partage sur le pratique de suivi évaluation des projets FIDA
Atelier de partage sur le pratique de suivi évaluation des projets FIDAFIDAfrique-IFADAfrica
 
Une expérience rurale novatrice : la production de semences certifiées d’arac...
Une expérience rurale novatrice : la production de semences certifiées d’arac...Une expérience rurale novatrice : la production de semences certifiées d’arac...
Une expérience rurale novatrice : la production de semences certifiées d’arac...FIDAfrique-IFADAfrica
 
Forum PPAAO sur les technologies améliorées et la sécurité alimentaire
Forum PPAAO sur les technologies améliorées et la sécurité alimentaireForum PPAAO sur les technologies améliorées et la sécurité alimentaire
Forum PPAAO sur les technologies améliorées et la sécurité alimentaireFIDAfrique-IFADAfrica
 
Village PPAAO à la FIARA - Seances de demonstration
Village PPAAO à la FIARA - Seances de demonstrationVillage PPAAO à la FIARA - Seances de demonstration
Village PPAAO à la FIARA - Seances de demonstrationFIDAfrique-IFADAfrica
 
Food Facility: Documenting and closing workshop 21-23 march 2012 (Abidjan)
Food Facility: Documenting and closing workshop 21-23 march 2012 (Abidjan)Food Facility: Documenting and closing workshop 21-23 march 2012 (Abidjan)
Food Facility: Documenting and closing workshop 21-23 march 2012 (Abidjan)FIDAfrique-IFADAfrica
 
Facilité Alimentaire : Atelier de capitalisation et de cloture 21-23 mars 201...
Facilité Alimentaire : Atelier de capitalisation et de cloture 21-23 mars 201...Facilité Alimentaire : Atelier de capitalisation et de cloture 21-23 mars 201...
Facilité Alimentaire : Atelier de capitalisation et de cloture 21-23 mars 201...FIDAfrique-IFADAfrica
 
Mauritanie - Programme de Lutte contre la Pauvreté Rurale par l’Appui aux Fil...
Mauritanie - Programme de Lutte contre la Pauvreté Rurale par l’Appui aux Fil...Mauritanie - Programme de Lutte contre la Pauvreté Rurale par l’Appui aux Fil...
Mauritanie - Programme de Lutte contre la Pauvreté Rurale par l’Appui aux Fil...FIDAfrique-IFADAfrica
 
An overview of the Ghana national M&E system
An overview of the Ghana national M&E systemAn overview of the Ghana national M&E system
An overview of the Ghana national M&E systemFIDAfrique-IFADAfrica
 
Dossier : Les coopératives de producteurs de semences d'arachides au Sénégal
Dossier : Les coopératives de  producteurs de semences d'arachides au SénégalDossier : Les coopératives de  producteurs de semences d'arachides au Sénégal
Dossier : Les coopératives de producteurs de semences d'arachides au SénégalFIDAfrique-IFADAfrica
 
50. Rapport de la 2è réunion du comité de pilotage du Programme Facilité
50. Rapport de la 2è réunion du comité de pilotage du Programme Facilité50. Rapport de la 2è réunion du comité de pilotage du Programme Facilité
50. Rapport de la 2è réunion du comité de pilotage du Programme FacilitéFIDAfrique-IFADAfrica
 

Plus de FIDAfrique-IFADAfrica (20)

Introduction au Suivi-Evalutation Participatif
Introduction au Suivi-Evalutation ParticipatifIntroduction au Suivi-Evalutation Participatif
Introduction au Suivi-Evalutation Participatif
 
Rapport de l'Atelier de Cloture - Programme Facilité Alimentaire (Abuja, Sept...
Rapport de l'Atelier de Cloture - Programme Facilité Alimentaire (Abuja, Sept...Rapport de l'Atelier de Cloture - Programme Facilité Alimentaire (Abuja, Sept...
Rapport de l'Atelier de Cloture - Programme Facilité Alimentaire (Abuja, Sept...
 
Stratégie de communication de waapp sénégal fiara.01pptx
Stratégie de communication de waapp sénégal fiara.01pptxStratégie de communication de waapp sénégal fiara.01pptx
Stratégie de communication de waapp sénégal fiara.01pptx
 
Impact des ta enjeux sur les céréales locales
Impact des ta enjeux sur les céréales localesImpact des ta enjeux sur les céréales locales
Impact des ta enjeux sur les céréales locales
 
Report on the Training of Monitoring and Evaluation staff of IFAD Projects in...
Report on the Training of Monitoring and Evaluation staff of IFAD Projects in...Report on the Training of Monitoring and Evaluation staff of IFAD Projects in...
Report on the Training of Monitoring and Evaluation staff of IFAD Projects in...
 
ASPRODEB-Senegal: The management of certified groundnut seeds production by c...
ASPRODEB-Senegal: The management of certified groundnut seeds production by c...ASPRODEB-Senegal: The management of certified groundnut seeds production by c...
ASPRODEB-Senegal: The management of certified groundnut seeds production by c...
 
Ghana Country programme evaluation
Ghana Country programme evaluationGhana Country programme evaluation
Ghana Country programme evaluation
 
La promotion des micro et petites entreprises rurales : un moyen efficace pou...
La promotion des micro et petites entreprises rurales : un moyen efficace pou...La promotion des micro et petites entreprises rurales : un moyen efficace pou...
La promotion des micro et petites entreprises rurales : un moyen efficace pou...
 
Le FIDA en RDC - Echos dans la presse
Le FIDA en RDC - Echos dans la presseLe FIDA en RDC - Echos dans la presse
Le FIDA en RDC - Echos dans la presse
 
Atelier de partage sur le pratique de suivi évaluation des projets FIDA
Atelier de partage sur le pratique de suivi évaluation des projets FIDAAtelier de partage sur le pratique de suivi évaluation des projets FIDA
Atelier de partage sur le pratique de suivi évaluation des projets FIDA
 
Une expérience rurale novatrice : la production de semences certifiées d’arac...
Une expérience rurale novatrice : la production de semences certifiées d’arac...Une expérience rurale novatrice : la production de semences certifiées d’arac...
Une expérience rurale novatrice : la production de semences certifiées d’arac...
 
Forum PPAAO sur les technologies améliorées et la sécurité alimentaire
Forum PPAAO sur les technologies améliorées et la sécurité alimentaireForum PPAAO sur les technologies améliorées et la sécurité alimentaire
Forum PPAAO sur les technologies améliorées et la sécurité alimentaire
 
Village PPAAO à la FIARA - Seances de demonstration
Village PPAAO à la FIARA - Seances de demonstrationVillage PPAAO à la FIARA - Seances de demonstration
Village PPAAO à la FIARA - Seances de demonstration
 
Allocution abidjan
Allocution abidjanAllocution abidjan
Allocution abidjan
 
Food Facility: Documenting and closing workshop 21-23 march 2012 (Abidjan)
Food Facility: Documenting and closing workshop 21-23 march 2012 (Abidjan)Food Facility: Documenting and closing workshop 21-23 march 2012 (Abidjan)
Food Facility: Documenting and closing workshop 21-23 march 2012 (Abidjan)
 
Facilité Alimentaire : Atelier de capitalisation et de cloture 21-23 mars 201...
Facilité Alimentaire : Atelier de capitalisation et de cloture 21-23 mars 201...Facilité Alimentaire : Atelier de capitalisation et de cloture 21-23 mars 201...
Facilité Alimentaire : Atelier de capitalisation et de cloture 21-23 mars 201...
 
Mauritanie - Programme de Lutte contre la Pauvreté Rurale par l’Appui aux Fil...
Mauritanie - Programme de Lutte contre la Pauvreté Rurale par l’Appui aux Fil...Mauritanie - Programme de Lutte contre la Pauvreté Rurale par l’Appui aux Fil...
Mauritanie - Programme de Lutte contre la Pauvreté Rurale par l’Appui aux Fil...
 
An overview of the Ghana national M&E system
An overview of the Ghana national M&E systemAn overview of the Ghana national M&E system
An overview of the Ghana national M&E system
 
Dossier : Les coopératives de producteurs de semences d'arachides au Sénégal
Dossier : Les coopératives de  producteurs de semences d'arachides au SénégalDossier : Les coopératives de  producteurs de semences d'arachides au Sénégal
Dossier : Les coopératives de producteurs de semences d'arachides au Sénégal
 
50. Rapport de la 2è réunion du comité de pilotage du Programme Facilité
50. Rapport de la 2è réunion du comité de pilotage du Programme Facilité50. Rapport de la 2è réunion du comité de pilotage du Programme Facilité
50. Rapport de la 2è réunion du comité de pilotage du Programme Facilité
 

Introduction to Participatory Monitoring-Evaluation

  • 1.
  • 2. INTRODUCTION TO PARTICIPATORY MONITORING-EVALUATION A SIMPLIFIED TRAINER’S GUIDE PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 3
  • 3. Published by West Africa Rural Foundation (WARF) N° 10075, Sacre- Cœur III- VDN - C.P. 13 DAKAR-Fann, SENEGAL Tel: (221) 33 865 00 60 - Fax: (221) 33 860 66 89 - E-mail: secretary@frao.org - Web site: www.frao.org Many thanks to: All IFAD funded projects in West and Central Africa for their contribution, WARF staff and consultants © FRAO/WARF - Dakar, September 2012 Design: creatif@orange.sn This publication was made possible by grant from IFAD for the Programme of Support for Monitoring and Evaluation Systems of IFAD projects in West and Central Africa. Its contents are solely the responsibility of the authors and do not necessarily represent the official view of IFAD. 4 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 4. TABLE OF CONTENTS ACRONYMS AND ABBREVIATIONS 06 FOREWORD 07 SESSION 1: Introduction to the workshop 08 SESSION 2: Brief overview of the participatory approach 12 SESSION 3: Introduction to participatory monitoring and evaluation (PME) 15 SESSION 4: Importance of PME for IFAD projects 18 SESSION 5: Stages of the PME process 22 SESSION 6: Setting up a pme system 24 SESSION 7: Identifying actors and analyzing their needs 26 SESSION 8: Definition of PME objectives 29 SESSION 9: Choice of PME indicators 31 SESSION 10: Choice of information gathering methods 35 SESSION 11: Information gathering and analysis 37 SESSION 12: Implementing changes 45 SESSION 13: Management and consolidation of the PME system 47 SESSION 14: Monitoring and evaluation of the PME implementation 49 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 5
  • 5. ACRONYMS AND ABBREVIATIONS CAS Community Assessment Sheet IFAD International Fund for Agricultural Development WARF West Africa Rural Foundation IED Afrique Innovation, Environment and Development in Africa MFI Microfinancing institution NHDI National Human Development Initiative OVI Objectively verifiable indicator PRA Participatory Rural Appraisal MSRE Micro and Small Rural Enterprises OP Organisation of Producers IAP Information and Awareness-raising Providers PROMER Rural Micro-Enterprises Promotion Project PME Participatory Monitoring and Evaluation SFPO Success, Failures, Potentials, Obstacles MES Monitoring and Evaluation System RIMS Results and Impact Management System PMU Project Management Unit 6 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 6. FOREWORD T his simplified guide is addressed to facilitators who pursued the trainers’ training course held in Toubab Dialao, Senegal in April 2008. These trainers will later be required to train officials in charge of Monitoring and Evaluation of IFAD projects in Participatory Monitoring and Evaluation (PME). These skills should enable the latter to assist beneficiaries of their interventions to set up a Participatory Monitoring and Evaluation system. Thus, the grassroots communities are the final beneficiaries of this capacity building process. For this reason, the content of this guide has been simplified; with emphasis essentially placed on the aspects that are of practical relevance for the establishment of the PME system at local level. Of course, facilitators are strongly encouraged to improve on it by drawing on their own experience or through documentary research. The design of the training content and guide are based on two fundamental assumptions. The first is that the selected trainers sufficiently master participatory research tools (PRA, Participatory Diagnosis) to be able to adapt and/or improve the proposed tools. The second assumption is that the trainers have a certain experience in educational activities. The document provides trainers with the basic elements required to prepare the staff of the concerned projects to assist the communities to set up a PME system. The document is organized in such a way as to provide (pedagogical) guidelines on the conduct of train- ing sessions and content on the PME system’s implementation process. Thus, each session is organized around two sheets. The first sheet (referred to, by convention, as learning exercise) proposes a pedagogical approach for the conduct of the session. To effectively apply these pedagogical indications it must be ensured that all the necessary logistics (including the availability of rooms for group work) are in place. The pedagogical proposals are indicative. The facilitators can modify them to ensure that they adapt to the context of each session. They can also be replaced by other techniques considered more appropriate. Each ses- sion bears a number. The second sheet (referred to as content sheet) provides a content summary to which the facilitator may refer to provide additional information. Of course, these sheets are not exhaustive. Facilitators are therefore strongly urged to enrich them with their own research and additional documentation in their possession. PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 7
  • 7. SESSION 1 INTRODUCTION TO THE WORKSHOP LEARNING EXERCISE 1 PRINCIPLES AND PEDAGOGICAL PROTOCOL 1. Objectives of the session • Inform participants about the context of the workshop • Identity participants • Determine the workshop objectives • Define the workshop’s management principles • Define the working rules (group contract) 2. Proposed technique: Interaction, brainstorming 3. Material and equipment required: Required materials and equipment: Padex paper, padex board, markers of different colours, wall sellotape, index cards of different colours 4. Total duration of session: 60 mn 5. Educational progression • Prior to participants’ arrival and installation, the facilitator should check the state of preparation of the room, the learning facilitation system and the equipment installed the day before. • The room should be arranged in U-form or in staggered rows depending on the space available • The tables should be mobile for the organization of group work • The order in which participants will intervene is determined before the start of the session Expression of expectations: • Provide each participant with three index cards on which he/she is required to state what he/she expects from this workshop (ex: Achievements to be consolidated, constraints/difficulties to be removed, needs to be met). • The cards are then collected, analyzed and classified according to category. • These expectations are analyzed on the basis of the objectives predefined by the organizers. • The workshop agenda is presented to participants, discussed and adopted • The draft group contract is presented to participants, amended and validated (Content card 1a) 6. Information provided by the facilitator The facilitator introduces the learning from experience approach which will guide the teaching facilitation approach (CONTENT CARD1b). The session’s work is summarised. 8 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 8. SESSION 1 INTRODUCTION TO THE WORKSHOP CONTENT CARD 1A 1. Group contract • Switch off or set mobile phones on vibration mode • Answer telephone calls outside the room • Ask for the floor before speaking • Listen to one another • Avoid repeating what others have already said • Be brief to facilitate effective time management • Limit going in and out of the room 2. Workshop principle • Learning based on experience • Allow participants to express their expertise • Diversify the interventions • Progress together on the basis of consensus 3. Organization of discussion sessions • Exchanges and discussions on salient points • Diversify teaching techniques • Production of ideas or experience acquisition to be listed on an index card • Plenary to present the outcome and collective analysis • Designation of a rapporteur for the day 4. Management of group work • Individual reflection based on past experience • Pooling • Write the ideas discussed on the index card • An idea per card • Write legibly, preferably in block letters PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 9
  • 9. SESSION 1 INTRODUCTION TO THE WORKSHOP CONTENT CARD 1B Stage 1: Sharing the participant’s experience (or a similar experience) The facilitator can use different tools or techniques such as case studies, simulation or role playing, group work, showing a documentary film, brainstorming during which participants talk about their expe- riences, etc. There is however need to underline that regardless of the technique used by the facilitator, prior preparation is essential. This can be very time-consuming. For example, if the facilitator wants to use case studies, he should gather and organize the information long before the training. He can use case studies already prepared but should examine them thoroughly himself in order to be able to answer questions that participants could ask him. In case he wants to introduce a role playing exercise, he should prepare his scenario beforehand with a clear definition of the different roles, the definition of adapted profiles to play the roles, etc. Stage 2: Reflection, conceptualization After presenting the experience/experiment, the facilitator invites participants to share their views about this experience. To properly organize the discussions, the facilitator prepares a certain number of key questions beforehand? For example: What are the key observations? How do they explain them? What are the lessons learnt? etc. All the ideas are written, as and when required, on the board or cards to be displayed on a notice board prepared beforehand. Stage 3: Conclusions, generalization During the third stage, the facilitator establishes the link between the analyses made by participants and the concepts or theory he wants to introduce. He will seize this opportunity to introduce any other idea or concept which had not been mentioned by participants. It will be discovered that most of the concepts which the facilitator wants to introduce during this session would have been mentioned by par- ticipants. This stage thus provides the facilitator with the opportunity to show participants that they al- ready have a real-life experience and an experience with these concepts; since the facilitator’s role is to help them express their knowledge. In short, help them to discover the knowledge hidden in each of them. This approach has another advantage because it helps to build the participant’s confidence, since there is little space for theoretical presentations. 10 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 10. SESSION 1 INTRODUCTION TO THE WORKSHOP CONTENT CARD 1C Application The last stage consists of the practical application of these new concepts. This application is generally made after the training, when the participant returns to his/her working environment. It is therefore ex- tremely important to evaluate the training application. This evaluation is generally done by the trainee’s structure of origin. But the introduction of a practical application stage in the training provides participants with the opportunity to test some of the concepts introduced during the training. Experience Application Reflection General Conclusion PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 11
  • 11. BRIEF OVERVIEW OF THE SESSION 2 PARTICIPATORY APPROACH WORKSHEET 2 1. Objectives of the session • Ensure that all participants have basic knowledge of participatory research principles, techniques and tools • Provide participants with additional information, if necessary 2. Proposed technique: Show a film on « Question of Differences» : Gender and PRA or another film (the film is among the distributed resources; the technique can therefore be applied by trainers). 3. Material and equipment required: Television, Cameoscope VHS, portable computer, padex paper, padex board, DVD/CD or pen drive. 4. Duration of session: 60 mn 5. Educational progression • Before showing the film, the facilitator informs participants that they should take note of the different parts (the principles, tools, recommendations, etc.) • Show the first part of the film on the principles of communication and introduction to PRA. • After the film show, open a discussion in plenary to ask participants to share the essential points they have identified. It will be appropriate to proceded by theme by theme to facilitate the discussions and the organization of information. • Ask one of the participants to write the ideas on the padex board as they are given. • When the discussion focuses on tools, ask participants whether they are all familiar with these tools and/or whether they know others (to be noted on the table). • At the end of the discussion, the facilitator can provide documentation sources to participants re- quiring additional training. To that end, it will be useful to prepare a small documentation for distribu- tion. 6. Information provided by the facilitator In case the facilitator has no film to show, he may use another teaching method. For example, he can organize a brainstorming session around the following key questions: - What is participation? - What are its main principles? - What conditions are absolutely necessary for its implementation?. - Which participatory tools do you know? - What are the constraints and difficulties linked to the implementation of such participation? NB : This session is not meant to provide in-depth training on participatory research; since being well-versed in the participatory approach principles, techniques and tools is among the criteria on which the selection of trainers is based. The purpose of the session is thus to recall these principles, techniques and tools. 12 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 12. BRIEF OVERVIEW OF THE SESSION 2 PARTICIPATORY APPROACH CONTENT CARD 2 ON PARTICIPATION What is participation? Participation is an active process in which the initiative is taken or «jointly taken» by the people, guided by their own ideas and using means and processes over which they have no effective control (Guèye,1999). Participation therefore means taking an active and decisive part in decisions concerning what should be done, how it is done, profit sharing, monitoring and evaluation. On the effectiveness of participation in development projects Different projects apply the principles of participation in different ways. Some involve the populations fully during the identification of problems and the planning of actions; but they quickly return to their old practices during the implementation stage. Other projects define their priorities and choose actions without the population’s participation and try to « catch-up » by entrusting a few responsibilities to beneficiaries. Others limit themselves with involving the populations in the monitoring and evaluation stage. Of course, none of these three situations is to be encouraged because the beneficiaries’ participation should be pursued at all stages of a programme’s life cycle. Question: How do you perceive the effectiveness of participation in your project ? Project’s internalfactors The project’s internal that encourage the constraints and limits Poor Average High populations participation restricting the popula- tions participation Planning Implementation Monitoring and Evaluation PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 13
  • 13. BRIEF OVERVIEW OF THE SESSION 2 PARTICIPATORY APPROACH WORKSHEET 2B Conditions of participation To ensure effective participation, the following three conditions should be simultaneously met: • All groups, particularly the so-called vulnerable ones, should be present • Such participation should not be limited to physical presence during decision-making; it should rather translate into an effective influence on the decisions and the monitoring of their implementation • It should not be limited to a specific stage of the project cycle but should be effective at all stages. Some principles to be respected? • The adoption of an interdisciplinary approach to better take into account the diversity of situations and perspectives in the analysis of local situations. However, interdisciplinarity supposes the inte- gration, in the team, of resource persons from the local community. • Making optimum use of local knowledge and capacities in the analysis of problems and the choice of solutions. The institution of PME provides a good opportunity for the application of this principle since the beneficiaries become key actors of the system while the facilitator/presenter plays the fa- cilitating role. • The adoption of an iterative approach, which makes it possible to better link the reflection and the action and immediately apply, in the field, ideas generated through collective reflection and action research. • The adoption, by project agents, of attitudes and behaviours that recognize the populations’ central position in the analysis, planning, implementation, monitoring-evaluation process and their prepared- ness to establish a relationship of partnership and mutual learning with the populations. • Emphasis to be placed on visualization tools which facilitate communication and everyone’s partic- ipation including those who can neither read or write. 14 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 14. INTRODUCTION TO PARTICIPATORY SESSION 3 MONITORING AND EVALUATION (PME) WORKSHEET 3 1. Objectives of the session • Define monitoring, evaluation and participatory monitoring and evaluation notions • Identify the main characteristics of participatory monitoring and evaluation • Analyze the differences between PME and conventional monitoring and evaluation 2. Proposed technique: Group work 3. Material and equipment required: Kraft paper, markers in sufficient numbers,cards of different colours 4. Duration of the session: 70 mn 5. Educational progression • Form groups of 5 to 7 people • Give 5 cards of the same colour to each group • Ask the following focal question: «What are the main characteristics of participatory monitoring and evaluation? » • Give 10 mn to groups to identify the main characteristics of participatory monitoring and evaluation • Prepare an area (kraft paper pinned on the wall, boards, etc.). • Ask the rapporteurs of different groups to present the results of their reflection • Classify the cards by regrouping those relating to the same idea in order to obtain a group of key points (ask a participant to do this classification) • Make a summary of the main characteristics of participatory monitoring and evaluation • Get participants to identify the similarities and differences in the definitions and propose a summary definition (5 mn). • The definition retained is written on padex paper and displayed in the room 6. Additional information provided by the facilitator: It is at this stage? Which one? that the facilitator may, if necessary, provide additional information, but if the proposed definitions take into account most of the elements contained in CONTENT CARD N° 3, it is recommended that emphasis be laid on the quality of the proposed definitions. PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 15
  • 15. INTRODUCTION TO PARTICIPATORY SESSION 3 MONITORING AND EVALUATION (PME) CONTENT CARD 3 Introduction to PME: Definition of concepts Basic Concepts (a few definitions drawn from the training) Monitoring: • Thorough and regular appraisal of resources, accomplishments and results of the intervention. Ap- proach consisting in ensuring that the planned activities have been carried out • Systematic and ongoing process for the collection of information on a programme or an activity to observe the changes that occurred and propose measures to guide the decisions to be taken Evaluation: • Specific judgement on the programme process, • Assessment of the level of accomplishment of results at the end of the project, • Judgement on the value of an intervention with reference to criteria and standards, • Reflection on the match between actions undertaken and initial objectives • Action of making judgement such as the progress towards meeting the objectives (effectiveness) of a programme or an activity, comparing results and costs (efficiency), or the sustainable changes gen- erated (impact). The initial objective may be formative to help the programme improve its perform- ance. However, other evaluations may lead to more radical decisions: Continue or stop (summative evaluation) Participatory monitoring-evaluation • An ongoing and regular process which actively involves stakeholders in all the stages of collecting, analyzing and using information on an intervention with a view to assessing the processes and results and making recommendations (provide information about decision-making). • It is a process to support the implementation of a development project/programme by grassroots communities and stakeholders which strengthens appropriation, mutual responsibility, transparency and knowledge of interrelations between the results, implementation factors and the environment. Differences between conventional monitoring-evaluation and PME CONVENTIONAL MONITORING PARTICIPATORY MONITORING -EVALUATION (CME) -EVALUATION (PME) Generally the projects or The beneficiaries with projector Who designs the system? programmes programme agents and other actors Indicators often selected More often criteria than indicators When to select indicators? at the start of the project and which are reviewed as time goes on generally remains unchanged Generally the project The populations participate Who analyzes the information? agents actively in the analysis What types of information? Essentially quantitative Pivotal role of the qualitative analysis Taking the different perspectives The diversity of view points is Poor, standardization into account highlighted Poor, standardized indicators Degree of flexibility Iterative process and collection tools Source : Guèye, B 16 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 16. INTRODUCTION TO PARTICIPATORY SESSION 3 MONITORING AND EVALUATION (PME) WORKSHEET 3 Importance of the PME • The PME contributes to improving transparency in the management of supported programmes sup- ported through the beneficiaries’ direct and ongoing control over decisions concerning resource al- location and the definition of priorities. • At the same time, it contributes to creating a reflex for the accountability reflex and the feeling of re- sponsibility towards beneficiaries. • It strengthens the relevance of programmes and the performance of actions initiated thanks to the populations’ enhanced participation in monitoring their implementation. • It strengthens the feeling of ownership of actions initiated among beneficiaries, and can thus en- courage them to be more involved. • The improvement of transparency in decision-making has led to strengthened confidence between beneficiaries and agents in charge of implementing the programmes • It strengthens the populations’ negotiation, planning and organizing capacities. The effective implementation of PME considerably improves the performance of programmes and the creation of longer lasting impacts. PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 17
  • 17. IMPORTANCE OF PME FOR SESSION 4 IFAD PROJECTS WORKSHEET 4 1. Objectives of the session Show the importance of Participatory Monitoring-Evaluation for IFAD projects 2. Proposed technique: Group work, plenary 3. Material and equipment required: Padex paper and board, sellotape, markers, video-projector, portable computers, Well-lit room, rooms for group work 4. Duration of session: 90 mn 5. Educational progression • The facilitator introduces group work. • Divide participants into 2 groups. • Ask the focal question below to which participants should respond: «What improvements could the PME bring about in the monitoring-evaluation system being implemented by IFAD projects»? • Give 40 minutes to the groups. • Ask the different groups to present the results of their reflections. • Open the discussions by asking speakers to lay emphasis on the contributions that may enrich the groups’ proposals. 6. Information provided by the facilitator The facilitator draws the key lessons based on CONTENT CARD N° 4: 18 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 18. IMPORTANCE OF PME FOR SESSION 4 IFAD PROJECTS CONTENT CARD 4 1. Objectives Satisfy the needs relative to core functions in the life of a project • A sound planning of activities • Monitoring results and • Evaluating the project’s impact. These three functions structure the system’s architecture: • Planning • Monitoring results • Evaluating the impact The discharge of these functions facilitates the project’s supervision, mid-term review and final evalua- tion. The key actors of MES at the Branch and Local levels. At branch level Two MSE actors are present at this level: Professional organizations and chambers of commerce. The branch represents the PMU and, in that capacity, constitutes a level of the project’s operational oversight. To achieve this, it is actively involved in the design and implementation of the MES through: • the validation of teaching materials and methods of the MES; • the collection, consolidation of MES data; • the use of MES products for monitoring (Trend charts); • data transmission at the PMU level; • support to MES actors at branch level; The same activities will be carried out by the SAFIR with respect to component B. PO and Chambers of commerce Professional organizations (PO) and chambers of commerce of which the MSRE are members, will pro- vide information about the support received and transmitted to MSRE within the framework of the proj- ect. At local level At this level, two key actors are present, support service providers and the MSRE which are the project’s main targets Support service providers The project has two categories of providers: information and awareness providers (IAP), specialist/gen- eralist non-financial service providers. PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 19
  • 19. IMPORTANCE OF PME FOR SESSION 4 IFAD PROJECTS CONTENT CARD 4 These service providers are involved in the collection, analysis and use of data concerning the services they provide to MSRE; the said data is then forwarded to the head of PMU monitoring-evaluation through the branches. The MSRE (micro, very small and small Enterprises), as well as AGR and PIE in the rural areas), These MSRE express their needs for support received from the various providers and MFI; they provide information concerning such support through the various providers. At this level, the type of beneficiaries (enterprise) makes it fundamental to collect process and use data to ensure better management in order to maximize the benefits. Logical Framework The logical framework is the main source for indicators of the monitoring-evaluation system. It helps to define the project objectives more clearly, and determine the expected causal connections - the « pro- gramme logic » - between the various elements of the chain of events that should lead to the achieve- ment of results: providing resources, implementation terms, outputs, results and impact. In this logical framework, the objectively verifiable indicators are the key tools for monitoring the progress registered in the achievement of objectives. The hierarchy of indicators follows that of objectives: The results achieved by the project and the anticipated effects can be accessed through some indicators, while other indicators are interested in assessing specific objectives. The monitoring mechanisms specify the data sources and the publication systems which will be used to verify the state of each indicator. They should show what has been achieved in terms of input, results, specific objectives and overall objective. The monitoring mechanisms and information system should provide evidence that the objectives have been achieved. The guidelines for a results and impact management system (RIMS) require the monitoring-evaluation system of IFAD-funded projects to fill in a certain number of key indicators; however, these are not ex- clusive, since a wider range of indicators (OVI of the logical framework) continue to be filled by the MES, a range in which the RIMS first and second level performance indicators and impact indicators take an important position. The identification report presents the logical framework with indicators per level of objectives (overall objective, specific objectives) as well as results indicators per component. 20 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 20. IMPORTANCE OF PME FOR SESSION 4 IFAD PROJECTS CONTENT CARD 4 Why a Participatory Monitoring and Evaluation System (PME) ? The purpose of the participatory approach in a monitoring-evaluation system is to guarantee: • that all project actors, particularly the direct beneficiaries, take ownership of the results to ensure that there are more effects and impacts • the involvement of these actors (MSRE, providers of non-financial support services, privileged part- ners) as much as other actors in the collection and analysis of results. • the facilitation of interaction, the development of synergy and consistency in the implementation of activities of the entire IFAD programme. It will therefore take into account the level of IFAD actors, projects and programmes in Senegal. • take into account the specificity of results and their indicators for the different categories of actors • enable direct beneficiaries to generate and participate in collecting data and information on the progress of the project and the achievement of results. Implementing the participatory approach in the monitoring-evaluation system Considering the need to collect data on the indicators, actors of the system can be classified into two major groups: • illiterates (the majority of RME managers, individual initiative developers) ; • literates (other actors) The collection system should therefore be adapted to the specific or different situation by taking the il- literate target into account, notably at the MSRE level, without changing the data quality. There is thus need to provide illiterate beneficiaries with the appropriate collection materials to enable them to monitor and evaluate their activities and results. Regardless of its simplicity, this system has to be buttressed by a results collection and analysis capacity building process. This capacity building process will be continuous and iterative in order to adapt better to the monitoring-evaluation system. PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 21
  • 21. SESSION 5 STAGES OF THE PME PROCESS WORKSHEET 5 1. Objectives of the session Identify the main stages for the setting up of a results-based PME system. 2. Proposed technique: group work, role playing, plenary 3. Material and equipment required: Padex paper and board, sellotape, markers, video-projector, portable computers, well-lit room, rooms for group work 4. Duration of session: 90 mn 5. Learning approach Introduction Introduce the theme of the session: • Divide participants into groups of 5 to 6 people, and ensure that the composition of groups alternates to avoid having the same people in the same groups all the time • Give a set of 10 cards to each group • Explain to the groups that they are required to identify the main stages which, in their views, are needed to set a participatory monitoring-evaluation system. They have a maximum of 10 cards. The number of stages should not be more than 10. • They have 15 minutes to discuss and identify the main PME stages • Prepare a space (kraft paper pinned on the wall, ZOPP boards, etc.). • At the end of the allowed time, ask the rapporteurs of different groups to present the cards on the PME stages • Choose a voluntary participant to classify the cards by regrouping those relating to the same stage in order to obtain a group of key points • Start a discussion to enable participants to draw a picture of the main stages • The main stages are written on a padex paper 6. Information provided by the facilitator At this stage, the facilitator may, if necessary, provide additional information. On the basis of CONTENT CARD N° 5, he should check whether there are any missing key stages. If any, he can again provoke the participants’ reflection to get them to identify the missing stage(s). 22 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 22. SESSION 5 STAGES OF THE PME PROCESS WORKSHEET 5 STAGES OF THE PME PROCESS 1 Decide to set up the system 2 7 Implement actions Identify the actors for change Management Define the Expectations and consolidation and Objectives 3 of PME system Collect and 6 analyze information Identify the Criteria and Indicators 4 5 Chose the information collection methods and tools Bara Guèye: Introduction to Participatory Monitoring and Evaluation PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 23
  • 23. SESSION 6 SETTING UP A PME SYSTEM WORKSHEET 6 1. Objectives of the session • Provide participants with information system, suggestions about the setting up of a PME • Share analysis tools in the process for the setting up of a monitoring-evaluation system • Provide participants with additional methodological guidance, if necessary 2. Proposed technique: brainstorming 3. Material and equipment required: Cards, padex paper and boards, markers, sellotape, 4. Duration of session: 60 mn 5. Educational progression • Organize brainstorming based on the following focal questions: In the specific context of your project or organisation, what reasons or factors motivated the decision to set up a PME system? What are the constraints and opportunities generated by the setting up of PME in your projects • The answers are noted on the index cards and then organized and discussed • The facilitator then introduces CONTENT CARD N° 7 • He asks representatives of different projects participating in the workshop to fill aide-mémoire card 7 (if a project has several representatives, they form a group). • At the end of this exercise, the groups present their results. • These results are discussed 6. Information provided by the facilitator At the end of the discussions, the facilitator invites participants to make suggestions and draw conclu- sions by referring to CONTENT CARD N° 6. 24 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 24. SESSION 6 SETTING UP A PME SYSTEM CONTENT CARD 6 Stage 1: DECIDE TO SET UP THE MONITORING SYSTEM ANALYSIS WORKSHEET ON THE CONDITIONS OF PME IN IFAD PROJECTS What institutional conditions/preconditions factors factors Depending on the are required to successfully implement the Favourable Unfavourable reply, what PME? measures should be taken? The PME is perceived by the project as an or- ganizational need Within the concerned IFAD project, there is a decentralized decision-making system which allows communities to take into account the results emanating from the application of the PME All members of the project have a clear reading of the change of attitude which the PME involves and are ready for these changes Participation is perceived as a democratic and non extractive process Groups who need the system most were identified There is an institutional context that facilitates community participation There are good facilitators within the project, who can assist the communities Existence, within the community, of people (presenters, community facilitators) who can possibly facilitate the process PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 25
  • 25. IDENTIFYING ACTORS AND SESSION 7 ANALYZING THEIR NEEDS WORKSHEET 7 1. Objectives of the session • Provide participants with the necessary tools and skills to identify actors 2. Proposed technique: Role playing, brainstorming, presentation, group work, 3. Material and equipment required: Kraft paper, markers in sufficient number, cards of different colours 4. Duration of session: 90mn 5. Educational progression • Choose 2 to 3 IFAD projects whose representatives in the training will act as resource persons. It is recommended to select (if possible) projects intervening in different sectors or having different components. • Divide the rest of the group equitably between the selected projects (group work) • The exercise consists in identifying key actors who have an influence on the project or are affected by it: The focal question « who are the different actors affected by the project or with direct or indirect influence on its functioning ? » (Brainstorming) duration • Give 10 minutes to draw up the list of actors • At this stage, the facilitator introduces the actors’ analytical grid (see CONTENT CARD N°7) • After presenting the tool, the groups are requested to pursue the exercise by filing the grid on the basis of the list of identified actors. Duration: 20 minutes • At the end of the allocated time, ask each group rapporteur to present the results of its group • Open a discussion on the different presentations. Duration: the remaining 50 minutes? • The facilitator makes recommendations /gives advice on how to use and take advantage of the grid within the framework of their work. When will the simulation announced in the proposed techniques be made? 6. Information provided by the facilitator Based on CONTENT CARD N° 7, the facilitator informs participants of the existence of other authors’ analysis tools. He may thus request participants to propose tools which may be listed on padex paper. The facilitator may request those making proposals to prepare summary sheets for the presentation on the use of these tools. These sheets could be improved, if necessary, and distributed to participants The facilitator can also present the power-interest grid explaining that it is complementary to the actors’ analysis grid presented earlier on. In general, the power-interest grid is applied first to classify actors according to their interest and power. The actors’ analysis grid can then be applied to better understand the nature of these interests and powers. 26 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 26. IDENTIFYING ACTORS AND SESSION 7 ANALYZING THEIR NEEDS CONTENT CARD 7 Stage 2: IDENTIFICATION AND ANALYSIS OF ACTORS Who are the actors? The actors are those who have an influence on or are affected by the project or programme concerned by the participatory monitoring-evaluation. The identification and analysis of actors are an important phase in the establishment of the PME sys- tem. The PME is set up to meet the concerns of these actors, particularly those directly affected by the inter- vention of the project or programme (direct and indirect beneficiaries). Some actors are more visible because of the positions they occupy and the roles they play in the com- munity or project. But there are also less visible actors who generally belong to so-called vulnerable groups and are most affected by the activities undertaken. These groups, which constitute the primary beneficiaries of the project, should play a central role in the design and management of the PME sys- tem. It is therefore important to have an appropriate approach and tools to identify them and examine their interests and what they expect from the project, the type of influence they can exert on the project ac- tivities and the arrangements to be made. How to conduct the actors’ analysis? There are several tools for that purpose. They include: The power-interest grid: It is used to make a simple mapping of actors by taking into consideration the interest that each of them could have for the PME system to be set up, as well as the influences (positive or negative) that he/she could have on the system. To apply it, one should first, identify all the project actors and second, prepare a typology by placing each actor in one of the 4 spaces of the grid, corresponding to its interest and the importance of his/her influence. Of course such a classification should be justified. At the end of the classification, one should examine the actions to be undertaken for each of the 4 categories of actors identified for the success of the PME system to be set up. The actors’ analysis grid: It facilitates the identification of the different actors, their interest for the system, their influence on the system, and the actions to be taken to improve their participation. As can be observed, this grid makes it possible to produce the same type of information as those generated by the power-interest grid, the only difference being that the former is used to classify actors. The two grids are also complementary since the actors’ analysis grid can be used as a back-up for the organization of information generated by the reflection which accompanies the preparation of the power- interest grid. But, for reasons of simplicity, one can choose to use only one of them. One should not lose sight of the fact that this process is, first and foremost, meant for the local populations and that, as a result, one should avoid using a variety of tools which would complicate the process even more. PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 27
  • 27. IDENTIFYING ACTORS AND SESSION 7 ANALYZING THEIR NEEDS CONTENT CARD 7 POWER-INTEREST GRID HIGH Keep them informed about the Important actors! conduct of the programme Do everything to maintain this group in the process Generally key beneficiaries POWER People or groups living in the community but Step up their level of information not directly affected by the and training Programme. If they are potential Need for negotiating capacity beneficiaries, they should, if possi- ble, be associated in some actions in order to prepare them LOW INTEREST Low HIGH THE ACTORS’ ANALYSIS GRID What negative What interest do What positive How to step up influence can this group of influence can this the participation Actors this group have actors have in group have on the of this group on the PME the PME? PME system ? of actors? system? 28 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 28. SESSION 8 DEFINITION OF PME OBJECTIVES WORKSHEET 8 1. Objectives of the session Improve the participants’ knowledge of PME to strengthen their capacity to assist the populations in identifying PME objectives 2. Proposed technique: Case study, role playing 3. Material and equipment required: Kraft paper, markers in sufficient number, cards of different colours 4. Duration of session: 90 mn 5. Educational progression • Choose 2 IFAD projects whose representatives in the training will simulate the role of direct beneficiaries. It is recommended to choose (if possible) projects intervening in different sectors or having different components. • Train as many groups as selected projects, if the number of participants allows it. • Explain that the exercise consists in putting oneself in the shoes of beneficiaries to identify the monitoring-evaluation objectives in the selected project. Other members of the group should ensure that the objective is clearly stated. Ask the following focal question « What are we trying to know or pursue through our participatory monitoring-evaluation system? » • Ask each group to formulate a maximum of two (2) objectives • Give each group a padex paper to list the objectives • At the end of the allotted time, ask each group rapporteur to present the objectives set for the IFAD project he/she represents • Open a discussion on the different presentations. Focal questions to guide the discussions: - Are the objectives well formulated? - Are they effectively PME objectives? - If not, what other reformulations can be proposed? 6. Information provided by the facilitator Drawing inspiration from Content Card N° 8, the facilitator provides the necessary additional information about the formulation of objectives. PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 29
  • 29. SESSION 8 DEFINITION OF PME OBJECTIVES CONTENT CARD 8 Stage 2: DEFINITION OF THE OBJECTIVES OF PME SYSTEM TO BE SET UP Define the monitoring objective. For simplicity, the objective of PME specifies what the key beneficiaries seek to monitor and evaluate. Who defines the PME objectives? Within the framework of PME, the objectives are those of key beneficiaries. The project is meant to assist the latter to identify the objectives they intend to assign to their PME system. The facilitator should build on the analysis previously conducted by actors to identify all persons or groups who should par- ticipate in the identification of objectives. A few rules • Since it is a PME system essentially meant for the communities, one should avoid being dogmatic in the formulation of these objectives • The populations should be provided with the opportunity to present their ideas (objective) clearly, regardless of the method they use. For example, the populations may formulate their PME objectives as follows: - we would like to know whether women participate effectively in the meetings held by our group- ing; - we would like to see whether the decisions taken concerning the management of financial re- sources allocated to the project are transparent, - we would like to see whether the quality of services provided by the project effectively meets our expectations • Ensure that the populations do not select many PME objectives. The more objectives there are, the more indicators one has to pursue. This makes the system more complex and more difficult to man- age • When the PME is launched for the first time, one should be limited to one or two simple objectives; and as the populations understand the system, new objectives can be added • For example, in view of the current situation of the project, is the monitoring of service quality the most important? Or the participatory monitoring-evaluation of the different actors’ participation? Or the PME of the achievement of project objectives? 30 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 30. SESSION 9 CHOICE OF PME INDICATORS WORKSHEET 9 1. Objectives of the session • Enable participants to understand what a monitoring-evaluation indicator is • Define the main characteristics of the indicator • Describe the process for the participatory definition of indicators with target groups 2. Proposed technique: Brainstorming, Group work 3. Material and equipment required: Padex, padex paper, markers, sheets, video projector, computer 4. Total duration of session: 90 mn 5. Educational progression • Ask participants to form pairs • Give 3 sheets to each group and ask them to write a key word describing the indicator, on each sheet • In plenary, ask each group to designate a rapporteur to present their results; • The sheets are displayed on the board or on a wide Kraft paper as they are presented; • The facilitator asks a participant to classify the sheets in homogenous clusters; • The list of key words is written on a padex paper • Building on content card n° 9, the facilitator completes the results produced, where relevant After this, the facilitator requests the working groups to come together around the PME objectives defined during the preceding session (session 8) • Ask the groups to define indicators in relation to the objectives defined • Ask the groups to present their results • Ask participants to discuss the results: question to guide the discussion: are the indicators clearly defined? • Write down the different comments on paper • Then ask in plenary: What characteristics are common to the different criteria defined? • The answers are written on padex paper 6. Information provided by the facilitator The facilitator draws a conclusion on the main characteristics of the indicator What is an indicator? • A revealer, • A marker, • A set of measures • A describer, • A simplifier of a more complex reality What is it used for? To measure the progress made during a given period of time in relation to a monitoring objective defined beforehand. Since each indicator provides information concerning only one part of the objective to be monitored, it is naturally necessary to have several indicators for each objective. For example, if the members of a grouping participate regularly in meetings, the different indicators should be identified. PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 31
  • 31. SESSION 9 CHOICE OF PME INDICATORS CONTENT CARD 9 Stage 4: CHOICE OF MONITORING INDICATORS What are the types of indicators • Resource indicators concern the budget allocated at every level of the intervention, the human resources mobilized, etc. The measurement of these indicators provides information about the efficiency of the project’s intervention. Example • Grants • Annual Budget • Borrowings • Labour • Input costs • Etc. • Activities indicators: to achieve the project objectives, a certain number of activities are implemented. The monitoring system may focus on the level of achievement of these activities • Meetings • Training • Visits • Etc. • Process indicators: They relate to the decision-making process and makes it possible to determine, for example, the inclusion and/or participation of actors, the regularity of meetings, the regularity of reports, etc. • Existence of reporting rules • Degree of women’s participation in decisions • Frequency of debriefing meetings • Etc. • Product indicators: When an activity is carried out, it generally generates a tangible or non tangible product. For example, at the end of a training, the number of people trained (product) can be assessed. The product is the immediate and tangible result of the combination of a resource (expenditure) and an activity (training): product: number of trainees • Trainees • Number of text books produced • Number of credit received • Etc. • The results indicators reflect behaviour. For example, a few months after the training, one can assess how many participants have applied what they learnt. Or if a project distributes equipment (product) one can assess how many beneficiaries use this equipment. Results indicators also assess the scaling down of women’s working hours following the introduction of a new activity or equipment. • Number of people who applied the training received • Use of credit obtained • Number of people who use the text books • Etc. 32 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 32. SESSION 9 CHOICE OF PME INDICATORS CONTENT CARD 9 Stage 4: CHOICE OF MONITORING INDICATORS • Impact indicators assess the long-term consequences of an intervention, beyond the immediate effects. However, it is very difficult to evaluate an impact and link its cause to a given project. Actually, the impacts are generally the product of several unrelated interventions in time and space. This explains why, in PME, emphasis Is particularly laid on the other levels and, in particular, on the effects. A few principles • Avoid being dogmatic: the criteria can also serve as a basis • Different groups may have different criteria or monitoring indicators • Since the process is iterative, the number and type of indicators may be readjusted as time goes on • At the beginning, choose a limited number of relevant indicators to foster learning • It is essential to have a certain balance between the different levels of criteria/indicators (associate criteria related to the activities and others related to the process); Example Our objective Indicators We would like to know • Number of meetings held whether women participate • Number of participants effectively in the meetings • Number of women held by our grouping • Number of decisions taken • Types of services offered • Total number of beneficiaries We would like to see • Number of female beneficiaries whether the quality of • Number of districts or villages services provided by the • Number of women beneficiaries per project effectively meets district/village our expectations • Number of people expressing satisfaction • Number of unsatisfied people • Etc. PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 33
  • 33. SESSION 9 CHOICE OF PME INDICATORS CONTENT CARD 9 Stage 4: CHOICE OF MONITORING INDICATORS What characteristics are common to these different indicators? They are • Simple: Each indicator refers to only one thing and is free of ambiguity • Measurable: These indicators are formulated in such a way that they would be measurable: Thus the changes made can be measured from one participation monitoring-evaluation session to another • Achievable/accessible: The populations may have access to information required to assess the changes • Effectively reflect the objective (relevancy): the indicator should measure what it is supposed to measure and not another reality • Temporally measurable: When a monitoring periodicity is defined, it should be ensured that it helps observe the expected developments in the indicator measurement. It is worth noting that the measurement notion does not necessarily refer to numbers and quantities. Less tangible indicators like perception can be measured using the appropriate measurement tools. Be careful to: Make a distinction between the criterion and the indicator The criterion refers to general values accepted by the community and serving as a beacon that guides the community’s view: ex, women’s participation in decision-making, the poor’s access to services. Very often, in the PME exercises, the populations mention the criteria first. The fa- cilitator, through probing questions, should be able to get them to identify the indicators. For example, if the group says it wants to evaluate women’s participation, the facilitator can ask its members what measures they intend to use for that (number of women participating in meet- ings, number of women in the office, number of participations at meetings, etc.) and which refer to indicators. A few steps for the participatory definition of indicators: • Bring together all the groups whose participation in the monitoring exercise in necessary • Identify what the success of the initiative means for each group, and this results in criteria • On the basis of the criteria, define indicators either in plenary, or in small groups • Define the units of analysis and the sampling procedure • The indicators are likely to change, depending on the progress of the project, the context, partners 34 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 34. CHOICE OF INFORMATION SESSION 10 GATHERING METHODS WORKSHEET 10 1. Objectives of the session Familiarize participants with the PME’s results-based participatory data collection tools and techniques 2. Proposed technique: Brainstorming, group work, presentation, case study 3. Material and equipment required: Kraft paper, padex paper, markers in sufficient number, cards of different colours 4. Duration: 65 mn 5. Educational progression • Brainstorming on participatory monitoring evaluation data analysis tools at the projects’ level (15mn) «What data analysis tools do you use in projects? » • If necessary, the list of tools is completed by the trainer/ facilitator (5 mn) • The participants are divided into small groups of 3 to 4 people and the facilitator assigns to each group 1 or 2 tools with which participants are familiar • The conditions of use of the listed tools are analyzed (favourable conditions, limits) 30mn • The groups present the results of their reflection (15 mn) 6. Information provided by the facilitator • Insist on the fact that in a participatory process, data collection and analysis are done simultane- ously • Based on CONTENT CARD N° 10, the facilitator provides the additional information required Before closing this session, he announces the presentation of the video on the use of the Evaluation Form by the Community as an example of an appropriate PME tool for the monitoring of qualitative indicators. PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 35
  • 35. CHOICE OF INFORMATION SESSION 10 GATHERING METHODS CONTENT CARD 10 Stage 5: CHOICE OF INFORMATION GATHERING METHODS AND TOOLS Several participatory tools can be used within the PME framework. However, the choice of a specific tool depends on the system that has been put in place. In fact, the PME application scale, the types of actors involved, the targeted objectives and the PME indicators influence the choice of tools. However, regardless of the types of tools chosen, an important principle, namely the demand for PME simplicity should be taken into consideration. In this perspective, a few rules should be complied with: • The tools should be chosen in close collaboration with the local actors entrusted with managing the system to be set up; • Limit the number of tools as much as possible. The greater their number, the more complex the PME system is; • To facilitate the involvement of everyone, and make the PME tool more user-friendly, there is need to promote visualization, as far as possible. It would be a mistake to believe that visualization is only meant to facilitate access to information for illiterates. Today, visualization has become a key dimen- sion of modern communication, and it is increasingly preferred to facilitate learning; • As regards visualization, illustrations should be chosen by /with the actors themselves (avoid having the consultant decide the forms of illustrations) ; • Need to translate the key concepts in local languages Proposed tools: The form for evaluation by the Community Assesment Forum (CAF) Advantages of the FEC • It is a tool that makes it possible to take into account, in an integrated manner, the different PME stages • Its application is based on the participation of all the groups • Its application provides IFAD project managers with immediate feedback on how beneficiaries perceive the quality of services and on measures to be taken • Actions to be implemented result from a collective reflection that takes the views of all actors into consideration • It is simple and accessible to all because it is based on visualization • The information is generated through focus groups, which facilitates the participation of groups with difficulties to express themselves during mixed group discussions Source : Guèye, B (INDh, 2008) CONTENT CARD N° 11 describes the Community Assessment Form (FEC) application process 36 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 36. INFORMATION GATHERING SESSION 11 AND ANALYSIS WORKSHEET 11 1. Objectives of the session Provide participants with the ability required for data collection 2. Proposed technique: Video projection, group work 3. Material and equipment required: video on the use of the form for evaluation by the community, Kraft paper, markers in sufficient number, cards of different colours 4. Duration of session: 90 mn 5. Educational progression • Introduce the video application context • Before starting the projection, ask participants to note the different stages of the Community Assessment Form (FEC) application (meaning of the acronym) • After the presentation, open a discussion session for a summary of the main stages; • The facilitator then proposes to participants to apply the Community Assessment Form (FEC) in their evaluation of the application of the participatory approach within IFAD projects • To that end, it is proposed that participants be divided into 2 groups representing field workers of IFAD projects (group of actors 1) and the populations beneficiaries of IFAD projects (group of actors 2). Choose an IFAD project • The two groups meet first to identify the indicators that will enable them to assess the effectiveness and quality of the application of the participatory approach by IFAD projects • Limit the number of criteria to no more than 5 (it is an educational exercise) • Follow the stages described in the card for the completion of the exercise • Following the presentation of results, the methodological observations are noted (difficulties, questions, etc.). 6. Facilitator’s information input • On the basis of CONTENT CARD N° 11, the facilitator tries to provide answers to the questions asked. He also provides all other necessary information on the use of the form, • He should however explain that the Community Assessment Form (FEC) was the tool preferred for the training, but that other tools exist. He gives examples of monitoring tools contained in CONTENT CARD 11. He may also ask participants to share other tools they know or use. The facilitator lists them on a padex paper PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 37
  • 37. INFORMATION GATHERING SESSION 11 AND ANALYSIS CONTENT CARD 11 Stage 6: INFORMATION GATHERING AND ANALYSIS Information gathering Presentation of the process on the use of the Community Assessment Form (FEC) FEC application process Session for acquaintance, mutual understanding, presentation of the objectives of the visit and the pro- ceedings of the session. During the presentation session, insist on the importance of the local actors’ commitment as an emerging approach to strengthen the performance of public programmes; but espe- cially on the need for local actors to acquire the capacities required to ensure monitoring and evaluation. Such a mechanism should be positively perceived, because the way in which beneficiaries perceive the services provided by the programme gives signals to officials and grassroots representatives that would enable them to improve the quality and performance of their services on a daily basis. Identify the key stakeholder groups. These groups benefit from the actions of the programme, those in charge of providing these services, or those in charge of controlling the implementation, etc. In reality, this identification has already been done (see session 8); Focus groups: division of team members into homogeneous sub-groups whose number is equal to that of the stakeholder groups. The criteria for the composition of these focus groups may vary from one PME system to another; it may be a criteria related to gender, residence, types of services received, etc. Ensure the proper distribution of skills, profiles and sex. A facilitator will be attached to each group to assist the latter to evaluate the indicators to be identified. There is need to ensure optimal time man- agement (moderation, reporting, in particular). Organize a brainstorming session regrouping all stakeholder groups to discuss and choose the most relevant monitoring-evaluation indicators. Avoid having too many indicators. In some cases, each stake- holder group chooses its indicators separately. But the advantage of having the same criteria lies in the fact that this facilitates comparisons; the evaluations made by through the differences relative to the same aspects; Before initiating the following stage, and in the event that the process is applied for the first time, the fa- cilitator assists the group to design the monitoring-evaluation medium. The latter is composed of a grid adjusted for the qualitative type indicators. The grid facilitates the measurement of the levels of satis- faction in relation to services received/rendered, actors’ involvement, management, etc. Below is a model of the assessment form: 38 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 38. INFORMATION GATHERING SESSION 11 AND ANALYSIS CONTENT CARD 11 Project Village or Zone: Nature of the monitored component: Stakeholder group: COMMENTS: jot down INDICATOR the reasons justifying the scores given 1.Dissatis- 2. Poorly 3.Moderately - 5.Very satisfied 4. Satisfied fied satisfied satisfied Ooooooo Ooooooo Ooooooooooo Oooooooooo Ooooooooooo INDICATOR (16%) (14%) (24%) (22%) (24%) INDICATOR INDICATOR INDICATOR INDICATOR Etc. • On the basis of the selected indicators, the different groups work separately to carry out the evaluation with the help of the evaluation form. In each group, explain clearly the principle of the exercise and the results expected: - copy the evaluation grid on padex paper; - Explain the grid filling principle and, in particular, the fact that participants vote individually (each participant should give a score for each criteria). It is even preferable for each participant to record his/her vote directly on the grid; - Regardless of the score given, the reasons for such a choice should be well argued and as one goes on, scored in the « comments » column by the facilitator; -When all the individual scores are recorded next to the corresponding criterion, these scores should be converted into percentage. The most significant observations are recorded in the cor- responding box (comment) • After collecting the scores given for all the evaluation criteria, start a discussion to collect all additional observations on the final results of the exercise. • Interface between actors. This is an important stage. It consists in regrouping the different stakeholder groups to compare the respective analyses. The exercise is not meant to build a consensus but to understand the factors that explain the differences in perception. It can be structured around key questions like: What are the differences/similarities observed in the perceptions and analyses by the different groups? How does the extended group interpret these differences and/or similarities ? What are the causes of these differences? What are the changes to be made? All this information shall be carefully noted on padex paper. The facilitator shall then help the group to organize this information into key thrust areas or themes. • Negotiation: On the basis of the results of the interface session, the actors identify the different actions to be implemented in order to improve the situation. PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 39
  • 39. INFORMATION GATHERING SESSION 11 AND ANALYSIS CONTENT CARD 11 Move from evaluation to monitoring To simplify things, monitoring can be considered as a regular succession of evaluation sessions con- cerning the same objectives and indicators. Thus, the monitoring process entails repeating the sessions at regular intervals to assess the different indicators that have been identified. After each session, the results will be recorded in the monitoring table (see model below). However, after recording the results in the monitoring table, the facilitator should get the group to compare these results with those obtained during the preceding monitoring session. The grid for the analysis of changes occurring between ses- sions may be used to gather the various information emanating from this analysis. Monitoring-evaluation of quantitative indicators A diverse range of simple tools may be used to monitor quantitative indicators. However, given the spe- cific situation of each participatory monitoring-evaluation system, the creativity and innovation of local actors are required to develop suitable tools. This also has the advantage of facilitating the appropriation of tools by the populations. For this reason, it is always strongly recommended to facilitators working with the communities- after identifying the indicators- to invite the actors of the system to create simple tools to measure these indicators by taking into account some principles discussed earlier, namely sim- plicity and the use of visualization to represent the indicators and quantities. The facilitator should avoid proposing his own tools from the onset. He should first invite the populations to explore their own cre- ativity potential before showing them the tool(s) at his disposal. Actually, it might not even be necessary for him to present his own tools if the populations succeed in developing a simple and efficient tool to measure the selected indicators. 40 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 40. INFORMATION GATHERING SESSION 11 AND ANALYSIS CONTENT CARD 11 A few examples of PME tools Example 1: Labour utilization monitoring form Type of beneficiary Period Period Period Initiative developing RME Number of jobs created Number of apprentices Training received Composante B Number of loans received Amount of loans Amount repaid Composante C PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 41
  • 41. INFORMATION GATHERING SESSION 11 AND ANALYSIS CONTENT CARD 11 Example 2: Programme CES 2, Burkina Faso. This tool may be adjusted to serve as a monitoring-evaluation medium. To that end, instead of daily intervals, one can adopt intervals that are more in line with the selected indicators (monthly, quarterly monitoring, etc.). Farming Activity Days in the Duration of Labor input Labor input Labor input Exaternal Cash expenses week work man woman child labor input on hired labor Day 1 1 symbol Day 1 1 symbol Day 1 1 symbol Day 1 1 symbol Day 1 1 symbol Day 1 1 symbol Day 1 1 symbol LEGEND Full Half Day of the Local X W workday workday week currency Source: Hien, Fidèle et Ouédraogo, Ali 42 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 42. INFORMATION GATHERING SESSION 11 AND ANALYSIS CONTENT CARD 11 Example 3: The evaluation wheel used to assess local governance in Fissel (Senegal). The use of this tool at regular intervals can show the Rural Council and other participants of the process, how the as- sessment of citizens can change following actions taken after each PME session. This tool can be used within the framework of any IFAD project to monitor and evaluate other qualitative indicators. DOXINU CONSEY RIIRAL 10 10 10 Limu jëf yi Caytub alal ji Japandik tënku 10 kaayi dogal yi 10 Jaapandik jumtu kaayi tétëlin Jaapandik tasu Xeeti kom-kom yi kaayi xabaar yi 10 10 Dayoob jumtukaay yi Bookiinu ndaw 10 ci dogal yi Limu way Limu ndaje yi japalé yi Téewayu 10 ndaw yi ci 10 ndaje yi Limu dogal yi 10 10 10 Source : Guèye, B (2005) PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 43
  • 43. INFORMATION GATHERING SESSION 11 AND ANALYSIS CONTENT CARD 11 Monitoring table model Monitoring session of:............. Monitoring session of:………. Monitoring session of:…… dissatis- Poorly Modera- satisfied Very dissa- Poorly Mode- Satis- Very Dis- Poor- Mode- Satis- Very Criterion fied satis- tely satis- tisfied satis- rately fied satis- satis- ly rately fied satis- fied satisfied fied fied satis- fied fied satis- satisfied fied fied fied 1 2 3 4 5 1 2 3 4 5 1 2 3 4 5 XX X XX XXx Xxx Xxx XXx XXx Xx XX XX XX xxx xxx xxx Indicator XX X 0% 15% 15% X X 30% 30% 30% 10% 35% 20% 15% Indicator Indicator Indicator Indicator Grid for the analysis of changes occurring between two monitoring sessions Indicators Compared to the preceding Factors explaining Factors explaining What actions need monitoring session, did the the positive the negative to be taken? evaluation of the indicator change in the change in the reveal (1) a positive change, evaluationof the evaluationof the (2) a negative change or criterion criterion (3) No change at all? Indicators Indicators Indicators Indicators Indicators 44 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 44. SESSION 12 IMPLEMENTING CHANGES WORKSHEET 12 1. Objectives • Provide information about the process for the activation of changes • Discuss with participants about tools and techniques for the introduction of changes 2. Proposed technique: Group work, role playing 3. Material and equipment required: Padex, padex paper, wall sellotape, markers, 4. Duration of session: 30mn 5. Educational progression • Maintain the same groups as those of the preceding session • Ask them to pursue the exercise by identifying and planning, on the basis of the evaluation results, the actions to be undertaken with a view to strengthening the resolve to take into consideration the participatory approach within IFAD projects • Introduce the tool (planning table below) which will be used to organize information: Who? What? How? When? How many? Who pays? • Each group draws its table, fills it and puts it on padex paper • The results of the work are presented and discussed in plenary • The facilitator provides other clarifications or further details, if necessary (adopting a name) 6. Additional information provided by the facilitator: The facilitator draws inspiration from the substance of CONTENT CARD N° 12 to conclude the session. PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 45
  • 45. SESSION 12 IMPLEMENTING CHANGES CONTENT CARD 12 IMPLEMENTING CHANGES Review the different actions proposed in the cards during preceding stages on the evaluation of indica- tors. The facilitator should however ensure that the actions scheduled fulfil a certain number criteria: • They should be realistic and achievable within reasonable time • The capacities and means required to achieve them should be available • Actors are firmly committed to implement them. The table below can be used to plan the implementation of actions How much and What? By whom? How? When? who pays ? 46 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 46. MANAGEMENT AND CONSOLIDATION SESSION 13 OF THE PME SYSTEM WORKSHEET 13 1. Objectives of the session • Identify the key elements of the results-based management of the PME system • Determine the measures and actions to be taken to ensure the sustainability of the system 2. Pedagogical approach: Brainstorming, Group work 3. Duration: 60 mn 4. Material and equipment required: Kraft paper, markers in sufficient number, cards of different colours 5. Educational progression • Ask participants to divide themselves into groups of 6 to 8 persons. • Explain the purpose of the exercise: It consist in identifying the key elements to be taken into con- sideration in the management of a system. • Give 5 Bristol cards to each group and ask them to write the results by putting only one idea on each card • At the end of the allocated time, ask the group rapporteurs to reconstitute the results of their pro- ceedings, • As they go along, the cards are affixed on a board in an appropriate space prepared beforehand • Request a voluntary participant to organize the different cards by putting together those that talk about the same idea • After this work, write on a padex paper, the key elements of PME management as they emerge from the group work 6. Information provided by the facilitator On the basis of CONTENT CARD N° 13, the facilitator provides any other additional information and clarifications required. PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 47
  • 47. MANAGEMENT AND CONSOLIDATION SESSION 13 OF THE PME SYSTEM CONTENT CARD 13 MANAGEMENT AND CONSOLIDATION OF THE PME SYSTEM The management of a PME system consists in: 1. Mobilizing the actors; • Inform the populations about the different activities related to the PME system • Raise their awareness about the importance of the system and the need for their participation • Organize sessions to reconstitute the results of monitoring sessions and collect their feedback • Ensure the regular participation of all the groups, particularly the vulnerable groups • Etc. 2. Facilitate the PME sessions (Facilitation, Appropriation and Sustainability of the system) : • Plan and organize the different PME sessions • Prepare the pedagogical materials • Organize the different focus groups • Facilitate the monitoring and evaluation sessions • Organize information emanating from monitoring sessions • Prepare reports • Disseminate information to the different actors 3. Resource management (media and other resources). • Manage the PME medium. It is suggested that the PME grid be reproduced on a solid and detach- able medium (Wooden table, for example) and place it in an accessible place (office of the monitoring committee) To enable everyone to be regularly informed • Manage all the reports and documents produced within the framework of the system 3. Follow-up the implementation of recommendations from the PME sessions; • Be in contact with the project and other actors to ensure the implementation of recommendations from the PME sessions • Evaluate the implementation of the PME system itself To play these different roles effectively, there is need to institute a simple, flexible but efficient orga- nizational mechanism. Generally, a body in charge of managing and coordinating the PME system is set up for that purpose. Regardless of the appellation (monitoring committee, PME system coordi- nation committee, etc.), the institution of this body should fulfil a certain number of criteria : • It should be representative of key stakeholders concerned by the programme on which the PME is focussed • It should have a reasonable size (between 5 and 8 people) to avoid cumbersomeness • The profile of members should be in line with the roles assigned to them and mentioned earlier. They should have complementary profiles: Some members have mobilization and/or facilitation skills, others are more skilled in management and logistic organization, while others are more comfortable in the monitoring of activities, etc. • Even though project representatives can be included in the organ responsible for coordinating the process, it is important to keep in mind that it is above all, a PME system. The main beneficiaries should be at the heart of the mechanism and should discharge the different mo- bilization, leadership and facilitation functions. Of course, the role played by the project staff at the beginning of the process may be relatively more significant, but should be progressively reduced as and when the beneficiaries acquire the necessary skills. 48 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012
  • 48. MONITORING AND EVALUATION SESSION 14 OF THE PME IMPLEMENTATION EDUCATIONAL EXERCISE 14 1. Objectives of the session Define a simple approach to monitor and evaluate the implementation of the PME system 2. Proposed technique: Individual work but in case of a big group (more than 15 people) the partici- pants can be arranged in groups of two or three. 3. Material and equipment required: Kraft paper, markers in sufficient numbers, cards of different colours 4. Duration: 45 minutes 5. Pedagogical progression • Give 3 cards to each participant • Ask each participant to propose 3 monitoring indicators for the PME system based on the following focal question: What are the indicators that can provide us with information about the functioning and quality of our PME system? • Give them 5 minutes to fill the cards. The rule is known to all: a card, a criterion or indicator • When all the participants have finished filling their cards, ask a volunteer to collect and display them [haphazardly) on the board or on the space provided for that purpose • Then ask the volunteer to regroup the different cards according to the key ideas • Write these ideas on a Padex paper 6. Information provided by the facilitator • Using Content Card N° 14, the facilitator may come up with other criteria. He may propose them but lay emphasis on the fact that the criteria defined by the main actors themselves are more important. For the record, the facilitator should be prepared to direct and possibly provide some points for the discussion on the PME success or failure indicators. • The community evaluation sheet may also be used in the evaluation of the results-based PME implementation. PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012 49
  • 49. MONITORING AND EVALUATION SESSION 14 OF THE PME IMPLEMENTATION CONTENT CARD 14 MONITORING AND EVALUATION OF THE PME SYSTEM The institution of the PME system should be monitored on a continuous and regular basis. This is all the more important since it is a learning process concerning a tool that is new for most actors. Methodological and institutional difficulties will emerge at the beginning and will continue to impede the system for a while. There is thus need to establish a monitoring mechanism in order to correct these difficulties as and when necessary. The Monitoring and Evaluation of the system may concern several aspects, including: The governance of the PME system: • Which actors participate? • What is their degree of participation? • How are the decisions taken? • Are the sessions held regularly? • Is the generated information shared between the project and the other actors? Technical knowledge of the System • Do all the beneficiary groups have a sound understanding of the system? • What do you think about the quality of the sessions’ facilitation? • Is the generated information properly collected? • Is there a monitoring medium accessible to all? Effects of the system • Are the recommendations emanating from the different sessions implemented? • Does the project adequately support the management of these recommendations? • Did the system improve the participation of the populations [the vulnerable groups in particular)? • Has the populations’ role in the monitoring of activities been effectively stepped up? • Etc. Some quantitative indicators • Number of PME sessions held • Changes initiated • Frequency of sessions • Number of participants per session (per sex, village or district, etc.) • Duration of monitoring sessions • Amounts/ costs of PME sessions • Amounts/ costs of initiated changes • Etc. Tools The Community evaluation sheet may also be used in the evaluation of indicators concerning some (evaluation) issues raised. However, the sheet can also be combined with other tools like the SFPO (Success, failures, potentialities, obstacles) analysis grid or the matrix of criteria which can be used in the form of focus group to see the differences in perspective between the various actors (including the project staff). Once again, it is up to the facilitator to help beneficiaries develop or find the most adapted evaluation tools. 50 PARTICIPATORY MONITORING AND EVALUATION (PME) ­ 2012