APR Workshop 2010-M&E-TG2 - annual outcome survey

TECHNICAL GUIDELINES No2
Conducting an annual outcome survey

I- What is the annual outcome survey and why to do it?
• The annual outcome survey is a simple household survey that will be undertaken
annually by project staff and will cover a small sample of 200 households selected
randomly.
• The survey will be conducted exclusively in villages targeted by the project or receiving
project interventions, and will include both project beneficiaries and non beneficiaries
(the latter used as control group).
• Overall, the exercise is expected to take no more than 3 months and can be
implemented by project staff and extension officers, with or without external support.
• The main objectives of the survey are to: (i) measure changes happening at the
household level in terms of livelihoods and food security during the project life; (ii)
assess targeting efficiency; (iii) provide evidence of project success or failure; and (iv)
provide timely performance information necessary to undertake corrective actions.

II- How and when to conduct the survey?
• Annual outcome surveys should be conduced every year starting from the 2nd year of
implementation.
• The survey should be implemented in conjunction with qualitative assessments that will
complement the household-level information, providing information on “why” and
“how” some outcomes were or were not achieved. This means that in each village, in
addition to the household interviews, the team should conduct a certain number of
focus group (FG) discussions and key informant (KI) interviews (see TG 3 and TG 4 for
more details on qualitative assessments).
• The figure below provides an overview of the survey design. The figure shows that the
field data collection teams will go to 20 villages, and in each village they will conduct 10
household interviews as well as focus groups and/or key informant interviews. The
number of qualitative interviews to conduct will be decided by the project (number in
the figure below given as examples).

Village 1 Village 20

1 Key
2 Key 10 HH
10 HH informa
informan interview
interview 1 Focus 2 Focus nt
t s
s group groups intervie
interview

200 Household interviews
10-15 Focus groups
10-15 Key informant interviews

TECHNICAL GUIDELINES No2 - Conducting an annual outcome survey

II- How to prepare and conduct an annual outcome survey?

Overview:
Estimated
Activity/step Comments Responsibility
Duration
1 Development of the 1-3 days Can take longer if M&E officer, with inputs from
questionnaire and questions are added or component coordinators and project
interview guides for modified from the coordinator.
qualitative standard template.
assessments (see TG
3 and 4)

2 Selection of the 1-3 days Depending on M&E officer. Lists to be provided by
sample availability of reliable project staff (villages) and local
lists. authorities (households).

3 Selection of 5 days If possible, M&E officer and project coordinator.
enumerators and enumerators should be
supervisors field officers and
supervisor project
staff.

4 Training of 1-2 days The training should M&E officer and external consultant if
enumerators and include a session on any.
field testing of sampling.
questionnaire and
qualitative
assessment guides

5 Logistical planning, 1-2 days M&E officer and Project coordinator.
preparation for data
collection

6 Data collection 1-3 weeks Depends on availability Project coordinator for supervision,
of cars/motorbikes. extension workers for data collection.

7 Data entry 1-2 weeks If Excel file is used, M&E officer for supervision, assistant
data entry can only be for data entry.
conducted by one
person at a time.

8 Data analysis 1 week M&E officer with support from
external consultant (if any).

9 Report writing 1 week M&E officer, with inputs from
component coordinators and project
coordinator.

10 Communication and ad hoc Project coordinator, M&E and KM
sharing events officer.


Step 1 - Developing the questionnaire

• A standard questionnaire is given in Annex V. Some parts of the questionnaire
(highlighted in yellow) must be adapted by the project staff according to the context of
the project.
• The questionnaire can either be used is as it is or be modified according to the specific
information needs of the project. Some guidance on how to modify the questionnaire
is given in Annex II.
• The administration of the questionnaire should not take more than 30 minutes per
household.

Step 2 - Selecting the sample

• The sampling frame (ie. population from where the sample is selected) is the list of
villages targeted by the project. This list should be available at project level.
• The sample will be composed of 200 households (20 villages, 10 households per
village).
• The selection of the sample is done in two stages: (1) Selection of 20 villages; and (2)
Selection of 10 households in each village.
• The same sampling frame will be used every year, but the sample selection will be re-
done every year. This means that different villages and different households will be
surveyed each year

Step 2 - Stage 1: Selection of 20 villages

There are two options:
Option A: If all villages covered by the project have identical socio-economic
conditions, random selection can be done.
Option B: If there are different groups of villages with different characteristics (for
example some villages are located in the lowlands, others in the highlands; or some
villages are poorer than others), then the stratified sampling methodology needs to be
used.

Option A: Random selection of 20 villages
 Write down the list of all the villages targeted by the project, in alphabetical
order, and give them a number from 1 to total number of villages.
Example:
The project ABC targets 212 villages, listed below in alphabetical order.

Numbe Village
r

1 Banora
2 Boubere
3 Boukaria
4 Diarendli
5 Kolla
6 Loppe Soun
…
…
…
…
209 Vienza
210 Vouk
211 Watagan
212 Winso

 Calculate the Sampling Interval (SI) according to the formula below:

SI = total number of villages/20.

 Round up if the decimal is 0.5 or greater. Round down if the decimal is less than
0.5.

Example:

SI = 212/20 = 10.6 SI = 11

 Select a Random Number (R) between 1 and SI. To find a random number, you can
use the Excel function Rand (type “=rand()” in an Excel worksheet) which gives a
random number comprised between 0 and 1, and multiply this number by SI to get
a number between 1 and SI.

 Round up if the decimal is 0.5 or greater. Round down if the decimal is less than
0.5.

Example:

Typing “rand()” on an Excel spreadsheet we get the number 0.54. We multiply this
number by SI.

R = 0.54 * SI = 0.54 * 11 = 5.94. R=6

 Select the Rth village from the list. This is the first village selected for your sample.
Add the sampling interval (SI) and select the next village. This is the second village
selected for your sample. Add again the sampling interval and go to the next
village, which will be your third village. Continue like this until you reach 20
villages. If you get to the end of the list, just continue from the beginning.

Example:
R=6 The 6th village (Dsik) is selected

th
6 + SI = 6 + 11 =17  The 17 village (Loufta) is selected

17 + SI = 17 + 11 = 28  The 28th village is selected


Etc.


Numbe Villages Selected?
Last village r
selected
1 Banora No
2 Boubere No
3 Boukaria Yes (20th)
4 Diarendli No
1st village 5 Doussoura No
selected
6 Dsik Yes (1st)
7 Farabat No
If you
8 Fardia No
reach the
9 Fomma No end of the
10 Gaghaty No list before
Sampling
11 Gogta No getting 20
interval villages,
12 Kalenko No
continue
13 Kolla No from the
14 Loppe Soun No beginning
15 Lansanaya No
16 Lenny Tiewi No
17 Loufta Yes (2nd)
… … …
… … …
… … …
… … …
204 Tambanao Yes (19th)
205 Toukri No
206 Tomokan No
207 Ullih No
208 Vienza No
209 Vouk No
210 Watagan No
211 Winao No
212 Winsik No

 The exercise is over and your list of 20 villages randomly selected is ready!

Option B: Selection of 20 villages through stratified random sampling

 Identify groups or clusters of villages, looking at their main characteristics.

Example:

Stratified village categories Nb of villages
Lowland villages 90
Highlands villages 122
Total 212


 Calculate the percentage in each group.

Example:

% Lowlands villages = ( 90 / 212 ) x 100 = 42 %
% Highlands villages = ( 122 / 212 ) x100 = 58 %

This tells us that, out of a sample of 20 villages:
- 42% should be villages in the lowlands (8 villages)
- 58% should be villages in highlands (22 villages)

 From there on, apply the same methodology as explained in Option A above.
 Calculate the Sampling Interval (SI) according to the formula below:

SI = total number of villages/8 [Lowlands villages] SI = 26
SI = total number of villages/22 [Highlands villages SI = 7

 For the next steps, you will random select the villages using two separate lists of
villages (corresponding to your two categories of villages).

 Etc.

Step 2 - Stage 2: Selection of 10 households in each selected village

• Once you have the list of 20 villages where you will go to collect data, you will need to
select randomly 10 households in each village.
• Two options exist for selecting households in the villages, described below.
• Option 1 is similar to the method for selection of the villages. It is preferred over
option 2. However, it requires having a reliable list of all households living in the
selected villages. If this information is not available, option 2 can be applied. Option 2
is cheaper and faster than option 1.
• Choosing the appropriate method for household selection will depend on the
information available and the logistic, time and resources constraints.
• More detailed information on sampling procedures is given in Annex III.

Option 1
• In each village, each household is given a unique number (no two households can
have the same number).
Example: In the village there are 35 households, such that households are numbered 1
to 35.
• A sampling interval (SI) is calculated, by dividing the total number of households by
10. Round up if the decimal is 0.5 or greater. Round down if the decimal is less
than 0.5.
Example: 35/10=3.5, SI=4.

• As in the selection of the villages, a random number between 1 and SI is selected (for
example, you can write numbers from 1 to 4 on small pieces of paper, fold them and
ask someone to pick one paper).
Example: The number 2 was picked. The household number 2 of the list is selected as the
first household. Then we add 4 (the sampling interval) and select the next household
(household number 6). Add again 4 and so on until you reach 10 households.

Option 2
• Once the data collection team arrives in the village, the approximate center of
the village is identified. A pencil or bottle is spun to select a random walking
direction (also called a transect line).
• The data collection team then counts the number of households encountered
along the transect line between the centre and the perimeter of the cluster
(end of the village). This number is divided by 10 (total number of household
needed in our case) to determine the interval at which households will be
selected in the transect line.
• When the transect line contains less than the number of households required,
all households in the line are included in the sample and the data collection
team returns to the center of the cluster to pick a second random walking
direction and the process is repeated.
• This may require returning to the center and repeating the process as for
transects with fewer than the number of required households.

Source: WFP sampling guidelines for vulnerability analysis,
ODAV (VAM) – WFP, Rome, December 2004


Step 3 – Conducting the survey

 Training and field testing of the questionnaire

• The survey team will consist of enumerators and their supervisors. It is recommended
that each team should consist of three enumerators and one supervisor (see below).

• Training and field testing must be organized with all enumerators and supervisors
before going to the field.

• The training should include sessions on: (i) questionnaire comprehension and
interviewing skills; (ii) sampling procedure for selection of the households in the
villages; (iii) how to conduct key informant interviews.
• The duration of the training can vary from one to two days, and the training can be
conducted in the project office.
• The training should include field testing of the data collection tools (questionnaire and
interview guidelines), the purpose being to verify that all questions are clear and easy
to understand by the respondent. If necessary, the questionnaire should be revised
after training and field testing. The revision must involve the trainees who did the field
testing.

 Selecting the enumerators and supervisors
• The data collection should be undertaken by 3 teams, each team being composed of 1
enumerator and 1 supervisor.
• The 3 teams will go to the first 2 villages together, and a debriefing will take place the
next day to discuss and agree on possible corrective actions to take for the rest of the
data collection exercise.
• Then each team will go to 6 villages, and stay one day in each village.
• The entire data collection should therefore take approximately 10-15 days if all teams
Data collection
can work at the same time, and if transportation from one village villages other is not
2 to the
teams
too long. More days will be needed if there is only one car/motorbike available and if
villages are very far from each other.

Debriefing and preparation for field work
Day 1 – 2 -3:

Day 4: 1 supervisor
(project staff)

1 supervisor
(project staff) 1 enumerator
1 supervisor (field officer)
(project staff)
Day 5 - 15 1 enumerator
(field officer)
1 enumerator
(field officer)

6 villages

6 villages

6 villages


 Logistical planning and preparation for data collection
The following material is needed for the data collection exercise:
 Cars or motorbikes to go to the villages (ideally 3 so that all teams can work
contemporaneously)
 Hardcopies of the questionnaires (plan for approx. 10 additional copies per team in
case of need)
 6 copies of the present guidelines (one for each team member)
 Pens and plastic folders to carry the questionnaires

 Data collection

Household surveys
• The respondent should be the head of household or any person designated by
him/her.
• If there is no respondent in the household (e.g. head of household is absent and the
other people do not want or cannot respond), the team should proceed to the next
selected household.
• See do & don’ts for interviewers in Annex IV.

Role of the supervisor
Throughout the fieldwork, the supervisor will be responsible for observing interviews and
provide assistance to enumerators when needed.
Supervisors should also make sure that questionnaires are reviewed for completeness,
legibility and consistency, during the field work (so that eventual corrections can be made
while in the village).

Step 4 – Analysing results

 Entering the data
• An Excel file is provided to facilitate data entry and data analysis.
• In the database, each row corresponds to a household (ie. a questionnaire), and each
column correspond to a variable (ie. a question).

 Analysing the data
• The data will include beneficiaries and non-beneficiaries households since the
selection of the households in the villages will be done randomly on all the households
living in the village.
• The results can be compared from year to year even though the same households will
not be surveyed each year.
• The expected outcomes of the project should guide the analysis of the data.
Remember to look back at your performance questions and Logframe before starting
the analysis and report writing. It will remind you what your analysis should focus on.


 Writing the report
• The emphasis should be on the meaning and implications of the data analysis for the
project, not on the methodological aspects (these can be put in annex).
• The survey report should not be more than 10 pages.

 Communicating and sharing the results
• Once a first draft of the report has been prepared, the M&E officer must organize a ½
day workshop with the project team and main stakeholders to present the results of
the survey and discuss the main issues.
• Enumerators (project field staff) and supervisors must participate in the workshop.
• After the workshop, comments can be integrated in the report and the final report
must be sent to IFAD and other stakeholders.


ANNEXES

I - Modifying the questionnaire
The basis for developing your questionnaire should be the Logframe, which is supposed to tell
you what the expected outcomes of each component are. If the Logframe is not clearly
defined, the project staff should meet to identify the outcomes they are interested in tracking
with the household survey. The design of the questionnaire is extremely important since the
same questionnaire will be used along the project life (in order to be able to compare the
results). Therefore make sure to insert all the information that you need to track outcomes.

-> How to translate the expected outcomes into indicators?
-> From indicator to question in the questionnaire

Example:

One expected outcome is “Improved quality of the crops and sustainable operating
conditions for small farmers”.

In order to know whether this outcome was achieved, the performance questions might be
as follows:
1 - “To what extent small farmers have improved the quality of their crops?”
2 - “Do small farmers have a more secured and stable access to market?”

What kind of information do you need in order to answer these two questions? Information
will be related to the quality of the crops and on how farmers are organized to sell their
products. You may need information both at farmer (household) level and at community
level (ie. talking to the marketing groups or community market institutions). Let’s focus on
household level indicators (ie. that we can inform through household survey).

Possible indicators at household level are:
1.1 - Number of farmers growing high value crops
1.2 – Perception of the farmers on the quality of their crops
1.3 - Perception of the farmers on the way project activities have improved their operating
conditions
2.1 – Number of farmers who are part of a marketing group
2.2 - Perception of the farmers on the ability of the group to improve their operating
conditions
2.3 - Perception of the farmers on the way project activities have increased the quality of the
crops

Now that we have the indicators, we need to translate them into questions to insert in the
questionnaire. One or more questions can be needed to inform one single indicator.
1.1 – “Do you grow high value crops?” Y/N
1.2 – “This year, did you improve the quality of your crops compared to last year?” Y/N
1.3 - “Do you see any relation between your participation in project activities and the quality
of your crops?” Y/N
2.1 - “Please explain your answer”
2.2 – “Are you part of a marketing group?” Y/N
2.3 – “Do you think that the fact that you are in this group has improved your operating
conditions?” Y/N


When modifying the questionnaire, remember that:
 Questions should be as clear as possible. Notes for enumerators must be inserted in
italic in the questionnaire when the question may not be interpreted correctly, or to
define a key term.
 Each question should correspond to a precise information need. It must add value to
the analysis without making it too complex.
 Delete questions that are not related to your project activities (e.g. if your project has
no micro-enterprise component, delete the section on micro-enterprises)
 If you add a question, make sure to attribute a unique variable number (e.g. K1).
 If you delete a question, modify the variable numbers to make sure they are coherent
(e.g. if you delete E2, E3 becomes E2, E4 become E3 etc.)
 When you modify question numbers, check in the analysis file that the variable
numbers correspond to the questionnaire.
 The administration of one questionnaire should take no more than 30 minutes. 15-20
min is ideal.
 You can arrange the questionnaires by component (one section by component)
instead of by thematic as in the example.

II - Sampling
Probability sampling will be used for the survey, since it minimizes the risk of biased selection.
This means that all target villages will have the same probability of being selected. In other
words, villages located far away from the project office in a remote area will have as much
probability to be selected as villages closer to the main urban centre and more easily
accessible. This will increase the cost and duration of the survey (enumerators are likely to
travel more) but will considerably increase the credibility of the results.
Probability sampling is opposed to convenience sampling, in which the prime consideration is
accessibility: only those easily reached by interviewers are included in the sample.
Convenience sampling does not permit generalization of the data.
To select the sample, the first thing you need is a sampling frame. The sampling frame is the
list of villages that will be considered for inclusion in the sample. Since the survey will cover
only villages who are participating in project activities, in our case the sampling frame will be
composed exclusively of all the villages targeted by the project. A list of these villages should
be available at project level.
For the selection of households in the village, sampling option 1 is recommended since it is
more statistically rigorous, but it is feasible only if an accurate list of all households in the
selected villages is available (or if a map can be drawn with the village leader indicating all the
households). If a list can be obtained from a recent census or from local authorities, and if the
villages are not too large in size, the survey team should use this option to select the
households.
The second option for selecting households is the most rapid, but also the least preferred
method. This method is commonly used in anthropometric surveys.

III - Interviewing skills: some do’s and don’ts for interviewers

• DO test the interview schedule beforehand for clarity, and to make sure questions
cannot be misunderstood.
• DO state clearly what the purpose of the interview is.
• DO assure the interviewee that what is said will be treated in confidence.
• DO ask if the interviewee minds if you take notes or tape record the interview.


• DO record the exact words of the interviewee as far as possible.
• DO keep talking as you write.
• DO keep the interview to the point.
• DO cover the full schedule of questions.
• DO watch for answers that are vague and probe for more information.
• DO be flexible and note down everything interesting that is said, even if it isn’t on the
schedule.
• DON’T offend the interviewee in any way.
• DON’T say things that are judgmental.
• DON’T interrupt in mid-sentence.
• DON’T put words into the interviewee’s mouth.
• DON’T show what you are thinking through changed tone of voice.


IV – Questionnaire

The following standard questionnaire may be amended to capture the essence of your
project interventions.

In so doing, irrelevant issues or questions should be deleted; and any additional
questions can be added.

Changing the questionnaire will however have implications on the Excel database that
IFAD has developed to facilitate data entry and analysis.

In case you will need support to amend this database to reflect the changes introduced
in the standard questionnnaire, please contact the IFAD Asia and Pacific Division
(m.donnat@ifad.org).

[Insert logo of
QUESTIONNAIRE ID: /___/___/___/ implementing agency]

ANNUAL OUTCOME SURVEY

[Insert name of the project and country]

I Date (D/D/M/M/Y/Y/Y/Y) : /___/___/___/___/___/___/___/___/

II Name of the enumerator: ___________________________________________________

Note for enumerator : Before starting the interview, introduce yourself, explain what are the objectives of
the survey and ask the person if he/she consents to respond to the questions. If not, go to the next
household.
Circle codes corresponding to the answers in the right column.

A – HOUSEHOLD IDENTIFICATION

A.1 Village ____________________________ A.2 District or Province _______________________

A.3 Name of the head of household : ______________________________________________________

A.4 What is the gender (sex) of the household head? A. Male B. Female

A. Well off

In terms of income group, in which of the following categories would you B. Average
A.5
consider that your households belongs?: C. Poor
D. Very poor

B – PARTICIPATION IN PROJECT ACTIVITIES
B.1 Since when is your household involved in project activities (year)? /___/___/___/___/

Over the last 12 months, were you (or any household member) involved A. Yes
B.2
in any activity of the [insert name of the project] B. No (->go to B4)

In which of the following project activities were you (or any member of your household) involved during the
B.3
past 12 months? [For each main set of activity below (e.g. “Forestry training”, circle the corresponding code]
B.3.1 - [Insert name of activity a] A. Yes B. No

B.3.2 - [Insert name of activity b] A. Yes B. No

B.3.3 - [Insert name of activity c] A. Yes B. No

A. Yes B. No
B.3.4 - [Insert name of activity d]

B.3.5 - [Insert name of activity e] A. Yes B. No

B.3.6 - [Insert name of activity f] A. Yes B. No

B.3.6 - [ continue list of activities…] A. Yes B. No

A. Very satisfied
In general, regarding how your participation in project activities has
B.4 B. Moderately satisfied
impacted on your living conditions, are you:
C. Not satisfied at all

A. Frequently
How often do you have contact with project staff (extension workers;
B.5 B. Occasionally
facilitators, etc.)?
C. Rarely

C - LIVELIHOODS

A. Yes
C.1 Do you have a source of cash income? B. No (no cash income, only
subsistence agriculture)
A. Higher
C.1.1 – Compared to last year (i.e. 12 months ago), would you say
B. Equal
that, this year, your income is:
C. Lower
/_ __/
What is the main source of income of your household?
C.2
[Use codes below and write corresponding code on the right] [One answer only]
[Adapt the response options below to the
context of your project]
G. Salaries, wages (employees)
A. Agriculture and sales of crops
H. Handicraft
B. Fishing and sales of fish
I. Remittances
C. Livestock and sales of animals
J. Begging, assistance
D. Natural resources
K. Other (specify:
E. Petty trading
F. Unskilled labour

C.3 Do you have other sources of income? A. Yes B. No (-> go to D.1)

C.3.1 - What are these other income sources for your household?
/_ _ _/ ; /_ __/ ; /__ _/
[Use same codes as above ]

[Max 3 answers]

D – FOOD SECURITY

Over the last 12 months, was there any period(s) during which you were
A. Yes
D.1 not able to provide 3 meals per day for your household (food shortage
B. No (-> go to D.2)
period)?
D.1.1 - For how many weeks in total, over the last 12 months? /___/___/
A. Some improvement

D.1.2 – Was there an improvement as compared to previous year? B. Same
C. Situation is worse

E – LAND TENURE

E.1 Do you own productive land (including fish ponds)? A. Yes B. No (-> go to E.2)

E.1.1- What is the size of your land (in acres)? /_ __/__ _/ acres

E.2 Do you have property rights on a land? A. Yes B. No (-> go to F.1)

A. Very secure
B. Moderately secure
E.2.1 - How secure do you consider your property rights?
C. Insecure
D. Very insecure

F - AGRICULTURAL PRODUCTION AND IRRIGATION

A. Yes, own consumption only
B. Yes, sales only
F.1 Do you cultivate land, and if so, for what purpose?
C. Yes, consumption and sale
D. No (-> go to F.5)

F.1.1 - Do you grow high value crops? [provide definition of high
A. Yes B. No
value crop]
F.1.2 - Compared to last year (i.e. 12 months ago), did the A. Yes B. No (-> go to
F.2)
productivity of your crops increase this year?
A. Small
F.1.2.1 - How would you quantify this increase? B. Medium
C. Large

F.1.2.2 – Is this increase related to any project activity? A. Yes B. No

During the past 12 months, did you adopt any new agricultural A. Yes B. No (-> go to
F.2
production technology promoted by the project? F.3)

/____/ ; /____/
F.2.1 - Which one? [response options to be adapted by project]
[Two answers maximum]

[Adapt the response options below to the context of your project]
A. Technology a
B. Technology b
C. Technology c
D. Technology d
E. Technology e

Compared to last year (ie. 12 months ago), this year, did your crop A. Yes B. No (-> go to
F.3
F.4)
production area increase:
A. Small

F.3.1 - How would you quantify this increase? B. Medium
C. Large

F.3.2 – Is this increase related to any project activity? A. Yes B. No

A. Yes B. No (->go to
F.4 Do you use irrigation system(s)? F.5)

F.4.1 - Did you manage to increase your irrigated area this year A. Yes B. No (->go to
F.5)
compared to last year (i.e. 12 months ago)?
A. Small

C. Large


F.5 Do you have access to a fish pond? F.6)
F.5.1 - Compared to last year (i.e. 12 months ago) did the A. Yes B. No (-> go to
productivity of this fish pond increase this year? F.6)

A. Small

C. Large


F.6 Do you own livestock? G.1)

F.6.1- Compared to last year (i.e. 12 months ago), is your herd A. Yes B. No (->go to
G.1)
size larger this year?

A. Small
C. Large


G – ACCESS TO MARKETS

G.1 Do you get an income from sales of agricultural production? G.2)

A. Increased
G.1.1 - Compared to last year (i.e. 12 months ago), has your
B. Did not change
income from sales of agricultural production increased?
C. Decreased

G.1.2 - Do you have a contract for selling your production? G.2)

G.1.2.1 - Has this contract improved your financial
A. Yes B. No
situation?
Compared to last year (i.e. 12 months ago), has your physical access A. Yes B. No
G.2
to market improved this year?

*******************************************************************************
The following sections (H, I and J) are optional: they should be included in the questionnaire only if
the project is involved in activities related to the particular topic. For example, if the project has a
natural resources management component, include the section on NRM (section J). Remove the
sections that are not relevant to the project

H – ACCESS TO RURAL FINANCIAL SERVICES
Did you (or any household member) borrow money over the last 12
H.1 A. Yes B. No (-> go to H.2)
months?
A. Informal (friends, NGOs,
Cooperatives/credit group)
H.1.1 – What was the source of credit?
B. Formal (bank/micro-finance
institution)

/___/___/___/___/___/___/___/
H.1.2 - How much did you borrow (total last 12 months)?
[Write the amount in the local currency]
[Currency]: _______________

A. Yes

H.1.3 – Have you repaid the amount borrowed? B. Not yet, but soon
C. No, cannot repay

A. Consumption (food, clothes,
ceremonies, etc.)
B. Income generating activities
(tools; equipment, etc.)
H.1.4 - What did you - or will you - use the money for?
C. Other investments (housing
[One answer: only the main use should be reported] improvement, land acquisition; etc.)
D. Education
E. Health

Overall, do you consider that, compared to last year (ie. 12 months ago),
H.2 A. Yes B. No
your household has now a better access to financial services?

H.2.1 - Would you say this is related to any project activity? A. Yes B. No(-> go to I.1)

I - ENTERPRISE DEVELOPMENT AND EMPLOYMENT

Do you or any household member have a non-farm enterprise?
I.1 A. Yes B. No (-> go to I.2)
[Provide definition of non-farm enterprise e.g. handicraft activities]
A. No employee
B. One to two employees
I.1.1 – In addition to yourself, how many employees do you have?
C. Three to five employees
D. More than five employees

A. Yes, establish
I.1.2 - Did the project help your household establish or expand
B. Yes , expand
your enterprise/business?
C. No (-> go to I.2)

Did project help you find a job or improve your employment
I.2 A. Yes B. No
conditions?

J – ACCESS TO NATURAL RESOURCES

[Section to adapt. Select only the parts that are relevant for your project activities.].

J.1 Do you have access to community fish ponds? A. Yes B. No (-> go to J.2)

J.1.1 – Is this access regulated? A. Yes B. No

J.1.2 – Has your access to the fish ponds improved since last year? A. Yes B. No

J.1.3 – Do you consider that the productivity of the fish ponds has A. Yes B. No (-> go to J.2)
improved as compared to last year?
J.1.3.1 - If yes, was it thanks to project activities? A. Yes B. No

J.2 Do you have access to marine fisheries? A. Yes B. No (-> go to J.3)

J.2.1 – Is the access regulated? A. Yes B. No

J.2.2 – Has your access to marine fisheries improved since last
A. Yes B. No
year?
J.2.3 – Do you consider that the productivity of the marine
A. Yes B. No (-> go to J.3)
fisheries has improved as compared to last year?
J.2.2.1 – If yes, was it thanks to project activities? A. Yes B. No

J.3 Do you have access to forest? A. Yes B. No (-> go to J.4)


J.3.2 – Do you consider that your access to the forest has improved A. Yes B. No (-> go to J.4)
as compared to last year?
J.3.3 – Do you consider that the productivity of the forest has A. Yes B. No (-> go to J.4)
J.3.3.1 – If yes, was it thanks to project activities? A. Yes B. No

J.4 Do you have access to community pasture land? A. Yes B. No (-> end)
A. Yes B. No
J.4.1 – Is this access regulated?
A. Yes B. No
J.4.2 – Do you consider that your access to pasture land has
J.4.3 – Do you consider that the productivity of the forest has A. Yes B. No (-> go to J.4)
A. Yes B. No
J.4.3.1 – If yes, was it thanks to project activities?

**********************************************************************************
***THIS IS THE END OF THE INTERVIEW, THANK YOU

QUESTIONNAIRE B
FOR NON BENEFICIARIES

This questionnaire is the same as questionnaire A except that it does not contain the questions related to
project activities. The numbering should not be changed, so that same questions have the same number in
both questionnaires.
C - LIVELIHOODS

A. Yes
C.1 Do you have a source of cash income? B. No (no cash income, only
subsistence agriculture)
A. Higher
C.1.1 – Compared to last year (i.e. 12 months ago), would you say
B. Equal
that, this year, your income is:
C. Lower
/_ __/
What is the main source of income of your household?
C.2
[Use codes below and write corresponding code on the right] [One answer only]
[Adapt the response options below to the
context of your project]
G. Salaries, wages (employees)
A. Agriculture and sales of crops
H. Handicraft
B. Fishing and sales of fish
I. Remittances
C. Livestock and sales of animals
J. Begging, assistance
D. Natural resources
K. Other (specify:
E. Petty trading
F. Unskilled labour

C.3 Do you have other sources of income? A. Yes B. No (-> go to D.1)

/_ _ _/ ; /_ __/ ; /__ _/
C.3.1 - What are these other income sources for your household?
[Use same codes as above ]
[Max 3 answers]

D – FOOD SECURITY

Over the last 12 months, was there any period(s) during which you were
A. Yes
D.1 not able to provide 3 meals per day for your household (food shortage
B. No (-> go to D.2)
period)?
D.1.1 - For how many weeks in total, over the last 12 months? /___/___/
A. Some improvement

D.1.2 – Was there an improvement as compared to previous year? B. Same
C. Situation is worse

E – LAND TENURE

E.1 Do you own productive land (including fish ponds)? A. Yes B. No (-> go to E.2)

E.1.1- What is the size of your land (in acres)? /_ __/__ _/ acres

E.2 Do you have property rights on a land? A. Yes B. No (-> go to F.1)

A. Very secure
B. Moderately secure
E.2.1 - How secure do you consider your property rights?
C. Insecure
D. Very insecure

F - AGRICULTURAL PRODUCTION AND IRRIGATION

A. Yes, own consumption only
B. Yes, sales only
F.1 Do you cultivate land, and if so, for what purpose?
C. Yes, consumption and sale
D. No (-> go to F.5)

F.1.1 - Do you grow high value crops? [provide definition of high
A. Yes B. No
value crop]
F.1.2 - Compared to last year (i.e. 12 months ago), did the
A. Yes B. No (-> go to F.2)
productivity of your crops increase this year?
A. Small
C. Large

During the past 12 months, did you adopt any new agricultural
F.2 production technology (e.g. promoted by government extension A. Yes B. No (-> go to F.3)
services or by a donor-funded project)?
A. Through government
extension services
B. Through an NGO
F.2.2 – How did you learn about this new technology?
C. Through donor-funded project
D. Through a neighbour/friend
E. On my own initiative

Compared to last year (ie. 12 months ago), this year, did your crop
F.3 A. Yes B. No (-> go to F.4)
production area increase:
A. Small

F.3.1 - How would you quantify this increase? B. Medium
C. Large

F.4 Do you use irrigation system(s)? A. Yes B. No (->go to F.5)

F.4.1 - Did you manage to increase your irrigated area this year
A. Yes B. No (->go to F.5)
compared to last year (i.e. 12 months ago)?
A. Small

C. Large

F.5 Do you have access to a fish pond? A. Yes B. No (->go to F.6)

F.5.1 - Compared to last year (i.e. 12 months ago) did the
A. Yes B. No (-> go to F.6)
productivity of this fish pond increase this year?
A. Small

C. Large

F.6 Do you own livestock? A. Yes B. No (->go to G.1)

F.6.1- Compared to last year (i.e. 12 months ago), is your herd size
A. Yes B. No (->go to G.1)
larger this year?
A Small
C. Large

G – ACCESS TO MARKETS

G.1 Do you get an income from sales of agricultural production? A. Yes B. No (->go to G.2)

A. Increased
G.1.1 - Compared to last year (i.e. 12 months ago), has your
B. Did not change
income from sales of agricultural production increased?
C. Decreased

G.1.2 - Do you have a contract for selling your production? A. Yes B. No (->go to G.2)

G.1.2.1 - Has this contract improved your financial
A. Yes B. No
situation?
Compared to last year (i.e. 12 months ago) has your physical access to A. Yes B. No
G.2
market improved this?

*******************************************************************************
The following sections (H, I and J) are optional: they should be included in the questionnaire only if
the project is involved in activities related to the particular topic. For example, if the project has a
natural resources management component, include the section on NRM (section J). Remove the
sections that are not relevant to the project

H – ACCESS TO RURAL FINANCIAL SERVICES

Did you (or any household member) borrow money over the last 12
H.1 A. Yes B. No (-> go to H.2)
months?
A. Informal (friends, NGOs,
Cooperatives/credit group)
H.1.1 – What was the source of credit?
B. Formal (bank/micro-finance
institution)

/___/___/___/___/___/___/___/
H.1.2 - How much did you borrow (total last 12 months)?
[Write the amount in the local currency]
[Currency]: _______________

A. Yes

H.1.3 – Have you repaid the amount borrowed? B. Not yet, but soon
C. No, cannot repay

A. Consumption (food, clothes,
ceremonies, etc.)
B. Income generating activities
(tools; equipment, etc.)
H.1.4 - What did you - or will you - use the money for?
C. Other investments (housing
[One answer: only the main use should be reported] improvement, land acquisition;
etc.)
D. Education
E. Health

Overall, do you consider that, compared to last year (i.e. 12 months ago),
H.2 A. Yes B. No
your household has now a better access to financial services?

I - ENTERPRISE DEVELOPMENT AND EMPLOYMENT

Do you or any household member have a non-farm enterprise?
I.1 A. Yes B. No (-> go to J.1)
[Provide definition of non-farm enterprise e.g. handicraft activities]
A. No employee
B. One to two employees
I.1.1 – In addition to yourself, how many employees do you have?
C. Three to five employees
D. More than five employees

A. Yes (Establish)
I.1.2 - Did anyone help you establish or expand your enterprise or
B. Yes (Expand)
business?
C. No
A. Government extension services

I.1.2.1 - If yes, who helped you? B. An NGO
C. A donor-funded project

J – ACCESS TO NATURAL RESOURCES

[Section to adapt. Select only the parts that are relevant for your project activities.].

J.1 Do you have access to community fish ponds? A. Yes B. No (-> go to J.2)


J.1.2 – Has your access to fish ponds improved compare to last
year?
J.1.3 – Do you consider that the productivity of the fish ponds A. Yes B. No (-> go to J.2)
has improved as compared to last year (i.e. 12 months ago)?

J.2 Do you have access to marine fisheries? A. Yes B. No (-> go to J.3)

J.2.1 – Is the access regulated? A. Yes B. No

year?
J.2.3 – Do you consider that the productivity of the fish ponds A. Yes B. No (-> go to J.3)
has improved as compared to last year (i.e. 12 months ago)?

J.3 Do you have access to forest? A. Yes B. No (-> go to J.5)


year?
J.3.3 – Do you consider that your access to the forest has A. Yes B. No (-> go to J.4)
improved as compared to last year (i.e. 12 months ago)?

J.4 Do you have access to community pasture land? A. Yes B. No (-> end)


J.4.2 – Has your access to fish ponds improved compare to last year?

J.4.3– Do you consider that your access to pasture land has improved A. Yes B. No
as compared to last year (i.e. 12 months ago)?

**********************************************************************************
***THIS IS THE END OF THE INTERVIEW, THANK YOU

APR Workshop 2010-M&E-TG2 - annual outcome survey

Recommandé

Recommandé

Contenu connexe

Similaire à APR Workshop 2010-M&E-TG2 - annual outcome survey

Similaire à APR Workshop 2010-M&E-TG2 - annual outcome survey (20)

Plus de IFAD International Fund for Agricultural Development

Plus de IFAD International Fund for Agricultural Development (20)

Dernier

Dernier (20)

APR Workshop 2010-M&E-TG2 - annual outcome survey