Whast goes up must come down: challenges of getting evidence back to the ground
Tracking beneficiaries and services delivered (Harry Carr, CRS)
1. ALNAP Annual Meeting
Tracking Beneficiaries
and
Services Delivered
Harry Carr, Senior Technical Advisor for M&E
Catholic Relief Services (CRS)
March 6, 2013
2. Beneficiary and Service Delivery Indicators
(BSDI)
Measure Agency-wide Performance
on
CRS Fundamental Program Outputs
Services Delivered
and
Beneficiaries Served
ALNAP Annual Meeting Presentation
3. Types of Benefits in CRS Projects
Direct Beneficiaries
BSDI
Indirect Beneficiaries
Benefits /
Services
Policy Advocacy
Environmental Protection Not
BSDI
Institutional Strengthening
ALNAP Annual Meeting Presentation
4. Catalogue of Services and Beneficiaries
Illustrative Service Categories
Program Sub- Service Means of Direct Indirect
Area Program Service Beneficiary Beneficiary
Area Delivery Definition Definition
Emergency Shelter Transitional Training
Shelter
Technical
Assistance Individual
Assets household
(Shelter Kit) member
Commodities
Other
ALNAP Annual Meeting Presentation
5. Illustrative Program Area and Services Catalogue:
Water and Sanitation
ALNAP Annual Meeting Presentation
6. Means of Service Delivery
Program area services are delivered via one or a
combination of eight categories of service delivery means
Training
Communication and Awareness
Technical Assistance/Counseling/Extension
Asset Distribution
Food Commodity Distribution
Cash Distribution
Equipment Distribution
Infrastructure Construction
Social/Commercial Networking and Partnership
ALNAP Annual Meeting Presentation
7. BSDI Data Flow Map
Point of Service Delivery
Beneficiary and service Typically data are recorded on
delivery data are registered
paper for individual beneficiary
Da
at
Regional/Partner Office Typically data are
Di
transcribed to Excel files
gi
Beneficiary and service delivery
ta
data are recorded and records
lD
are updated
at
a
Da
ta
Project Management Office
Typically data are stored Beneficiary and services delivery
in a project database data are stored, maintained,
analyzed and reported Rp
eo
rts
aaD
t
On-line Agency
Database (PIMS) Donor
ALNAP Annual Meeting Presentation
8. BSDI Performance Products
BSDI allows accurate, annual agency-wide tracking of CRS performance
“Number” and “% targeted” of direct beneficiaries served” by
•Sub-program area service categories
•Geographic location (GPS) point of service delivery
•Gender and other beneficiary demographic characteristics
BSDI allows integrated technical and financial performance analysis
“Costs per beneficiary by service”
BSDI will track “double counted” beneficiaries in a multi-sector projects
Title II Project beneficiary of nutrition, agriculture and microfinance services
ALNAP Annual Meeting Presentation
Notes de l'éditeur
BSDI indicators are actual, understandable, meaningful and precise agency-level performance measures . Although CRS has developed and tracks program-area wide performance measures and donor defined standardized indicators, CRS has chosen to focus and refine its agency-wide performance measures at the output level . CRS understands that its beneficiaries serviced and the services they are provided are essential measures of agency performance. If we don’t reach the people needing relief or development assistance with the services they need then there can be no expectation of higher level agency outcomes or ultimate impact.
You can think of CRS conducting projects that deliver different types of benefits: Projects with the primary intention of delivering a particular benefit to an identifiable person or group of persons – BENFICIARIES Direct Beneficiaries and Indirect Beneficiaries Projects with the intention of enhancing a particularly policy environment Projects with the intention of strengthening institutions or empower communities BSDI is used for projects that deliver a benefit to beneficiaries. Other common measures will be developed for other types of projects.
BSDI gathers data not only on beneficiaries reached and services delivered but also on the means through which the service is delivered. Any given service will be delivered through one of nine categories of service delivery means . Having these data will provide still another dimension of “services delivered”.
BSDI data are gathered at the point of service delivery, typically recorded on paper by a field agent, community volunteer, implementing partner In two ways: Beneficiary data – name, id. number, project number, gender, age and geographic location – is registered along with the services he/she are eligible for. Service data – service delivered, date of service delivery, project number, beneficiary name, beneficiary id. number BSDI are recorded on forms, client journals and/or registers (clinic, school, etc.) BSDI data are transmitted to implementing partner field offices, regional project offices, etc. typically in paper form where they are: Recorded in project registers or binders in paper form or Entered into a Excel spreadsheet BSDI data may be transmitted via ICT device such as SMS, iPod/iPad, etc. BSDI data are then transmitted to the project HQ office where they are stored in a database of some kind: Linked Excel spreadsheets (macro) Access database SPSS database Etc. BSDI data are reported from the project office to the donor and to the PIMS database