CORE Group GHPC15 October 9, 2015 SBC Workshop: Behavior Change in the Age of Complexity: Implications for Monitoring and Evaluation

1. Key Trends in Alternative Approaches to Monitoring and
Evaluating Social and Behavior Change
Janine Schooley, MPH
Senior Vice President, Programs
CORE Fall Meeting, October 9, 2015

2. W W W . P C I G L O B A L . O R G
PCI’s experience in pushing the SBC
M&E envelope:
• Less donor-driven
• Less proving and more improving
• Learning from other disciplines
• Embracing the messiness
• Learning about measuring the hard to
measure
1

3. W W W . P C I G L O B A L . O R G
The Transformometer Idea
3

4. W W W . P C I G L O B A L . O R G
The Transformometer Idea cont’d
3
Counting Beneficiaries by Probability of Transformation
HIGH MODERATE LOWER
Any of these results indicate a high
probability of transformation,
particularly when service intensity is
high
Any of these results indicate a
moderate probability of
transformation, particularly when
service intensity is medium to low
Any of these results indicate a
low probability of
transformation, particularly
when service intensity is low
PCI interventions that… PCI interventions that… PCI interventions that…
Result in beneficiary being provider
of “new” services or information or
motivation to others that will likely
be sustained over time
Result in beneficiary being
provided with a service or process
that leads to attitude and/or
behavior change
Result in beneficiary being
a passive recipient of
information, education or
communication messages
Result in beneficiary engaging in
collective action or social advocacy
for his/herself, family or community
Reach an indirect beneficiary
through a direct beneficiary in the
moderate or high category of
transformation
Provide beneficiaries with
workshops or training with
minimal participation or
engagement
Result in beneficiary applying new
knowledge or skills outside of the
original area of intervention
Result in new or improved
services that meet a particular
beneficiary need
Serve beneficiaries very
minimally, eg. via one
exposure to mass media
outreach
Result in a significant improvement
in health, hunger and/or hardship
outcomes with likelihood of being
sustained
Result in an improvement in
health, hunger and/or hardship
outcomes but that have an
uncertain likelihood of being
sustained
Result in an unknown or
unclear benefit with
unlikely potential for
lasting attitude or behavior
change
High service intensity
(4 or more interventions)
Moderate service intensity (2-3
interventions)
Low service intensity
(1 intervention)

5. W W W . P C I G L O B A L . O R G
Measuring Sustainable Impact
Post project sustainability studies to understand,
learn from and improve the sustainability of our
impact:
• Bolivia DAP
• Bolivia USDA Food for Education
• South Africa Prevention in Action
• Indonesia Child Survival
• Planned: Ethiopia Women Empowered
• Planned: Botswana Building Bridges (local
capacity strengthening)
6

6. W W W . P C I G L O B A L . O R G
Measuring Social Change
Measuring social change through the Women
Empowered Initiative, BMGF-funded Parivartan
Program in India, Border Healthy Start, etc.:
• Individual and collective agency, efficacy
• Collective action
• Voice and social advocacy
• Social and human capital enhancement
• Cross generational outcomes
6

7. W W W . P C I G L O B A L . O R G 9
Lives Changed Indices (LCI)
A unique set of tools to measure the life-changing
impact of integrated programming:
• Application throughout the Women Empowered
Initiative
• Across a wide spectrum of economic, social
and behavioral characteristics – 7 modules
• Administered as a pre/post test and also with
case/control methodology
• Cellular-enabled data collection
• Moving from LCI 1.0 to 1.5 and now 2.0 and
beyond

8. Thanks!
jschooley@pciglobal.org
W W W . P C I G L O B A L . O R G