This presentation uses two examples of projects covered by Internews to talk about the use of ICTs for M&E and innovative approaches to evaluate and collect data for Monitoring and Evaluation purposes.
2. USING ICT FOR M&E
IN DADAAB, KENYA
OVERVIEW OF THE HUMANITARIAN DATA
TOOLKIT PILOT PROJECT - JANUARY 2013
3. 1. How do we collect data in real time
and assure the quality of our dataset?
2. How can we analyze data faster and
without internet?
3. How do we harvest the knowledge of
the local population when doing data
collection?
THE PROBLEMS
4. We need a ready to deploy kit to do
surveys
We need a methodology “out of the
shelf” that we can replicate and teach in
little time while guaranteeing the quality
We need to use a technology that can
be customized and adapted to the local
situation
THE NEEDS
6. 1. An open source, free hardware and
software package to be deployed in
the field
2. A creative commons methodology to
do surveys in the field using local
communities
3. An offline/online system for data
gathering and data aggregation
using both mobile phones and
papers
THE SOLUTION
7. Internet cables to connect the Wifi modem
A laptop working also as server for FormHub.
The computer has an extra battery that allows it
to work for 24 hours without electricity
Wi-fi modem
Power strips that can recharge also via
USB.
THE KIT
A mini scanner that can also be powered via
USB
Multi USB Port
Android phones
Paper forms
8. Form is
downloaded
into the
phones
Form is created in XLS
format and uploaded into
FormHub
THE WORKFLOW
Data is downloaded in XLS format
Data collected
is uploaded
into FormHub
Data is collected on the
ground
9. Paper forms are
prepared and blank
form is loaded into
Captricity
Paper forms are uploaded into
Captricity for digitalization
THE WORKFLOW
Data is downloaded
in XLS format
Paper forms are used to
collect data in the field
10. THE RESULTS
What isn’t visible in the graph is the qualitative improvement that
we observed each day as well. There was a clear improvement in
the enumerators’ facility and comfort with the phones, and also in
their ability to correctly and efficiently do the paper-based surveys.
13. How do we know IVR is the most
appropriate tech to use?
What if we try a different approach?
Thinking about user-centered design
research how might ICIL approach this
question?
QUESTIONS
14. What information do communities in
FATA and KPK need to make better
decisions that can improve their lives?
What are the most effective ways to get
them critical information? What sources
and channels are used and trusted?
How is technology changing how people
access or share information? What will these
behaviors look like in the next few years?
15. ‣Uses
ethnographic research approaches to
better understand people
‣Help
us learn about and interpret people’s
needs, motivations, aspirations, and how they
impact their behavior
‣Over
time, process reveals the complex
ecosystems in which people operate
DESIGN RESEARCH APPROACH
16. KEY TOOLS FOR THIS STUDY
SHADOWING
OBSERVATION
INTERVIEWS
19. THEME 1: INFORMATION FLOWS
From what sources does a person get the information he or she
needs? Once they get a piece of information, how do they
choose who to share it with?
20. THEME 2: TRUST
How do people determine whether a piece of news or
information is – or a source – is credible or trustworthy?
21. THEME 3: INFLUENCE
What is influence and reach of different information
sources? How is influence determined and measured?
22. THEME 4: DISPLACEMENT
How does migration and displacement – both conflictrelated and work-related – impact how FATA populations
access and use information?
23. THEME 5: TECHNOLOGY
& NEW MEDIA
How is new technology changing the ways people access,
share, create, and evaluate information? What new media
channels are people using, and for what purposes?
Impact: Design for Social Change | SVA | August 4, 2011
24. BENEFITS OF THIS APPROACH
‣NEW
ARE:
AND IMPROVED PROGRAMS/INITIATIVES THAT
‣
Improved, flexible, appropriate solutions
‣
Based on the actual needs of local communities
‣
Based on the actual capacities of local communities
‣
Informed by a deep understanding of the cultural and
political context
‣
Sustainable, based on observed trends of information
and technology behaviors into the future
‣
Higher probability of success/impact
25. BENEFITS OF THIS APPROACH
‣SUPPORTS,
VALIDATES AND ENHANCES OUR
UNDERSTANDING
‣
What we know and what we think we know
‣
Surface the unknown
‣ADDS
TO AND ENHANCES CURRENT RESEARCH
ENDEAVORS
‣NEW
TOOLS AND APPROACHES FOR M&E:
‣
more insights into impacts and how to measure
‣
More potent and relevant measures of impact useful to
us and to funders
‣
Blends beautifully with participatory approaches
26. DESIGN RESEARCH
Put people at the heart of problem-solving
Takes a systems approach to solutions
Identifies opportunities for impact
27. BENEFITS OF OUR APPROACH TO
INNOVATION
‣THE
IMPORTANT OF EXPERIMENTATION
‣
A safe space for people to try, experiment and risk
‣
The ability to act outside projects funding mechanisms
‣ICT
is not a silver bullet but it is a tool which use cannot be
avoided
‣NEW
TOOLS AND APPROACHES FOR M&E:
‣
more DATA and better QUALITY
‣
Tap into the local knowledge and make the local
communities the center of the system
‣
Move the focus -M&E/research that looks to the future
rather than reporting past
MOVING FORWARD
Guided conversations that allow us to discover and probe for respondents’ attitudes and thought processes
Ideally, conducted in private and in a natural setting
Can be scheduled or ad hoc
Can do several with one respondent
Approximately 1 hour in length
Uses a set of questions as a guide, not as a fixed rule
Will be a key tool throughout this project
Respondents self-report their responses to a specific question (or set of questions) to help us understand a particular habit, behavior, or process over time
Written responses
Short interviews at regular intervals
Photo or video diaries
Well-suited to young people
Documents and artifacts can tell us a lot about the people and cultures that produce or use them, based on how they are designed, distributed, and/or used:
Documents may include posters, brochures, advertisements, and other informational material aimed at our respondents
Artifacts may be anything that our respondents may use to access, share, or store information
Start 11:30am / 3 minutes each
What was the last piece of information you needed to get, that you had to search for?
How did you search for it? Once you had it, did you share it with anyone?
(We want to understand how information moves, and how do people choose certain sources, etc. Not just focused on media.)
What sources do you trust? What sources do you always question? Why?
Photo –Daily Mashrique Popular newspaper Mohmand
Protests in Mohmand – against movie Sept 2012
Is solution oriented: not research for the sake of research