This was presented at mySociety's TICTeC Show & Tell event, which was held virtually on 23rd March 2021. More details on the event can be found here: https://tictec.mysociety.org/showandtells/2021
7. In
practice
:
Monitors use our App to report Progress & Problems
A promise is made to a community
Duty bearers are informed and take action
8. In
practice
: A promise is made to a community
Duty bearers are informed and take action
Problems are fixed
Monitors use our App to report Progress & Problems
9. In
practice
: A promise is made to a community
Duty bearers are informed and take action
Communities benefit
Problems are fixed
Monitors use our App to report Progress & Problems
10. The Types of data we’ve collected and
what we’ve learned
11. Version 1
Objective:
Provide end users the
ability to report
problems how they see
them in their own words
Give ownership of the
project to those
monitoring
Key Learnings
High Qualitative data
No required fields
resulted in non
comparable data
Difficult to make
conclusions and
resolve issues
12. Version 2: Update
Change:
• Everything was made
mandatory
• Free text & Open ended
questions kept
Key Learnings
Better ability to compare
answers
We were not being considerate
of monitors time
13. Version 3
Change:
• Effort conduct on
simplifying & streamlining
• Less required fields
• Large shift to yes/no
answers
Key Learnings
Better monitoring experience
More monitoring
More Data
Some feedback lacked depth
We had to go back to
monitors for
clarification
14. DevCheck V1-V3: Insights & Lessons
learned
The Bottom line:
• Restricted metrics make for simple analytics
Free Text:
• Can be accessibility barrier
• Multilingual & varying alphabets introduce considerable
complexity
15. Our Objective: Relevant & Actionable Data
Open Process:
• Working closely with partners to
define:
• Desired Metrics
• Data use cases
• Question Sets
Closed questions:
• With defined specific questions
can be asked
16. Version 4
Change:
• All questions are changed to selectable
answers / yes & no
• With the option to add
comments
• Option to include
additional Media
I’d like to tell you a Little bit about the application that we develop and the lessons we’ve learned about data gathering in the field.
Org
App
Iteration
Lessons learned -> Data we’ve gathered
Live data
Methodology
Technology
Project Progress
1) Authority & Ability to Deliver
Deviations to what has been promised
Being delivered
Brought to the attention
Real time
JWG -> Assist forming
Fix’s reported
It’s a collaborative process
Valuble insight into the monitoring experience
Different problems reported on different visits
Empower users
If you limit the data inputs you don’t need to clean your data
Free Text Requires a higher level of literacy