Proving it
•Télécharger en tant que PPTX, PDF•
0 j'aime•255 vues
This document discusses tools and techniques for evaluating outcomes of social investments. It outlines 7 steps to consider when exploring evaluation: 1) determining what information is needed, 2) identifying who to speak with, 3) how and where to obtain the needed information, 4) when to do the evaluation, 5) how to involve people in the research process, 6) what to do with the collected information, and 7) allocating necessary resources. The goal is to gather both quantitative and qualitative data to understand how programs have worked and their impact on people and communities.
Recommandé
Contenu connexe
En vedette
En vedette (16)
Similaire à Proving it
Similaire à Proving it (20)
Plus de National Association for Neighbourhood Management
Plus de National Association for Neighbourhood Management (20)
Dernier
Dernier (20)
Proving it
- 1. Exploring evaluation tools and techniques
- 2. 1. What do we want to find out? How do people feel? How have things worked? ? Who is involved? What is changing?
- 3. 2. Who do we need to talk to get the information we need? • Sampling • Connecting with people
- 4. 3. How and where can we get the information we need? New data e.g. survey e.g. focus groups Quantitative Qualitative e.g. health data e.g. forums Existing data
- 7. Using existing data Housing and essential needs Education and learning Employment and training Physical health Substance use and addiction Mental health Personal and social wellbeing Politics, influence and participation Finance and legal matters Arts and Culture http://www.thinknpc.org/publications/mapping-outcomesfor-social-investment/
- 8. NPC: Physical health Definition Context Vulnerable groups Key outcomes Approaches to measurement Related outcomes
- 11. 4. When can we do this?
- 12. 5. How can we involve people in doing the research? Community researchers Active residents Sense making sessions
- 13. 6. What will we do with the information we collect? Think about analysis before you begin Collect manageable data Think about your audience(s) Stories create emotional connections Numbers have impact
- 14. 7. How much resource do we need to allocate to this? cost/benefit Cost of materials Time Training
Notes de l'éditeur
- This toolkit is available on-line at http://www.localtrust.org.uk/wp-content/uploads/2012/02/2013-04-23-Checking-your-progress-toolkit-updated.pdfThe 7 steps from the ‘checking your progress coordination tool’ (page 4) are used in this presentation.
- What do we want to find out? What people think and feel about what is happening, what are their needs and wants and what they would like to see changed, how are they involved in Big Local? These are example questions and you may identify others in your area.
- 2. Who do we need to talk to in order to get the information we need? Residents, local organisations, community groups, professionals, local authorities, other statutory agencies, other voluntary groups? Two key things to think about are:Sampling – It’s unlikely that you’ll be able to talk to everyone so you will probably need to take a sample – a smaller group that represents the bigger group you wish to talk to. Check how well the sample fits with the overall group that you want to know about - are you speaking to enough men/women? Are you speaking to the right age groups? Etc. Watch out for ‘biases’ - for example, if you only interview people in the daytime you would probably speak to more people who are not working (e.g. retired, parents of young children, unemployed) than people who are in work. Sometimes it’s difficult to get a perfect sample in reality, so think about how any biases may be affecting your resultsConnecting with people – how can you get to your target audience? Where do they tend to spend their time and can you go to them? What might get them interested in taking part?
- 3. How and where can we get the information we need? Through building positive relationships; using questionnaires; holding interviews; having focus groups or other group discussions; minuting public meetings; and using local and national statistics or film and audio recordings. Quantitative data= Numerical information, e.g. the number of people attending an event or survey data where you ask people to rate on a scale how they feel about somethingQualitative data = Information that is not numerical, e.g. stories, interview data or photographsExisting data what data are you collecting for other purposes (e.g. through consultation) that could be used for evaluation?What data is available on your area from other sources (see example on slide 8)?Find examples of ways to collect data in the Big Local ‘Checking your progress flipcards’ http://www.localtrust.org.uk/wp-content/uploads/2012/02/Flip-Cards-resources-04-17-13-final.pdf
- New ways of finding out things are developing all the time and technology is enabling different ways to conduct research. Are there people in your area that can help you to use technology to gather data in different ways?
- This is an example of quick and simple way to take a ‘temperature check’ on people’s views. This was looking at citizenship and asked ‘What did you do last week that made you a citizen?’ People could choose coloured badges to represent their responses which included:I broke the lawI did nothingI kept myself informedI raised issuesI helped someoneI said what I believeI obeyed the lawI used public services
- Using existing dataNPC have developed a series of outcomes maps that can help you identify what to measure and where you can access existing data, relating to the topics listed on this slide. The link at the bottom of the slide will take you to these resources.
- This is they type of content provided in the NPC outcomes maps
- Where available, the maps have links to existing questionnaires which you can use or adapt for your own needs
- When can we do this? Who will collect the information? At regular intervals - the start, middle and end of individual projects; through the people carrying out the projects and/or with partners and residents interested in carrying out or contributing to the research This image shows one area’s ‘planning for real’ exercise where people use cards such to highlight good and bad things about their area. This type of exercise can be used more than once to look at how things are changing over time.
- How can we involve people in doing the research? By inviting people to be research/evidence champions; through training community researchers; by asking people already involved in delivery to help you show why what they are doing is important; and by publicly asking residents to help plan and participate in the research Read about one area’s experience of working with community researchers here:http://www.localtrust.org.uk/?press-coverage=researchers-finding-out-how-dewsbury-moor-residents-want-1m-spentActive residents may be collecting their own data for other purposes that could be used for evaluation. For example, UnLtd Star People may be collecting data about the success of their project.Sense making sessions – share your data with groups to stimulate a conversation about what the findings mean.
- What will we do with the information we collect? Use it! To provide feedback to those taking part in individual projects and the research; to make changes to the way things are working with the knowledge and learning gained; and to provide evidence of achievements to get more funding
- How much resource do we need to allocate to this? Think about the time needed to carry out research, people's skills, what materials you will need, any associated financial costs, and how to plan the tasks effectively. You may need a timeline for when each research/evidence task will happen and at least one named person allocated to each task to ensure it gets finished