SlideShare une entreprise Scribd logo
1  sur  19
Introduction ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
"Not everything that can be counted counts, and not everything that counts can be counted."  Albert Einstein’s desk at Princeton University
“ Evaluation of  online  participation ... is still  just  an evaluation of participation!” * Alice Casey’s desk  at the Involve offices, London *  Less catchy, but  also true
Back to basics...why evaluate? ,[object Object],[object Object],[object Object],[object Object],[object Object]
A choice of purpose ,[object Object],[object Object],[object Object],[object Object],[object Object]
Its never too soon... ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
External or internal evaluation?  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
So, if ; "Not everything that can be counted counts, and not everything that counts can be counted."  … then how on earth do we know  what  to count and  how  to count it? Evaluation of  online participation
We’re   still   learning... but here are some ideas...
How do we measure? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Involve your stakeholders... ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
A step further... Participatory Evaluation ,[object Object],[object Object],[object Object],[object Object],[object Object]
What do we measure?
Some useful definitions Term Definition Outputs  Tangible products (reports, meetings etc.) Outcomes  Overall direct results (increased skills, reduced crime etc.) Impact  Longer-term results (may include unintended effects) Quantitative  Objective, measurable, predetermined response options Qualitative Subjective, interpretative, open ended response options
[object Object],[object Object],[object Object],[object Object],[object Object],‘ Thin’ engagement Deeper engagement
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object],[object Object],Creative commons thanks for photos go to: plindberg, memotions

Contenu connexe

Tendances

Books & Mortar: Getting attention for facility plans
Books & Mortar: Getting attention for facility plansBooks & Mortar: Getting attention for facility plans
Books & Mortar: Getting attention for facility plansRebecca Jones
 
ChildStory District Solutions Showcase - Main Presentation
ChildStory District Solutions Showcase - Main PresentationChildStory District Solutions Showcase - Main Presentation
ChildStory District Solutions Showcase - Main PresentationChildStory
 
ChildStory District Solutions Showcase - FutureGov Handout
ChildStory District Solutions Showcase - FutureGov HandoutChildStory District Solutions Showcase - FutureGov Handout
ChildStory District Solutions Showcase - FutureGov HandoutChildStory
 
Evaluation Theory Tree: Evaluation Approaches
Evaluation Theory Tree: Evaluation ApproachesEvaluation Theory Tree: Evaluation Approaches
Evaluation Theory Tree: Evaluation ApproachesInnovation Network
 
ChildStory District Solutions Showcase - TACSI/FutureGov Part 1
ChildStory District Solutions Showcase - TACSI/FutureGov Part 1ChildStory District Solutions Showcase - TACSI/FutureGov Part 1
ChildStory District Solutions Showcase - TACSI/FutureGov Part 1ChildStory
 
NPC, Measuring Impact in the Voluntary Sector 2016
NPC, Measuring Impact in the Voluntary Sector 2016NPC, Measuring Impact in the Voluntary Sector 2016
NPC, Measuring Impact in the Voluntary Sector 2016Business Connectors
 
Framing & Defining Metrics for Libraries
Framing & Defining Metrics for LibrariesFraming & Defining Metrics for Libraries
Framing & Defining Metrics for LibrariesRebecca Jones
 
Imagine and dream big about your library
Imagine and dream big about your libraryImagine and dream big about your library
Imagine and dream big about your libraryRebecca Jones
 
Beyond just usability: desirability testing (Susan Mercer)
Beyond just usability: desirability testing (Susan Mercer)Beyond just usability: desirability testing (Susan Mercer)
Beyond just usability: desirability testing (Susan Mercer)UXPA International
 
Interaction 20 talk - Using hypotheses to hold together your learning, thinki...
Interaction 20 talk - Using hypotheses to hold together your learning, thinki...Interaction 20 talk - Using hypotheses to hold together your learning, thinki...
Interaction 20 talk - Using hypotheses to hold together your learning, thinki...dxw digital
 
Social Media & Its Implications for Content Strategy
Social Media & Its Implications for Content StrategySocial Media & Its Implications for Content Strategy
Social Media & Its Implications for Content StrategyPam Noreault
 
ChildStory District Solutions Showcase - Barnardos/Gamification
ChildStory District Solutions Showcase - Barnardos/GamificationChildStory District Solutions Showcase - Barnardos/Gamification
ChildStory District Solutions Showcase - Barnardos/GamificationChildStory
 
Facilitating workshops and meetings with stakeholders
Facilitating workshops and meetings with stakeholdersFacilitating workshops and meetings with stakeholders
Facilitating workshops and meetings with stakeholdersMark Reed
 
Ringing the changes: transforming teams and technologies
Ringing the changes: transforming teams and technologiesRinging the changes: transforming teams and technologies
Ringing the changes: transforming teams and technologies Zak Mensah
 
Advice for young consultants
Advice for young consultantsAdvice for young consultants
Advice for young consultantsZENeSYS
 
Online conversations: sense or nonsense? By Di Tunney & Rachel Francis
Online conversations: sense or nonsense? By Di Tunney & Rachel FrancisOnline conversations: sense or nonsense? By Di Tunney & Rachel Francis
Online conversations: sense or nonsense? By Di Tunney & Rachel FrancisMerlien Institute
 

Tendances (17)

Books & Mortar: Getting attention for facility plans
Books & Mortar: Getting attention for facility plansBooks & Mortar: Getting attention for facility plans
Books & Mortar: Getting attention for facility plans
 
ChildStory District Solutions Showcase - Main Presentation
ChildStory District Solutions Showcase - Main PresentationChildStory District Solutions Showcase - Main Presentation
ChildStory District Solutions Showcase - Main Presentation
 
ChildStory District Solutions Showcase - FutureGov Handout
ChildStory District Solutions Showcase - FutureGov HandoutChildStory District Solutions Showcase - FutureGov Handout
ChildStory District Solutions Showcase - FutureGov Handout
 
Evaluation Theory Tree: Evaluation Approaches
Evaluation Theory Tree: Evaluation ApproachesEvaluation Theory Tree: Evaluation Approaches
Evaluation Theory Tree: Evaluation Approaches
 
ChildStory District Solutions Showcase - TACSI/FutureGov Part 1
ChildStory District Solutions Showcase - TACSI/FutureGov Part 1ChildStory District Solutions Showcase - TACSI/FutureGov Part 1
ChildStory District Solutions Showcase - TACSI/FutureGov Part 1
 
NPC, Measuring Impact in the Voluntary Sector 2016
NPC, Measuring Impact in the Voluntary Sector 2016NPC, Measuring Impact in the Voluntary Sector 2016
NPC, Measuring Impact in the Voluntary Sector 2016
 
Framing & Defining Metrics for Libraries
Framing & Defining Metrics for LibrariesFraming & Defining Metrics for Libraries
Framing & Defining Metrics for Libraries
 
Imagine and dream big about your library
Imagine and dream big about your libraryImagine and dream big about your library
Imagine and dream big about your library
 
Beyond just usability: desirability testing (Susan Mercer)
Beyond just usability: desirability testing (Susan Mercer)Beyond just usability: desirability testing (Susan Mercer)
Beyond just usability: desirability testing (Susan Mercer)
 
Interaction 20 talk - Using hypotheses to hold together your learning, thinki...
Interaction 20 talk - Using hypotheses to hold together your learning, thinki...Interaction 20 talk - Using hypotheses to hold together your learning, thinki...
Interaction 20 talk - Using hypotheses to hold together your learning, thinki...
 
Social Media & Its Implications for Content Strategy
Social Media & Its Implications for Content StrategySocial Media & Its Implications for Content Strategy
Social Media & Its Implications for Content Strategy
 
ChildStory District Solutions Showcase - Barnardos/Gamification
ChildStory District Solutions Showcase - Barnardos/GamificationChildStory District Solutions Showcase - Barnardos/Gamification
ChildStory District Solutions Showcase - Barnardos/Gamification
 
Facilitating workshops and meetings with stakeholders
Facilitating workshops and meetings with stakeholdersFacilitating workshops and meetings with stakeholders
Facilitating workshops and meetings with stakeholders
 
Ringing the changes: transforming teams and technologies
Ringing the changes: transforming teams and technologiesRinging the changes: transforming teams and technologies
Ringing the changes: transforming teams and technologies
 
How Can We Use Assessment Techniques to Enhance the Learning of Pareducators?...
How Can We Use Assessment Techniques to Enhance the Learning of Pareducators?...How Can We Use Assessment Techniques to Enhance the Learning of Pareducators?...
How Can We Use Assessment Techniques to Enhance the Learning of Pareducators?...
 
Advice for young consultants
Advice for young consultantsAdvice for young consultants
Advice for young consultants
 
Online conversations: sense or nonsense? By Di Tunney & Rachel Francis
Online conversations: sense or nonsense? By Di Tunney & Rachel FrancisOnline conversations: sense or nonsense? By Di Tunney & Rachel Francis
Online conversations: sense or nonsense? By Di Tunney & Rachel Francis
 

En vedette

2.1 local government benchmarking solace
2.1 local government benchmarking   solace2.1 local government benchmarking   solace
2.1 local government benchmarking solacePublicSectorConference
 
Online Evaluations: The Student Experience
Online Evaluations: The Student ExperienceOnline Evaluations: The Student Experience
Online Evaluations: The Student Experienceguestf89d5d
 
Teacher evaluations using technology
Teacher evaluations using technologyTeacher evaluations using technology
Teacher evaluations using technologyRichard Voltz
 
Purpose of Evaluation 评论的艺术
Purpose of Evaluation 评论的艺术 Purpose of Evaluation 评论的艺术
Purpose of Evaluation 评论的艺术 刘 世一
 
University Student Payment System ( USPS )
University Student Payment System ( USPS )University Student Payment System ( USPS )
University Student Payment System ( USPS )Md.Mojibul Hoque
 

En vedette (7)

Cooperative Online Evaluation
Cooperative Online EvaluationCooperative Online Evaluation
Cooperative Online Evaluation
 
2.1 local government benchmarking solace
2.1 local government benchmarking   solace2.1 local government benchmarking   solace
2.1 local government benchmarking solace
 
Online Evaluation
Online EvaluationOnline Evaluation
Online Evaluation
 
Online Evaluations: The Student Experience
Online Evaluations: The Student ExperienceOnline Evaluations: The Student Experience
Online Evaluations: The Student Experience
 
Teacher evaluations using technology
Teacher evaluations using technologyTeacher evaluations using technology
Teacher evaluations using technology
 
Purpose of Evaluation 评论的艺术
Purpose of Evaluation 评论的艺术 Purpose of Evaluation 评论的艺术
Purpose of Evaluation 评论的艺术
 
University Student Payment System ( USPS )
University Student Payment System ( USPS )University Student Payment System ( USPS )
University Student Payment System ( USPS )
 

Similaire à Online evaluation for Local Government Information Unit

Good practice in evaluation research
Good practice in evaluation researchGood practice in evaluation research
Good practice in evaluation researchQSR International
 
Evaluation training for wellcome trust 15th may
Evaluation training for wellcome trust 15th mayEvaluation training for wellcome trust 15th may
Evaluation training for wellcome trust 15th mayBruce Etherington
 
Exploring Users' Values, Motivations and Emotions
Exploring Users' Values, Motivations and EmotionsExploring Users' Values, Motivations and Emotions
Exploring Users' Values, Motivations and EmotionsNorthern User Experience
 
Ces 2013 towards a cdn definition of evaluation
Ces 2013   towards a cdn definition of evaluationCes 2013   towards a cdn definition of evaluation
Ces 2013 towards a cdn definition of evaluationCesToronto
 
An Introduction to the World of User Research
An Introduction to the World of User ResearchAn Introduction to the World of User Research
An Introduction to the World of User ResearchMethods
 
Overview of Evaluation Methods and Choices.pptx
Overview of Evaluation Methods and Choices.pptxOverview of Evaluation Methods and Choices.pptx
Overview of Evaluation Methods and Choices.pptxChrisHayes76322
 
Introduction to Evaluation.pptx
Introduction to Evaluation.pptxIntroduction to Evaluation.pptx
Introduction to Evaluation.pptxChrisHayes76322
 
Communications Audit
Communications AuditCommunications Audit
Communications Auditguesta8fe5
 
Usability Testing Basics: What's it All About? at Web SIG Cleveland
Usability Testing Basics: What's it All About? at Web SIG ClevelandUsability Testing Basics: What's it All About? at Web SIG Cleveland
Usability Testing Basics: What's it All About? at Web SIG ClevelandCarol Smith
 
Street Jibe Evaluation Workshop 2
Street Jibe Evaluation Workshop 2Street Jibe Evaluation Workshop 2
Street Jibe Evaluation Workshop 2Brent MacKinnon
 
How To Buy Online Qualitative - Digsite Webinar Slides
How To Buy Online Qualitative - Digsite Webinar SlidesHow To Buy Online Qualitative - Digsite Webinar Slides
How To Buy Online Qualitative - Digsite Webinar SlidesAudrey Perelshtein
 
The art and science of impact evaluation in the cultural sector
The art and science of impact evaluation in the cultural sectorThe art and science of impact evaluation in the cultural sector
The art and science of impact evaluation in the cultural sectorPatternmakers
 
Losing Control In Qualitative Research
Losing Control In Qualitative ResearchLosing Control In Qualitative Research
Losing Control In Qualitative ResearchLatitude Insights
 
Using Analytics to Improve Student Success
Using Analytics to Improve Student SuccessUsing Analytics to Improve Student Success
Using Analytics to Improve Student SuccessMatthew D. Pistilli
 
How to write the impact sections of a Horizon 2020 proposal
How to write the impact sections of a Horizon 2020 proposalHow to write the impact sections of a Horizon 2020 proposal
How to write the impact sections of a Horizon 2020 proposalMark Reed
 
Meaningful Measures: Why size (and volume) doesn't matter
Meaningful Measures: Why size (and volume) doesn't matterMeaningful Measures: Why size (and volume) doesn't matter
Meaningful Measures: Why size (and volume) doesn't matterRebecca Jones
 
I school evaluation symposium, irwin, april 2014 pauledit
I school evaluation symposium, irwin, april 2014 pauleditI school evaluation symposium, irwin, april 2014 pauledit
I school evaluation symposium, irwin, april 2014 pauleditStephen Abram
 

Similaire à Online evaluation for Local Government Information Unit (20)

Good practice in evaluation research
Good practice in evaluation researchGood practice in evaluation research
Good practice in evaluation research
 
Evaluation training for wellcome trust 15th may
Evaluation training for wellcome trust 15th mayEvaluation training for wellcome trust 15th may
Evaluation training for wellcome trust 15th may
 
Exploring Users' Values, Motivations and Emotions
Exploring Users' Values, Motivations and EmotionsExploring Users' Values, Motivations and Emotions
Exploring Users' Values, Motivations and Emotions
 
Ces 2013 towards a cdn definition of evaluation
Ces 2013   towards a cdn definition of evaluationCes 2013   towards a cdn definition of evaluation
Ces 2013 towards a cdn definition of evaluation
 
An Introduction to the World of User Research
An Introduction to the World of User ResearchAn Introduction to the World of User Research
An Introduction to the World of User Research
 
Overview of Evaluation Methods and Choices.pptx
Overview of Evaluation Methods and Choices.pptxOverview of Evaluation Methods and Choices.pptx
Overview of Evaluation Methods and Choices.pptx
 
Introduction to Evaluation.pptx
Introduction to Evaluation.pptxIntroduction to Evaluation.pptx
Introduction to Evaluation.pptx
 
Communications Audit
Communications AuditCommunications Audit
Communications Audit
 
Rosenhan "User Research"
Rosenhan "User Research"Rosenhan "User Research"
Rosenhan "User Research"
 
Usability Testing Basics: What's it All About? at Web SIG Cleveland
Usability Testing Basics: What's it All About? at Web SIG ClevelandUsability Testing Basics: What's it All About? at Web SIG Cleveland
Usability Testing Basics: What's it All About? at Web SIG Cleveland
 
Street Jibe Evaluation Workshop 2
Street Jibe Evaluation Workshop 2Street Jibe Evaluation Workshop 2
Street Jibe Evaluation Workshop 2
 
How To Buy Online Qualitative - Digsite Webinar Slides
How To Buy Online Qualitative - Digsite Webinar SlidesHow To Buy Online Qualitative - Digsite Webinar Slides
How To Buy Online Qualitative - Digsite Webinar Slides
 
The art and science of impact evaluation in the cultural sector
The art and science of impact evaluation in the cultural sectorThe art and science of impact evaluation in the cultural sector
The art and science of impact evaluation in the cultural sector
 
Losing Control In Qualitative Research
Losing Control In Qualitative ResearchLosing Control In Qualitative Research
Losing Control In Qualitative Research
 
Research Week 1
Research Week 1Research Week 1
Research Week 1
 
Using Analytics to Improve Student Success
Using Analytics to Improve Student SuccessUsing Analytics to Improve Student Success
Using Analytics to Improve Student Success
 
How to write the impact sections of a Horizon 2020 proposal
How to write the impact sections of a Horizon 2020 proposalHow to write the impact sections of a Horizon 2020 proposal
How to write the impact sections of a Horizon 2020 proposal
 
Meaningful Measures: Why size (and volume) doesn't matter
Meaningful Measures: Why size (and volume) doesn't matterMeaningful Measures: Why size (and volume) doesn't matter
Meaningful Measures: Why size (and volume) doesn't matter
 
I school evaluation symposium, irwin, april 2014 pauledit
I school evaluation symposium, irwin, april 2014 pauleditI school evaluation symposium, irwin, april 2014 pauledit
I school evaluation symposium, irwin, april 2014 pauledit
 
Designing Mobile UX
Designing Mobile UXDesigning Mobile UX
Designing Mobile UX
 

Online evaluation for Local Government Information Unit

  • 1.
  • 2. "Not everything that can be counted counts, and not everything that counts can be counted." Albert Einstein’s desk at Princeton University
  • 3. “ Evaluation of online participation ... is still just an evaluation of participation!” * Alice Casey’s desk at the Involve offices, London * Less catchy, but also true
  • 4.
  • 5.
  • 6.
  • 7.
  • 8. So, if ; "Not everything that can be counted counts, and not everything that counts can be counted." … then how on earth do we know what to count and how to count it? Evaluation of online participation
  • 9. We’re still learning... but here are some ideas...
  • 10.
  • 11.
  • 12.
  • 13. What do we measure?
  • 14. Some useful definitions Term Definition Outputs Tangible products (reports, meetings etc.) Outcomes Overall direct results (increased skills, reduced crime etc.) Impact Longer-term results (may include unintended effects) Quantitative Objective, measurable, predetermined response options Qualitative Subjective, interpretative, open ended response options
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.

Notes de l'éditeur

  1. Evaluating Public Engagement TCI/Involve 2008
  2. Evaluating Public Engagement TCI/Involve 2008
  3. Evaluating Public Engagement TCI/Involve 2008