SlideShare une entreprise Scribd logo
1  sur  21
How to avoid research debt
a workshop on ResearchOps
for user research in service design
Caroline Jarrett Stephanie Rosenbaum
cj@effortmark.co.uk stephanie@teced.com
#SDinGov
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
User research is crucial
for service design
https://www.gov.uk/service-manual/service-standard
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
What happens after user research?
• Decisions made, do you
move on and forget it?
• Do you preserve that
research for re-use?
• How to you communicate
research to someone new?
Image credit: https://picryl.com/media/goodby-mother-goodby-sweetheart-song
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
ResearchOps is
work that we do
to do good research
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
“ResearchOps is
the mechanisms and strategies
that set user research in motion.
It provides the roles, tools and processes
needed to support researchers
in delivering and scaling
the impact of the craft across an organisation.”
@teamreops / @katetowsey
https://www.slideshare.net/uxbri/what-is-researchops-kate-towsey
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
“our user researchers are only actually
researching about 30% of their time”
• “We work with the team to improve the service”
• “We communicate what we know”
• “We prepare for research”
• “We look at site analytics”
Leisa Reichelt
https://userresearch.blog.gov.uk/2014/09/10/what-user-researchers-do-when-theyre-not-researching/
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
There can be a surprisingly large quantity of pieces of
paper after an evaluation
Jarrett, C (2001) “Unit 7: Evaluation in Practice” in
Open University course M873 User Interface Design and Evaluation
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Missing items?
• We review previous research for relevant insights
• “We work with the team to improve the service”
• “We communicate what we know”
• “We prepare for research”
• “We look at site analytics”
• We organise what we have done for reuse later
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Research debt is
work that we assign
to our future selves
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Technology evolves, people move on
https://web.archive.org/web/20170429074727/
https://servicemanual.hackpad.com/User-research-on-design-patterns-di8PSAAShG1
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
https://twitter.com/Lorna_Wall/status/1006441548488331269
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
This workshop is in three parts
1. Describe:
What things does
research create?
2. Compare:
What do we currently do
with those things?
3. Improve:
What does best practice
look like?
Image credit: https://www.flickr.com/photos/boston_public_library/8557193567
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Describe – on your own at first
• What things does your research create?
• Consider:
Tangible: such as objects, things you pick up / set down / back up
Intangible: such as decisions, opinions, empathy, ‘lightbulb moments’
Immediate: answers to the research questions, explorations of hypotheses
Longer-term: deeper understanding of users, better ideas about how to meet
their needs
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Pair up and swap ideas
• What things does your research create?
• Consider:
Tangible: such as objects, things you pick up / set down / back up
Intangible: such as decisions, opinions, empathy, ‘lightbulb moments’
Immediate: answers to the research questions, explorations of hypotheses
Longer-term: deeper understanding of users, better ideas about how to meet
their needs
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Pool ideas in larger groups
• What things does your research create?
• Consider:
Tangible: such as objects, things you pick up / set down / back up
Intangible: such as decisions, opinions, empathy, ‘lightbulb moments’
Immediate: answers to the research questions, explorations of hypotheses
Longer-term: deeper understanding of users, better ideas about how to meet
their needs
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Compare – on your own at first
• What things do you (or your organisation) currently do?
1. We have a clear policy for this and we do it immediately
2. We have a policy and we get round to it occasionally
3. We don't have a policy but we wish we did
4. We don't have a policy and we don't see any need for one
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Improve:
What does best practice look like?
• What are your ideas for making this happen regularly?
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Tips for a good handover - Nadia Huq
• Write down names and job titles of everyone involved in the build, from
senior management to developers to contacts at GOV.UK.
• Keep a list of additional functionality or design changes you would have
explored if you’d had the time.
• If you can, put together a map of the end to end journey. They’re great for
quickly getting a bird’s-eye view of a service.
• If you do a heuristic review of an existing service, include screenshots of it
at the time of review. Years down the line, without screenshots, it can be
really tricky to work out what you were looking at.
• Save everything in one place, with a clear taxonomy and naming
conventions.
https://hodigital.blog.gov.uk/2017/10/27/take-note-why-you-should-keep-records-of-service-decisions/
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Idea 1: The Research Debt Sprint
(mainly for agile teams working in 2-week sprints)
• Set aside one sprint each quarter for paying research debt
• No new research
• Organise and clear up the stuff
• Think about the insights and gaps
• Write some reports, publications, blog posts
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Idea 2: The Project Close-Down
(mainly for agencies working on specific engagements)
• Set aside a week of close-down time after each
• Organise and clear up the stuff
• Do a retro on the project
– What went well
– What went badly
– What we’ll do more of next time
– What we’ll avoid next time
• Write a whitepaper, case study, marketing literature
Caroline Jarrett @cjforms Stephanie Rosenbaum @teced
Keep in touch
Caroline cj@effortmark.co.uk
Stephanie stephanie@teced.com

Contenu connexe

Tendances

But the light-bulb has to want to change: Why do usability problems so often...
 But the light-bulb has to want to change: Why do usability problems so often... But the light-bulb has to want to change: Why do usability problems so often...
But the light-bulb has to want to change: Why do usability problems so often...Caroline Jarrett
 
Six crucial survey concepts that UX professionals need to know
Six crucial survey concepts that UX professionals need to knowSix crucial survey concepts that UX professionals need to know
Six crucial survey concepts that UX professionals need to knowCaroline Jarrett
 
Surveys in practice and theory
Surveys in practice and theorySurveys in practice and theory
Surveys in practice and theoryCaroline Jarrett
 
10 tips for a better UX survey
10 tips for a better UX survey10 tips for a better UX survey
10 tips for a better UX surveyCaroline Jarrett
 
Five Steps to Better Surveys: part of the Surveys that Work training course f...
Five Steps to Better Surveys: part of the Surveys that Work training course f...Five Steps to Better Surveys: part of the Surveys that Work training course f...
Five Steps to Better Surveys: part of the Surveys that Work training course f...Caroline Jarrett
 
10 tips for a better survey at UX Bristol
10 tips for a better survey at UX Bristol10 tips for a better survey at UX Bristol
10 tips for a better survey at UX BristolCaroline Jarrett
 
Effective Use of Surveys in UX | Triangle UXPA Workshop
Effective Use of Surveys in UX | Triangle UXPA WorkshopEffective Use of Surveys in UX | Triangle UXPA Workshop
Effective Use of Surveys in UX | Triangle UXPA WorkshopAmanda Stockwell
 
Design tips for complex forms by @cjforms 2013
Design tips for complex forms by @cjforms 2013Design tips for complex forms by @cjforms 2013
Design tips for complex forms by @cjforms 2013Caroline Jarrett
 
Surveys that work EBI_2017
Surveys that work EBI_2017Surveys that work EBI_2017
Surveys that work EBI_2017Caroline Jarrett
 
Buttons on forms and surveys: a look at some research 2012
Buttons on forms and surveys: a look at some research 2012Buttons on forms and surveys: a look at some research 2012
Buttons on forms and surveys: a look at some research 2012Caroline Jarrett
 
Web Survey and Forms Usability Design & Testing
Web Survey and Forms Usability Design & TestingWeb Survey and Forms Usability Design & Testing
Web Survey and Forms Usability Design & TestingJennifer Romano Bergstrom
 
Taxonomy Validation
Taxonomy ValidationTaxonomy Validation
Taxonomy ValidationDave Cooksey
 
Creating a Virtuous Cycle - The Research and Design Feedback Loop
Creating a Virtuous Cycle - The Research and Design Feedback LoopCreating a Virtuous Cycle - The Research and Design Feedback Loop
Creating a Virtuous Cycle - The Research and Design Feedback LoopJulie Stanford
 
Effective Remote Product Management by Oracle Sr Principal PM
Effective Remote Product Management by Oracle Sr Principal PMEffective Remote Product Management by Oracle Sr Principal PM
Effective Remote Product Management by Oracle Sr Principal PMProduct School
 
Exploratory user research (How to figure out what to test)
Exploratory user research (How to figure out what to test)Exploratory user research (How to figure out what to test)
Exploratory user research (How to figure out what to test)Dhyana Scarano
 
Success takes teams, not working together
Success takes teams, not working togetherSuccess takes teams, not working together
Success takes teams, not working togetherKate Matsudaira
 
UXPA DC UX 101 - User Research
UXPA DC UX 101 - User Research UXPA DC UX 101 - User Research
UXPA DC UX 101 - User Research UXPA DC
 
UX Lesson 2: User Research
UX Lesson 2: User ResearchUX Lesson 2: User Research
UX Lesson 2: User ResearchJoan Lumanauw
 

Tendances (20)

But the light-bulb has to want to change: Why do usability problems so often...
 But the light-bulb has to want to change: Why do usability problems so often... But the light-bulb has to want to change: Why do usability problems so often...
But the light-bulb has to want to change: Why do usability problems so often...
 
Six crucial survey concepts that UX professionals need to know
Six crucial survey concepts that UX professionals need to knowSix crucial survey concepts that UX professionals need to know
Six crucial survey concepts that UX professionals need to know
 
Surveys in practice and theory
Surveys in practice and theorySurveys in practice and theory
Surveys in practice and theory
 
10 tips for a better UX survey
10 tips for a better UX survey10 tips for a better UX survey
10 tips for a better UX survey
 
Five Steps to Better Surveys: part of the Surveys that Work training course f...
Five Steps to Better Surveys: part of the Surveys that Work training course f...Five Steps to Better Surveys: part of the Surveys that Work training course f...
Five Steps to Better Surveys: part of the Surveys that Work training course f...
 
10 tips for a better survey at UX Bristol
10 tips for a better survey at UX Bristol10 tips for a better survey at UX Bristol
10 tips for a better survey at UX Bristol
 
Effective Use of Surveys in UX | Triangle UXPA Workshop
Effective Use of Surveys in UX | Triangle UXPA WorkshopEffective Use of Surveys in UX | Triangle UXPA Workshop
Effective Use of Surveys in UX | Triangle UXPA Workshop
 
Design tips for complex forms by @cjforms 2013
Design tips for complex forms by @cjforms 2013Design tips for complex forms by @cjforms 2013
Design tips for complex forms by @cjforms 2013
 
Surveys that work EBI_2017
Surveys that work EBI_2017Surveys that work EBI_2017
Surveys that work EBI_2017
 
Buttons on forms and surveys: a look at some research 2012
Buttons on forms and surveys: a look at some research 2012Buttons on forms and surveys: a look at some research 2012
Buttons on forms and surveys: a look at some research 2012
 
Web Survey and Forms Usability Design & Testing
Web Survey and Forms Usability Design & TestingWeb Survey and Forms Usability Design & Testing
Web Survey and Forms Usability Design & Testing
 
Taxonomy Validation
Taxonomy ValidationTaxonomy Validation
Taxonomy Validation
 
Creating a Virtuous Cycle - The Research and Design Feedback Loop
Creating a Virtuous Cycle - The Research and Design Feedback LoopCreating a Virtuous Cycle - The Research and Design Feedback Loop
Creating a Virtuous Cycle - The Research and Design Feedback Loop
 
Raskar Entrepreneurship in Imaging, Imaging Ventures, CVPR 2012
Raskar Entrepreneurship in Imaging, Imaging Ventures, CVPR 2012Raskar Entrepreneurship in Imaging, Imaging Ventures, CVPR 2012
Raskar Entrepreneurship in Imaging, Imaging Ventures, CVPR 2012
 
Effective Remote Product Management by Oracle Sr Principal PM
Effective Remote Product Management by Oracle Sr Principal PMEffective Remote Product Management by Oracle Sr Principal PM
Effective Remote Product Management by Oracle Sr Principal PM
 
Exploratory user research (How to figure out what to test)
Exploratory user research (How to figure out what to test)Exploratory user research (How to figure out what to test)
Exploratory user research (How to figure out what to test)
 
Success takes teams, not working together
Success takes teams, not working togetherSuccess takes teams, not working together
Success takes teams, not working together
 
UXPA DC UX 101 - User Research
UXPA DC UX 101 - User Research UXPA DC UX 101 - User Research
UXPA DC UX 101 - User Research
 
SY 7034 Week8
SY 7034 Week8SY 7034 Week8
SY 7034 Week8
 
UX Lesson 2: User Research
UX Lesson 2: User ResearchUX Lesson 2: User Research
UX Lesson 2: User Research
 

Similaire à How to Avoid Research Debt

Research Operations at Scale (Christian Rohrer at DesignOps Summit 2017)
Research Operations at Scale (Christian Rohrer at DesignOps Summit 2017)Research Operations at Scale (Christian Rohrer at DesignOps Summit 2017)
Research Operations at Scale (Christian Rohrer at DesignOps Summit 2017)Rosenfeld Media
 
D school assignment 3 Prototype and Test
D school assignment 3 Prototype and TestD school assignment 3 Prototype and Test
D school assignment 3 Prototype and TestLee-Anne Walker
 
Pallid Sturgeon Research Project
Pallid Sturgeon Research ProjectPallid Sturgeon Research Project
Pallid Sturgeon Research ProjectBrenda Zerr
 
Skills & ideas for #ProblemGamblingKTE
Skills & ideas for #ProblemGamblingKTE Skills & ideas for #ProblemGamblingKTE
Skills & ideas for #ProblemGamblingKTE Anne Bergen
 
Learn Learning + Prototype Testing
Learn Learning + Prototype TestingLearn Learning + Prototype Testing
Learn Learning + Prototype TestingDave Hora
 
UX Field Research Toolkit - A Workshop at Big Design - 2017
UX Field Research Toolkit - A Workshop at Big Design - 2017UX Field Research Toolkit - A Workshop at Big Design - 2017
UX Field Research Toolkit - A Workshop at Big Design - 2017Kelly Moran
 
Deliver:agile2018 - basic user research skills for non-designers
Deliver:agile2018 - basic user research skills for non-designersDeliver:agile2018 - basic user research skills for non-designers
Deliver:agile2018 - basic user research skills for non-designersSophie Freiermuth
 
Collaborative Research | uxlx 2014
Collaborative Research | uxlx 2014Collaborative Research | uxlx 2014
Collaborative Research | uxlx 2014Erika Hall
 
Agile concepts for quality and process engineers for slideshare
Agile concepts for quality and process engineers   for slideshareAgile concepts for quality and process engineers   for slideshare
Agile concepts for quality and process engineers for slideshareYuval Yeret
 
Exploring the UX Research Toolbox
Exploring the UX Research ToolboxExploring the UX Research Toolbox
Exploring the UX Research ToolboxAnthony Hempell
 
UX Burlington 2017: Exploratory Research in UX Design
UX Burlington 2017: Exploratory Research in UX DesignUX Burlington 2017: Exploratory Research in UX Design
UX Burlington 2017: Exploratory Research in UX DesignSarah Fathallah
 
User Experience Design Fundamentals - Part 2: Talking with Users
User Experience Design Fundamentals - Part 2: Talking with UsersUser Experience Design Fundamentals - Part 2: Talking with Users
User Experience Design Fundamentals - Part 2: Talking with UsersLaura B
 
Usability Testing for Survey Research:How to and Best Practices
Usability Testing for Survey Research:How to and Best PracticesUsability Testing for Survey Research:How to and Best Practices
Usability Testing for Survey Research:How to and Best Practicesegeisen
 
The Well Connected Facility
The Well Connected FacilityThe Well Connected Facility
The Well Connected FacilityRyan Duggan
 
Impact the UX of Your Website with Contextual Inquiry
Impact the UX of Your Website with Contextual InquiryImpact the UX of Your Website with Contextual Inquiry
Impact the UX of Your Website with Contextual InquiryRachel Vacek
 
The Secrets of High Performance: Science Edition - Nicole Forsgren - Codemoti...
The Secrets of High Performance: Science Edition - Nicole Forsgren - Codemoti...The Secrets of High Performance: Science Edition - Nicole Forsgren - Codemoti...
The Secrets of High Performance: Science Edition - Nicole Forsgren - Codemoti...Codemotion
 
Big Data LDN 2017: Preserving The Key Principles Of Academic Research In A Bu...
Big Data LDN 2017: Preserving The Key Principles Of Academic Research In A Bu...Big Data LDN 2017: Preserving The Key Principles Of Academic Research In A Bu...
Big Data LDN 2017: Preserving The Key Principles Of Academic Research In A Bu...Matt Stubbs
 

Similaire à How to Avoid Research Debt (20)

Research Operations at Scale (Christian Rohrer at DesignOps Summit 2017)
Research Operations at Scale (Christian Rohrer at DesignOps Summit 2017)Research Operations at Scale (Christian Rohrer at DesignOps Summit 2017)
Research Operations at Scale (Christian Rohrer at DesignOps Summit 2017)
 
Catalyst Relay 2012 Midland - Patchworks relay -final
Catalyst Relay 2012 Midland - Patchworks   relay -finalCatalyst Relay 2012 Midland - Patchworks   relay -final
Catalyst Relay 2012 Midland - Patchworks relay -final
 
D school assignment 3 Prototype and Test
D school assignment 3 Prototype and TestD school assignment 3 Prototype and Test
D school assignment 3 Prototype and Test
 
Pallid Sturgeon Research Project
Pallid Sturgeon Research ProjectPallid Sturgeon Research Project
Pallid Sturgeon Research Project
 
Skills & ideas for #ProblemGamblingKTE
Skills & ideas for #ProblemGamblingKTE Skills & ideas for #ProblemGamblingKTE
Skills & ideas for #ProblemGamblingKTE
 
Learn Learning + Prototype Testing
Learn Learning + Prototype TestingLearn Learning + Prototype Testing
Learn Learning + Prototype Testing
 
UX Field Research Toolkit - A Workshop at Big Design - 2017
UX Field Research Toolkit - A Workshop at Big Design - 2017UX Field Research Toolkit - A Workshop at Big Design - 2017
UX Field Research Toolkit - A Workshop at Big Design - 2017
 
Deliver:agile2018 - basic user research skills for non-designers
Deliver:agile2018 - basic user research skills for non-designersDeliver:agile2018 - basic user research skills for non-designers
Deliver:agile2018 - basic user research skills for non-designers
 
Collaborative Research | uxlx 2014
Collaborative Research | uxlx 2014Collaborative Research | uxlx 2014
Collaborative Research | uxlx 2014
 
Agile concepts for quality and process engineers for slideshare
Agile concepts for quality and process engineers   for slideshareAgile concepts for quality and process engineers   for slideshare
Agile concepts for quality and process engineers for slideshare
 
Exploring the UX Research Toolbox
Exploring the UX Research ToolboxExploring the UX Research Toolbox
Exploring the UX Research Toolbox
 
UX Burlington 2017: Exploratory Research in UX Design
UX Burlington 2017: Exploratory Research in UX DesignUX Burlington 2017: Exploratory Research in UX Design
UX Burlington 2017: Exploratory Research in UX Design
 
User Experience Design Fundamentals - Part 2: Talking with Users
User Experience Design Fundamentals - Part 2: Talking with UsersUser Experience Design Fundamentals - Part 2: Talking with Users
User Experience Design Fundamentals - Part 2: Talking with Users
 
Catalyst Relay 2012 Midland - Patchworks
Catalyst Relay 2012 Midland - PatchworksCatalyst Relay 2012 Midland - Patchworks
Catalyst Relay 2012 Midland - Patchworks
 
Usability Testing for Survey Research:How to and Best Practices
Usability Testing for Survey Research:How to and Best PracticesUsability Testing for Survey Research:How to and Best Practices
Usability Testing for Survey Research:How to and Best Practices
 
The Well Connected Facility
The Well Connected FacilityThe Well Connected Facility
The Well Connected Facility
 
Impact the UX of Your Website with Contextual Inquiry
Impact the UX of Your Website with Contextual InquiryImpact the UX of Your Website with Contextual Inquiry
Impact the UX of Your Website with Contextual Inquiry
 
Future-Proofing Your Projects
Future-Proofing Your ProjectsFuture-Proofing Your Projects
Future-Proofing Your Projects
 
The Secrets of High Performance: Science Edition - Nicole Forsgren - Codemoti...
The Secrets of High Performance: Science Edition - Nicole Forsgren - Codemoti...The Secrets of High Performance: Science Edition - Nicole Forsgren - Codemoti...
The Secrets of High Performance: Science Edition - Nicole Forsgren - Codemoti...
 
Big Data LDN 2017: Preserving The Key Principles Of Academic Research In A Bu...
Big Data LDN 2017: Preserving The Key Principles Of Academic Research In A Bu...Big Data LDN 2017: Preserving The Key Principles Of Academic Research In A Bu...
Big Data LDN 2017: Preserving The Key Principles Of Academic Research In A Bu...
 

Plus de Caroline Jarrett

Creating truly accessible forms, SDinGov 2024
Creating truly accessible forms, SDinGov 2024Creating truly accessible forms, SDinGov 2024
Creating truly accessible forms, SDinGov 2024Caroline Jarrett
 
Using surveys to uncover audience insights
Using surveys to uncover audience insightsUsing surveys to uncover audience insights
Using surveys to uncover audience insightsCaroline Jarrett
 
2023 Surveys that work Olin.pptx
2023 Surveys that work Olin.pptx2023 Surveys that work Olin.pptx
2023 Surveys that work Olin.pptxCaroline Jarrett
 
The Phylogenetic Tree in forms design - making forms work for complex academ...
The Phylogenetic Tree in forms design - making forms work for complex  academ...The Phylogenetic Tree in forms design - making forms work for complex  academ...
The Phylogenetic Tree in forms design - making forms work for complex academ...Caroline Jarrett
 
Four ways to make a better survey WebExpo2023
Four ways to make a better survey WebExpo2023Four ways to make a better survey WebExpo2023
Four ways to make a better survey WebExpo2023Caroline Jarrett
 
Content design in practice May 2023.pptx
Content design in practice May 2023.pptxContent design in practice May 2023.pptx
Content design in practice May 2023.pptxCaroline Jarrett
 
Two ways to improve your survey, webinar for Delib 2023.pptx
Two ways to improve your survey, webinar for Delib 2023.pptxTwo ways to improve your survey, webinar for Delib 2023.pptx
Two ways to improve your survey, webinar for Delib 2023.pptxCaroline Jarrett
 
How to save money by fixing forms, WebExpo2023
How to save money by fixing forms, WebExpo2023How to save money by fixing forms, WebExpo2023
How to save money by fixing forms, WebExpo2023Caroline Jarrett
 
Two ways to improve your surveys: the Most Crucial Question and the Burning I...
Two ways to improve your surveys: the Most Crucial Question and the Burning I...Two ways to improve your surveys: the Most Crucial Question and the Burning I...
Two ways to improve your surveys: the Most Crucial Question and the Burning I...Caroline Jarrett
 
How to look at a form Boye 22.pptx
How to look at a form Boye 22.pptxHow to look at a form Boye 22.pptx
How to look at a form Boye 22.pptxCaroline Jarrett
 
Prune tune postpone explain.pptx
Prune tune postpone explain.pptxPrune tune postpone explain.pptx
Prune tune postpone explain.pptxCaroline Jarrett
 
What is a service designer SDinGOV 22 with all stickies.pptx
What is a service designer SDinGOV 22 with all stickies.pptxWhat is a service designer SDinGOV 22 with all stickies.pptx
What is a service designer SDinGOV 22 with all stickies.pptxCaroline Jarrett
 
Helping teenage boys to become responsible adults.pptx
Helping teenage boys to become responsible adults.pptxHelping teenage boys to become responsible adults.pptx
Helping teenage boys to become responsible adults.pptxCaroline Jarrett
 
Some thoughts on surveys: Boye and Company member conference call
Some thoughts on surveys: Boye and Company member conference callSome thoughts on surveys: Boye and Company member conference call
Some thoughts on surveys: Boye and Company member conference callCaroline Jarrett
 
Better surveys - presentation to Loyal Health March 2022.pptx
Better surveys - presentation to Loyal Health March 2022.pptxBetter surveys - presentation to Loyal Health March 2022.pptx
Better surveys - presentation to Loyal Health March 2022.pptxCaroline Jarrett
 
Plain language to improve your survey houston 2022
Plain language to improve your survey houston 2022Plain language to improve your survey houston 2022
Plain language to improve your survey houston 2022Caroline Jarrett
 
Surveys that work:training course for Rosenfeld Media, day 1
Surveys that work:training course for Rosenfeld Media, day 1Surveys that work:training course for Rosenfeld Media, day 1
Surveys that work:training course for Rosenfeld Media, day 1Caroline Jarrett
 
Surveys that work: training course for Rosenfeld media, day 2
Surveys that work: training course for Rosenfeld media, day 2Surveys that work: training course for Rosenfeld media, day 2
Surveys that work: training course for Rosenfeld media, day 2Caroline Jarrett
 
Surveys that work: training course for Rosenfeld Media, day 3
Surveys that work: training course for Rosenfeld Media, day 3 Surveys that work: training course for Rosenfeld Media, day 3
Surveys that work: training course for Rosenfeld Media, day 3 Caroline Jarrett
 
Surveys that work: an introduction to the Survey Octopus and Total Survey Error
Surveys that work: an introduction to the Survey Octopus and Total Survey ErrorSurveys that work: an introduction to the Survey Octopus and Total Survey Error
Surveys that work: an introduction to the Survey Octopus and Total Survey ErrorCaroline Jarrett
 

Plus de Caroline Jarrett (20)

Creating truly accessible forms, SDinGov 2024
Creating truly accessible forms, SDinGov 2024Creating truly accessible forms, SDinGov 2024
Creating truly accessible forms, SDinGov 2024
 
Using surveys to uncover audience insights
Using surveys to uncover audience insightsUsing surveys to uncover audience insights
Using surveys to uncover audience insights
 
2023 Surveys that work Olin.pptx
2023 Surveys that work Olin.pptx2023 Surveys that work Olin.pptx
2023 Surveys that work Olin.pptx
 
The Phylogenetic Tree in forms design - making forms work for complex academ...
The Phylogenetic Tree in forms design - making forms work for complex  academ...The Phylogenetic Tree in forms design - making forms work for complex  academ...
The Phylogenetic Tree in forms design - making forms work for complex academ...
 
Four ways to make a better survey WebExpo2023
Four ways to make a better survey WebExpo2023Four ways to make a better survey WebExpo2023
Four ways to make a better survey WebExpo2023
 
Content design in practice May 2023.pptx
Content design in practice May 2023.pptxContent design in practice May 2023.pptx
Content design in practice May 2023.pptx
 
Two ways to improve your survey, webinar for Delib 2023.pptx
Two ways to improve your survey, webinar for Delib 2023.pptxTwo ways to improve your survey, webinar for Delib 2023.pptx
Two ways to improve your survey, webinar for Delib 2023.pptx
 
How to save money by fixing forms, WebExpo2023
How to save money by fixing forms, WebExpo2023How to save money by fixing forms, WebExpo2023
How to save money by fixing forms, WebExpo2023
 
Two ways to improve your surveys: the Most Crucial Question and the Burning I...
Two ways to improve your surveys: the Most Crucial Question and the Burning I...Two ways to improve your surveys: the Most Crucial Question and the Burning I...
Two ways to improve your surveys: the Most Crucial Question and the Burning I...
 
How to look at a form Boye 22.pptx
How to look at a form Boye 22.pptxHow to look at a form Boye 22.pptx
How to look at a form Boye 22.pptx
 
Prune tune postpone explain.pptx
Prune tune postpone explain.pptxPrune tune postpone explain.pptx
Prune tune postpone explain.pptx
 
What is a service designer SDinGOV 22 with all stickies.pptx
What is a service designer SDinGOV 22 with all stickies.pptxWhat is a service designer SDinGOV 22 with all stickies.pptx
What is a service designer SDinGOV 22 with all stickies.pptx
 
Helping teenage boys to become responsible adults.pptx
Helping teenage boys to become responsible adults.pptxHelping teenage boys to become responsible adults.pptx
Helping teenage boys to become responsible adults.pptx
 
Some thoughts on surveys: Boye and Company member conference call
Some thoughts on surveys: Boye and Company member conference callSome thoughts on surveys: Boye and Company member conference call
Some thoughts on surveys: Boye and Company member conference call
 
Better surveys - presentation to Loyal Health March 2022.pptx
Better surveys - presentation to Loyal Health March 2022.pptxBetter surveys - presentation to Loyal Health March 2022.pptx
Better surveys - presentation to Loyal Health March 2022.pptx
 
Plain language to improve your survey houston 2022
Plain language to improve your survey houston 2022Plain language to improve your survey houston 2022
Plain language to improve your survey houston 2022
 
Surveys that work:training course for Rosenfeld Media, day 1
Surveys that work:training course for Rosenfeld Media, day 1Surveys that work:training course for Rosenfeld Media, day 1
Surveys that work:training course for Rosenfeld Media, day 1
 
Surveys that work: training course for Rosenfeld media, day 2
Surveys that work: training course for Rosenfeld media, day 2Surveys that work: training course for Rosenfeld media, day 2
Surveys that work: training course for Rosenfeld media, day 2
 
Surveys that work: training course for Rosenfeld Media, day 3
Surveys that work: training course for Rosenfeld Media, day 3 Surveys that work: training course for Rosenfeld Media, day 3
Surveys that work: training course for Rosenfeld Media, day 3
 
Surveys that work: an introduction to the Survey Octopus and Total Survey Error
Surveys that work: an introduction to the Survey Octopus and Total Survey ErrorSurveys that work: an introduction to the Survey Octopus and Total Survey Error
Surveys that work: an introduction to the Survey Octopus and Total Survey Error
 

Dernier

Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Hy...
Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Hy...Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Hy...
Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Hy...Pooja Nehwal
 
Case Study of Hotel Taj Vivanta, Pune
Case Study of Hotel Taj Vivanta, PuneCase Study of Hotel Taj Vivanta, Pune
Case Study of Hotel Taj Vivanta, PuneLukeKholes
 
Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)
Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)
Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)amitlee9823
 
RT Nagar Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bang...
RT Nagar Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bang...RT Nagar Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bang...
RT Nagar Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bang...amitlee9823
 
Tapestry Clothing Brands: Collapsing the Funnel
Tapestry Clothing Brands: Collapsing the FunnelTapestry Clothing Brands: Collapsing the Funnel
Tapestry Clothing Brands: Collapsing the Funneljen_giacalone
 
AMBER GRAIN EMBROIDERY | Growing folklore elements | Root-based materials, w...
AMBER GRAIN EMBROIDERY | Growing folklore elements |  Root-based materials, w...AMBER GRAIN EMBROIDERY | Growing folklore elements |  Root-based materials, w...
AMBER GRAIN EMBROIDERY | Growing folklore elements | Root-based materials, w...BarusRa
 
💫✅jodhpur 24×7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...
💫✅jodhpur 24×7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...💫✅jodhpur 24×7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...
💫✅jodhpur 24×7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...sonalitrivedi431
 
Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Gi...
Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Gi...Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Gi...
Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Gi...Pooja Nehwal
 
Editorial design Magazine design project.pdf
Editorial design Magazine design project.pdfEditorial design Magazine design project.pdf
Editorial design Magazine design project.pdftbatkhuu1
 
Kala jadu for love marriage | Real amil baba | Famous amil baba | kala jadu n...
Kala jadu for love marriage | Real amil baba | Famous amil baba | kala jadu n...Kala jadu for love marriage | Real amil baba | Famous amil baba | kala jadu n...
Kala jadu for love marriage | Real amil baba | Famous amil baba | kala jadu n...babafaisel
 
Best VIP Call Girls Noida Sector 44 Call Me: 8448380779
Best VIP Call Girls Noida Sector 44 Call Me: 8448380779Best VIP Call Girls Noida Sector 44 Call Me: 8448380779
Best VIP Call Girls Noida Sector 44 Call Me: 8448380779Delhi Call girls
 
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...RitikaRoy32
 
Stark Industries Marketing Plan (1).pptx
Stark Industries Marketing Plan (1).pptxStark Industries Marketing Plan (1).pptx
Stark Industries Marketing Plan (1).pptxjeswinjees
 
Chapter 19_DDA_TOD Policy_First Draft 2012.pdf
Chapter 19_DDA_TOD Policy_First Draft 2012.pdfChapter 19_DDA_TOD Policy_First Draft 2012.pdf
Chapter 19_DDA_TOD Policy_First Draft 2012.pdfParomita Roy
 
2-tool presenthdbdbdbdbddhdhddation.pptx
2-tool presenthdbdbdbdbddhdhddation.pptx2-tool presenthdbdbdbdbddhdhddation.pptx
2-tool presenthdbdbdbdbddhdhddation.pptxsuhanimunjal27
 
Peaches App development presentation deck
Peaches App development presentation deckPeaches App development presentation deck
Peaches App development presentation decktbatkhuu1
 
Booking open Available Pune Call Girls Kirkatwadi 6297143586 Call Hot Indian...
Booking open Available Pune Call Girls Kirkatwadi  6297143586 Call Hot Indian...Booking open Available Pune Call Girls Kirkatwadi  6297143586 Call Hot Indian...
Booking open Available Pune Call Girls Kirkatwadi 6297143586 Call Hot Indian...Call Girls in Nagpur High Profile
 
Booking open Available Pune Call Girls Nanded City 6297143586 Call Hot India...
Booking open Available Pune Call Girls Nanded City  6297143586 Call Hot India...Booking open Available Pune Call Girls Nanded City  6297143586 Call Hot India...
Booking open Available Pune Call Girls Nanded City 6297143586 Call Hot India...Call Girls in Nagpur High Profile
 

Dernier (20)

Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Hy...
Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Hy...Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Hy...
Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Hy...
 
Case Study of Hotel Taj Vivanta, Pune
Case Study of Hotel Taj Vivanta, PuneCase Study of Hotel Taj Vivanta, Pune
Case Study of Hotel Taj Vivanta, Pune
 
Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)
Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)
Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)
 
RT Nagar Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bang...
RT Nagar Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bang...RT Nagar Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bang...
RT Nagar Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bang...
 
Tapestry Clothing Brands: Collapsing the Funnel
Tapestry Clothing Brands: Collapsing the FunnelTapestry Clothing Brands: Collapsing the Funnel
Tapestry Clothing Brands: Collapsing the Funnel
 
AMBER GRAIN EMBROIDERY | Growing folklore elements | Root-based materials, w...
AMBER GRAIN EMBROIDERY | Growing folklore elements |  Root-based materials, w...AMBER GRAIN EMBROIDERY | Growing folklore elements |  Root-based materials, w...
AMBER GRAIN EMBROIDERY | Growing folklore elements | Root-based materials, w...
 
💫✅jodhpur 24×7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...
💫✅jodhpur 24×7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...💫✅jodhpur 24×7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...
💫✅jodhpur 24×7 BEST GENUINE PERSON LOW PRICE CALL GIRL SERVICE FULL SATISFACT...
 
Call Girls Service Mukherjee Nagar @9999965857 Delhi 🫦 No Advance VVIP 🍎 SER...
Call Girls Service Mukherjee Nagar @9999965857 Delhi 🫦 No Advance  VVIP 🍎 SER...Call Girls Service Mukherjee Nagar @9999965857 Delhi 🫦 No Advance  VVIP 🍎 SER...
Call Girls Service Mukherjee Nagar @9999965857 Delhi 🫦 No Advance VVIP 🍎 SER...
 
Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Gi...
Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Gi...Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Gi...
Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Gi...
 
Editorial design Magazine design project.pdf
Editorial design Magazine design project.pdfEditorial design Magazine design project.pdf
Editorial design Magazine design project.pdf
 
Kala jadu for love marriage | Real amil baba | Famous amil baba | kala jadu n...
Kala jadu for love marriage | Real amil baba | Famous amil baba | kala jadu n...Kala jadu for love marriage | Real amil baba | Famous amil baba | kala jadu n...
Kala jadu for love marriage | Real amil baba | Famous amil baba | kala jadu n...
 
Best VIP Call Girls Noida Sector 44 Call Me: 8448380779
Best VIP Call Girls Noida Sector 44 Call Me: 8448380779Best VIP Call Girls Noida Sector 44 Call Me: 8448380779
Best VIP Call Girls Noida Sector 44 Call Me: 8448380779
 
young call girls in Vivek Vihar🔝 9953056974 🔝 Delhi escort Service
young call girls in Vivek Vihar🔝 9953056974 🔝 Delhi escort Serviceyoung call girls in Vivek Vihar🔝 9953056974 🔝 Delhi escort Service
young call girls in Vivek Vihar🔝 9953056974 🔝 Delhi escort Service
 
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
UI:UX Design and Empowerment Strategies for Underprivileged Transgender Indiv...
 
Stark Industries Marketing Plan (1).pptx
Stark Industries Marketing Plan (1).pptxStark Industries Marketing Plan (1).pptx
Stark Industries Marketing Plan (1).pptx
 
Chapter 19_DDA_TOD Policy_First Draft 2012.pdf
Chapter 19_DDA_TOD Policy_First Draft 2012.pdfChapter 19_DDA_TOD Policy_First Draft 2012.pdf
Chapter 19_DDA_TOD Policy_First Draft 2012.pdf
 
2-tool presenthdbdbdbdbddhdhddation.pptx
2-tool presenthdbdbdbdbddhdhddation.pptx2-tool presenthdbdbdbdbddhdhddation.pptx
2-tool presenthdbdbdbdbddhdhddation.pptx
 
Peaches App development presentation deck
Peaches App development presentation deckPeaches App development presentation deck
Peaches App development presentation deck
 
Booking open Available Pune Call Girls Kirkatwadi 6297143586 Call Hot Indian...
Booking open Available Pune Call Girls Kirkatwadi  6297143586 Call Hot Indian...Booking open Available Pune Call Girls Kirkatwadi  6297143586 Call Hot Indian...
Booking open Available Pune Call Girls Kirkatwadi 6297143586 Call Hot Indian...
 
Booking open Available Pune Call Girls Nanded City 6297143586 Call Hot India...
Booking open Available Pune Call Girls Nanded City  6297143586 Call Hot India...Booking open Available Pune Call Girls Nanded City  6297143586 Call Hot India...
Booking open Available Pune Call Girls Nanded City 6297143586 Call Hot India...
 

How to Avoid Research Debt

  • 1. How to avoid research debt a workshop on ResearchOps for user research in service design Caroline Jarrett Stephanie Rosenbaum cj@effortmark.co.uk stephanie@teced.com #SDinGov
  • 2. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced User research is crucial for service design https://www.gov.uk/service-manual/service-standard
  • 3. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced What happens after user research? • Decisions made, do you move on and forget it? • Do you preserve that research for re-use? • How to you communicate research to someone new? Image credit: https://picryl.com/media/goodby-mother-goodby-sweetheart-song
  • 4. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced ResearchOps is work that we do to do good research
  • 5. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced “ResearchOps is the mechanisms and strategies that set user research in motion. It provides the roles, tools and processes needed to support researchers in delivering and scaling the impact of the craft across an organisation.” @teamreops / @katetowsey https://www.slideshare.net/uxbri/what-is-researchops-kate-towsey
  • 6. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced “our user researchers are only actually researching about 30% of their time” • “We work with the team to improve the service” • “We communicate what we know” • “We prepare for research” • “We look at site analytics” Leisa Reichelt https://userresearch.blog.gov.uk/2014/09/10/what-user-researchers-do-when-theyre-not-researching/
  • 7. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced There can be a surprisingly large quantity of pieces of paper after an evaluation Jarrett, C (2001) “Unit 7: Evaluation in Practice” in Open University course M873 User Interface Design and Evaluation
  • 8. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Missing items? • We review previous research for relevant insights • “We work with the team to improve the service” • “We communicate what we know” • “We prepare for research” • “We look at site analytics” • We organise what we have done for reuse later
  • 9. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Research debt is work that we assign to our future selves
  • 10. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Technology evolves, people move on https://web.archive.org/web/20170429074727/ https://servicemanual.hackpad.com/User-research-on-design-patterns-di8PSAAShG1
  • 11. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced https://twitter.com/Lorna_Wall/status/1006441548488331269
  • 12. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced This workshop is in three parts 1. Describe: What things does research create? 2. Compare: What do we currently do with those things? 3. Improve: What does best practice look like? Image credit: https://www.flickr.com/photos/boston_public_library/8557193567
  • 13. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Describe – on your own at first • What things does your research create? • Consider: Tangible: such as objects, things you pick up / set down / back up Intangible: such as decisions, opinions, empathy, ‘lightbulb moments’ Immediate: answers to the research questions, explorations of hypotheses Longer-term: deeper understanding of users, better ideas about how to meet their needs
  • 14. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Pair up and swap ideas • What things does your research create? • Consider: Tangible: such as objects, things you pick up / set down / back up Intangible: such as decisions, opinions, empathy, ‘lightbulb moments’ Immediate: answers to the research questions, explorations of hypotheses Longer-term: deeper understanding of users, better ideas about how to meet their needs
  • 15. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Pool ideas in larger groups • What things does your research create? • Consider: Tangible: such as objects, things you pick up / set down / back up Intangible: such as decisions, opinions, empathy, ‘lightbulb moments’ Immediate: answers to the research questions, explorations of hypotheses Longer-term: deeper understanding of users, better ideas about how to meet their needs
  • 16. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Compare – on your own at first • What things do you (or your organisation) currently do? 1. We have a clear policy for this and we do it immediately 2. We have a policy and we get round to it occasionally 3. We don't have a policy but we wish we did 4. We don't have a policy and we don't see any need for one
  • 17. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Improve: What does best practice look like? • What are your ideas for making this happen regularly?
  • 18. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Tips for a good handover - Nadia Huq • Write down names and job titles of everyone involved in the build, from senior management to developers to contacts at GOV.UK. • Keep a list of additional functionality or design changes you would have explored if you’d had the time. • If you can, put together a map of the end to end journey. They’re great for quickly getting a bird’s-eye view of a service. • If you do a heuristic review of an existing service, include screenshots of it at the time of review. Years down the line, without screenshots, it can be really tricky to work out what you were looking at. • Save everything in one place, with a clear taxonomy and naming conventions. https://hodigital.blog.gov.uk/2017/10/27/take-note-why-you-should-keep-records-of-service-decisions/
  • 19. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Idea 1: The Research Debt Sprint (mainly for agile teams working in 2-week sprints) • Set aside one sprint each quarter for paying research debt • No new research • Organise and clear up the stuff • Think about the insights and gaps • Write some reports, publications, blog posts
  • 20. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Idea 2: The Project Close-Down (mainly for agencies working on specific engagements) • Set aside a week of close-down time after each • Organise and clear up the stuff • Do a retro on the project – What went well – What went badly – What we’ll do more of next time – What we’ll avoid next time • Write a whitepaper, case study, marketing literature
  • 21. Caroline Jarrett @cjforms Stephanie Rosenbaum @teced Keep in touch Caroline cj@effortmark.co.uk Stephanie stephanie@teced.com

Notes de l'éditeur

  1. Successful service design integrates ongoing user research and usability testing throughout the design process, to continuously improve the service.