SlideShare une entreprise Scribd logo
1  sur  47
Télécharger pour lire hors ligne
Guerilla
Usability Testing
by Andy Budd
So what is usability
        testing anyway?

Usability testing generally involves setting a series
of tasks for people to complete and noting any
problems they encounter – It’s as simple as that!
Example Usability Test
Think aloud protocol
As the name suggests, you set a series of tasks
and ask the subject to verbalise their thoughts
and feelings by ‘thinking aloud’. The object of this
is to gain valuable insight into the thought
processes behind the users actions.
Rock, paper, scissors

You can test on everything from a low fidelity
paper prototype, through a HTML prototypes,
to a live site. You can test your existing site, your
competitors sites or a brand new solutuion.
Guerilla Usability Testing
Guerilla Usability Testing
Guerilla Usability Testing
Testing Shadowgrounds
Benefits of usability
        testing for designers
•   Help inform the design process
•   Uncover unknown or unexpected issues
•   Fix problems early in the process when they are easy to fix
•   Test assumptions
•   Highlight unnecessary features
•   Provide objectivity help and solve opinion battles
•   Set baselines and measure improvement
•   Get stakeholder buy-in
Benefits of usability
       testing for site owners
•   Fix problems early in the process when they are cheaper to fix
•   Improve customer satisfaction and retention
•   Increase conversion rates
•   Reduce maintenance, training and support costs
•   Get stakeholder buy-in
•   Reduce project risk
•   Set baselines and measure improvement
•   It’s so cheap you’d be stupid not to
Back to Shadowgrounds
Formative vs. Summative
Behavior vs. Opinion
Performance Metrics
Completion Rates – Are users able to complete the task?

Time on Task – How long does it take users to complete?

Page Views – How many pages does it take to complete?

Errors – The number and severity of errors per task?

Satisfaction – How does the user rate the system?
Usability Testing Halo3
Data
Results
Formal testing
Pros
•   Will recruit test subjects for you
•   Facilitators less likely to bias results
•   Comfortable facilities
•   The whole team can be present
•   Quantitative data likely to have more statistical validity
•   Professionally written report or presentation
Cons
•   Time consuming to set up, run and analyse results
•   Expensive so often only run once at the end of the project
•   Facilitators only have shallow knowledge of the project
•   Focus on quantitative over qualitative reduces insight
•   Smaller test samples can invalidate quantitative results
•   Most projects don’t require the level of statistical rigour
•   Easy for the results to be ‘thrown over the fence’ and
    forgotton
Informal (guerilla) testing
Pros
•   Very quick and easy to perform
•   Relatively inexpensive so can afford multiple tests
•   Qualitative nature can provide improved design insight
•   Results can be fed back into the design process almost
    immediately with no loss of signal
Cons
• Have to recruit subjects, arrange location and write tests
  yourself.
• Familiarity with project may introduce personal bias
• Less statistical rigour on quantitative results
RITE Methodology
How to get corporate/
          client buy-in
•   Don’t ask permission. Just do it anyway.
•   Show, don’t explain
•   Explain how it will reduce the risk that the project will fail.
•   Demonstrate the return on investment.
•   Highlight the benefits for your team.
•   Explain how it will provide hard data you can measure
    success against.
Select your tasks
 (5-6 tasks, 45 min max)
Good and Bad Tasks
Bad: Search for a bookcase

Good: You have 200+ books in your fiction
collection, currently in boxes strewn around your
living room. Find a way to organize them.
Testing plan
•   Introduce the project
•   State the goals of the test
•   Profile your desired test subjects
•   Create a test subject screener
•   Outline your testing methodology
•   Define your tasks
•   Write a testing script
•   Design a post test survey
Select your subjects
Recruiting test subjects
•   Client contacts
•   Via the client website (ehtnio.com?)
•   Recruitment agency
•   Market research agency
•   Twitter
•   Local notice boards and mailing lists
•   Other offices/departments
•   Classified ads e.g. gumtree
Remuneration
•   Cash
•   Vouchers
•   Wine and Chocolates
•   Beer and pizza
•   Movie tickets
•   Nothing
How many test subjects
    are enough?
Scouting for Locations
The basic set-up
Lab in a box
Morae
Silverback
Selecting a moderator
On the day
• Don’t keep people waiting around
• Have everything already set up and waiting
• Welcome people and thank them for their time
• Explain what you’ll be doing and how the test will work
• Remunerate them in advance so they understand it’s not
  contingent on their performance
• Ask them to sign a waiver
• Remind them that you’re testing the system, not them
• Encourage them to think aloud
Think aloud exercise
Be a good moderator
• Be friendly and put the person at ease
• Stay objective and detached. Try not to bond
• Start with a simple task
• Keep instructions simple
• Don’t give hints or ask leading questions
• Give encouraging but non-committal feedback
• Don’t ask opinion-based questions
• Avoid asking what the user would do in a certain sittuation
• If you don’t understand an action feel free to ask why they
  did something
• Know when to stop a task but don’t rescue people too soon
• Summarise key findings
Moderation Techniques
•   “What are you currently thinking?”
•   “Describe the steps you’re going through here”
•   “What do you think will happen next?”
•   “Is that what you expected to happen?”
•   “That was confusing?”
•   “And you were expecting ...?”
•   “Would you mind repeating that again?”
Usability Testing Mistakes
•   Not doing a proper run through of the test in advance
•   Incomplete or buggy prototypes
•   Not scheduling enough time between sessions
•   Bad task design
•   Accidental Revelation
•   Getting frustrated or losing detachment
Wrapping up
•   Answer any questions they may have
•   Administer the post test survey
•   Thank them for their help
•   Show them out
•   Capture any important notes immediatly
•   Prepare for the next test
Review and implement
        ASAP
Reports and Presentations

Contenu connexe

Tendances

1. Design - Intro UIUX Design.pdf
1. Design - Intro UIUX Design.pdf1. Design - Intro UIUX Design.pdf
1. Design - Intro UIUX Design.pdfJejeCans
 
Wireframing Basics - UX and the Design Process by Amber Vasquez
Wireframing Basics - UX and the Design Process by Amber VasquezWireframing Basics - UX and the Design Process by Amber Vasquez
Wireframing Basics - UX and the Design Process by Amber VasquezMightybytes
 
User interface and user experience ui ux design basics
User interface  and user experience ui ux design basicsUser interface  and user experience ui ux design basics
User interface and user experience ui ux design basicsRavi Bhadauria
 
"Beginner" UI/UX Project Presentation
"Beginner" UI/UX Project Presentation"Beginner" UI/UX Project Presentation
"Beginner" UI/UX Project PresentationRao Purna
 
UX RULES: 10 ESSENTIAL PRINCIPLES
UX RULES: 10 ESSENTIAL PRINCIPLESUX RULES: 10 ESSENTIAL PRINCIPLES
UX RULES: 10 ESSENTIAL PRINCIPLESJeremy Robinson
 
Intro to design sprint
Intro to design sprintIntro to design sprint
Intro to design sprintAngelene Jessy
 
UXR 101 - Introduction to UX Research
UXR 101 - Introduction to UX ResearchUXR 101 - Introduction to UX Research
UXR 101 - Introduction to UX ResearchNizar Maulana
 
A KPI framework for startups
A KPI framework for startupsA KPI framework for startups
A KPI framework for startupsyalisassoon
 
"What Are the Key Differences between UI and UX Design?"
"What Are the Key Differences between UI and UX Design?""What Are the Key Differences between UI and UX Design?"
"What Are the Key Differences between UI and UX Design?"MITAcademy1
 
Introduction To Usability
Introduction To UsabilityIntroduction To Usability
Introduction To UsabilityOvidiu Von M
 
Introduction to User Experience Design
Introduction to User Experience DesignIntroduction to User Experience Design
Introduction to User Experience DesignKiera McMaster
 
Roadmapping the Product Roadmap (ProductCamp Boston 2016)
Roadmapping the Product Roadmap (ProductCamp Boston 2016)Roadmapping the Product Roadmap (ProductCamp Boston 2016)
Roadmapping the Product Roadmap (ProductCamp Boston 2016)ProductCamp Boston
 
UX Design (5 Laws of UX)
UX Design (5 Laws of UX)UX Design (5 Laws of UX)
UX Design (5 Laws of UX)Steve Molloy
 
Putting Users in UX: Research Methods for Strategy
Putting Users in UX: Research Methods for StrategyPutting Users in UX: Research Methods for Strategy
Putting Users in UX: Research Methods for StrategyUsability Matters
 

Tendances (20)

UI/UX Fundamentals
UI/UX FundamentalsUI/UX Fundamentals
UI/UX Fundamentals
 
1. Design - Intro UIUX Design.pdf
1. Design - Intro UIUX Design.pdf1. Design - Intro UIUX Design.pdf
1. Design - Intro UIUX Design.pdf
 
UX Best Practices
UX Best PracticesUX Best Practices
UX Best Practices
 
Wireframing Basics - UX and the Design Process by Amber Vasquez
Wireframing Basics - UX and the Design Process by Amber VasquezWireframing Basics - UX and the Design Process by Amber Vasquez
Wireframing Basics - UX and the Design Process by Amber Vasquez
 
The Importance of UX
The Importance of UXThe Importance of UX
The Importance of UX
 
User interface and user experience ui ux design basics
User interface  and user experience ui ux design basicsUser interface  and user experience ui ux design basics
User interface and user experience ui ux design basics
 
"Beginner" UI/UX Project Presentation
"Beginner" UI/UX Project Presentation"Beginner" UI/UX Project Presentation
"Beginner" UI/UX Project Presentation
 
UX RULES: 10 ESSENTIAL PRINCIPLES
UX RULES: 10 ESSENTIAL PRINCIPLESUX RULES: 10 ESSENTIAL PRINCIPLES
UX RULES: 10 ESSENTIAL PRINCIPLES
 
Intro to design sprint
Intro to design sprintIntro to design sprint
Intro to design sprint
 
Introduction to UI UX
Introduction to UI UXIntroduction to UI UX
Introduction to UI UX
 
What is UX?
What is UX?What is UX?
What is UX?
 
UXR 101 - Introduction to UX Research
UXR 101 - Introduction to UX ResearchUXR 101 - Introduction to UX Research
UXR 101 - Introduction to UX Research
 
A KPI framework for startups
A KPI framework for startupsA KPI framework for startups
A KPI framework for startups
 
Basics of UX Research
Basics of UX ResearchBasics of UX Research
Basics of UX Research
 
"What Are the Key Differences between UI and UX Design?"
"What Are the Key Differences between UI and UX Design?""What Are the Key Differences between UI and UX Design?"
"What Are the Key Differences between UI and UX Design?"
 
Introduction To Usability
Introduction To UsabilityIntroduction To Usability
Introduction To Usability
 
Introduction to User Experience Design
Introduction to User Experience DesignIntroduction to User Experience Design
Introduction to User Experience Design
 
Roadmapping the Product Roadmap (ProductCamp Boston 2016)
Roadmapping the Product Roadmap (ProductCamp Boston 2016)Roadmapping the Product Roadmap (ProductCamp Boston 2016)
Roadmapping the Product Roadmap (ProductCamp Boston 2016)
 
UX Design (5 Laws of UX)
UX Design (5 Laws of UX)UX Design (5 Laws of UX)
UX Design (5 Laws of UX)
 
Putting Users in UX: Research Methods for Strategy
Putting Users in UX: Research Methods for StrategyPutting Users in UX: Research Methods for Strategy
Putting Users in UX: Research Methods for Strategy
 

Similaire à Guerilla Usability Testing

Library Website Usability
Library Website UsabilityLibrary Website Usability
Library Website UsabilityEllie Dworak
 
Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality productCarmen Brion
 
Everything You Need to Know for a Better Website in 2014 | Crystal Olig | Oxi...
Everything You Need to Know for a Better Website in 2014 | Crystal Olig | Oxi...Everything You Need to Know for a Better Website in 2014 | Crystal Olig | Oxi...
Everything You Need to Know for a Better Website in 2014 | Crystal Olig | Oxi...Lessing-Flynn
 
PHX Session #3 - "It Works on My Machine!" Closing the Loop Between Developme...
PHX Session #3 - "It Works on My Machine!" Closing the Loop Between Developme...PHX Session #3 - "It Works on My Machine!" Closing the Loop Between Developme...
PHX Session #3 - "It Works on My Machine!" Closing the Loop Between Developme...Steve Lange
 
How To Write A SQL Server Performance Review
How To Write A SQL Server Performance ReviewHow To Write A SQL Server Performance Review
How To Write A SQL Server Performance ReviewQuest Software
 
Lead Generation - Landing Page HubSpot May2009
Lead Generation - Landing Page HubSpot May2009Lead Generation - Landing Page HubSpot May2009
Lead Generation - Landing Page HubSpot May2009HubSpot
 
How to Improve Your Organization\'s Website Through Usability Testing
How to Improve Your Organization\'s Website Through Usability TestingHow to Improve Your Organization\'s Website Through Usability Testing
How to Improve Your Organization\'s Website Through Usability TestingCAMT
 
Danny Setiawan - How to Increase Conversion with Usability Testing
Danny Setiawan - How to Increase Conversion with Usability TestingDanny Setiawan - How to Increase Conversion with Usability Testing
Danny Setiawan - How to Increase Conversion with Usability TestingAutumn Quarantotto
 
How to increase conversion with usability testing
How to increase conversion with usability testingHow to increase conversion with usability testing
How to increase conversion with usability testingDanny Setiawan
 
The future of testing magento 2 james cowie from shero commerce - 10 24-20 ...
The future of testing magento 2   james cowie from shero commerce - 10 24-20 ...The future of testing magento 2   james cowie from shero commerce - 10 24-20 ...
The future of testing magento 2 james cowie from shero commerce - 10 24-20 ...James Cowie
 
Session #3: "It Works on My Machine!" Closing the Loop Between Development & ...
Session #3: "It Works on My Machine!" Closing the Loop Between Development & ...Session #3: "It Works on My Machine!" Closing the Loop Between Development & ...
Session #3: "It Works on My Machine!" Closing the Loop Between Development & ...Steve Lange
 
Research workshop study_methods_v5
Research workshop study_methods_v5Research workshop study_methods_v5
Research workshop study_methods_v5UXPA International
 
Taxonomy Validation
Taxonomy ValidationTaxonomy Validation
Taxonomy ValidationDave Cooksey
 
Optimizing Legal Service Delivery
Optimizing Legal Service DeliveryOptimizing Legal Service Delivery
Optimizing Legal Service DeliveryIFLP
 
Anton Muzhailo - Practical Test Process Improvement using ISTQB
Anton Muzhailo - Practical Test Process Improvement using ISTQBAnton Muzhailo - Practical Test Process Improvement using ISTQB
Anton Muzhailo - Practical Test Process Improvement using ISTQBIevgenii Katsan
 
Webinar: How to Conduct Unmoderated Remote Usability Testing
Webinar: How to Conduct Unmoderated Remote Usability TestingWebinar: How to Conduct Unmoderated Remote Usability Testing
Webinar: How to Conduct Unmoderated Remote Usability TestingUserZoom
 
Chat Smarter At Penn State
Chat Smarter At Penn StateChat Smarter At Penn State
Chat Smarter At Penn StateJohn Meier
 

Similaire à Guerilla Usability Testing (20)

Library Website Usability
Library Website UsabilityLibrary Website Usability
Library Website Usability
 
Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality product
 
Everything You Need to Know for a Better Website in 2014 | Crystal Olig | Oxi...
Everything You Need to Know for a Better Website in 2014 | Crystal Olig | Oxi...Everything You Need to Know for a Better Website in 2014 | Crystal Olig | Oxi...
Everything You Need to Know for a Better Website in 2014 | Crystal Olig | Oxi...
 
PHX Session #3 - "It Works on My Machine!" Closing the Loop Between Developme...
PHX Session #3 - "It Works on My Machine!" Closing the Loop Between Developme...PHX Session #3 - "It Works on My Machine!" Closing the Loop Between Developme...
PHX Session #3 - "It Works on My Machine!" Closing the Loop Between Developme...
 
How To Write A SQL Server Performance Review
How To Write A SQL Server Performance ReviewHow To Write A SQL Server Performance Review
How To Write A SQL Server Performance Review
 
Lead Generation - Landing Page HubSpot May2009
Lead Generation - Landing Page HubSpot May2009Lead Generation - Landing Page HubSpot May2009
Lead Generation - Landing Page HubSpot May2009
 
Usability
UsabilityUsability
Usability
 
How to Improve Your Organization\'s Website Through Usability Testing
How to Improve Your Organization\'s Website Through Usability TestingHow to Improve Your Organization\'s Website Through Usability Testing
How to Improve Your Organization\'s Website Through Usability Testing
 
Intro to Lean UX with UserTesting
Intro to Lean UX with UserTestingIntro to Lean UX with UserTesting
Intro to Lean UX with UserTesting
 
Danny Setiawan - How to Increase Conversion with Usability Testing
Danny Setiawan - How to Increase Conversion with Usability TestingDanny Setiawan - How to Increase Conversion with Usability Testing
Danny Setiawan - How to Increase Conversion with Usability Testing
 
How to increase conversion with usability testing
How to increase conversion with usability testingHow to increase conversion with usability testing
How to increase conversion with usability testing
 
The future of testing magento 2 james cowie from shero commerce - 10 24-20 ...
The future of testing magento 2   james cowie from shero commerce - 10 24-20 ...The future of testing magento 2   james cowie from shero commerce - 10 24-20 ...
The future of testing magento 2 james cowie from shero commerce - 10 24-20 ...
 
Session #3: "It Works on My Machine!" Closing the Loop Between Development & ...
Session #3: "It Works on My Machine!" Closing the Loop Between Development & ...Session #3: "It Works on My Machine!" Closing the Loop Between Development & ...
Session #3: "It Works on My Machine!" Closing the Loop Between Development & ...
 
Karat at CMU
Karat at CMUKarat at CMU
Karat at CMU
 
Research workshop study_methods_v5
Research workshop study_methods_v5Research workshop study_methods_v5
Research workshop study_methods_v5
 
Taxonomy Validation
Taxonomy ValidationTaxonomy Validation
Taxonomy Validation
 
Optimizing Legal Service Delivery
Optimizing Legal Service DeliveryOptimizing Legal Service Delivery
Optimizing Legal Service Delivery
 
Anton Muzhailo - Practical Test Process Improvement using ISTQB
Anton Muzhailo - Practical Test Process Improvement using ISTQBAnton Muzhailo - Practical Test Process Improvement using ISTQB
Anton Muzhailo - Practical Test Process Improvement using ISTQB
 
Webinar: How to Conduct Unmoderated Remote Usability Testing
Webinar: How to Conduct Unmoderated Remote Usability TestingWebinar: How to Conduct Unmoderated Remote Usability Testing
Webinar: How to Conduct Unmoderated Remote Usability Testing
 
Chat Smarter At Penn State
Chat Smarter At Penn StateChat Smarter At Penn State
Chat Smarter At Penn State
 

Plus de Andy Budd

I for one welcome our new robot overlords
I for one welcome our new robot overlordsI for one welcome our new robot overlords
I for one welcome our new robot overlordsAndy Budd
 
The Good, the Bad and the Ugly of Conversational Interfaces
The Good, the Bad and the Ugly of Conversational InterfacesThe Good, the Bad and the Ugly of Conversational Interfaces
The Good, the Bad and the Ugly of Conversational InterfacesAndy Budd
 
Desiging for competitive advantage
Desiging for competitive advantageDesiging for competitive advantage
Desiging for competitive advantageAndy Budd
 
The ux of user experience
The ux of user experienceThe ux of user experience
The ux of user experienceAndy Budd
 
The ux of architecture
The ux of architectureThe ux of architecture
The ux of architectureAndy Budd
 
Redefining ux
Redefining uxRedefining ux
Redefining uxAndy Budd
 
The ux of user experience
The ux of user experienceThe ux of user experience
The ux of user experienceAndy Budd
 
Design for Start-Ups
Design for Start-UpsDesign for Start-Ups
Design for Start-UpsAndy Budd
 
Ux professionalism
Ux professionalismUx professionalism
Ux professionalismAndy Budd
 
Digital Product Design
Digital Product DesignDigital Product Design
Digital Product DesignAndy Budd
 
Product management
Product managementProduct management
Product managementAndy Budd
 
Ignore UX At Your Peril
Ignore UX At Your PerilIgnore UX At Your Peril
Ignore UX At Your PerilAndy Budd
 
Persuasive Design: Encouraging Your Users To Do What You Want Them To!
Persuasive Design:  Encouraging Your Users To Do What You Want Them To!Persuasive Design:  Encouraging Your Users To Do What You Want Them To!
Persuasive Design: Encouraging Your Users To Do What You Want Them To!Andy Budd
 
Seductive Design
Seductive DesignSeductive Design
Seductive DesignAndy Budd
 
Guerilla Usability Testing — @media 2009
Guerilla Usability Testing — @media 2009Guerilla Usability Testing — @media 2009
Guerilla Usability Testing — @media 2009Andy Budd
 
Publishing 2.0
Publishing 2.0Publishing 2.0
Publishing 2.0Andy Budd
 
Usability Testing
Usability TestingUsability Testing
Usability TestingAndy Budd
 
Designing The User Experience Curve 2.0
Designing The User Experience Curve 2.0Designing The User Experience Curve 2.0
Designing The User Experience Curve 2.0Andy Budd
 
Architecting Human Behaviour
Architecting Human BehaviourArchitecting Human Behaviour
Architecting Human BehaviourAndy Budd
 
Designing the User Experience Curve
Designing the User Experience CurveDesigning the User Experience Curve
Designing the User Experience CurveAndy Budd
 

Plus de Andy Budd (20)

I for one welcome our new robot overlords
I for one welcome our new robot overlordsI for one welcome our new robot overlords
I for one welcome our new robot overlords
 
The Good, the Bad and the Ugly of Conversational Interfaces
The Good, the Bad and the Ugly of Conversational InterfacesThe Good, the Bad and the Ugly of Conversational Interfaces
The Good, the Bad and the Ugly of Conversational Interfaces
 
Desiging for competitive advantage
Desiging for competitive advantageDesiging for competitive advantage
Desiging for competitive advantage
 
The ux of user experience
The ux of user experienceThe ux of user experience
The ux of user experience
 
The ux of architecture
The ux of architectureThe ux of architecture
The ux of architecture
 
Redefining ux
Redefining uxRedefining ux
Redefining ux
 
The ux of user experience
The ux of user experienceThe ux of user experience
The ux of user experience
 
Design for Start-Ups
Design for Start-UpsDesign for Start-Ups
Design for Start-Ups
 
Ux professionalism
Ux professionalismUx professionalism
Ux professionalism
 
Digital Product Design
Digital Product DesignDigital Product Design
Digital Product Design
 
Product management
Product managementProduct management
Product management
 
Ignore UX At Your Peril
Ignore UX At Your PerilIgnore UX At Your Peril
Ignore UX At Your Peril
 
Persuasive Design: Encouraging Your Users To Do What You Want Them To!
Persuasive Design:  Encouraging Your Users To Do What You Want Them To!Persuasive Design:  Encouraging Your Users To Do What You Want Them To!
Persuasive Design: Encouraging Your Users To Do What You Want Them To!
 
Seductive Design
Seductive DesignSeductive Design
Seductive Design
 
Guerilla Usability Testing — @media 2009
Guerilla Usability Testing — @media 2009Guerilla Usability Testing — @media 2009
Guerilla Usability Testing — @media 2009
 
Publishing 2.0
Publishing 2.0Publishing 2.0
Publishing 2.0
 
Usability Testing
Usability TestingUsability Testing
Usability Testing
 
Designing The User Experience Curve 2.0
Designing The User Experience Curve 2.0Designing The User Experience Curve 2.0
Designing The User Experience Curve 2.0
 
Architecting Human Behaviour
Architecting Human BehaviourArchitecting Human Behaviour
Architecting Human Behaviour
 
Designing the User Experience Curve
Designing the User Experience CurveDesigning the User Experience Curve
Designing the User Experience Curve
 

Dernier

Chicago Medical Malpractice Lawyer Chicago Medical Malpractice Lawyer.pdf
Chicago Medical Malpractice Lawyer Chicago Medical Malpractice Lawyer.pdfChicago Medical Malpractice Lawyer Chicago Medical Malpractice Lawyer.pdf
Chicago Medical Malpractice Lawyer Chicago Medical Malpractice Lawyer.pdfSourav Sikder
 
Data skills for Agile Teams- Killing story points
Data skills for Agile Teams- Killing story pointsData skills for Agile Teams- Killing story points
Data skills for Agile Teams- Killing story pointsyasinnathani
 
PDT 89 - $1.4M - Seed - Plantee Innovations.pdf
PDT 89 - $1.4M - Seed - Plantee Innovations.pdfPDT 89 - $1.4M - Seed - Plantee Innovations.pdf
PDT 89 - $1.4M - Seed - Plantee Innovations.pdfHajeJanKamps
 
Borderless Access - Global Panel book-unlock 2024
Borderless Access - Global Panel book-unlock 2024Borderless Access - Global Panel book-unlock 2024
Borderless Access - Global Panel book-unlock 2024Borderless Access
 
Slicing Work on Business Agility Meetup Berlin
Slicing Work on Business Agility Meetup BerlinSlicing Work on Business Agility Meetup Berlin
Slicing Work on Business Agility Meetup BerlinAnton Skornyakov
 
Developing Coaching Skills: Mine, Yours, Ours
Developing Coaching Skills: Mine, Yours, OursDeveloping Coaching Skills: Mine, Yours, Ours
Developing Coaching Skills: Mine, Yours, OursKaiNexus
 
The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...
The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...
The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...Brian Solis
 
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptxHELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptxHelene Heckrotte
 
Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024Borderless Access
 
A flour, rice and Suji company in Jhang.
A flour, rice and Suji company in Jhang.A flour, rice and Suji company in Jhang.
A flour, rice and Suji company in Jhang.mcshagufta46
 
Michael Vidyakin: Introduction to PMO (UA)
Michael Vidyakin: Introduction to PMO (UA)Michael Vidyakin: Introduction to PMO (UA)
Michael Vidyakin: Introduction to PMO (UA)Lviv Startup Club
 
Tata Kelola Bisnis perushaan yang bergerak
Tata Kelola Bisnis perushaan yang bergerakTata Kelola Bisnis perushaan yang bergerak
Tata Kelola Bisnis perushaan yang bergerakEditores1
 
TalentView Webinar: Empowering the Modern Workforce_ Redefininig Success from...
TalentView Webinar: Empowering the Modern Workforce_ Redefininig Success from...TalentView Webinar: Empowering the Modern Workforce_ Redefininig Success from...
TalentView Webinar: Empowering the Modern Workforce_ Redefininig Success from...TalentView
 
To Create Your Own Wig Online To Create Your Own Wig Online
To Create Your Own Wig Online  To Create Your Own Wig OnlineTo Create Your Own Wig Online  To Create Your Own Wig Online
To Create Your Own Wig Online To Create Your Own Wig Onlinelng ths
 
Borderless Access - Global Panel book-unlock 2024
Borderless Access - Global Panel book-unlock 2024Borderless Access - Global Panel book-unlock 2024
Borderless Access - Global Panel book-unlock 2024Borderless Access
 
UNLEASHING THE POWER OF PROGRAMMATIC ADVERTISING
UNLEASHING THE POWER OF PROGRAMMATIC ADVERTISINGUNLEASHING THE POWER OF PROGRAMMATIC ADVERTISING
UNLEASHING THE POWER OF PROGRAMMATIC ADVERTISINGlokeshwarmaha
 
Harvard Business Review.pptx | Navigating Labor Unrest (March-April 2024)
Harvard Business Review.pptx | Navigating Labor Unrest (March-April 2024)Harvard Business Review.pptx | Navigating Labor Unrest (March-April 2024)
Harvard Business Review.pptx | Navigating Labor Unrest (March-April 2024)tazeenaila12
 
Building Your Personal Brand on LinkedIn - Expert Planet- 2024
 Building Your Personal Brand on LinkedIn - Expert Planet-  2024 Building Your Personal Brand on LinkedIn - Expert Planet-  2024
Building Your Personal Brand on LinkedIn - Expert Planet- 2024Stephan Koning
 
Project Brief & Information Architecture Report
Project Brief & Information Architecture ReportProject Brief & Information Architecture Report
Project Brief & Information Architecture Reportamberjiles31
 
Cracking the ‘Business Process Outsourcing’ Code Main.pptx
Cracking the ‘Business Process Outsourcing’ Code Main.pptxCracking the ‘Business Process Outsourcing’ Code Main.pptx
Cracking the ‘Business Process Outsourcing’ Code Main.pptxWorkforce Group
 

Dernier (20)

Chicago Medical Malpractice Lawyer Chicago Medical Malpractice Lawyer.pdf
Chicago Medical Malpractice Lawyer Chicago Medical Malpractice Lawyer.pdfChicago Medical Malpractice Lawyer Chicago Medical Malpractice Lawyer.pdf
Chicago Medical Malpractice Lawyer Chicago Medical Malpractice Lawyer.pdf
 
Data skills for Agile Teams- Killing story points
Data skills for Agile Teams- Killing story pointsData skills for Agile Teams- Killing story points
Data skills for Agile Teams- Killing story points
 
PDT 89 - $1.4M - Seed - Plantee Innovations.pdf
PDT 89 - $1.4M - Seed - Plantee Innovations.pdfPDT 89 - $1.4M - Seed - Plantee Innovations.pdf
PDT 89 - $1.4M - Seed - Plantee Innovations.pdf
 
Borderless Access - Global Panel book-unlock 2024
Borderless Access - Global Panel book-unlock 2024Borderless Access - Global Panel book-unlock 2024
Borderless Access - Global Panel book-unlock 2024
 
Slicing Work on Business Agility Meetup Berlin
Slicing Work on Business Agility Meetup BerlinSlicing Work on Business Agility Meetup Berlin
Slicing Work on Business Agility Meetup Berlin
 
Developing Coaching Skills: Mine, Yours, Ours
Developing Coaching Skills: Mine, Yours, OursDeveloping Coaching Skills: Mine, Yours, Ours
Developing Coaching Skills: Mine, Yours, Ours
 
The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...
The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...
The End of Business as Usual: Rewire the Way You Work to Succeed in the Consu...
 
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptxHELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
 
Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024Borderless Access - Global B2B Panel book-unlock 2024
Borderless Access - Global B2B Panel book-unlock 2024
 
A flour, rice and Suji company in Jhang.
A flour, rice and Suji company in Jhang.A flour, rice and Suji company in Jhang.
A flour, rice and Suji company in Jhang.
 
Michael Vidyakin: Introduction to PMO (UA)
Michael Vidyakin: Introduction to PMO (UA)Michael Vidyakin: Introduction to PMO (UA)
Michael Vidyakin: Introduction to PMO (UA)
 
Tata Kelola Bisnis perushaan yang bergerak
Tata Kelola Bisnis perushaan yang bergerakTata Kelola Bisnis perushaan yang bergerak
Tata Kelola Bisnis perushaan yang bergerak
 
TalentView Webinar: Empowering the Modern Workforce_ Redefininig Success from...
TalentView Webinar: Empowering the Modern Workforce_ Redefininig Success from...TalentView Webinar: Empowering the Modern Workforce_ Redefininig Success from...
TalentView Webinar: Empowering the Modern Workforce_ Redefininig Success from...
 
To Create Your Own Wig Online To Create Your Own Wig Online
To Create Your Own Wig Online  To Create Your Own Wig OnlineTo Create Your Own Wig Online  To Create Your Own Wig Online
To Create Your Own Wig Online To Create Your Own Wig Online
 
Borderless Access - Global Panel book-unlock 2024
Borderless Access - Global Panel book-unlock 2024Borderless Access - Global Panel book-unlock 2024
Borderless Access - Global Panel book-unlock 2024
 
UNLEASHING THE POWER OF PROGRAMMATIC ADVERTISING
UNLEASHING THE POWER OF PROGRAMMATIC ADVERTISINGUNLEASHING THE POWER OF PROGRAMMATIC ADVERTISING
UNLEASHING THE POWER OF PROGRAMMATIC ADVERTISING
 
Harvard Business Review.pptx | Navigating Labor Unrest (March-April 2024)
Harvard Business Review.pptx | Navigating Labor Unrest (March-April 2024)Harvard Business Review.pptx | Navigating Labor Unrest (March-April 2024)
Harvard Business Review.pptx | Navigating Labor Unrest (March-April 2024)
 
Building Your Personal Brand on LinkedIn - Expert Planet- 2024
 Building Your Personal Brand on LinkedIn - Expert Planet-  2024 Building Your Personal Brand on LinkedIn - Expert Planet-  2024
Building Your Personal Brand on LinkedIn - Expert Planet- 2024
 
Project Brief & Information Architecture Report
Project Brief & Information Architecture ReportProject Brief & Information Architecture Report
Project Brief & Information Architecture Report
 
Cracking the ‘Business Process Outsourcing’ Code Main.pptx
Cracking the ‘Business Process Outsourcing’ Code Main.pptxCracking the ‘Business Process Outsourcing’ Code Main.pptx
Cracking the ‘Business Process Outsourcing’ Code Main.pptx
 

Guerilla Usability Testing

  • 2. So what is usability testing anyway? Usability testing generally involves setting a series of tasks for people to complete and noting any problems they encounter – It’s as simple as that!
  • 4. Think aloud protocol As the name suggests, you set a series of tasks and ask the subject to verbalise their thoughts and feelings by ‘thinking aloud’. The object of this is to gain valuable insight into the thought processes behind the users actions.
  • 5. Rock, paper, scissors You can test on everything from a low fidelity paper prototype, through a HTML prototypes, to a live site. You can test your existing site, your competitors sites or a brand new solutuion.
  • 10. Benefits of usability testing for designers • Help inform the design process • Uncover unknown or unexpected issues • Fix problems early in the process when they are easy to fix • Test assumptions • Highlight unnecessary features • Provide objectivity help and solve opinion battles • Set baselines and measure improvement • Get stakeholder buy-in
  • 11. Benefits of usability testing for site owners • Fix problems early in the process when they are cheaper to fix • Improve customer satisfaction and retention • Increase conversion rates • Reduce maintenance, training and support costs • Get stakeholder buy-in • Reduce project risk • Set baselines and measure improvement • It’s so cheap you’d be stupid not to
  • 15. Performance Metrics Completion Rates – Are users able to complete the task? Time on Task – How long does it take users to complete? Page Views – How many pages does it take to complete? Errors – The number and severity of errors per task? Satisfaction – How does the user rate the system?
  • 17. Data
  • 20. Pros • Will recruit test subjects for you • Facilitators less likely to bias results • Comfortable facilities • The whole team can be present • Quantitative data likely to have more statistical validity • Professionally written report or presentation
  • 21. Cons • Time consuming to set up, run and analyse results • Expensive so often only run once at the end of the project • Facilitators only have shallow knowledge of the project • Focus on quantitative over qualitative reduces insight • Smaller test samples can invalidate quantitative results • Most projects don’t require the level of statistical rigour • Easy for the results to be ‘thrown over the fence’ and forgotton
  • 23. Pros • Very quick and easy to perform • Relatively inexpensive so can afford multiple tests • Qualitative nature can provide improved design insight • Results can be fed back into the design process almost immediately with no loss of signal
  • 24. Cons • Have to recruit subjects, arrange location and write tests yourself. • Familiarity with project may introduce personal bias • Less statistical rigour on quantitative results
  • 26. How to get corporate/ client buy-in • Don’t ask permission. Just do it anyway. • Show, don’t explain • Explain how it will reduce the risk that the project will fail. • Demonstrate the return on investment. • Highlight the benefits for your team. • Explain how it will provide hard data you can measure success against.
  • 27. Select your tasks (5-6 tasks, 45 min max)
  • 28. Good and Bad Tasks Bad: Search for a bookcase Good: You have 200+ books in your fiction collection, currently in boxes strewn around your living room. Find a way to organize them.
  • 29. Testing plan • Introduce the project • State the goals of the test • Profile your desired test subjects • Create a test subject screener • Outline your testing methodology • Define your tasks • Write a testing script • Design a post test survey
  • 31. Recruiting test subjects • Client contacts • Via the client website (ehtnio.com?) • Recruitment agency • Market research agency • Twitter • Local notice boards and mailing lists • Other offices/departments • Classified ads e.g. gumtree
  • 32. Remuneration • Cash • Vouchers • Wine and Chocolates • Beer and pizza • Movie tickets • Nothing
  • 33. How many test subjects are enough?
  • 36. Lab in a box
  • 37. Morae
  • 40. On the day • Don’t keep people waiting around • Have everything already set up and waiting • Welcome people and thank them for their time • Explain what you’ll be doing and how the test will work • Remunerate them in advance so they understand it’s not contingent on their performance • Ask them to sign a waiver • Remind them that you’re testing the system, not them • Encourage them to think aloud
  • 42. Be a good moderator • Be friendly and put the person at ease • Stay objective and detached. Try not to bond • Start with a simple task • Keep instructions simple • Don’t give hints or ask leading questions • Give encouraging but non-committal feedback • Don’t ask opinion-based questions • Avoid asking what the user would do in a certain sittuation • If you don’t understand an action feel free to ask why they did something • Know when to stop a task but don’t rescue people too soon • Summarise key findings
  • 43. Moderation Techniques • “What are you currently thinking?” • “Describe the steps you’re going through here” • “What do you think will happen next?” • “Is that what you expected to happen?” • “That was confusing?” • “And you were expecting ...?” • “Would you mind repeating that again?”
  • 44. Usability Testing Mistakes • Not doing a proper run through of the test in advance • Incomplete or buggy prototypes • Not scheduling enough time between sessions • Bad task design • Accidental Revelation • Getting frustrated or losing detachment
  • 45. Wrapping up • Answer any questions they may have • Administer the post test survey • Thank them for their help • Show them out • Capture any important notes immediatly • Prepare for the next test