1. @thedxw www.dxw.com @lily_dart @rosebotanic@thedxw www.dxw.com @lily_dart @rosebotanic
Guerrilla tactics in usability testing
When time and money are against you
2. @thedxw www.dxw.com @lily_dart @rosebotanic
dxw is an agency specialising in
agile, user-focused digital
services for the public sector.
We like making users happy.
3. @thedxw www.dxw.com @lily_dart @rosebotanic
the art of pouncing on lone people
in cafes and public spaces, [then]
quickly filming them whilst they use
a website for a couple of minutes”
“
@MartinBelam
5. @thedxw www.dxw.com @lily_dart @rosebotanic
Guerrilla usability testing
Can tell you:
￫ If users can understand the purpose of the site
6. @thedxw www.dxw.com @lily_dart @rosebotanic
Guerrilla usability testing
Can tell you:
￫ If users can understand the purpose of the site
￫ If users can navigate to the content they want
7. @thedxw www.dxw.com @lily_dart @rosebotanic
Guerrilla usability testing
Can tell you:
￫ If users can understand the purpose of the site
￫ If users can navigate to the content they want
￫ If users understand the language you’re using
8. @thedxw www.dxw.com @lily_dart @rosebotanic
Guerrilla usability testing
Can tell you:
￫ If users can understand the purpose of the site
￫ If users can navigate to the content they want
￫ If users understand the language you’re using
￫ If users are satisfied with what they find
12. @thedxw www.dxw.com @lily_dart @rosebotanic
Guerrilla considerations
Consider:
￫ Environment
￫ Incentives
￫ Understanding who you’re speaking to
13. @thedxw www.dxw.com @lily_dart @rosebotanic
Today
We will cover:
￫ How to prepare a session
￫ Practice running a session
￫ Analyse findings
More info: http://bit.ly/dxw-guerrilla-survival-guide
14. @thedxw www.dxw.com @lily_dart @rosebotanic@thedxw www.dxw.com @lily_dart @rosebotanic
Task: Groups
￫ Break into groups
￫ Introduce yourself
￫ Select a product owner
￫ Working on, or familiar with a website or service
￫ Find a device to test the website on
15. @thedxw www.dxw.com @lily_dart @rosebotanic@thedxw www.dxw.com @lily_dart @rosebotanic
Task: Decide what to test
￫ Product owner has 1 minute to explain the service:
￫ Who is using the service?
￫ Why are they using the service?
￫ What does the service allow them to do?
￫ Pick one thing that is high priority on that service, either:
￫ A piece of content
￫ Or, a transaction
￫ Fill in the story sheet
18. @thedxw www.dxw.com @lily_dart @rosebotanic
Scenarios
We prefer scenarios over tasks:
￫ To give participants context
￫ To allow for more natural behaviour
19. @thedxw www.dxw.com @lily_dart @rosebotanic
Scenarios
We prefer scenarios over tasks:
￫ To give participants context
￫ To allow for more natural behaviour
￫ To avoid pattern matching
20. @thedxw www.dxw.com @lily_dart @rosebotanic
You have just been offered a full-time job and are
about to sign the employment contract.
The contract says that you only get 5 days of paid
holiday per year. You aren’t sure if, legally, that’s
enough. Where do you go to check?
Example scenario
21. @thedxw www.dxw.com @lily_dart @rosebotanic
You have just been offered a full-time job and are
about to sign the employment contract.
The contract says that you only get 5 days of paid
holiday per year. You aren’t sure if, legally, that’s
enough. Where do you go to check?
Example scenario
22. @thedxw www.dxw.com @lily_dart @rosebotanic
You have just been offered a full-time job and are
about to sign the employment contract.
The contract says that you only get 5 days of paid
holiday per year. You aren’t sure if, legally, that’s
enough. Where do you go to check?
Example scenario
23. @thedxw www.dxw.com @lily_dart @rosebotanic
You have just been offered a full-time job and are
about to sign the employment contract.
The contract says that you only get 5 days of paid
holiday per year. You aren’t sure if, legally, that’s
enough. Where do you go to check?
Example scenario
24. @thedxw www.dxw.com @lily_dart @rosebotanic
You have just been offered a full-time job and are
about to sign the employment contract.
The contract says that you only get 5 days of paid
holiday per year. You aren’t sure if, legally, that’s
enough. Where do you go to check?
Example scenario
25. @thedxw www.dxw.com @lily_dart @rosebotanic@thedxw www.dxw.com @lily_dart @rosebotanic
Task: Scenario
Write a scenario:
￫ Look back at your story sheet
￫ Think about what circumstance might create that need
￫ Write a scenario for your participants, considering:
￫ How much detail is needed
￫ How relatable the situation is
32. @thedxw www.dxw.com @lily_dart @rosebotanic
Interviewing technique
To get the most value from your session:
￫ Ask participants to speak their thoughts aloud
33. @thedxw www.dxw.com @lily_dart @rosebotanic
Interviewing technique
To get the most value from your session:
￫ Ask participants to speak their thoughts aloud
￫ Use non-leading prompts if they go quiet
34. @thedxw www.dxw.com @lily_dart @rosebotanic
Interviewing technique
To get the most value from your session:
￫ Ask participants to speak their thoughts aloud
￫ Use non-leading prompts if they go quiet
￫ Let participants come to their own conclusions
35. @thedxw www.dxw.com @lily_dart @rosebotanic@thedxw www.dxw.com @lily_dart @rosebotanic
Task: Testing the website
Test your session out:
￫ Product owner will move to the next group
￫ Lead researcher runs guerrilla usability session
￫ Other researchers write insights on post-it notes:
￫ Participant quotes
￫ Participant actions
37. @thedxw www.dxw.com @lily_dart @rosebotanic
Analysing findings
Create findings out of insights:
￫ Focus on understanding user needs and behaviour
38. @thedxw www.dxw.com @lily_dart @rosebotanic
Analysing findings
Create findings out of insights:
￫ Focus on understanding user needs and behaviour
￫ Avoid designing solutions
40. @thedxw www.dxw.com @lily_dart @rosebotanic@thedxw www.dxw.com @lily_dart @rosebotanic
Task: Analyse
Analyse your findings with your group:
￫ Discuss your post-it notes
￫ Group similar quotes and actions together
￫ Agree 3 findings to discuss
42. @thedxw www.dxw.com @lily_dart @rosebotanic
Today
We practised:
￫ How to prepare a script using scenarios
￫ How to interview participants without leading them
￫ How to collect and analyse findings collaboratively
43. @thedxw www.dxw.com @lily_dart @rosebotanic
Next steps
Learn more about:
￫ Environment
￫ Incentives
￫ Screening participants
￫ Interview technique
More info at http://bit.ly/dxw-guerrilla-survival-guide
