This document discusses best practices for conducting user testing. It outlines different types of moderated user testing, including in-person, guerrilla, and remote moderated testing. It emphasizes the importance of recruiting representative users from diverse backgrounds and writing test scenarios that ask factual, not opinion-based, questions. Finally, it stresses the critical role of the moderator in facilitating productive user tests by letting users do most of the talking and remaining neutral.

1. User testing done right
Els Aerts
@els_aerts

2. A long time ago, at a conference
far, far away…

4. User testing is
useless testing.

10. “First rule of usability? Don’t listen to users.”
Jakob Nielsen

11. So, how do you do user testing right?

12. User testing
Moderated
user testing
Unmoderated
user testing
• In-person user test
• Guerilla user test
• Remote moderated test
• Tree structure test
• Card sorting
• Screenshot test
• 5-second test

13. Moderated user testing

15. A focus group is not a user test.
@els_aerts

16. 3 types of moderated user testing
In-person moderated user testing Guerilla user testing Remote moderated user testing

17. In person moderated user testing
Observation room
Your team
Recording the test Sharing the screen
Testing room
Moderator + Test participant

19. Guerilla user testing

20. © MARSEL VAN OOSTEN | SQUIVER.COM

21. Remote moderated user testing

24. 1. Recruit the right users

25. Don’t test with
your partner.

26. Don't become too fixated on a
ridiculously precise user profile.

27. Be mindful of device preference.
Image: Евгений Донцов - https://www.youtube.com/watch?v=tgyUw2mhIMA

28. Recruit for diversity.
Image: George A Spiva https://www.flickr.com/photos/spivaartworkers/8750275571/in/set-72157633526380662

29. 2. Write a good scenario

31. Best starting point for your user test
scenario: data.
@els_aerts

33. Tell a story.
Image: johnlund.com
Tailor your questions.

34. Tell a story.
Image: johnlund.com

35. Questions to avoid
• Do you like x?
• What do you think about y?
• Would you use it more often if we added z?
• …

36. Ask questions that lead to facts,
not opinions.
@els_aerts

37. A user test scenario is a guide,
not a straightjacket.
@els_aerts

38. 3. Be a kick-ass moderator *
* This is MUCH harder than it sounds.

39. The moderator is both the biggest strength
and weakness in moderated user testing.
@els_aerts

40. “A good moderator adopts
3 personalities simultaneously.”
Jared Spool

41. 1. Flight attendant

42. 2. Sportscaster

43. 4. Scientist3. Scientist

44. 4. Switzerland

45. 99% of the talking during a user test should
be done by the test user.
@els_aerts

46. SHUT THE F*CK UP!

47. Thank you!
@els_aerts