Ce diaporama a bien été signalé.
Nous utilisons votre profil LinkedIn et vos données d’activité pour vous proposer des publicités personnalisées et pertinentes. Vous pouvez changer vos préférences de publicités à tout moment.

Best Practices From 10 Years of Remote Research

555 vues

Publié le

Based on 60,000+ hours of research from Nate Bolt, founder of Ethnio and former UX Research Manager at Facebook.

Publié dans : Design
  • Identifiez-vous pour voir les commentaires

Best Practices From 10 Years of Remote Research

  1. 1. Best Practices From 10 Years of Remote UX Research
  2. 2. thx
  3. 3. UX Research vs. Remote UX Research vs. User Research
  4. 4. Watching people use interfaces in order to design better interfaces
  5. 5. 60 YEARS AGO
  6. 6. LET’S RECORDHUMANSUSING INTERFACES 30 YEARS AGO
  7. 7. Vs. 10 YEARS AGO
  8. 8. 1% 
 Humans observing humans 99% 
 Data
  9. 9. • UX Research (Facebook, Google) • Experience Research (AirBnB) • Insights (Netflix) • Design Research (Uber) • User Research (So Many People) INTERCHANGEABLE TERMS
  10. 10. Analytics Data Science Quantitative Research User Research UX Research Usability User Research 1:1 Observation Lean Research
  11. 11. TEXT Geography of remote UX Research
  12. 12. Btw I’m Nate Bolt
  13. 13. PLEASE BUY THIS BOOK
  14. 14. ethn.io
  15. 15. How To Plan, Recruit, and Conduct Remote UX Research
  16. 16. 1. Ask the right questions 
 AKA Conversations with Stakeholders
  17. 17. Figuring out the right question(s) is tricky
  18. 18. Quantitative research lets us test our assumptions, and qualitative research lets us find out what we don't know. “ ”
  19. 19. What do our customers/ users/humans want? “ ”
  20. 20. • Remoteresear.ch site • Mental Models by Indi Young • Just Enough Research by Erika Hall • Cognition in The Wild by Ed Hutchins • Complete Beginner's Guide to Design Research • Observing the User Experience: A Practitioner's Guide to User Research A Deeper Read
  21. 21. 2. Try to Incorporate Data •Surveys •Experiments (A/B, etc) •System data •Purchase Behavior
  22. 22. 3. Identify Testing Goals
  23. 23. What do our customers/ users/humans want? “ ”
  24. 24. (and write them down in a G&O and then in a Moderator Script)
  25. 25. remoteresear.ch/category/samples
  26. 26. 3. Recruit real humans ethn.io
  27. 27. The Recruiting Spectrum Grab Someone in Your Office Live Customer Intercept Recruiting Agency
  28. 28. 4. Combine Tools & Methods
  29. 29. Observe Behavior
  30. 30. 5. Collaborate don’t report
  31. 31. And how does this fit into the design process?
  32. 32. Understand Prototype Build
  33. 33. Understand • review existing research • focus groups • interviews • ethnography • surveys • card sorts • data analysis • diary studies
  34. 34. Prototype • participatory design • collaborative design • brainstorming techniques • heuristic evaluation • paper prototype testing • static mock testing
  35. 35. Build • usability testing • heuristic evaluation • diary study • A/B test • field testing
  36. 36. 1. Identify Testing Goals 2. Incorporate Data 3. Recruit Real Humans 4. Combine tools & methods 5. Collaborate Don’t Report How To Plan, Recruit, and Conduct Remote UX Research
  37. 37. Pitfalls And Now Some Common
  38. 38. Decision Theory & Adaptive Systems Group
  39. 39. • Hypothetical Questions • A False Premise • Opinions are worthless Some Common Pitfalls of Remote UX Research
  40. 40. • Behavior • Context • Behavior Best Practices From 10 Years of Remote UX Research
  41. 41. • Bandwidth (games) • Security (prototypes) • Translation (time) • Rapport (lacking) Even More Pitfalls
  42. 42. How&When to Run Rapid Remote UX Research
  43. 43. 46 Million Americans That’s 22 Million Households 15% of the country
  44. 44. Now what percentage of those 46 million were employed within a year of receiving food assistance?
  45. 45. > 80%
  46. 46. So these are working people. People with families. Teachers, etc. How do they apply?
  47. 47. 90 Minutes / 53 Days up to
  48. 48. Alan Williams Design Lead, SNAP Caroline Hays Health Focus Area Intern Jacob Soloman Policy analyst and project manager
  49. 49. SNAP(Supplemental Nutrition Assistance Program) Let’s Try the Interface for a Application
  50. 50. Just Stop
  51. 51. 30 phone interviews 10 minutes each 58 unique experiences in California
  52. 52. And 15 Follow-Up Phone Interviews
  53. 53. Quant & Qual
  54. 54. 11 Minutes / 53 Days (?)
  55. 55. • 30 Remote Interviews • Real context • 15 Follow-Ups • Little to No Report • Input straight to designer & engineer Best Practices From 10 Years of Remote UX Research
  56. 56. • Easy, cheap, & fast phone interviews • Quick “Guerilla” Human Observation • No statistical significance • Behavior repeats over small samples • Combine with other inputs Best Practices From 10 Years of Remote UX Research
  57. 57. Top Tools for Remote UX Research
  58. 58. “At least a little behavioral” - Marv Surveys. Web Analytics.
  59. 59. Five Categories •Mobile (spans other categories) •Moderated (screen-sharing + audio) •Self-moderated (usertesting.com) •Automated (loop11, usabilla) •Fancy Analytics on Steroids (crazyegg)
  60. 60. remoteresear.ch/tools
  61. 61. Conceptual For A Long Time Self-Moderated Moderated Web Analytics Automated Static Automated Live
  62. 62. Tasks On Concepts For A Long Time People Talk To A Machine Talk To People Fancy-Ass Analytics Task Bar On Images Task Bar On A Live Site
  63. 63. I.A. & Navigation For Ad Agencies Ammunition Insight Just Better Analytics Still More Ammunition More Ammunition
  64. 64. Conceptual For A Long Time Self-Moderated Moderated Web Analytics Automated Static Automated Live Deep Behavioral Ux Insight
  65. 65. Opinions Conceptual For A Long Time Self-Moderated Moderated Web Analytics Automated Static Automated Live
  66. 66. Ad Agencies Love It Conceptual For A Long Time Self-Moderated Moderated Web Analytics Automated Static Automated Live
  67. 67. USABILLA Clicks & Questions Heatmaps You do your own recruiting $49 - $199
  68. 68. ethn.io
  69. 69. If NASA can do THIS from 153 million miles away, we can meet our users where they are, even if we’re a couple thousand miles away.
  70. 70. Thanks for attending Go run some awesome remote UX research
  71. 71. fin.
  72. 72. • Remoteresear.ch site • Mental Models by Indi Young • Just Enough Research by Erika Hall • Cognition in The Wild by Ed Hutchins • Complete Beginner's Guide to Design Research • Observing the User Experience: A Practitioner's Guide to User Research A Deeper Read
  73. 73. nate@ethn.io @ethnio Nate Bolt

×