SlideShare une entreprise Scribd logo
1  sur  38
The User Is Always Right (Usually)
4 Research Methods That Get Results
by Michael Hartman, Sandstorm Design®
A little about Sandstorm®
• Chicago-based UX and digital marketing agency
• Drupal development shop
• 1500+ in depth interviews and usability studies
• Industry Expertise
– Healthcare
– Financial Services
– Associations
– Technology
– Manufacturing
What we’ll cover
In Depth
User Interviews
Heuristic
Analysis
Card Sorting
& Tree Testing
Usability
Studies
In Depth User Interviews
Why Conduct In Depth User Interviews
• Uncover user goals and use cases
• Content requirements
• Functional requirements
What to Expect from In Depth Interviews?
• User stories and requirements
• Personas
• Allocate budget to most beneficial functionality
• Identify opportunities to meet previously unknown needs
• Align organization goals with user goals
• First step in design process
• Anytime is better than never
• If you haven’t spoken with your users yet, do it now
When Conduct In Depth User Interviews?
1. Identify research goals
2. Identify your user groups
3. Write protocol
4. Recruit and schedule
5. Conduct interviews
6. Analyze results, user stories, requirements, personas
How to Conduct In Depth User Interviews
1. Ask a mix of open-ended questions, behavior
based questions and quantified questions
2. Allow space for follow up and probing
3. Be flexible yet consistent
Tips for In Depth User Interviews
Case Study: Health Care
Card Sorting & Tree Testing
Why Do Card Sorting and Tree Testing
Build a user centered site structure and navigation
• Create a new navigation system and menu structure
• Test an existing navigation system and menu structure
• Identify user-centric labels for your navigation
and content
When to Conduct Card Sorting or Tree Testing
• At the beginning of the design process
• Anytime you realize your current navigation sucks
How to Conduct Card Sorting
• Identify / catalog your content
• Choose sample of content for testing
• Conduct the study – online or in-person
• Analyze results and build your new navigation
How to Conduct Tree Testing
• Build a sample menu structure of your site (the tree)
• Ask your users “where would you go to find X?”
• Adjust you menu structure accordingly
Tips for Card Sorting and Tree Testing
• At least 16-20 users
• The online tools are worth the cost
• Test users not stakeholders
Case Study: Neurosurgery
Case Study: Neurosurgery
Usability Studies
Why Conduct Usability Testing
• Add user context to your QA process
• Test forms and processes
• Test mobile and touch devices
5 – 6 Users Per User Group
Reference: http://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/
• Identify confusing or unclear language and
navigation labels
• Identify confusing or broken processes
• Identify inconsistencies between multi-device versions
of your site (mobile, tablet, desktop)
• Identify issues with the “findability” of content
What to Expect from Usability Testing
When to Test in the Design Process?
• Early and often is the best practice...but definitely before
launch
• Informal usability testing with your team
• Test wireframes and prototypes
• A/B testing on user interface concepts
How to Conduct Usability Testing
• Identify the goal of your study and key tasks
• Identify your users and participant criteria
• Write test protocol
• Recruit users
• Conduct study
• Analyze results and make improvements
Tips for Usability Testing
• Focus on conversion points
• Think aloud protocol
• Record if possible
• Allow room for follow up questions and clarifications
• Don’t interfere; observe
• Test mobile, touch and desktop experiences
• Involve users not stakeholders
Case Study: Radio Flyer
Heuristic Analysis
Heuristic Analysis
• A checklist of heuristics with pass / fail / needs
improvement scoring
• Reasonable substitute for a usability study when it’s not
possible to recruit users
• Check for 508 compliance
• Identify usability issues when testing with real users
is not possible
• Checks for site structure, 508 compliance, SEO best
practices, etc
• Benchmark your site against recognized
usability standards
What to Expect from a Heuristic Analysis
When to Conduct a Heuristic Analysis
• When you don’t have time or budget for a usability study
• When your site needs to meet certain compliance
standards (508 or WCAG 2.0)
How to Conduct a Heuristic Analysis
• Define heuristics, several good lists available online
• Conduct analysis, when practical have multiple people
review the site
• Follow your list of heuristics
• Analyze results and make improvements
Tips for Conducting a Heuristic Analysis
• Several good checklists available online
Case Study: Bermuda Monetary Authority
Interpretation & Analysis
Questions?
Presented by:
Michael Hartman
Director of Technology & Usability
Sandstorm®
773.348.4200
mhartman@sandstormdesign.com
®
The User Is Always Right (Usually): 4 User Research Methods That Get Results

Contenu connexe

Similaire à The User Is Always Right (Usually): 4 User Research Methods That Get Results

Conducting User Research
Conducting User ResearchConducting User Research
Conducting User ResearchJeremy Horn
 
Content Strategy and User Experience: Combination in Practice
Content Strategy and User Experience: Combination in PracticeContent Strategy and User Experience: Combination in Practice
Content Strategy and User Experience: Combination in PracticeAmy Grace Wells
 
How to Conduct Usability Studies: A Librarian Primer
How to Conduct Usability Studies: A Librarian PrimerHow to Conduct Usability Studies: A Librarian Primer
How to Conduct Usability Studies: A Librarian PrimerTao Zhang
 
Usability Testing for Qualitative Researchers - QRCA NYC Chapter event
Usability Testing for Qualitative Researchers - QRCA NYC Chapter eventUsability Testing for Qualitative Researchers - QRCA NYC Chapter event
Usability Testing for Qualitative Researchers - QRCA NYC Chapter eventKay Aubrey
 
5 Things You Can Do Starting Today to Improve Your Product's User Experience ...
5 Things You Can Do Starting Today to Improve Your Product's User Experience ...5 Things You Can Do Starting Today to Improve Your Product's User Experience ...
5 Things You Can Do Starting Today to Improve Your Product's User Experience ...Catharine Robertson
 
Usability Testing To Prioritize Your Designs
Usability Testing To Prioritize Your DesignsUsability Testing To Prioritize Your Designs
Usability Testing To Prioritize Your DesignsElizabeth Snowdon
 
User research for Product Managers - Product Tank London Jan 17
User research for Product Managers - Product Tank London Jan 17User research for Product Managers - Product Tank London Jan 17
User research for Product Managers - Product Tank London Jan 17Morag McLaren
 
Usability testing(Northeastern University-2014)
Usability testing(Northeastern University-2014)Usability testing(Northeastern University-2014)
Usability testing(Northeastern University-2014)Northeastern University
 
User Research for the Web and Applications
User Research for the Web and ApplicationsUser Research for the Web and Applications
User Research for the Web and ApplicationsDani Nordin
 
How to Build Winning Products by Microsoft Sr. Product Manager
How to Build Winning Products by Microsoft Sr. Product ManagerHow to Build Winning Products by Microsoft Sr. Product Manager
How to Build Winning Products by Microsoft Sr. Product ManagerProduct School
 
HCI(Human Computer Interaction)-PPT-REPORT.pptx
HCI(Human Computer Interaction)-PPT-REPORT.pptxHCI(Human Computer Interaction)-PPT-REPORT.pptx
HCI(Human Computer Interaction)-PPT-REPORT.pptxvliencycapateiii
 
Creating Disruptive Strategies In Legacy Products
Creating Disruptive Strategies In Legacy ProductsCreating Disruptive Strategies In Legacy Products
Creating Disruptive Strategies In Legacy ProductsJulie Anne Reda
 
Prototyping for web and mobile workshop
Prototyping for web and mobile workshopPrototyping for web and mobile workshop
Prototyping for web and mobile workshopSimon Phillips
 
Usability Evaluation
Usability EvaluationUsability Evaluation
Usability EvaluationSaqib Shehzad
 
Leveraging User Research
Leveraging User ResearchLeveraging User Research
Leveraging User ResearchTom Satwicz
 
Don t make them think: create an easy-to-use website and catalog through user...
Don t make them think: create an easy-to-use website and catalog through user...Don t make them think: create an easy-to-use website and catalog through user...
Don t make them think: create an easy-to-use website and catalog through user...Margaret Ostrander
 
Usability Testing - Adding a New Level to Your Toolbox
Usability Testing - Adding a New Level to Your ToolboxUsability Testing - Adding a New Level to Your Toolbox
Usability Testing - Adding a New Level to Your ToolboxExcella
 

Similaire à The User Is Always Right (Usually): 4 User Research Methods That Get Results (20)

Usability testing 2013.12.20.
Usability testing 2013.12.20.Usability testing 2013.12.20.
Usability testing 2013.12.20.
 
Conducting User Research
Conducting User ResearchConducting User Research
Conducting User Research
 
Content Strategy and User Experience: Combination in Practice
Content Strategy and User Experience: Combination in PracticeContent Strategy and User Experience: Combination in Practice
Content Strategy and User Experience: Combination in Practice
 
How to Conduct Usability Studies: A Librarian Primer
How to Conduct Usability Studies: A Librarian PrimerHow to Conduct Usability Studies: A Librarian Primer
How to Conduct Usability Studies: A Librarian Primer
 
Usability Testing for Qualitative Researchers - QRCA NYC Chapter event
Usability Testing for Qualitative Researchers - QRCA NYC Chapter eventUsability Testing for Qualitative Researchers - QRCA NYC Chapter event
Usability Testing for Qualitative Researchers - QRCA NYC Chapter event
 
5 Things You Can Do Starting Today to Improve Your Product's User Experience ...
5 Things You Can Do Starting Today to Improve Your Product's User Experience ...5 Things You Can Do Starting Today to Improve Your Product's User Experience ...
5 Things You Can Do Starting Today to Improve Your Product's User Experience ...
 
Usability Testing To Prioritize Your Designs
Usability Testing To Prioritize Your DesignsUsability Testing To Prioritize Your Designs
Usability Testing To Prioritize Your Designs
 
User research for Product Managers - Product Tank London Jan 17
User research for Product Managers - Product Tank London Jan 17User research for Product Managers - Product Tank London Jan 17
User research for Product Managers - Product Tank London Jan 17
 
Notes on usability testing
Notes on usability testingNotes on usability testing
Notes on usability testing
 
Usability testing(Northeastern University-2014)
Usability testing(Northeastern University-2014)Usability testing(Northeastern University-2014)
Usability testing(Northeastern University-2014)
 
User Research for the Web and Applications
User Research for the Web and ApplicationsUser Research for the Web and Applications
User Research for the Web and Applications
 
How to Build Winning Products by Microsoft Sr. Product Manager
How to Build Winning Products by Microsoft Sr. Product ManagerHow to Build Winning Products by Microsoft Sr. Product Manager
How to Build Winning Products by Microsoft Sr. Product Manager
 
HCI(Human Computer Interaction)-PPT-REPORT.pptx
HCI(Human Computer Interaction)-PPT-REPORT.pptxHCI(Human Computer Interaction)-PPT-REPORT.pptx
HCI(Human Computer Interaction)-PPT-REPORT.pptx
 
Creating Disruptive Strategies In Legacy Products
Creating Disruptive Strategies In Legacy ProductsCreating Disruptive Strategies In Legacy Products
Creating Disruptive Strategies In Legacy Products
 
Prototyping for web and mobile workshop
Prototyping for web and mobile workshopPrototyping for web and mobile workshop
Prototyping for web and mobile workshop
 
Ch 3
Ch   3Ch   3
Ch 3
 
Usability Evaluation
Usability EvaluationUsability Evaluation
Usability Evaluation
 
Leveraging User Research
Leveraging User ResearchLeveraging User Research
Leveraging User Research
 
Don t make them think: create an easy-to-use website and catalog through user...
Don t make them think: create an easy-to-use website and catalog through user...Don t make them think: create an easy-to-use website and catalog through user...
Don t make them think: create an easy-to-use website and catalog through user...
 
Usability Testing - Adding a New Level to Your Toolbox
Usability Testing - Adding a New Level to Your ToolboxUsability Testing - Adding a New Level to Your Toolbox
Usability Testing - Adding a New Level to Your Toolbox
 

Dernier

TriStar Gold Corporate Presentation - April 2024
TriStar Gold Corporate Presentation - April 2024TriStar Gold Corporate Presentation - April 2024
TriStar Gold Corporate Presentation - April 2024Adnet Communications
 
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort ServiceCall US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort Servicecallgirls2057
 
Chapter 9 PPT 4th edition.pdf internal audit
Chapter 9 PPT 4th edition.pdf internal auditChapter 9 PPT 4th edition.pdf internal audit
Chapter 9 PPT 4th edition.pdf internal auditNhtLNguyn9
 
Financial-Statement-Analysis-of-Coca-cola-Company.pptx
Financial-Statement-Analysis-of-Coca-cola-Company.pptxFinancial-Statement-Analysis-of-Coca-cola-Company.pptx
Financial-Statement-Analysis-of-Coca-cola-Company.pptxsaniyaimamuddin
 
International Business Environments and Operations 16th Global Edition test b...
International Business Environments and Operations 16th Global Edition test b...International Business Environments and Operations 16th Global Edition test b...
International Business Environments and Operations 16th Global Edition test b...ssuserf63bd7
 
8447779800, Low rate Call girls in Tughlakabad Delhi NCR
8447779800, Low rate Call girls in Tughlakabad Delhi NCR8447779800, Low rate Call girls in Tughlakabad Delhi NCR
8447779800, Low rate Call girls in Tughlakabad Delhi NCRashishs7044
 
Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...Seta Wicaksana
 
Guide Complete Set of Residential Architectural Drawings PDF
Guide Complete Set of Residential Architectural Drawings PDFGuide Complete Set of Residential Architectural Drawings PDF
Guide Complete Set of Residential Architectural Drawings PDFChandresh Chudasama
 
Call Girls Contact Number Andheri 9920874524
Call Girls Contact Number Andheri 9920874524Call Girls Contact Number Andheri 9920874524
Call Girls Contact Number Andheri 9920874524najka9823
 
PSCC - Capability Statement Presentation
PSCC - Capability Statement PresentationPSCC - Capability Statement Presentation
PSCC - Capability Statement PresentationAnamaria Contreras
 
Call Us 📲8800102216📞 Call Girls In DLF City Gurgaon
Call Us 📲8800102216📞 Call Girls In DLF City GurgaonCall Us 📲8800102216📞 Call Girls In DLF City Gurgaon
Call Us 📲8800102216📞 Call Girls In DLF City Gurgaoncallgirls2057
 
The-Ethical-issues-ghhhhhhhhjof-Byjus.pptx
The-Ethical-issues-ghhhhhhhhjof-Byjus.pptxThe-Ethical-issues-ghhhhhhhhjof-Byjus.pptx
The-Ethical-issues-ghhhhhhhhjof-Byjus.pptxmbikashkanyari
 
Fordham -How effective decision-making is within the IT department - Analysis...
Fordham -How effective decision-making is within the IT department - Analysis...Fordham -How effective decision-making is within the IT department - Analysis...
Fordham -How effective decision-making is within the IT department - Analysis...Peter Ward
 
8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR
8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR
8447779800, Low rate Call girls in Shivaji Enclave Delhi NCRashishs7044
 
Unlocking the Future: Explore Web 3.0 Workshop to Start Earning Today!
Unlocking the Future: Explore Web 3.0 Workshop to Start Earning Today!Unlocking the Future: Explore Web 3.0 Workshop to Start Earning Today!
Unlocking the Future: Explore Web 3.0 Workshop to Start Earning Today!Doge Mining Website
 
Investment in The Coconut Industry by Nancy Cheruiyot
Investment in The Coconut Industry by Nancy CheruiyotInvestment in The Coconut Industry by Nancy Cheruiyot
Investment in The Coconut Industry by Nancy Cheruiyotictsugar
 
Darshan Hiranandani [News About Next CEO].pdf
Darshan Hiranandani [News About Next CEO].pdfDarshan Hiranandani [News About Next CEO].pdf
Darshan Hiranandani [News About Next CEO].pdfShashank Mehta
 
Kenya Coconut Production Presentation by Dr. Lalith Perera
Kenya Coconut Production Presentation by Dr. Lalith PereraKenya Coconut Production Presentation by Dr. Lalith Perera
Kenya Coconut Production Presentation by Dr. Lalith Pereraictsugar
 

Dernier (20)

TriStar Gold Corporate Presentation - April 2024
TriStar Gold Corporate Presentation - April 2024TriStar Gold Corporate Presentation - April 2024
TriStar Gold Corporate Presentation - April 2024
 
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort ServiceCall US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
 
Chapter 9 PPT 4th edition.pdf internal audit
Chapter 9 PPT 4th edition.pdf internal auditChapter 9 PPT 4th edition.pdf internal audit
Chapter 9 PPT 4th edition.pdf internal audit
 
Financial-Statement-Analysis-of-Coca-cola-Company.pptx
Financial-Statement-Analysis-of-Coca-cola-Company.pptxFinancial-Statement-Analysis-of-Coca-cola-Company.pptx
Financial-Statement-Analysis-of-Coca-cola-Company.pptx
 
International Business Environments and Operations 16th Global Edition test b...
International Business Environments and Operations 16th Global Edition test b...International Business Environments and Operations 16th Global Edition test b...
International Business Environments and Operations 16th Global Edition test b...
 
Corporate Profile 47Billion Information Technology
Corporate Profile 47Billion Information TechnologyCorporate Profile 47Billion Information Technology
Corporate Profile 47Billion Information Technology
 
8447779800, Low rate Call girls in Tughlakabad Delhi NCR
8447779800, Low rate Call girls in Tughlakabad Delhi NCR8447779800, Low rate Call girls in Tughlakabad Delhi NCR
8447779800, Low rate Call girls in Tughlakabad Delhi NCR
 
Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...
 
Guide Complete Set of Residential Architectural Drawings PDF
Guide Complete Set of Residential Architectural Drawings PDFGuide Complete Set of Residential Architectural Drawings PDF
Guide Complete Set of Residential Architectural Drawings PDF
 
Call Girls Contact Number Andheri 9920874524
Call Girls Contact Number Andheri 9920874524Call Girls Contact Number Andheri 9920874524
Call Girls Contact Number Andheri 9920874524
 
No-1 Call Girls In Goa 93193 VIP 73153 Escort service In North Goa Panaji, Ca...
No-1 Call Girls In Goa 93193 VIP 73153 Escort service In North Goa Panaji, Ca...No-1 Call Girls In Goa 93193 VIP 73153 Escort service In North Goa Panaji, Ca...
No-1 Call Girls In Goa 93193 VIP 73153 Escort service In North Goa Panaji, Ca...
 
PSCC - Capability Statement Presentation
PSCC - Capability Statement PresentationPSCC - Capability Statement Presentation
PSCC - Capability Statement Presentation
 
Call Us 📲8800102216📞 Call Girls In DLF City Gurgaon
Call Us 📲8800102216📞 Call Girls In DLF City GurgaonCall Us 📲8800102216📞 Call Girls In DLF City Gurgaon
Call Us 📲8800102216📞 Call Girls In DLF City Gurgaon
 
The-Ethical-issues-ghhhhhhhhjof-Byjus.pptx
The-Ethical-issues-ghhhhhhhhjof-Byjus.pptxThe-Ethical-issues-ghhhhhhhhjof-Byjus.pptx
The-Ethical-issues-ghhhhhhhhjof-Byjus.pptx
 
Fordham -How effective decision-making is within the IT department - Analysis...
Fordham -How effective decision-making is within the IT department - Analysis...Fordham -How effective decision-making is within the IT department - Analysis...
Fordham -How effective decision-making is within the IT department - Analysis...
 
8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR
8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR
8447779800, Low rate Call girls in Shivaji Enclave Delhi NCR
 
Unlocking the Future: Explore Web 3.0 Workshop to Start Earning Today!
Unlocking the Future: Explore Web 3.0 Workshop to Start Earning Today!Unlocking the Future: Explore Web 3.0 Workshop to Start Earning Today!
Unlocking the Future: Explore Web 3.0 Workshop to Start Earning Today!
 
Investment in The Coconut Industry by Nancy Cheruiyot
Investment in The Coconut Industry by Nancy CheruiyotInvestment in The Coconut Industry by Nancy Cheruiyot
Investment in The Coconut Industry by Nancy Cheruiyot
 
Darshan Hiranandani [News About Next CEO].pdf
Darshan Hiranandani [News About Next CEO].pdfDarshan Hiranandani [News About Next CEO].pdf
Darshan Hiranandani [News About Next CEO].pdf
 
Kenya Coconut Production Presentation by Dr. Lalith Perera
Kenya Coconut Production Presentation by Dr. Lalith PereraKenya Coconut Production Presentation by Dr. Lalith Perera
Kenya Coconut Production Presentation by Dr. Lalith Perera
 

The User Is Always Right (Usually): 4 User Research Methods That Get Results

  • 1. The User Is Always Right (Usually) 4 Research Methods That Get Results by Michael Hartman, Sandstorm Design®
  • 2.
  • 3. A little about Sandstorm® • Chicago-based UX and digital marketing agency • Drupal development shop • 1500+ in depth interviews and usability studies • Industry Expertise – Healthcare – Financial Services – Associations – Technology – Manufacturing
  • 4.
  • 5. What we’ll cover In Depth User Interviews Heuristic Analysis Card Sorting & Tree Testing Usability Studies
  • 6. In Depth User Interviews
  • 7. Why Conduct In Depth User Interviews • Uncover user goals and use cases • Content requirements • Functional requirements
  • 8. What to Expect from In Depth Interviews? • User stories and requirements • Personas • Allocate budget to most beneficial functionality • Identify opportunities to meet previously unknown needs • Align organization goals with user goals
  • 9. • First step in design process • Anytime is better than never • If you haven’t spoken with your users yet, do it now When Conduct In Depth User Interviews?
  • 10. 1. Identify research goals 2. Identify your user groups 3. Write protocol 4. Recruit and schedule 5. Conduct interviews 6. Analyze results, user stories, requirements, personas How to Conduct In Depth User Interviews
  • 11. 1. Ask a mix of open-ended questions, behavior based questions and quantified questions 2. Allow space for follow up and probing 3. Be flexible yet consistent Tips for In Depth User Interviews
  • 13. Card Sorting & Tree Testing
  • 14. Why Do Card Sorting and Tree Testing Build a user centered site structure and navigation • Create a new navigation system and menu structure • Test an existing navigation system and menu structure • Identify user-centric labels for your navigation and content
  • 15. When to Conduct Card Sorting or Tree Testing • At the beginning of the design process • Anytime you realize your current navigation sucks
  • 16. How to Conduct Card Sorting • Identify / catalog your content • Choose sample of content for testing • Conduct the study – online or in-person • Analyze results and build your new navigation
  • 17. How to Conduct Tree Testing • Build a sample menu structure of your site (the tree) • Ask your users “where would you go to find X?” • Adjust you menu structure accordingly
  • 18. Tips for Card Sorting and Tree Testing • At least 16-20 users • The online tools are worth the cost • Test users not stakeholders
  • 22. Why Conduct Usability Testing • Add user context to your QA process • Test forms and processes • Test mobile and touch devices
  • 23. 5 – 6 Users Per User Group Reference: http://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/
  • 24. • Identify confusing or unclear language and navigation labels • Identify confusing or broken processes • Identify inconsistencies between multi-device versions of your site (mobile, tablet, desktop) • Identify issues with the “findability” of content What to Expect from Usability Testing
  • 25. When to Test in the Design Process? • Early and often is the best practice...but definitely before launch • Informal usability testing with your team • Test wireframes and prototypes • A/B testing on user interface concepts
  • 26. How to Conduct Usability Testing • Identify the goal of your study and key tasks • Identify your users and participant criteria • Write test protocol • Recruit users • Conduct study • Analyze results and make improvements
  • 27. Tips for Usability Testing • Focus on conversion points • Think aloud protocol • Record if possible • Allow room for follow up questions and clarifications • Don’t interfere; observe • Test mobile, touch and desktop experiences • Involve users not stakeholders
  • 30. Heuristic Analysis • A checklist of heuristics with pass / fail / needs improvement scoring • Reasonable substitute for a usability study when it’s not possible to recruit users • Check for 508 compliance
  • 31. • Identify usability issues when testing with real users is not possible • Checks for site structure, 508 compliance, SEO best practices, etc • Benchmark your site against recognized usability standards What to Expect from a Heuristic Analysis
  • 32. When to Conduct a Heuristic Analysis • When you don’t have time or budget for a usability study • When your site needs to meet certain compliance standards (508 or WCAG 2.0)
  • 33. How to Conduct a Heuristic Analysis • Define heuristics, several good lists available online • Conduct analysis, when practical have multiple people review the site • Follow your list of heuristics • Analyze results and make improvements
  • 34. Tips for Conducting a Heuristic Analysis • Several good checklists available online
  • 35. Case Study: Bermuda Monetary Authority
  • 37. Questions? Presented by: Michael Hartman Director of Technology & Usability Sandstorm® 773.348.4200 mhartman@sandstormdesign.com ®

Notes de l'éditeur

  1. Technology and Usability Director at Sandstorm Design Lead usability study and user research practice Also do UX – wireframing, user flows, etc Also lead projects / Drupal
  2. Boutique design agency in Chicago Il Association space Key Industries Healthcare Finance Manufacturing Government (Tax and financial reporting) Usability Studies and User Research for B2B B2C E-Commerce Clients include AT&T, Radio Flyer, Time Warner Cable, The Metropolitan Opera, American Medical Association
  3. Your users help write your user stories If you want to answer any of the following questions, we recommend In Depth User Interviews: How do I understand my users? What features would bring the most benefit to my site/users? What do users think about our brand compared to our competitors? How should we be engaging our customers?
  4. Indentify your research goals. What questions are you trying to answer? Determine what types of users (user groups) will participate in the study. A user group is a set of users who have similar goals or use cases on your site or application. This is different from demographics. Write a protocol, that’s a fancy word for the list of questions your going to ask your users. Recruit and schedule the interviews. Interviews can be conducted over the phone to make it convenient for the participants. We recommend offering a gratuity or incentive to participate. Conduct the interviews, 30 to 45 minutes each should be good. Analyze the results and develop your user stories, requirements and/or personas. The results can also be helpful in making business decisions about the scope of your project.
  5. For example, what’s the primary reason you visit example.com? Tell me about the last time you visited example.com, what did you visit for? Tell me 3 things you like about example.com? Tell me 3 things you would like to see improved with example.com? questions like, can you tell me more about that? Can you give me an example? , follow up questions may vary but be sure to follow your protocol with all participants. You’re looking to identify trends, so you’ll need to be consistent in your research methods
  6. Card sorting and tree testing are the yin and yang of determining and testing your navigation and menu structure. Card sorting exercises consist of writing examples of your content on cards and having your users sort those cards into groups and label them. Tree testing works in the other direction where you present the user with a navigation structure and ask them to find particular piece of content. Both are quick and easy ways to arrive at an effective navigation structure and there are several great online tools for conducting both of these exercises. If you’re looking to solve any of the following, card sorting and/or tree testing will help: You’ve heard feedback that your content is hard to find. You’re not sure what to label a section or type of content? Your navigation structure is overly complicated. (hint: it shouldn’t be complicated at all).  
  7. How can we get more users to complete the check out process? How can we get users to accurately complete each step of this form? How does our site perform on mobile devices? How can we help our users learn more about what we have to offer?
  8. particularly useful for check-out and registration processes or any conversion points
  9. at Sandstorm we start the testing process as soon as we have enough wireframes or a prototype to start getting feedback. Usability testing early in the process can help indentify issues before budget is spent developing something that’s not optimal. It’s also the tool to use if parts of your site aren’t performing as expected. Even when your site is performing well, you’ll want to make sure your site is optimized for your users.
  10. Identify the goal of your study and the key tasks you want to test, don’t try to test too much in one study. If you want to test a lot of areas, it’s better to do multiple studies. Identify your users and participant criteria; make sure you’re testing with people who would use your site in the ‘real’ world. Write the testing protocol, the list of scenarios you want to test. Recruit users – we recommend offering a gratuity for participation.
  11. Only offer help when it is clear the users has failed the task and you need to move on.
  12. A heuristic analysis is a good substitute for a usability study when a study with your site users is not possible. It can be completed faster and requires fewer resources and therefore less of your budget. Keep in mind, a usability professional will catch most of a site’s usability issues, the downside is you’ll be missing the context and nuances of testing with real site users, particularly in uncovering issues with content and labeling.
  13. Will identify some things a usability study will not find H1 tags, page titles, alt text on images, branding, etc
  14. at Sandstorm we start the testing process as soon as we have enough wireframes or a prototype to start getting feedback. Usability testing early in the process can help indentify issues before budget is spent developing something that’s not optimal. It’s also the tool to use if parts of your site aren’t performing as expected. Even when your site is performing well, you’ll want to make sure your site is optimized for your users.
  15. Define your heuristics, there are several good lists available online, we’ve adapted and appended these lists to create our own set of heuristics. We look at things like: Are navigation and page titles easy to find and use? Are links easy to identify? Are font sizes and spacing easily readable? Is the color contrast between design elements stark enough for easy legibility? Is it clear what each action does? Is it clear what path to take? Are error messages clear and easy to understand? Does the site work well on multiple devices and smaller screens? Conduct the analysis, we use a Google form to list the heuristics and note our comments. When practical we have more than one usability expert conduct the analysis and compare notes. Analyze the results and make improvements to your site.
  16. Define your heuristics, there are several good lists available online, we’ve adapted and appended these lists to create our own set of heuristics. We look at things like: Are navigation and page titles easy to find and use? Are links easy to identify? Are font sizes and spacing easily readable? Is the color contrast between design elements stark enough for easy legibility? Is it clear what each action does? Is it clear what path to take? Are error messages clear and easy to understand? Does the site work well on multiple devices and smaller screens? Conduct the analysis, we use a Google form to list the heuristics and note our comments. When practical we have more than one usability expert conduct the analysis and compare notes. Analyze the results and make improvements to your site.
  17. Only offer help when it is clear the users has failed the task and you need to move on.
  18. If you don’t have the budget for recruiting real users, at least find someone who is not familiar with the project.