SlideShare une entreprise Scribd logo
1  sur  32
Télécharger pour lire hors ligne
Elizabeth Snowdon
Business / Web Analyst Consultant
         eliz.snowdon@gmail.com
Why does usability matter
What is usability
Planning a usability test
Types of usability studies
Q&A
Senior Business / Web Analyst Consultant
Over 10 years experience in high-technology
companies leading software implementations,
usability testing and web site design projects
Conducting usability tests since 2003
Contact Info
◦ LinkedIn:ca.linkedin.com/in/elizabethsnowdon
◦ Email: eliz.snowdon@gmail.com
Usability can save time, money and lives
On the web, usability is a precondition for
survival
On commercial off the shelf software
applications, usability can determine market
share
Signs at the time of the March 2, 2007 bus
accident
Usability Professionals Association
◦ Is an approach that incorporates direct user
  feedback throughout the development cycle in
  order to reduce costs and create products and tools
  that meet user needs

Steve Krug, author of Don’t Make Me Think
◦ “..making sure that something works well: that a
  person of average (or even below average) ability
  and experience can use the thing --- for it’s
  intended purpose without getting hopelessly
  frustrated”
Increased productivity
Decreased training and support costs
Increased sales and revenues
Reduced development time and costs
Reduced maintenance costs
Increased customer satisfaction


Source: UPA.org web site
Focus on users’ needs, tasks, and goals
Invest in initial research and requirements
◦ Identify your target audience and observe them
◦ Let users define product requirements
Iterative design process
Observe real target users using the system
is a technique used to evaluate a product by
testing it on users.
test users will try to complete typical tasks
while observers watch, listen and takes notes.
Goal
◦ identify any usability problems
◦ collect quantitative data on participants'
  performance
◦ determine participant's satisfaction with the
  product
1.   Plan user tests
2.   Conduct user tests
3.   Analyze findings
4.   Present findings
5.   Modify and retest designs
Purpose
  Problem statement/test objectives
  User profile
  Method (test design)
  Task list
  Test environment/equipment
  Test monitor role
  Evaluation measures (data to be collected)
  Report contents and presentation

Source: Rubin: "Handbook of Usability Testing", chapter 5
Paper prototype
HTML prototype
Live site or application
Competitor’s site or application
Brand new site or application
test early and test often
identify problems before they get coded
When validating claims regarding your
product or against competitors
during the development of a product
 to mould or improve the product
 Iterative

Output
 Usability problems and suggested fixes
 Highlight videos
At the end of a development stage
 To measure or validate the usability of a product
 "How usable is this product"
 To compare against competitor products or
 usability metrics
 To generate data to support marketing claims
 about usability

Output
 Statistical measures of usability
 Reports or white papers
Observe user behavior
Listen to user feedback
Facilitator stays quiet, observes, take notes
Test one user at a time
Mainly qualitative
Source:
                                 Jakob Nielsen




6-8 users per test or 5 users spread over
multiple tests
little ROI in testing more than 9 users
Moderator / Note-taker
◦ Screen sharing: WebEx or web conferencing tool
◦ Recording: Morae, Camtasia
◦ Speakerphone

Participant
◦ High speed internet access
◦ Speakerphone or headset telephone

for more info, go to Remote Testing
Presentation http://bit.ly/7RYwSO
Decide what to test
◦ What are your objectives
Recruit users
◦ Who is your target audience?
◦ Write a screener
Write tasks that meet your objectives
Understand requirements
◦ What do users want to accomplish?
◦ What does the company want to accomplish?
Determine the goals
◦ What tasks does the web site or application
  support?
Decide on the area of focus
◦ Tasks that have the most impact on your site
◦ Typical tasks
◦ Most critical tasks
First impression questions
◦ What is your impression of this home page or
  application?
Exploratory task
◦ Open-ended / research-oriented
Directed tasks
◦ Specific / answer-oriented
Task success
Task time
Errors
Efficiency
◦ Number of steps required to perform a task
Self-reported metrics
◦ Likert scale
◦ Do you prefer A or B?
Tullis, Albert (2009), Measuring the User Experience .
Rubin, Jeff (1994), Handbook of Usability Testing.
Usability.gov http://www.usability.gov/
Jakob Nielsen http://www.useit.com/
Usability Professionals Association
http://www.upassoc.org/
Jeff Sauro – Quantitative Usability
http://www.measuringusability.com/calc.php
STC usability site http://www.stcsig.org/usability/

Nielsen, Jakob, and Landauer, Thomas K.: "A mathematical
model of the finding of usability problems," Proceedings of
ACM INTERCHI'93 Conference (Amsterdam, The
Netherlands, 24-29 April 1993), pp. 206-213.
Any questions?
Feel free to contact me at
eliz.snowdon@gmail.com if have any further
questions or would like to explore the idea of
setting up a usability test in your
organization.

Contenu connexe

Tendances

Mobile UI Design – User Centered Design and UI Best Practices
Mobile UI Design – User Centered Design and UI Best PracticesMobile UI Design – User Centered Design and UI Best Practices
Mobile UI Design – User Centered Design and UI Best PracticesOXD
 
Conducting User Research
Conducting User ResearchConducting User Research
Conducting User ResearchJeremy Horn
 
What is a User Experience?
What is a User Experience? What is a User Experience?
What is a User Experience? Dotinum
 
UX Lesson 5: Information Architecture
UX Lesson 5: Information ArchitectureUX Lesson 5: Information Architecture
UX Lesson 5: Information ArchitectureJoan Lumanauw
 
UI & UX Design for Startups
UI & UX Design for StartupsUI & UX Design for Startups
UI & UX Design for StartupsRichard Fang
 
Usability principles 1
Usability principles 1Usability principles 1
Usability principles 1Sameer Chavan
 
Best Practices for Benchmarking the Website User Experience featuring Measuri...
Best Practices for Benchmarking the Website User Experience featuring Measuri...Best Practices for Benchmarking the Website User Experience featuring Measuri...
Best Practices for Benchmarking the Website User Experience featuring Measuri...UserZoom
 
Getting Started With UX Research
Getting Started With UX ResearchGetting Started With UX Research
Getting Started With UX ResearchGilang Andi Pradana
 
UX Experience Design: Processes and Strategy
UX Experience Design: Processes and StrategyUX Experience Design: Processes and Strategy
UX Experience Design: Processes and StrategyCHI UX Indonesia
 
Personas, scenarios, user stories
Personas, scenarios, user storiesPersonas, scenarios, user stories
Personas, scenarios, user storiesInteractionDesign
 
UXPA 2021: How do you know your users feel satisfied
UXPA 2021: How do you know your users feel satisfied   UXPA 2021: How do you know your users feel satisfied
UXPA 2021: How do you know your users feel satisfied UXPA International
 

Tendances (20)

Mobile UI Design – User Centered Design and UI Best Practices
Mobile UI Design – User Centered Design and UI Best PracticesMobile UI Design – User Centered Design and UI Best Practices
Mobile UI Design – User Centered Design and UI Best Practices
 
Conducting User Research
Conducting User ResearchConducting User Research
Conducting User Research
 
Research Methods in UX
Research Methods in UXResearch Methods in UX
Research Methods in UX
 
What is a User Experience?
What is a User Experience? What is a User Experience?
What is a User Experience?
 
UX Lesson 5: Information Architecture
UX Lesson 5: Information ArchitectureUX Lesson 5: Information Architecture
UX Lesson 5: Information Architecture
 
UI & UX Design for Startups
UI & UX Design for StartupsUI & UX Design for Startups
UI & UX Design for Startups
 
What is UX?
What is UX?What is UX?
What is UX?
 
Usability principles 1
Usability principles 1Usability principles 1
Usability principles 1
 
Best Practices for Benchmarking the Website User Experience featuring Measuri...
Best Practices for Benchmarking the Website User Experience featuring Measuri...Best Practices for Benchmarking the Website User Experience featuring Measuri...
Best Practices for Benchmarking the Website User Experience featuring Measuri...
 
Usability_Evaluation
Usability_EvaluationUsability_Evaluation
Usability_Evaluation
 
Getting Started With UX Research
Getting Started With UX ResearchGetting Started With UX Research
Getting Started With UX Research
 
What Is Usability?
What Is Usability?What Is Usability?
What Is Usability?
 
UX Experience Design: Processes and Strategy
UX Experience Design: Processes and StrategyUX Experience Design: Processes and Strategy
UX Experience Design: Processes and Strategy
 
What is UX?
What is UX?What is UX?
What is UX?
 
UX design
UX designUX design
UX design
 
Personas, scenarios, user stories
Personas, scenarios, user storiesPersonas, scenarios, user stories
Personas, scenarios, user stories
 
Ux design process
Ux design processUx design process
Ux design process
 
Usability Testing
Usability TestingUsability Testing
Usability Testing
 
UX Usability Heuristics
UX Usability HeuristicsUX Usability Heuristics
UX Usability Heuristics
 
UXPA 2021: How do you know your users feel satisfied
UXPA 2021: How do you know your users feel satisfied   UXPA 2021: How do you know your users feel satisfied
UXPA 2021: How do you know your users feel satisfied
 

Similaire à Usability Testing 101 - an introduction

Prototyping and Usability Testing your designs
Prototyping and Usability Testing your designsPrototyping and Usability Testing your designs
Prototyping and Usability Testing your designsElizabeth Snowdon
 
How to do usability testing and eye tracking
How to do usability testing and eye trackingHow to do usability testing and eye tracking
How to do usability testing and eye trackingObjective Experience
 
Usability Testing - Sivaprasath Selvaraj
Usability Testing - Sivaprasath SelvarajUsability Testing - Sivaprasath Selvaraj
Usability Testing - Sivaprasath SelvarajSivaprasath Selvaraj
 
Useagility Webinar - Automated User Testing
Useagility Webinar - Automated User TestingUseagility Webinar - Automated User Testing
Useagility Webinar - Automated User TestingUseagility
 
Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality productCarmen Brion
 
User Zoom Webinar Monster Aug09 Vf
User Zoom Webinar Monster Aug09 VfUser Zoom Webinar Monster Aug09 Vf
User Zoom Webinar Monster Aug09 VfUserZoom
 
Usability Testing and QA 7-18-14
Usability Testing and QA 7-18-14Usability Testing and QA 7-18-14
Usability Testing and QA 7-18-14Shilpa Thanawala
 
Usability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working GroupUsability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working GroupNormanMendoza
 
Usability Techniques for Startups
Usability Techniques for StartupsUsability Techniques for Startups
Usability Techniques for StartupsPerfetti Media
 
Dev's Guide to Feedback Driven Development
Dev's Guide to Feedback Driven DevelopmentDev's Guide to Feedback Driven Development
Dev's Guide to Feedback Driven DevelopmentMarty Haught
 
Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience UserZoom
 
Let's make users happy
Let's make users happyLet's make users happy
Let's make users happydpuiu
 
Universal usability engineering
Universal usability engineeringUniversal usability engineering
Universal usability engineeringAswathi Shankar
 
User testing methodology
User testing methodologyUser testing methodology
User testing methodologyJames Hatfield
 
Webinar: How to Conduct Unmoderated Remote Usability Testing
Webinar: How to Conduct Unmoderated Remote Usability TestingWebinar: How to Conduct Unmoderated Remote Usability Testing
Webinar: How to Conduct Unmoderated Remote Usability TestingUserZoom
 
Moving the Needle with UX Benchmarking
Moving the Needle with UX BenchmarkingMoving the Needle with UX Benchmarking
Moving the Needle with UX BenchmarkingUserZoom
 
Usability Testing and QA 12 11-15
Usability Testing and QA 12 11-15Usability Testing and QA 12 11-15
Usability Testing and QA 12 11-15Shilpa Thanawala
 

Similaire à Usability Testing 101 - an introduction (20)

Prototyping and Usability Testing your designs
Prototyping and Usability Testing your designsPrototyping and Usability Testing your designs
Prototyping and Usability Testing your designs
 
How to do usability testing and eye tracking
How to do usability testing and eye trackingHow to do usability testing and eye tracking
How to do usability testing and eye tracking
 
Intro to Lean UX with UserTesting
Intro to Lean UX with UserTestingIntro to Lean UX with UserTesting
Intro to Lean UX with UserTesting
 
Usability Testing - Sivaprasath Selvaraj
Usability Testing - Sivaprasath SelvarajUsability Testing - Sivaprasath Selvaraj
Usability Testing - Sivaprasath Selvaraj
 
Useagility Webinar - Automated User Testing
Useagility Webinar - Automated User TestingUseagility Webinar - Automated User Testing
Useagility Webinar - Automated User Testing
 
Design research for a quality product
Design research for a quality productDesign research for a quality product
Design research for a quality product
 
User Zoom Webinar Monster Aug09 Vf
User Zoom Webinar Monster Aug09 VfUser Zoom Webinar Monster Aug09 Vf
User Zoom Webinar Monster Aug09 Vf
 
Usability Testing and QA 7-18-14
Usability Testing and QA 7-18-14Usability Testing and QA 7-18-14
Usability Testing and QA 7-18-14
 
Usability
UsabilityUsability
Usability
 
Usability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working GroupUsability Primer - for Alberta Municipal Webmasters Working Group
Usability Primer - for Alberta Municipal Webmasters Working Group
 
Usability Techniques for Startups
Usability Techniques for StartupsUsability Techniques for Startups
Usability Techniques for Startups
 
Dev's Guide to Feedback Driven Development
Dev's Guide to Feedback Driven DevelopmentDev's Guide to Feedback Driven Development
Dev's Guide to Feedback Driven Development
 
Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience
 
Let's make users happy
Let's make users happyLet's make users happy
Let's make users happy
 
Notes on usability testing
Notes on usability testingNotes on usability testing
Notes on usability testing
 
Universal usability engineering
Universal usability engineeringUniversal usability engineering
Universal usability engineering
 
User testing methodology
User testing methodologyUser testing methodology
User testing methodology
 
Webinar: How to Conduct Unmoderated Remote Usability Testing
Webinar: How to Conduct Unmoderated Remote Usability TestingWebinar: How to Conduct Unmoderated Remote Usability Testing
Webinar: How to Conduct Unmoderated Remote Usability Testing
 
Moving the Needle with UX Benchmarking
Moving the Needle with UX BenchmarkingMoving the Needle with UX Benchmarking
Moving the Needle with UX Benchmarking
 
Usability Testing and QA 12 11-15
Usability Testing and QA 12 11-15Usability Testing and QA 12 11-15
Usability Testing and QA 12 11-15
 

Dernier

Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024The Digital Insurer
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Jeffrey Haguewood
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Orbitshub
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024The Digital Insurer
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdfSandro Moreira
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamUiPathCommunity
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Victor Rentea
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 

Dernier (20)

Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 

Usability Testing 101 - an introduction

  • 1. Elizabeth Snowdon Business / Web Analyst Consultant eliz.snowdon@gmail.com
  • 2. Why does usability matter What is usability Planning a usability test Types of usability studies Q&A
  • 3. Senior Business / Web Analyst Consultant Over 10 years experience in high-technology companies leading software implementations, usability testing and web site design projects Conducting usability tests since 2003 Contact Info ◦ LinkedIn:ca.linkedin.com/in/elizabethsnowdon ◦ Email: eliz.snowdon@gmail.com
  • 4.
  • 5. Usability can save time, money and lives On the web, usability is a precondition for survival On commercial off the shelf software applications, usability can determine market share
  • 6. Signs at the time of the March 2, 2007 bus accident
  • 7.
  • 8.
  • 9. Usability Professionals Association ◦ Is an approach that incorporates direct user feedback throughout the development cycle in order to reduce costs and create products and tools that meet user needs Steve Krug, author of Don’t Make Me Think ◦ “..making sure that something works well: that a person of average (or even below average) ability and experience can use the thing --- for it’s intended purpose without getting hopelessly frustrated”
  • 10. Increased productivity Decreased training and support costs Increased sales and revenues Reduced development time and costs Reduced maintenance costs Increased customer satisfaction Source: UPA.org web site
  • 11.
  • 12. Focus on users’ needs, tasks, and goals Invest in initial research and requirements ◦ Identify your target audience and observe them ◦ Let users define product requirements Iterative design process Observe real target users using the system
  • 13. is a technique used to evaluate a product by testing it on users. test users will try to complete typical tasks while observers watch, listen and takes notes. Goal ◦ identify any usability problems ◦ collect quantitative data on participants' performance ◦ determine participant's satisfaction with the product
  • 14. 1. Plan user tests 2. Conduct user tests 3. Analyze findings 4. Present findings 5. Modify and retest designs
  • 15. Purpose Problem statement/test objectives User profile Method (test design) Task list Test environment/equipment Test monitor role Evaluation measures (data to be collected) Report contents and presentation Source: Rubin: "Handbook of Usability Testing", chapter 5
  • 16. Paper prototype HTML prototype Live site or application Competitor’s site or application Brand new site or application
  • 17.
  • 18. test early and test often identify problems before they get coded When validating claims regarding your product or against competitors
  • 19. during the development of a product to mould or improve the product Iterative Output Usability problems and suggested fixes Highlight videos
  • 20. At the end of a development stage To measure or validate the usability of a product "How usable is this product" To compare against competitor products or usability metrics To generate data to support marketing claims about usability Output Statistical measures of usability Reports or white papers
  • 21. Observe user behavior Listen to user feedback Facilitator stays quiet, observes, take notes Test one user at a time Mainly qualitative
  • 22. Source: Jakob Nielsen 6-8 users per test or 5 users spread over multiple tests little ROI in testing more than 9 users
  • 23.
  • 24. Moderator / Note-taker ◦ Screen sharing: WebEx or web conferencing tool ◦ Recording: Morae, Camtasia ◦ Speakerphone Participant ◦ High speed internet access ◦ Speakerphone or headset telephone for more info, go to Remote Testing Presentation http://bit.ly/7RYwSO
  • 25.
  • 26.
  • 27. Decide what to test ◦ What are your objectives Recruit users ◦ Who is your target audience? ◦ Write a screener Write tasks that meet your objectives
  • 28. Understand requirements ◦ What do users want to accomplish? ◦ What does the company want to accomplish? Determine the goals ◦ What tasks does the web site or application support? Decide on the area of focus ◦ Tasks that have the most impact on your site ◦ Typical tasks ◦ Most critical tasks
  • 29. First impression questions ◦ What is your impression of this home page or application? Exploratory task ◦ Open-ended / research-oriented Directed tasks ◦ Specific / answer-oriented
  • 30. Task success Task time Errors Efficiency ◦ Number of steps required to perform a task Self-reported metrics ◦ Likert scale ◦ Do you prefer A or B?
  • 31. Tullis, Albert (2009), Measuring the User Experience . Rubin, Jeff (1994), Handbook of Usability Testing. Usability.gov http://www.usability.gov/ Jakob Nielsen http://www.useit.com/ Usability Professionals Association http://www.upassoc.org/ Jeff Sauro – Quantitative Usability http://www.measuringusability.com/calc.php STC usability site http://www.stcsig.org/usability/ Nielsen, Jakob, and Landauer, Thomas K.: "A mathematical model of the finding of usability problems," Proceedings of ACM INTERCHI'93 Conference (Amsterdam, The Netherlands, 24-29 April 1993), pp. 206-213.
  • 32. Any questions? Feel free to contact me at eliz.snowdon@gmail.com if have any further questions or would like to explore the idea of setting up a usability test in your organization.