SlideShare une entreprise Scribd logo
1  sur  16
(welcome to)


End User Testing
“User experience is really the whole totality.
 Opening the package… good example. It’s
 the total experience that matters. And that
    starts from when you first hear about a
  product… experience is more based upon
  memory than reality. If your memory of the
 product is wonderful, you will excuse all sorts
              of incidental things.”
                 (Don Norman)
Usability Principles
                                   (Jakob Nielson)


•   learnability: How easy is it for users to complete basic tasks the
    first time they encounter the design? (ex. long press vs. tap)

•   efficiency: Once users have learned the design, how quickly can
    they perform a task?

•   memorability: When users return to a design after a period of not
    using it, how easily can they reestablish proficiency?

•   errors: How many errors do users make, how severe are these
    errors, and how easily can they recover from these errors? (ex.
    Does an error message occur? Does it tell the user what to do next? Does it
    say what is wrong? )


•   satisfaction: How pleasant is it to use the design?
Testing Intent
•   With all tests you want to discover whether the user:
     •   Gets the point of the page(s)

     •   Understands the navigation system

     •   Can guess where to find things

•   In a general test you want to know:
     •   How do users interact with the device they are testing?

     •   What is difficult for people to do?

     •   Where do they get lost?

     •   What makes sense to them?

     •   What makes them feel distrustful or insecure?

     •   What do they like and what do they hate?

•   In a specific test you might want to know:
     •   Can the user accomplish a key task?

     •   Can the user find something specific?
What is the difference?
                     (functionality vs usability testing)




Usability testing                                           Functionality testing




              • Ease of use                • Does it work
              • Ease of navigation
              • Look and feel
Testing Roles

•   Moderator:
     •   Person who is guiding the user through the test


•   Note Taker:
     •   Person who is observing (silently) and gathering data

•   User:
     •   Person who is testing the device


•   Observers:
     •   Person or group of people behind a one-way mirror observing the session
Test Moderator
• Is friendly
• Makes the user feel comfortable
• Encourages user to comment out loud
• Stays objective and detached
• Watches the user do what comes naturally.
• Sees what the user does alone, without helping
    • Knows when to stop a task, but does not rescue user
       too soon
• Gives encouraging, non-committal feedback
• Summarizes findings with user
Test Note Taker
• Silent observer
• Takes note of user interaction with device. Notes when user:
   •   hesitates, worries, or is forced to think
   •   misunderstands something
   •   gets frustrated or annoyed
   •   gives up

• Also notes:
   • Answers to questions from moderator
   • Length of time to complete task
   • Difficulty in completing a task

• May ask moderator to ask user additional questions at the
  end of the session (if necessary)
Observers
• Silent observation of the test session

• Who should be involved?
   • Stakeholders

   • Designers

   • QA Team members

   • Executive team
Reasons to Observe

•   Credibilty: visibility to the test as it occurs vs. belief results are made up/
    personal preference or opinion
     “That's a big credibility booster. It's not just you saying it, but there's actually someone
        else who's saying it as well.” (Jakob Nielson)


•   Memorabilty: it’s easier to remember things you have witnessed than to
    have glanced through a report

•   Empathy: visibility to real end user, rather than test team or a pseudo “user”

•   Fewer design mistakes: when design team sees the end user, they are
    more likely to use design that works
Test Steps
•   Briefing with observers/note taker/moderator
•   Prepare testing environment
•   Greet user
•   Interview user
•   Distribute any necessary paperwork (legal waiver)
•   Conduct test
•   Q&A with user
•   Summarize findings with user
Greeting the User
• Introduction:
   •   Moderator will put the user at ease
   •   Try general topics, such as discussing the weather
   •   Introduce user to self (moderator) & the note taker


• Answer any questions the user might have beforehand

• What to say:
   •   We are evaluating the device, not you
   •   You are helping the design team understand what is not working
   •   You can take a break or stop at anytime during the testing
Background Interview
• Things to ask:
   • Experience with similar products
       • Has the user used a tablet before?

       • Has the user used a mobile device before?

       • If yes, how often do they use these devices?

       • If yes, what do they use these devices for?
Task Based Testing
• moderator:
   •   Give user a task to complete
   •   Check for understanding of instruction
   •   Reassure user that the product is being tested, not them
   •   Watch the user complete task without interference.
   •   Respond to silence, unclear answers
   •   Answer user questions at the completion of the task


• note taker:
   •   Take note of user behavior / interaction with device
Sticky Issues
                              (Things to watch out for)


• leading questions:
   •   some users may say what they think you want them to say

• asking design questions
   •   users will know where there is a problem, not how to design the solution.
        “Everyday people are not very good designers.” (Donald Norman)


• feeling attached or opinionated:
   •   be unbiased. All answers are valid and valuable


• using technical terms
   •   examples:
        • bugs vs issues
        • device vs product
        • launch vs start
Still curious?
                       (recommended reading)




• Don’t Make Me Think by Steve Krug

• The Design of Everyday Things by Donald A. Norman

• iPad Usability Testing Report by Nielson Nelson Group
  (slideshow)

• Uxbooth.com

Contenu connexe

Tendances

UXPA DC - UX 101 Intensive Workshop - Usability Testing
UXPA DC - UX 101 Intensive Workshop - Usability TestingUXPA DC - UX 101 Intensive Workshop - Usability Testing
UXPA DC - UX 101 Intensive Workshop - Usability TestingStephanie Pratt
 
Guerilla usability testing
Guerilla usability testingGuerilla usability testing
Guerilla usability testingrcolomar
 
Simon Peter Schrjver: Pair Testing
Simon Peter Schrjver: Pair TestingSimon Peter Schrjver: Pair Testing
Simon Peter Schrjver: Pair TestingAnna Royzman
 
Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...
Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...
Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...Fiona Tranquada
 
Using Automated Testing Tools to Empower Your User Research
Using Automated Testing Tools to Empower Your User ResearchUsing Automated Testing Tools to Empower Your User Research
Using Automated Testing Tools to Empower Your User ResearchUserZoom
 
99 Problem, But is this issue one?
99 Problem, But is this issue one?99 Problem, But is this issue one?
99 Problem, But is this issue one?AJ Siegel
 
Faster Usability Testing in an Agile World presented at Agile2011
Faster Usability Testing in an Agile World presented at Agile2011Faster Usability Testing in an Agile World presented at Agile2011
Faster Usability Testing in an Agile World presented at Agile2011Carol Smith
 
Usability Testing & You
Usability Testing & YouUsability Testing & You
Usability Testing & YouCate Kompare
 
User Testing for Accessibility
User Testing for AccessibilityUser Testing for Accessibility
User Testing for AccessibilityUsability Matters
 
Building a Successful Organization By Mastering Failure
Building a Successful Organization By Mastering FailureBuilding a Successful Organization By Mastering Failure
Building a Successful Organization By Mastering Failurejgoulah
 

Tendances (12)

UXPA DC - UX 101 Intensive Workshop - Usability Testing
UXPA DC - UX 101 Intensive Workshop - Usability TestingUXPA DC - UX 101 Intensive Workshop - Usability Testing
UXPA DC - UX 101 Intensive Workshop - Usability Testing
 
Delhi it professionals
Delhi it professionalsDelhi it professionals
Delhi it professionals
 
Guerilla usability testing
Guerilla usability testingGuerilla usability testing
Guerilla usability testing
 
Simon Peter Schrjver: Pair Testing
Simon Peter Schrjver: Pair TestingSimon Peter Schrjver: Pair Testing
Simon Peter Schrjver: Pair Testing
 
Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...
Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...
Expecting the Unexpected: Preparing for Successful User Research Sessions (Do...
 
Using Automated Testing Tools to Empower Your User Research
Using Automated Testing Tools to Empower Your User ResearchUsing Automated Testing Tools to Empower Your User Research
Using Automated Testing Tools to Empower Your User Research
 
99 Problem, But is this issue one?
99 Problem, But is this issue one?99 Problem, But is this issue one?
99 Problem, But is this issue one?
 
Faster Usability Testing in an Agile World presented at Agile2011
Faster Usability Testing in an Agile World presented at Agile2011Faster Usability Testing in an Agile World presented at Agile2011
Faster Usability Testing in an Agile World presented at Agile2011
 
Usability Testing & You
Usability Testing & YouUsability Testing & You
Usability Testing & You
 
User Testing for Accessibility
User Testing for AccessibilityUser Testing for Accessibility
User Testing for Accessibility
 
Paper Prototyping
Paper PrototypingPaper Prototyping
Paper Prototyping
 
Building a Successful Organization By Mastering Failure
Building a Successful Organization By Mastering FailureBuilding a Successful Organization By Mastering Failure
Building a Successful Organization By Mastering Failure
 

En vedette

Usability Testing
Usability TestingUsability Testing
Usability TestingAndy Budd
 
Lean Usability
Lean UsabilityLean Usability
Lean Usabilityglusman
 
UX STRAT 2014: Bill Rattner, "Creating a Long-Term, Unified Plan for Digital ...
UX STRAT 2014: Bill Rattner, "Creating a Long-Term, Unified Plan for Digital ...UX STRAT 2014: Bill Rattner, "Creating a Long-Term, Unified Plan for Digital ...
UX STRAT 2014: Bill Rattner, "Creating a Long-Term, Unified Plan for Digital ...UX STRAT
 
Introduction to Usability Testing: The DIY Approach - GA, London January 13th...
Introduction to Usability Testing: The DIY Approach - GA, London January 13th...Introduction to Usability Testing: The DIY Approach - GA, London January 13th...
Introduction to Usability Testing: The DIY Approach - GA, London January 13th...Evgenia (Jenny) Grinblo
 
Usability Testing 101 - an introduction
Usability Testing 101 - an introductionUsability Testing 101 - an introduction
Usability Testing 101 - an introductionElizabeth Snowdon
 

En vedette (7)

Usability Testing
Usability TestingUsability Testing
Usability Testing
 
Lean Usability
Lean UsabilityLean Usability
Lean Usability
 
Lean User Testing Intro
Lean User Testing IntroLean User Testing Intro
Lean User Testing Intro
 
UX Maturity Models
UX Maturity ModelsUX Maturity Models
UX Maturity Models
 
UX STRAT 2014: Bill Rattner, "Creating a Long-Term, Unified Plan for Digital ...
UX STRAT 2014: Bill Rattner, "Creating a Long-Term, Unified Plan for Digital ...UX STRAT 2014: Bill Rattner, "Creating a Long-Term, Unified Plan for Digital ...
UX STRAT 2014: Bill Rattner, "Creating a Long-Term, Unified Plan for Digital ...
 
Introduction to Usability Testing: The DIY Approach - GA, London January 13th...
Introduction to Usability Testing: The DIY Approach - GA, London January 13th...Introduction to Usability Testing: The DIY Approach - GA, London January 13th...
Introduction to Usability Testing: The DIY Approach - GA, London January 13th...
 
Usability Testing 101 - an introduction
Usability Testing 101 - an introductionUsability Testing 101 - an introduction
Usability Testing 101 - an introduction
 

Similaire à Introduction to Usability Testing

User Experience Basics for Product Management
User Experience Basics for Product ManagementUser Experience Basics for Product Management
User Experience Basics for Product ManagementRoger Hart
 
Basic Principles of Interface design
Basic Principles of Interface designBasic Principles of Interface design
Basic Principles of Interface designZdeněk Lanc
 
UsabilityMatters_Usability_Testing_Introduction_Workshop
UsabilityMatters_Usability_Testing_Introduction_WorkshopUsabilityMatters_Usability_Testing_Introduction_Workshop
UsabilityMatters_Usability_Testing_Introduction_WorkshopUsability Matters
 
Usability Testing
Usability TestingUsability Testing
Usability TestingJan Moons
 
UXprobe workshop at Dare Festival 2016
UXprobe workshop at Dare Festival 2016UXprobe workshop at Dare Festival 2016
UXprobe workshop at Dare Festival 2016UXprobe
 
The what, when, why and how of usability
The what, when, why and how of usabilityThe what, when, why and how of usability
The what, when, why and how of usabilitySimpleUsability
 
How to Effectively Lead Focus Groups: Presented at ProductTank Toronto
How to Effectively Lead Focus Groups: Presented at ProductTank TorontoHow to Effectively Lead Focus Groups: Presented at ProductTank Toronto
How to Effectively Lead Focus Groups: Presented at ProductTank TorontoTremis Skeete
 
Usability Evaluation
Usability EvaluationUsability Evaluation
Usability EvaluationSaqib Shehzad
 
Collaborative usability observation session intro
Collaborative usability observation session introCollaborative usability observation session intro
Collaborative usability observation session introNeil Allison
 
Usability testing / Nearly everything you need to know to get started
Usability testing / Nearly everything you need to know to get startedUsability testing / Nearly everything you need to know to get started
Usability testing / Nearly everything you need to know to get startedRebecca Destello
 
Engl317 project4 slidedoc1_about_usabilitytesting
Engl317 project4 slidedoc1_about_usabilitytestingEngl317 project4 slidedoc1_about_usabilitytesting
Engl317 project4 slidedoc1_about_usabilitytestingZachary Williamson
 
More Than Usability
More Than UsabilityMore Than Usability
More Than UsabilityRazan Sadeq
 
Usability Lab within Agile (by Ian Franklin at NUX Leeds January 2018)
Usability Lab within Agile (by Ian Franklin at NUX Leeds January 2018)Usability Lab within Agile (by Ian Franklin at NUX Leeds January 2018)
Usability Lab within Agile (by Ian Franklin at NUX Leeds January 2018)Northern User Experience
 
User eXperience insights
User eXperience insightsUser eXperience insights
User eXperience insightsMarion Boberg
 
Yes U can! - User Checks; iterative usability testing with actionable results
Yes U can! - User Checks; iterative usability testing with actionable resultsYes U can! - User Checks; iterative usability testing with actionable results
Yes U can! - User Checks; iterative usability testing with actionable resultsAnouschka Scholten
 
Pre-Conference Course: UX and Agile: Making a Great Experience -
Pre-Conference Course: UX and Agile: Making a Great Experience - Pre-Conference Course: UX and Agile: Making a Great Experience -
Pre-Conference Course: UX and Agile: Making a Great Experience - UXPA International
 

Similaire à Introduction to Usability Testing (20)

User Experience Basics for Product Management
User Experience Basics for Product ManagementUser Experience Basics for Product Management
User Experience Basics for Product Management
 
Basic Principles of Interface design
Basic Principles of Interface designBasic Principles of Interface design
Basic Principles of Interface design
 
Intro to Lean UX with UserTesting
Intro to Lean UX with UserTestingIntro to Lean UX with UserTesting
Intro to Lean UX with UserTesting
 
UsabilityMatters_Usability_Testing_Introduction_Workshop
UsabilityMatters_Usability_Testing_Introduction_WorkshopUsabilityMatters_Usability_Testing_Introduction_Workshop
UsabilityMatters_Usability_Testing_Introduction_Workshop
 
Usability Testing
Usability TestingUsability Testing
Usability Testing
 
UXprobe workshop at Dare Festival 2016
UXprobe workshop at Dare Festival 2016UXprobe workshop at Dare Festival 2016
UXprobe workshop at Dare Festival 2016
 
The what, when, why and how of usability
The what, when, why and how of usabilityThe what, when, why and how of usability
The what, when, why and how of usability
 
How to Effectively Lead Focus Groups: Presented at ProductTank Toronto
How to Effectively Lead Focus Groups: Presented at ProductTank TorontoHow to Effectively Lead Focus Groups: Presented at ProductTank Toronto
How to Effectively Lead Focus Groups: Presented at ProductTank Toronto
 
Usability Evaluation
Usability EvaluationUsability Evaluation
Usability Evaluation
 
Collaborative usability observation session intro
Collaborative usability observation session introCollaborative usability observation session intro
Collaborative usability observation session intro
 
Usability testing / Nearly everything you need to know to get started
Usability testing / Nearly everything you need to know to get startedUsability testing / Nearly everything you need to know to get started
Usability testing / Nearly everything you need to know to get started
 
Engl317 project4 slidedoc1_about_usabilitytesting
Engl317 project4 slidedoc1_about_usabilitytestingEngl317 project4 slidedoc1_about_usabilitytesting
Engl317 project4 slidedoc1_about_usabilitytesting
 
ICS3211 lecture 10
ICS3211 lecture 10ICS3211 lecture 10
ICS3211 lecture 10
 
More Than Usability
More Than UsabilityMore Than Usability
More Than Usability
 
Usability Lab within Agile (by Ian Franklin at NUX Leeds January 2018)
Usability Lab within Agile (by Ian Franklin at NUX Leeds January 2018)Usability Lab within Agile (by Ian Franklin at NUX Leeds January 2018)
Usability Lab within Agile (by Ian Franklin at NUX Leeds January 2018)
 
ICS3211 Lecture 9
ICS3211 Lecture 9ICS3211 Lecture 9
ICS3211 Lecture 9
 
User eXperience insights
User eXperience insightsUser eXperience insights
User eXperience insights
 
ICS3211_lecture 9_2022.pdf
ICS3211_lecture 9_2022.pdfICS3211_lecture 9_2022.pdf
ICS3211_lecture 9_2022.pdf
 
Yes U can! - User Checks; iterative usability testing with actionable results
Yes U can! - User Checks; iterative usability testing with actionable resultsYes U can! - User Checks; iterative usability testing with actionable results
Yes U can! - User Checks; iterative usability testing with actionable results
 
Pre-Conference Course: UX and Agile: Making a Great Experience -
Pre-Conference Course: UX and Agile: Making a Great Experience - Pre-Conference Course: UX and Agile: Making a Great Experience -
Pre-Conference Course: UX and Agile: Making a Great Experience -
 

Dernier

Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Principled Technologies
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdflior mazor
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 

Dernier (20)

Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 

Introduction to Usability Testing

  • 2. “User experience is really the whole totality. Opening the package… good example. It’s the total experience that matters. And that starts from when you first hear about a product… experience is more based upon memory than reality. If your memory of the product is wonderful, you will excuse all sorts of incidental things.” (Don Norman)
  • 3. Usability Principles (Jakob Nielson) • learnability: How easy is it for users to complete basic tasks the first time they encounter the design? (ex. long press vs. tap) • efficiency: Once users have learned the design, how quickly can they perform a task? • memorability: When users return to a design after a period of not using it, how easily can they reestablish proficiency? • errors: How many errors do users make, how severe are these errors, and how easily can they recover from these errors? (ex. Does an error message occur? Does it tell the user what to do next? Does it say what is wrong? ) • satisfaction: How pleasant is it to use the design?
  • 4. Testing Intent • With all tests you want to discover whether the user: • Gets the point of the page(s) • Understands the navigation system • Can guess where to find things • In a general test you want to know: • How do users interact with the device they are testing? • What is difficult for people to do? • Where do they get lost? • What makes sense to them? • What makes them feel distrustful or insecure? • What do they like and what do they hate? • In a specific test you might want to know: • Can the user accomplish a key task? • Can the user find something specific?
  • 5. What is the difference? (functionality vs usability testing) Usability testing Functionality testing • Ease of use • Does it work • Ease of navigation • Look and feel
  • 6. Testing Roles • Moderator: • Person who is guiding the user through the test • Note Taker: • Person who is observing (silently) and gathering data • User: • Person who is testing the device • Observers: • Person or group of people behind a one-way mirror observing the session
  • 7. Test Moderator • Is friendly • Makes the user feel comfortable • Encourages user to comment out loud • Stays objective and detached • Watches the user do what comes naturally. • Sees what the user does alone, without helping • Knows when to stop a task, but does not rescue user too soon • Gives encouraging, non-committal feedback • Summarizes findings with user
  • 8. Test Note Taker • Silent observer • Takes note of user interaction with device. Notes when user: • hesitates, worries, or is forced to think • misunderstands something • gets frustrated or annoyed • gives up • Also notes: • Answers to questions from moderator • Length of time to complete task • Difficulty in completing a task • May ask moderator to ask user additional questions at the end of the session (if necessary)
  • 9. Observers • Silent observation of the test session • Who should be involved? • Stakeholders • Designers • QA Team members • Executive team
  • 10. Reasons to Observe • Credibilty: visibility to the test as it occurs vs. belief results are made up/ personal preference or opinion “That's a big credibility booster. It's not just you saying it, but there's actually someone else who's saying it as well.” (Jakob Nielson) • Memorabilty: it’s easier to remember things you have witnessed than to have glanced through a report • Empathy: visibility to real end user, rather than test team or a pseudo “user” • Fewer design mistakes: when design team sees the end user, they are more likely to use design that works
  • 11. Test Steps • Briefing with observers/note taker/moderator • Prepare testing environment • Greet user • Interview user • Distribute any necessary paperwork (legal waiver) • Conduct test • Q&A with user • Summarize findings with user
  • 12. Greeting the User • Introduction: • Moderator will put the user at ease • Try general topics, such as discussing the weather • Introduce user to self (moderator) & the note taker • Answer any questions the user might have beforehand • What to say: • We are evaluating the device, not you • You are helping the design team understand what is not working • You can take a break or stop at anytime during the testing
  • 13. Background Interview • Things to ask: • Experience with similar products • Has the user used a tablet before? • Has the user used a mobile device before? • If yes, how often do they use these devices? • If yes, what do they use these devices for?
  • 14. Task Based Testing • moderator: • Give user a task to complete • Check for understanding of instruction • Reassure user that the product is being tested, not them • Watch the user complete task without interference. • Respond to silence, unclear answers • Answer user questions at the completion of the task • note taker: • Take note of user behavior / interaction with device
  • 15. Sticky Issues (Things to watch out for) • leading questions: • some users may say what they think you want them to say • asking design questions • users will know where there is a problem, not how to design the solution. “Everyday people are not very good designers.” (Donald Norman) • feeling attached or opinionated: • be unbiased. All answers are valid and valuable • using technical terms • examples: • bugs vs issues • device vs product • launch vs start
  • 16. Still curious? (recommended reading) • Don’t Make Me Think by Steve Krug • The Design of Everyday Things by Donald A. Norman • iPad Usability Testing Report by Nielson Nelson Group (slideshow) • Uxbooth.com