SlideShare une entreprise Scribd logo
1  sur  12
Télécharger pour lire hors ligne
Usability – Assuring Quality in Use


        Marko Nieminen
        Professor of Usability and User Interfaces, D.Sc.(Tech.)
        Aalto University School of Science
        Department of Computer Science and Engineering
        SoberIT - Software Business and Engineering Laboratory
Test and Testing

•  A qualitative or quantitative procedure that consists of
   determination of one or more characteristics of a given
   product, process or service according to a specified
   procedure

•  Why testing? For instance,

•  Determine if, or verify that, the requirements of a
   specification, regulation, or contract are met
•  Decide if a new product development program is on track:
   Demonstrate proof of concept
•  Validate suitability for end-use
Quality in Use – Related to Usability and
User Experience


                The capability of a system
                 to enable specified users
                to achieve specified goals
 with effectiveness, productivity, safety, and satisfaction
               in specified contexts of use.
Usability Test: Lab




                      http://www.sigchi.org/chi97/proceedings/overview/tst.htm
                                           Usability Lab at Fidelity Investments
Watching Television – On-site
Scenario: Mobile Ticketing


1       Matti sees Madonna’s concert
        promotion at bar in Tampere




         He takes a picture of promotion
    2    poster by using his mobile phone



              Matti logs in to service for buying
         3    tickets. Service identifies
              Madonna’s concert proposition.



                 4     He buys the concert ticket and
                       travel ticket at the same time   6
…and the scenario continues

5       Mikko checks his route and
        tickets through mobile phone



         He validates travel ticket by
    6    using a mobile phone when he
         walks in to train at Tampere



              Mikko decides to stop for one
         7    beer and buy it by using mobile
              phone


                     He validates concert ticket by
                 8   using mobile phone when he
                     arrives to gate of concert       7
Field Tests




              (Tamminen & Oulasvirta 2005)
Testing for ”Quality in Use” Addresses

•    Real users
•    Real settings
•    Real tasks
•    Real events
•    Real process
•    Real details
•    Real effects
•    Real outcome

•  Expected (quantitative) and unexpected (qualitative) issues
Usability Metrics: System Usability Scale
(SUS)
1.   I think that I would like to use this system frequently.
2.   I found the system unnecessarily complex.
3.   I thought the system was easy to use.
4.   I think that I would need the support of a technical person to be able
     to use this system.
5.  I found the various functions in this system were well integrated.
6.  I thought there was too much inconsistency in this system.
7.  I would imagine that most people would learn to use this system very
     quickly.
8.  I found the system very cumbersome to use.
9.  I felt very confident using the system.
10.  I needed to learn a lot of things before I could get going with this
     system.
                                                                           Sauro (2011)
                                             http://www.measuringusability.com/sus.php
Processes for Managing Quality in Use:
Usability Maturity Model

•    HCD1 Ensure HCD content in system strategy
•    HCD2 Plan the HCD process
•    HCD3 Specify user and organisational requirements
•    HCD4 Understand and specify the context of use
•    HCD5 Produce design solutions
•    HCD6 Evaluate designs against requirements
•    HCD7 Facilitate human-system implementation
Usability – Assuring Quality in Use


        Marko Nieminen
        Professor of Usability and User Interfaces, D.Sc.(Tech.)
        Aalto University School of Science
        Department of Computer Science and Engineering
        SoberIT - Software Business and Engineering Laboratory

Contenu connexe

Similaire à Pmc usability-testing

Why Remote Research Is (or isn't) Right for your project
Why Remote Research Is (or isn't) Right for your projectWhy Remote Research Is (or isn't) Right for your project
Why Remote Research Is (or isn't) Right for your projectGreenlight Guru
 
Remote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityRemote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityUser Vision
 
User Testing by Alvin Chai
User Testing by Alvin ChaiUser Testing by Alvin Chai
User Testing by Alvin ChaiCHI UX Indonesia
 
Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience UserZoom
 
Four best practices for performance testing mobile apps soasta and utopia
Four best practices for performance testing mobile apps   soasta and utopiaFour best practices for performance testing mobile apps   soasta and utopia
Four best practices for performance testing mobile apps soasta and utopiaSOASTA
 
Ubiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERV
Ubiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERVUbiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERV
Ubiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERVIiro Jantunen
 
Dey alexander usability_training_notes_01
Dey alexander usability_training_notes_01Dey alexander usability_training_notes_01
Dey alexander usability_training_notes_01danamato
 
Best practices for mobile app testing neobric
Best practices for mobile app testing neobricBest practices for mobile app testing neobric
Best practices for mobile app testing neobricNeobric
 
Language learning using augmented reality
Language learning using augmented realityLanguage learning using augmented reality
Language learning using augmented realityAmritanshu Sawarn
 
Unit 3_Evaluation Technique.pptx
Unit 3_Evaluation Technique.pptxUnit 3_Evaluation Technique.pptx
Unit 3_Evaluation Technique.pptxssuser50f868
 
Context detection and effects on behavior
Context detection and effects on behaviorContext detection and effects on behavior
Context detection and effects on behaviorTimo Smura
 
An Introduction To Mobile Software Testing
An Introduction To Mobile Software TestingAn Introduction To Mobile Software Testing
An Introduction To Mobile Software TestingStephen Janaway
 
SUS - ease of use perceptions and eportfoliostfolios Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios  Stephen BrightSUS - ease of use perceptions and eportfoliostfolios  Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios Stephen BrightePortfolios Australia
 
SUS - ease of use perceptions and eportfoliostfolios Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios  Stephen BrightSUS - ease of use perceptions and eportfoliostfolios  Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios Stephen BrightePortfolios Australia
 
Four Best Practices for Modern Performance Testing
Four Best Practices for Modern Performance TestingFour Best Practices for Modern Performance Testing
Four Best Practices for Modern Performance TestingSOASTA
 
Mobile testing practices
Mobile testing practicesMobile testing practices
Mobile testing practicesRakesh Jha
 
Caveon Webinar Series: The Good and Bad of Online Proctoring
Caveon Webinar Series: The Good and Bad of Online ProctoringCaveon Webinar Series: The Good and Bad of Online Proctoring
Caveon Webinar Series: The Good and Bad of Online ProctoringCaveon Test Security
 

Similaire à Pmc usability-testing (20)

Why Remote Research Is (or isn't) Right for your project
Why Remote Research Is (or isn't) Right for your projectWhy Remote Research Is (or isn't) Right for your project
Why Remote Research Is (or isn't) Right for your project
 
Remote usability testing and remote user research for usability
Remote usability testing and remote user research for usabilityRemote usability testing and remote user research for usability
Remote usability testing and remote user research for usability
 
User Testing by Alvin Chai
User Testing by Alvin ChaiUser Testing by Alvin Chai
User Testing by Alvin Chai
 
Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience
 
classmar2.ppt
classmar2.pptclassmar2.ppt
classmar2.ppt
 
Four best practices for performance testing mobile apps soasta and utopia
Four best practices for performance testing mobile apps   soasta and utopiaFour best practices for performance testing mobile apps   soasta and utopia
Four best practices for performance testing mobile apps soasta and utopia
 
Suman_Cv
Suman_CvSuman_Cv
Suman_Cv
 
Ubiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERV
Ubiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERVUbiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERV
Ubiquitous Services and Ethics: MIMOSA, MINAmI, and UBI-SERV
 
Ranjith S
Ranjith SRanjith S
Ranjith S
 
Dey alexander usability_training_notes_01
Dey alexander usability_training_notes_01Dey alexander usability_training_notes_01
Dey alexander usability_training_notes_01
 
Best practices for mobile app testing neobric
Best practices for mobile app testing neobricBest practices for mobile app testing neobric
Best practices for mobile app testing neobric
 
Language learning using augmented reality
Language learning using augmented realityLanguage learning using augmented reality
Language learning using augmented reality
 
Unit 3_Evaluation Technique.pptx
Unit 3_Evaluation Technique.pptxUnit 3_Evaluation Technique.pptx
Unit 3_Evaluation Technique.pptx
 
Context detection and effects on behavior
Context detection and effects on behaviorContext detection and effects on behavior
Context detection and effects on behavior
 
An Introduction To Mobile Software Testing
An Introduction To Mobile Software TestingAn Introduction To Mobile Software Testing
An Introduction To Mobile Software Testing
 
SUS - ease of use perceptions and eportfoliostfolios Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios  Stephen BrightSUS - ease of use perceptions and eportfoliostfolios  Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios Stephen Bright
 
SUS - ease of use perceptions and eportfoliostfolios Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios  Stephen BrightSUS - ease of use perceptions and eportfoliostfolios  Stephen Bright
SUS - ease of use perceptions and eportfoliostfolios Stephen Bright
 
Four Best Practices for Modern Performance Testing
Four Best Practices for Modern Performance TestingFour Best Practices for Modern Performance Testing
Four Best Practices for Modern Performance Testing
 
Mobile testing practices
Mobile testing practicesMobile testing practices
Mobile testing practices
 
Caveon Webinar Series: The Good and Bad of Online Proctoring
Caveon Webinar Series: The Good and Bad of Online ProctoringCaveon Webinar Series: The Good and Bad of Online Proctoring
Caveon Webinar Series: The Good and Bad of Online Proctoring
 

Dernier

08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 

Dernier (20)

08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 

Pmc usability-testing

  • 1. Usability – Assuring Quality in Use Marko Nieminen Professor of Usability and User Interfaces, D.Sc.(Tech.) Aalto University School of Science Department of Computer Science and Engineering SoberIT - Software Business and Engineering Laboratory
  • 2. Test and Testing •  A qualitative or quantitative procedure that consists of determination of one or more characteristics of a given product, process or service according to a specified procedure •  Why testing? For instance, •  Determine if, or verify that, the requirements of a specification, regulation, or contract are met •  Decide if a new product development program is on track: Demonstrate proof of concept •  Validate suitability for end-use
  • 3. Quality in Use – Related to Usability and User Experience The capability of a system to enable specified users to achieve specified goals with effectiveness, productivity, safety, and satisfaction in specified contexts of use.
  • 4. Usability Test: Lab http://www.sigchi.org/chi97/proceedings/overview/tst.htm Usability Lab at Fidelity Investments
  • 6. Scenario: Mobile Ticketing 1 Matti sees Madonna’s concert promotion at bar in Tampere He takes a picture of promotion 2 poster by using his mobile phone Matti logs in to service for buying 3 tickets. Service identifies Madonna’s concert proposition. 4 He buys the concert ticket and travel ticket at the same time 6
  • 7. …and the scenario continues 5 Mikko checks his route and tickets through mobile phone He validates travel ticket by 6 using a mobile phone when he walks in to train at Tampere Mikko decides to stop for one 7 beer and buy it by using mobile phone He validates concert ticket by 8 using mobile phone when he arrives to gate of concert 7
  • 8. Field Tests (Tamminen & Oulasvirta 2005)
  • 9. Testing for ”Quality in Use” Addresses •  Real users •  Real settings •  Real tasks •  Real events •  Real process •  Real details •  Real effects •  Real outcome •  Expected (quantitative) and unexpected (qualitative) issues
  • 10. Usability Metrics: System Usability Scale (SUS) 1.  I think that I would like to use this system frequently. 2.  I found the system unnecessarily complex. 3.  I thought the system was easy to use. 4.  I think that I would need the support of a technical person to be able to use this system. 5.  I found the various functions in this system were well integrated. 6.  I thought there was too much inconsistency in this system. 7.  I would imagine that most people would learn to use this system very quickly. 8.  I found the system very cumbersome to use. 9.  I felt very confident using the system. 10.  I needed to learn a lot of things before I could get going with this system. Sauro (2011) http://www.measuringusability.com/sus.php
  • 11. Processes for Managing Quality in Use: Usability Maturity Model •  HCD1 Ensure HCD content in system strategy •  HCD2 Plan the HCD process •  HCD3 Specify user and organisational requirements •  HCD4 Understand and specify the context of use •  HCD5 Produce design solutions •  HCD6 Evaluate designs against requirements •  HCD7 Facilitate human-system implementation
  • 12. Usability – Assuring Quality in Use Marko Nieminen Professor of Usability and User Interfaces, D.Sc.(Tech.) Aalto University School of Science Department of Computer Science and Engineering SoberIT - Software Business and Engineering Laboratory