The usability test involved 5 participants completing 5 tasks while the researcher measured demographics, task completion rates, time on task, expected and actual difficulty, observations, and overall satisfaction. Key results included that all participants completed the first two tasks but only 3 completed the third task fully. Time on task varied significantly between tasks. Participants found some tasks more difficult to complete than others. Overall satisfaction was mixed but navigation and terminology clarity received more positive than negative feedback.

1. Usability testing
Analyzing and reporting data

2. Identify users/audiences
Understand user needs & goals
Requirements
Analysis
Understand client needs & goals
R e s e a r c h
Technical requirements & limitations
Conceptual Research previous versions
Design
Research competition
Mockups & Use cases
Prototypes
Task analysis
Information architecture
Production
Mockup generation
Mockup evaluation
Launch Production
Quality assurance
User problem tracking

3. Assuming 5 users & the following measures:
1. Demographics, background
2. Task completion
3. Time on task
4. Expected difficulty
5. Actual difficulty
6. Observations
7. Overall satisfaction

4. 1. Demographics, background
3
2.25
40% 1.5
60%
0.75
0
Male Female
Male
Female

5. Graduate (G1)
M
30
Senior
Electrical and Computer Engineering

6. Participants Info.
4 Grad students (male)
1 Faculty member (female)
Who
Mechanical Eng.
Material Eng.
Electrical & Computer Eng.
How often Once a week (average)
Age 27.2 years old (average)
Range: 20~40

7. Participants Info. (Cont’d)
Total length of usage Time spent per Log-in
4 5
4
3
2.5
Hour(s)
Year(s)
3
2
2
1.7
1
1
0 0
P1 P2 P3 P4 P5 AVE P1 P2 P3 P4 P5 AVE
Participant # Participant #

8. 1. Demographics, background
Which presentation mode
did you like best?

9. 1. Demographics, background
Which presentation mode
did you like best?
Show & Tell:
Recognition rather than Recall

10. 1 2
40%
60%
3 Participants Info. 4 Participants Info. (Cont’d)
Total length of usage Time spent per Log-in
4 Grad students (male) 5
4
1 Faculty member (female)
Who 3
4
Mechanical Eng. 2.5
Material Eng.
Hour(s)
Year(s)
3
Electrical & Computer Eng. 2
2
1.7
How often Once a week (average) 1
1
0
27.2 years old (average)
0
Age
P1 P2 P3 P4 P5 AVE P1 P2 P3 P4 P5 AVE
Participant # Participant #
Range: 20~40

11. 1. Demographics, background
Which presentation mode
did you like best?

12. 1. Demographics, background
Which presentation mode
did you like best?
Because of small number of
users, present both
averages and individual
data.

13. 2. Task completion
5 users -- 5 tasks
• All 5 users completed tasks 1 and 2
• 3 users completed task 3; 1 partial
completion, 1 incomplete
• 3 users completed task 4; 2 partial
completions
• 2 users completed, 3 partial completions

15. 3. Time on task
5 users -- 5 tasks
T1 T2 T3 T4 T5
U1
U2
U3
U4
U5

16. 3. Time on task
5 users -- 5 tasks
T1 T2 T3 T4 T5
U1
U2
Average per user
U3 OR
Average per task?
U4
U5

17. Which task was more difficult to complete?
Mean Time-on-Task (95%CI)
270!
240!
210!
203!
180!
150!
Time(sec)
120!
90!
75!
66!
60!
49!
30! 25!
0!
Task#1! Task#2! Task#3! Task#4! Task#5!

18. Is this graph useful? Why?

19. 4. Expected difficulty and 5. Actual difficulty
• Per task?
• Average across tasks?

20. 4. Expected difficulty and 5. Actual difficulty
• Per task?
• Average across tasks?

21. 4. Expected difficulty and 5. Actual difficulty

22. 6. Observations
• What do you think would be important to
report?
• How?

23. 7. Overall satisfaction

24. Overall “barometer”
# of Participants
0 1 2 3 4 5
Search
1 1 3
Feature
Ease of
4 1
Navigation
Terminology
3 2
Clarity
Organization
3 2
Clarity
Satisfied Neutral Disatisfied

25. Meaningful, Easy to read & Understand
1. Demographics, background
2. Task completion
3. Time on task
4. Expected difficulty
5. Actual difficulty
6. Observations
7. Overall satisfaction