1. Usability Testing : XEROX
PrintBack
Brianna Slutsky
Master of Science, Applied Experimental & Engineering
Psychology at RIT
Nicholas Iuliucci
Master of Science, Applied Experimental & Engineering
Psychology at RIT
Anushri Thanedar
Master of Science, Human Computer Interaction at RIT
Erroyl Rolle
Master of Science, Human Computer Interaction at RIT
Sunday, May 27, 12
2. Agenda
1. What is the product
2. Target Audience
3. Evaluation Goals
4. How we ran the test
5. Methods and Procedures
(How we set it up)
a. Setup
b. Actual test
6. Findings Data Analysis
a. Qualitative data
b. Quantitative data
c. Recommendation
Sunday, May 27, 12
3. PRODUCT
• XEROX PrintBack
• Client: XEROX
•What is PrintBack: “ A Mobile Printing Solution”
Sunday, May 27, 12
5. BENEFITS TO THE USERS
• Print Intelligent, Go Mobile
• No more wait, print anywhere, anytime
• Print Document and Photos
• Un-compromised print quality
Sunday, May 27, 12
7. TESTING GOALS
• Test PrintBack app & installation on IOS device
• Test PrintBack app & installation on Android device
• Test PrintBack installation on Windows 7 PC
• Test PrintBack installation on Mac OS
Sunday, May 27, 12
8. CLIENT FOCUS
• Setup and installation on the phone and computer
A. Windows7 + iPhone preferred combination
• Ease of downloading PrintBack
• Printing from Dropbox and email
• Saving Documents On computer/phone
Sunday, May 27, 12
9. PLATFORM
Users Platform
User 1 PC-Android
User 2 Mac-iPhone
User 3 PC-Android
User 4 PC-iPhone
User 5 Mac-Android
User 6 PC-iPhone
Sunday, May 27, 12
19. TEST PROCEDURES
• Participant greeted
• Download PrintBack on the Computer
• Download PrintBack on the Smartphone
A. Recorded using Camtasia, USB Webcams and mobile sled
• Take a picture and save it to the “Print Using” location
• Print a PDF, from a mobile device
Sunday, May 27, 12
20. TESTING TASKS
1.Pre-Test Survey
2.Task 1(Download PrintBack from the company website on computer)
• Post-Test Survey
3.Task 2 (Find and Download PrintBack App on Mobile Phone)
• Post-Test Survey
4.Tasks 3 + 4 Printing and Saving
• Post-Test Survey
5.Interview and Debriefing
Sunday, May 27, 12
22. QUALITATIVE RESULTS
• Computer Installation:
• "Make the download easier to find."
• "On the page that talked about print back drivers and
installers a bolded download PrintBack link perhaps."
• "I was a little confused what to do once you installed the
program."
Sunday, May 27, 12
23. QUALITATIVE RESULTS
• Mobile Installation:
• "Once I realized that the app was not already downloaded, I
downloaded it from the app store it became very easy to
install and use."
• “The mobile print idea is great, but it has to print from any
printer. I get lost, I am not a phone tech person.”
Sunday, May 27, 12
24. QUANTITATIVE RESULTS
3
2
1
Mobile Overall
How would you rate your overall experience of
installing PrintBack on your mobile device?
somewhat poor
very enjoyable
acceptable
Sunday, May 27, 12
25. QUANTITATIVE RESULTS
1
5
Mobile Installing
(1=Very Poor to 5=Easy-to-Use)
very easy-to-use
easy-to-use
Sunday, May 27, 12
26. QUANTITATIVE RESULTS
4
2
Mobile Setting-Up
(1=Very Poor to 5=Easy-to-Use)
easy-to-use
very easy-to-use
Sunday, May 27, 12
27. MOBILE FEEDBACK
users Do you have any suggestions for the future of this system?
User 2 Once I realized that the app was not already downloaded, I downloaded it from the
app store it became very easy to install and use.
User 5 I like it. It didn't seem as complicated as some apps I've worked with... I guess it was
so easy that I thought I must have missed something.
User 6 Not sure how I link it to my printer exactly...
I wish that was more explicit
Sunday, May 27, 12
28. QUANTITATIVE RESULTS
2
3
2
Computer overall
How would you rate your overall
experience using this system?
somewhat poor
acceptable
neutral
Sunday, May 27, 12
29. QUANTITATIVE RESULTS
2
3
Computer Installing
(1=Very Poor to 5=Easy-to-Use)
very easy-to-use easy-to-use
NOTE: user 6 website
connection lost
Sunday, May 27, 12
30. COMPUTER FEEDBACK
users Do you have any suggestions for the future of this system?
User 1 Make the download easier to find.
User 2 I was a little confused what to do once you installed the program.
User 3 On the page that talked about PrintBack drivers and installers a bolded download
PrintBack link perhaps.
User 4 Couldn't find the xerox PrintBack download button without having to search for it on
the site. A few questions I was unsure of the answers to make the correct selections.
User 5 If the program could install right to my application folder... or give me a save as function.
User 6
The link to the download page was not working, therefore I could not complete the full
task. It was very easy to find the download, but the link to download it was broken.
Hence, I don't know that I can answer most of this survey meaningfully.
Sunday, May 27, 12
31. PRINTING & SAVING
• Saving: “poor” or “somewhat poor” ease-of-use, and overall
experience was “very difficult”
• Printing from Mobile: majority said it was at least “somewhat
difficult” in terms of usage and all said the experience was
“somewhat poor”
Sunday, May 27, 12
32. RECOMMENDATIONS
• Make use of more naturalistic wording
• Explain why users should make use of PrintBack for saving
• Further develop user interface for PC to increase system
status visibility and feedback
• Increase clarity of system model
• Increase error prevention
Sunday, May 27, 12
33. BUG ON THE MAC
information
overlap the link
to dropbox is
hidden
Sunday, May 27, 12
34. PROFESSIONAL
RECOMMENDATIONS
• Use less text, wherever possible
• More feedback across steps
• Increase visibility of system status
• Increase clarity of setup process for associated programs
Sunday, May 27, 12
