Usability Test Results Analysis

SOLRpac Usability Test Results Analysis 

Question 1:

You need to read The Sound and the Fury by William Faulkner for a literature course and you
don't want to buy the book. Does the library own it and is it available in King Library?

Completed: 14
Not completed: 0
Average time: 32 seconds

Methods Utilized:

Title search: 12, 75%
Keyword search: 3, 19%
Author search: 1, 6%

Comments:

concern that King library was lower on the list than Hamilton and others
should have done a title search
quot;this one is easier to readquot; - comparing the item location display with classic view

Question 1a:

Where is it located?

Completed: 14
Not completed: 0

Methods Utilized:

Browse page: 14, 100%

Comments:

didn't scroll down to see if it was available from other libraries

Question 1b:

You want to go get the book but there's no paper around to write down the location. The
system has a feature that texts book and location information to your cell phone. How
would you do that?

Completed: 13
Not completed: 1

Methods Utilized:

Browse page: 12; 86%
Advanced search options: 1; 7%
Request item: 1, 7%

Comments:

quot;that's really good. I hate when I write it down and later I look at it and say I don't know
what this is..quot;
quot;Hm. Very cool.quot;
quot;That is really nice, I could definitely see a lot of use for that.quot;
quot;I really like that a lotquot;
quot;Super usefulquot;
quot;This would be the last thing I would attempt to do.quot;

Question 2:

You need to get some other novels written by William Faulkner, author of The Sound and the
Fury. Show me how you would do that.

Completed: 13
Not completed: 1
Average time: 1:06 minutes

Methods Utilized:

Author search: 9; 64%
Keyword search: 2; 14%
Incorrect use of facets: 2; 14%
Author link: 1; 7%

Comments:

she thought there was a better way to do search but couldn't figure it out - 1-03
quot;okay, not clickablequot; referring to author's name
quot;there's no a start over, is there?quot;
quot;it'd be really nice if i could just click his name.quot;
quot;there might be an author thing here...i guess notquot; - referring to facets sidebar

Question 2a:

After you've found some books, you want to save them somehow so you can get back to
them easily. Tag the items quot;ENG 142quot; so you can find them later.

Completed: 13
Not completed: 1

Methods Utilized:

Browse page: 13; 100%

Comments:

didn't notice button status change...
didn't understand question / didn't understand concept of tagging
quot;oh...that's really cool too.quot;

Question 3:

This literature course requires you to write a paper about Faulkner and his writings. You
need to find some books written about William Faulkner. How would you do that?

Completed: 11
Not completed: 1

Methods Utilized:

Subject search: 11; 92%
Keyword search: 1; 8 %

Comments:

with reference to facet: quot;very fancyquot;
user said they'd like to see a description of item...such as an abstract..
liked the google books link
quot;is there a search within results?quot;
used google books link

Question 3a:

Can you find books in this set of results that are about quot;Yoknapatawpha Countyquot;?

Completed: 10
Not completed: 4

Methods Utilized:

Correct use of facets: 6; 29%
Ctrl-f: 1; 5%

Comments:

quot;there should be a way to search within thisquot;
quot;is there a way to search through these resultsquot;
quot;is there a search within results?quot;
quot;i don't know how you would do that..search within the search.quot;

Question 4:

You are writing a paper on aspects of economic recessions for an Econonomics course. Can
you find some available books on this subject?

Completed: 14
Not completed: 0

Methods Utilized:


Comments:

User said they are used to a quot;start overquot; link

Question 4a:

Where are they located?

Completed: 14
Not completed: 0

Methods Utilized:

Browse record: 14; 100%

Comments:

-

Question 4b:

You need to compile a bibliography for the paper. Can you export one of the books to your
RefWorks account?

Completed: 12
Not completed: 0

Methods Utilized:


Comments:

don't have refworks account

Question 4c:

If you don't have a RefWorks account, can you figure out how to get the citation for your
bibliography?

Completed: 11
Not completed: 2

Methods Utilized:

Mark this record: 1; 9%

Comments:

quot;if i don't have it then usually i use some other citation machinequot;
quot;like this a lotquot;
user said would just do it the traditional way typically
quot;that's pretty sweet.quot;

Question 5:

You are taking a history course and your instructor wants you to read articles from his
favorite journal, The Public Historian. Does the library own this journal?

Completed: 13
Not completed: 1

Methods Utilized:

Title search: 12; 42%
Looked for journal title option: 7; 25%

Comments:

looking for quot;journal titlequot; in drop box
quot;that's pretty coolquot; referring to browse by format

Question 5a:

Where is it located?

Completed: 13
Not completed: 1

Methods Utilized:


Comments:

didn't know what quot;king perquot; meant

Question 6:

You're taking a high level French course which requires you to read and report on any
fiction book written in French. How would you find this item?

Completed: 11
Not completed: 3

Methods Utilized:

Browse and facets: 6; 35%
quot;french fictionquot; keyword search: 4; 23%

quot;french fictionquot; subject search: 4; 23%
Search and facets: 2; 12%
french keyword search: 1; 6%

Comments:

quot;usually i just walk over to sectionquot;
quot;this one has me stumpedquot;

Usability Test Results Analysis

Recommandé

Recommandé

Contenu connexe

Similaire à Usability Test Results Analysis

Similaire à Usability Test Results Analysis (7)

Dernier

Dernier (20)

Usability Test Results Analysis