1. NCSU Libraries Rapid user testing with prototypes TRLN Annual Meeting – July 2010 Susan Teague Rector & Angie Ballard 1
2. What we tested Do users navigate using the expected menu items? Do users pre-select tabs in a tabbed search box before entering search terms? How do users interact with tabbed or non-tabbed search results? 2
3. Methodology Users were recruited in situ in the library lobby Navigation Testing Search Box Testing Users were asked to complete 4 of 15 tasks using a working prototype of navigation menus only. Each task required the user to open a navigation menu and indicate which menu item they would select to look for the specified information. Facilitators recorded up to 4 of each user’s menu selections, in order of selection. 3 Each participant completed 2 tasks using one of the 2 search models; many participants volunteered to answer more than 2 questions. Facilitators documented tab the participant initially selected search term(s) used path taken to complete the task, whether the participant used the default ‘All’ tab only, silos only or both. A facilitator assessment of task difficulty was recorded for both tests
4. Test Setup 4 Used candy bars as incentives 2 laptops with browsers open to prototype Cycled through 15 tasks; 2-4 tasks per user in five minute sessions D. H. Hill Lobby
5. Response Rate Total of 32 participants in 2 hours 24 Undergraduates 3 Graduates 2 Staff 1 Visitor 2 Library Staff Members Total of 28 participants in 4 hours 22 Undergraduates 3 Graduates 2 Library Staff Members 1 Non-Traditional Student Navigation Testing Search Box Testing 5
6. Take Aways Rapid testing: Yields more feedback in less time. Best for testing specific features. Tests should last no more than 5 minutes. Saves resources for recruiting, scheduling, logistics, testing, and compensation. Does not save research planning & analysis time. 6
7. Take Aways Informal test environment may mean more realistic user interactions with product. Results are somewhat skewed toward users who use the physical space. Should be balanced with results from other types of testing. Helps uncover areas for further testing. 7
8. Results & full presentation http://news.lib.ncsu.edu/redesign/2010/04/22/usability-testing/ 8
