Presentation given by Jonathan Hassell (Accessibility Editor, Digital Curriculum for BBC New Media) and Giles Colborne (Director, cx partners) at BSI accessibility event in 2005.
Covers: what are 'reasonable steps' to ensure your site is accessible; comparison of 'blind following of standards & conformance badges' approach to accessibility with user-centred design (based on ISO 9421-12 standards for measuring usability and ISO 13407 user-centred design process); comparison of cost-benefits of various usability & accessibility testing methods to assure your site meets your users' needs.
How to Troubleshoot Apps for the Modern Connected Worker
2005: Accessibility: which site production standards and testing methods will give maximum return on investment
1. What standards do you need to meet for your
site to be accessible?
Which methods will give maximum ROI?
Dr Jonathan Hassell Giles Colborne
Accessibility Editor, Digital Curriculum Director,cxpartners
BBC New Media President,UK UPA
Presentation to
BSI Accessibility conference
12/11/2011 11/12/2011 7/7/05 v0.19
jonathan.hassell@bbc.co.uk
18. ISO 9421-12: Measuring usability
Satisfaction Effectiveness
Efficiency
Identify key tasks
Identify key disabled audiences
How well can your disabled users complete tasks on your web site?
19. ISO 9421-12: Measuring usability
Effectiveness
Satisfaction
Efficiency
How often can disabled users complete each task?
- Task completion rate
How well can they complete each task?
- Degree of completion
- Error rates
20. ISO 9421-12: Measuring usability
Satisfaction Effectiveness
Efficiency
How much effort does it take to complete each task?
- Number of keystrokes / clicks
- Time taken
- Pauses
21. ISO 9421-12: Measuring usability
Satisfaction
Effectiveness
Efficiency
Is user satisfied with the experience
- What is an appropriate experience?
- Different for education, banking, buying CDs, entertainment
- Does the experience fit with your brand values?
- Perceived efficiency
- Perceived effectiveness
22. ISO 9421-12: Measuring usability
Effectiveness
Satisfaction
Efficiency
Different systems need a different balance of these elements
Web sites are often self-service
Effectiveness and satisfaction dominate measures of web site usability
23. ISO 9421-12: Measuring usability
Effectiveness
Satisfaction
Efficiency
But for disabled users, efficiency becomes a massive problem
Improving accessibility can be about improving efficiency for disabled
users
24. ISO 9421-12: Measuring usability
45
40
35
30
25
20
15
10
5
0
Effectiveness Efficiency Satisfaction
Measures are only meaningful when you compare them
So measure at least twice
For instance
- Proposed site versus competitors
- Proposed site versus current site
25. Usability testing methods
Quality of data
User testing
Remote testing
User reviews / interviews
Expert walkthrough
Heuristics
Testing with assistive technologies
Automated testing
Cost
26. ISO 13407: The user centred design process
Plan user
Produce
centred
prototype Success!
design
s
activities
Test
Specify solutions
goals with
users
Specify
context
of use
27. Can you really test wireframes?
Exterior
Menu for exterior features -
link to other zones
Drag the mouse to spin the car.
Labels zoom forward and back
Feature 1 Click on label to explore
Feature 2
feature
Click on action nav to order
brochure
Performance
Image of car
Interior
360 spin
Feature 3
AcmeCar jingle
Test drive | Brochure | Downloads Acme
None
28. Can you really test wireframes
Main nav
Sub nav (features)
Call to action
Feature 1
Feature 2
Main nav
Interior
Exterior
Performance
Performance
Content Main content
Sub nav
Interior
Feature 1 Logo
Feature 2
Feature 3
Feature 3
Test drive | Brochure | Downloads AcmeCar
Logo
Call to action