15. QA Mobile Accuracy
Expert Assessment vs QA Assessments
Responsive Accuracy: 9%
Native Mobile Accuracy: 15%
Ouch!
16. Challenges
– Client and QA Team
Didn’t Recognize A11Y
Complexity
– Mixed Resource
Expertise without
Training
– Duplication of Effort
– Consistency
– Accuracy
18. Trinity A11Y 101 Training Program
• Deque Way > A11Y Assessments
– 66 specific checkpoints for WCAG 2.0 A & AA
• Issue Description Library
• Training / Mentoring (Deque U)
• Reimagining the Mixed Resource AVT Process
19. Deque Way > A11Y Assessments
• Currently in Excel Spreadsheet
• For each page tested, there are 66 mental checkpoints
(to cover all of WCAG 2.0 A and AA)
• Broad Success Criteria are broken down into specific
items to test for (example, 1.1.1 and 1.3.1 are very
broad success criteria, you can’t expect a newly trained
person to remember all 8 types of image concepts to
check for when testing for 1.1.1 without guidance)
• Links to the W3C Success Criteria – The Truth
• Links to Deque Way Checkpoint Testing Methodology
– Includes if sight is required
– Suggestions for tools to use for testing
– Acceptance Criteria for passing this checkpoint
20. Example of Issue Description Library
• WCAG SC: 1.1.1 Non-Text Content
• Deque Checkpoint: 1.1.1.a – Alternative Text (Active Images)
• Deque Checkpoint Requirement: All linked images have
descriptive alternative text (alt attribute value, title attribute
value, aria-label property or aria-labelledby property) that
serves the same purpose and presents the same information
as the linked image.
• Issue Descriptions:
– The alternative text for @element is missing.
– The alternative text for @element is not appropriate or
meaningful.
– …
21. Proposed AVT Process
• AVT with Mixed Resources:
• AVT1 (Concrete) done by QA person 1
• AVT2 (Conceptual) done by Expert person A
• AVT Final done by Expert person A
AVT1: Concrete (Auto/Manual/AT)
AVT2: Conceptual (Auto/Manual/AT)
AVT Final
ExpertA
QA1
ExpertA
22. Deque Way Checkpoints
Concrete vs. Conceptual
Concrete (Auto/Manual/AT)
– 3.1.1 Default Page Language
Conceptual (Auto/Manual/AT)
– 1.3.2 Meaningful Sequence
25. The Experiment
• Jeanine Lineback
Assistive Tech User
A11Y Expert
• Jeff Miller
Software Engineer
A11Y Novice
26. • Jeanine
– Power Screen Reader User
– Wcag 2.0 Interpretation
• Jeff
– Software Developer
– Sighted Assistance
– Accessibility Testing Tools
Strengths Going In
Jeanine Jeff
Power Screen Reader User Software Developer
WCAG 2.0 Interpretation Sighted Assistance
Accessibility Testing Tools
27. • Jeanine
– Visual Descripton of User Interface
– Access to source code
– Tool requests and installation
– Orientation with Tool Layouts
• Jeff
– Assistive Technology Functionality
– Accessibility Standards Application
– Conceptual Success Criteria
Rapid Learning Curve Perks
Jeanine Jeff
Visual description of User Interface Assistive Technology functionality
Access to source code Accessibility standards application
Tool requests and installation Conceptual success criteria
Orientation with tool layouts
28. • Jeanine
– Use of tools with a11y limitations
– Explanation of screen reader issues
– Description of WCAG violations
– HTML, JavaScript and ARIA knowledge
• Jeff
– Screen Reader Proficiency
– Perpsective on practical user experinces
– Remediation beyond identification
Strengths Gained
Jeanine Jeff
Use of tools with A11Y limitations Screen reader proficiency
Explanation of screen reader issues Perspective on practical user experiences
Description of WCAG violations Remediation beyond identification
HTML, JavaScript, and ARIA knowledge
34. • Triangle divided into 3 layers
• Bottom/largest layer = Accessible by Design
(scope, design, deve, qa)
• Middle layer = A11Y Knowledge in All Roles
• Top/Smallest layer = QA A11y
• Star image to left of triangle with text inside that
reads “A11Y Experts”
• Star image to right of triangle with text inside
that reads A!!Y Knowledge Repository
Effective/Efficient A11Y for mega.com
QA
A11Y
A11Y Knowledge
in All Roles
Accessible by Design
(scope, design, dev, qa)
A11Y
Knowledge
Repository
A11Y
Experts
Maximizing Strengths: Efficient & Effective A11y Testing
What is your super power?
Expert a11y testing takes time. We’ve conducted research on using a11y expert brains wisely & more efficiently while simultaneously nurturing the next generation of experts.
Now, let’s have our presenter introductions. I’m Glenda the Goodwitch Sims. I’m lead of Team A11y at Deque.
What do you think worked well? What do you think didn’t work well?
Pricing Pressure exists.
We must position the value.
ALWAYS go for strategy . ALWAYS go for training.. ALWAYS go for the Hard Stuff.
OUR METHODOLOGY, OUR TRAINING, and where Possible OUR TOOLS.
DO it right the first time, do it efficient.
FALSE Positives = Developer Time
Self-Sufficient Accessibility
45% of WCAG 2.0 A and AA Success Criteria require some sighted assistance.
What happens when there is no one to pair with. If you are the only person doing A11Y.
How do you use resources pragmatically?
Jeanine’s Knowbility Experience
Glenda’s early days at UT
While you may be alone in your org, you are not alone in the battle for accessibility. Reach out to your community. Find a mentor. Go to locale meet-ups and conferences to get inspired, re-energized and stronger/smarter.
So, how do we achieve incredible a11y. We need to know our strengths, and we need to stop trying to do everything by ourselves. We need top open doors into our field and mentor the next geration.
