Kaspar Loog - Testers tired eyes

1. Testers’ tired eyes
Kaspar Loog

2. Speaker info
Kaspar Loog, Estonia
Founder of Browserbite
Sr Project Manager, Danske Bank
• Testing industry since 2007
• Different lead roles in QA
• Chair of Nordic Testing Days
/in/kasparloo
g

3. Do you remember a website?
• Does NOT work on your iPad?
• Does NOT work on your Safari?
• Does NOT work on Internet Explorer 8? ;)

4. Internet Explorer 9

5. Where’s that
button?
Internet Explorer 8

6. Seedcamp.com
missed 20% of market!

7. Launch of iPad: Resolutionary?

8. Let’s do some math!
• Operating systems
– Versions
• Devices
– Variations
– Firmware versions
• Resolutions
– Orientation
– Pixel scaling
• Browsers
– Versions
• iOS, Win, Mac OS, Linux
– 10.0, 10.1, 10.2, 10.3,. 10.4
• iPhone 7
– Ordinary + Plus version
• 750 x 1334
– 750 x 1334, 750 x 1334
– Normal, Large
• Safari, Chrome
– Oh my god!!??

9. 6 ways that browsers cheat you
• Gradients
• Dithering
• Antialiasing
• Javascript/DOM interpretation differences
• Resolution differences
• Code „enhancment“
• Evergreen versions

10. Gradients, dithering, antialias

11. Javascript, DOM, HTML5

12. Resolution differences

13. Your brain fools you

14. People see „blocks“ not HTML

15. Font differences

16. Wrapping
• Big text  affects visual layout
–  PROBLEM
• vs
• Small text  affects visual layout
–  NO PROBLEM (usually)

18. People fail at testing visual differences
1 tester out of 3 finds the actual issues
Layout testers are about 2x better than „average“ testers

19. Cross browser testing & Computer
Vision
URL
Compare
Process
Capture
Report

20. Man vs machine – issues found
0,0%
10,0%
20,0%
30,0%
40,0%
50,0%
60,0%
70,0%
80,0%
90,0%
100,0%
Position Visual Total
browserbite
Reference group
Average tester
Tool + one tester

21. False positives & negatives
0,0%
5,0%
10,0%
15,0%
20,0%
25,0%
30,0%
35,0%
40,0%
45,0%
50,0%
False positive False negative
browserbite
Reference group
Average tester

22. Speed, performance, volume
Metric Average tester Automated
Browsers covered 2 13
URL-s tested 50 50
Time spent (minutes) 150 13

23. Summary
• Layout testing = money in the bank
• Browser vendors have very different implementations of
standards
• Humans make lousy testers
• Best practical combination: human-computer-human

24. Questions
5 minutes.
You can also ask questions from me in the lounge zone