Mobile testing can appear to be an impossible task. These slides talk through the aspects that need to be considered.

1. Mobile Testing with
Confidence
Amy Phillips
@itjustbroke

2. • Fragmentation
• Reduced control over versions being used
• Release process can be slow
• Less control over environment (settings, other
apps, etc)
Confidence
ˈkɒnfɪd(ə)ns/
Belief in oneself and
one’s powers or abilities

3. • Fragmentation

4. • Fragmentation

5. Releases can
be slow

6. Reduced Control
• Releases
• Environment

7. PANIC!!!

8. DON’T
PANIC!!!

9. What is Testing?
An empirical, technical, investigation
conducted to provide stakeholders
with information about the quality of
the product or service under test.
- James Bach

10. What is Quality?
“value to some person
who matters”
- Michael Bolton

11. What Makes A Tester?

12. What Are We Trying To Do?
• Have we built the right thing?
• Have we broken stuff that used to
work?
• Have we introduced unintended
behaviour?

13. Test Approach

14. Don’t Test
Develop

15. Test At The End
Develop Test
Bug Fix

16. Develop Test
Bug Fix
Test As We Go
Develop Test

17. Choose The Right Approach
• The right approach is the one that
works for you
• It might change over time
• Do what’s right for your users

18. What To Test?

19. Features
• Do they look right? • Do they work correctly?

20. Memory Usage
• Download size
• Runtime size
• Memory
management

21. Crashes

22. Battery Usage

23. Performance

24. Security

25. Settings

26. Time

27. Orientation

28. Connectivity
• 4G
• 3G
• WIFI
• GPRS
• No Service

29. Accessibility

30. Uninstalling
• Remove all data
• Leave device in
state that allows
re-install

31. Automation

32. Plan Your Testing
• Pick and choose test areas
• Focus on risk
• Monitor coverage

33. Where To Test?

34. Test Device or Emulator?

35. Test Environment
Test
Environment
Live
Environment

36. Test Environment

37. Engage Users

38. Mobile Testing
• Plan your testing in advance
• Focus on risk
• Learn from your mistakes
• Make it easy for the user to
recover from problems

39. Questions?
Amy Phillips
@itjustbroke