Test Strategy 101 for Mobile

1. Enough is not enough
Test Strategy for Mobile
Jatin Bhasin
@jatin_bhasin

2. Who am I ?
! Tester
! Agilist
! Learner
! Traveller
! ThoughtWorker

3. What is Test Strategy ?

4. Definition
A test strategy is an outline that
describes the testing approach of
the software development cycle.
It is created to inform project
managers, testers, and developers
about some key issues of the
testing process.

5. Test Strategy
! Scope
! Roles and Responsibilities
! Environment
! Testing Tools
! Risks and Mitigation
! Schedule
! Priorities
! and more…

6. Why all the buzz about Mobile?

7. Did you know?
(Source: Mobile Marketing Association Asia)
World Population ~ 7 Billion
Toothbrushes
~ 4.2 Billion
Cell Phones
~ 5.1 Billion

8. Yes, that’s true!
! Smartphone usage grew by 50% from 2011 to 2012
! 91% of Americans have their mobile device within reach 24x7
! This year, mobile phones will surpass PCs as the primary means of
accessing the internet
! In 2011, Apple sold 48m mobile devices
V/S 4.9m desktops/laptops.
! Only 20% of businesses have invested in a mobile solution
(Source: various)

9. Types of Mobile apps
Native Hybrid Mobile Web

10. Big challenges on small devices
! Environment
! Application
! Users
! Devices
! Network
! Automation

11. Environment
! Frequent OS changes
! Domain Constraints

12. Application
! Native/web/hybrid Apps
! Behavior on different devices
! Tech stack differs for each OS
! Comparison with web counterparts

13. Users
! Intuitive UI
! Accommodating
maximum functionality

14. Devices
! Browser limitations
! Touch and non-touch devices
! Memory Constraints
! Battery Drainage
! Keypad lock

15. Network
! Sans network
! Offline support
! Wi-Fi
! Interruptions

16. Automation
! Device OS specific tools
! Testing across platforms
! Who will do it?

17. Test thy app
! Physical Device
! Simulators
! Testing in the ‘Cloud’
! Crowd Source testing
! Automation

18. Physical Devices
! Benefits
! Challenges

19. Simulators
! Benefits
! Challenges

20. Testing in the ‘cloud’
! Benefits
! Challenges
! Examples
! Device Anywhere
! Perfecto Mobile
! Testdroid

21. Crowd Source testing
! Benefits
! Challenges
! Examples
! Mob4Hire
! uTest
! Testcovery

22. Automation - Android
! Robotium
! Bot-Bot
! Monkeyrunner
! DroidPilot
! AndroidDriver
(Selenium/WebDriver)

23. Automation - iOS
! Frank
! KIF (Keep It Functional)
! UIAutomation
! Zucchini

24. Automation - cross platform
! Appium
! Calabash
! NativeDriver
! And many more…

25. Types of testing
! Usability
! Performance
! Security
! Interface Testing
! Services Testing
! Low level resource testing
! Compatibility
! Operational

26. Usability Testing
! Ease of use
! Single handed use
! How intuitive is it

27. Performance Testing
! Need for speed
! Get real
! Business impact
! 3rd party integrations
! Performance tuning

28. Security Testing
! Penetration test
! Vulnerability Assessment
! Encryption

29. Mobile means faster feedback!
! User Ratings

30. Forget me not !
! Budget
! Time to market
! Target users

31. Recap
Challenges in Mobile Testing
Test thy app
Devices
Application UsersEnvironment
Network Automation
Automation
Tools
Testing in Cloud
Physical device Simulators
Testing Types
#2
#3
#4
#1
Crowdsourcing
Performance Usability
Security
Cross-platform
iOS
Android

32. Questions