Recent Microsoft studies have demonstrated not everyone gets automated testing right; many enterprises still lack the know-how to achieve optimum results. Join our upcoming webinar on 5 Keys to your best Automated Testing Strategy. In this webinar, we will cover: Avoiding the Automation ‘Gotchas’ Visualizing end-to-end performance Predicting and solving performance issues …along with a live demo of SOASTA’s Mobile Functional Test with integrated device performance metrics.

1. Welcome.
5 Keys to Your Best
Automated Testing
Strategy
November 18th, 2015
We will start at 10:02pm PT

2. Propelics creates mobile strategies and
world-class Apps for the Enterprise.
Propelics: Background
• 15+ year track record
• Founded in 2011
• Fortune 500 focus
• Global delivery experience
Trusted by some of the largest global brands:
• 100% focused on digital and
mobile for the Enterprise
• San Jose, Boston, Pittsburgh,
Guadalajara
2

3. © 2015 SOASTA. All rights reserved. 3
November 18, 2015
Delivering Performance for Industry Leaders
Media &
EntertainmentConsumerFinancial Hi-Tech GlobalRetail

4. Shahab Choudhry: Partner - Propelics
Shahab is a visionary thought
leader who has been at the
forefront of trying to make sense
of the various technology shifts in
the past two decades.
He has advised several startups,
early stage companies and
Fortune 500 companies in making
the most of these technology
shifts. He continues to be a
“Trusted Advisor” to some of the
leading brands around the world.
Shahab is frequent speaker at
conferences related to mobile.
4

5. Tom Chavez– SOASTA Product Evangelist
5
Tom Chavez has more than twenty
years of experience as a manager and
product manager in the software
development tools field. Today Tom
works in product management at
SOASTA, the leader in performance
analytics. He has worked across the
Silicon Valley at industry leaders
including Apple, Sun, PalmSource, and
Intuit delivering tools for Mac, Java,
PalmOS, Linux and Android
development and testing. He speaks
frequently at industry conferences and
meet-ups. Follow Tom on twitter
@TomChavez

6. Q:
What are the key
considerations for
my Mobile Testing
Automation
Strategy?
6

7. The mobile testing
reality…
7

8. Reality #1:
QA and Testing have an Impact on
Customer Value, End-User Experience and
Customer Satisfaction
76% of the executives interviewed saying it is
important or very important
8

9. Reality #2:
The Unforgiving User
Quick to download - Quick to delete
74% of downloaded apps are opened only once
40% of apps are deleted after first use
Average expected wait time for a app to launch is 2 sec
Top reason for deleting apps – app crashed
Enterprise Expectation = Consumer Experience
Gift of Consumerization
9

10. Reality #3:
Mobile is playing a more integral role
More and more from Apps
10
Flurry Analytics

11. Reality #4:
35% of the QA and Testing budget for new
development is spent on mobile
11
World Quality Report 2015 - 2016

12. Reality #5:
Mobile is different – Hard to keep up and it
is not getting any easier
12
World Quality Report 2015 - 2016

13. 5 Keys to Your Best
Automated Testing
Strategy

14. 1. Don’t try to
Automate everything

15. 1. Don’t try to Automate everything
15
• Know when and what to automate
• Core Test Cases
• Low rate of change – mature functionality and UX
• Repetitive/Mundane – Testing Fatigue and Human Error
• Some test cases can only be tested in non-automated ways
• Not all apps in your portfolio are good candidates for
automation
• Apps that have a high impact
• Large User Base
• Multiple devices

16. Mobile App Portfolio – App Assessment Framework
16

17. Mobile App Testing Automaton Roadmap
17

18. Mobile Testing Automaton Roadmap - Ranking
18
Business Criticality (H,M,L)
Core/frequently used functionality, Security/data
breach/privacy/legal, Dependence on 3rd Party
data or technology, User experience impact
Value of Automation (H,M,L)
Increases quality, Reduces resource load, High
volume/Repetitive/Data driven, Feature life-span,
Smoke test/Build verification
Automation Readiness (H,M,L)
Test Script Complexity, Stable Functionality,
Measurable results, Recordable actions, Explicit
list of observable steps, Test Script
Maintainability
Ease of Automation (H,M,L)
Data or logic driven, Object level user interface,
Known expected results around user experience,
Clear acceptance criteria per test case, Minimal
performance issues interacting with external end
points or services

19. 2. Understand the
impact of the “New
Math”

20. 20
Mobile Testing: The Complexity Equation
# of supported devices
# of supported OSes
OS updates per year
Number of Apps
# of test cases per app
App release frequency
The “I can barely keep up” syndrome
X

21. 3. Automation is not
an “Instant Fix”

23. 4. Take the time to
Design the
Regression Suite

24. 4. Take the time to Design the Regression Suite
• Spend time to analyze each app, user stories and test
cases
• Look for re-usable elements
• Design the regression suite with components that
when updated can be inherited by other test cases
• Starting to “record” scripts without a plan can lead to
rework later.

25. 5. Use a Mobile
Specific Automation
Platform

26. 5. Use a Mobile Specific Automation Platform
• Support of mobile device specific functionality
• Accommodate device types
• Ease of use – Minimal requirement for programming
languages to record scripts

27. 1. Don’t try to automate everything
2. Understand the impact of the “New Math”
3. Automation is not an “Instant fix”
4. Take the time to design the Regression Suite
5. Use a mobile specific automation platform
5 Keys to Your Best Automated Testing
Strategy

28. SOASTA TouchTest
Demo

29. Propelics Mobile Testing Services
• Mobile Testing Readiness Kickstart
• Mobile Test Automation Kickstart
• Mobile Testing as a Managed Service
• SOASTA TouchTest Training and Advisory Services

31. Webinar Attendee Special Offer
31
Special Offer
Free 1 Hour Mobile
Advisory Call
info@propelics.com
888-405-2820
Testing Strategy
For Mobile
App Scoping
& Prototype
Enterprise
Mobile Roadmap
IT Strategy for
Mobile
Mobile UI/UX
Design
Mobile COE
Mobile Testing
Automation

32. 32
Thank you for attending!