Your mobile test plan doesn’t have to be adhoc. Join us and learn how to start testing more methodically to achieve the test coverage level that’s right for you.

1. Choose the Right Devices for Testing this Quarter
August, 2015
Eran Kinsbruner
Dir, Product Marketing
Mobile Technical Evangelist
Perfecto Mobile

2. Some Housekeeping before we start
Submit questions
using the Q&A
panel.
Participate in the
polls
Watch your email
for a copy of the
recording and
slides
Complete the
survey following
the presentation

3. Agenda
• Framework and methodology
• 2nd Edition index drill down and insights
• Adding your own analytics
• Heads-up – market calendar
• Q &A

4. Introducing Perfecto Mobile
Dominant leader &
visionary
Strong
Ecosystem
Perfecto @ a glance
Partnering with Enterprises to create better mobile
apps faster with continuous quality
“Perfecto Mobile marks shift in mobile
apps QA with Continuous Quality Lab”
4
Setting the bar for
market success
• Founded in late 2006, Business HQ in Boston
• Over 200 employees globally
• Fortune 500 customer base

5. The Continuous Quality Coverage Framework™
Answer the customer’s most common question:
“Which devices/form factors
should I test to assure sufficient
market coverage?”

6. It’s Fundamental all around
For the Business it’s
market coverage
• Great end user experience
• Build requirement for IT
• Optimize user engagement & rating
For the Dev/QA it’s
test coverage
• Optimize process
• Discover bugs early, mitigate risk
• Continuously test on what matters

7. Digital Predator Or Digital Prey?

8. Mobile Test Coverage Index –
2nd Edition Aug 2015
• Market Analysis
• 4,000+ Devices
• 460,000 Hours of Mobile
Cloud Testing

9. New!

10. Mobile Test Coverage Index – Q2 2015 Key Insights & Trends
iOS & Android Shares:
• iOS dominates U.S
• Android in Europe is as
follows:
• Clear win in Germany
• Samsung & Apple are
the same in UK
• EU5 aggregated –
Android wins
Nexus Devices Share
• Small both in U.S and
Europe
• Must be included in each
Index!
Trends & Q3
• Huawei is the 3rd smartphone
vendor worldwide
• Its new Ascend P8 marked as
strong leader!
• Key iOS & Android Releases in Q3
• Android M 6.0 ( LG & Huawei)
• iOS 9 (iPhones 6S/6S
Plus/iPad Pro (12.9’’))
• Legacy devices are critical (Samsung
S3 e.g.)

11. Global Mobile Market Share – Q2 2015
Source: Strategy Analytics
Global Mobile Phone Vendor Marketshare (%) Q2 ‘14 Q2 ‘15
Samsung 22.3% 20.5%
Apple 8.2% 10.9%
Huawei 4.8% 7.0%
Microsoft 11.8% 6.4%
Xiamoi 3.5% 4.6%
Others 49.4% 50.6%
Total 100.0% 100.0%
One of the 2 new
Google Nexus Devices

12. 85%
3%2%
iOS 8
iOS 7
Earlier
Which OS versions and Screen sizes to include in the mix?
JellyBeans & KitKat == ±74% distribution
Lollipop – Must OS in any Index
Legacy devices – still uses GingerBread & ICS
Android Marshmallow (6.0) – Beta available today for testing on Nexus
devices
• Minimum of 6 devices
(Smartphones & Tablets)
• * iOS 9 Beta – Must be
included
Minimum of 8 devices
(Smartphones & Tablets)

13. Index Aug-2015 Edition

14. Poll
What is the minimal number of devices & OS’s mix (iOS/Android)
which you currently test on?

15. Coverage Target
The minimal recommended device list
matched to relevant OS list
Additional devices and OS for
enhanced 50% market
coverage
Highest recommended coverage of
Devices and OS’s with more legacy
and new devices/OS’s included
80%50%30%
10-16
Devices
17-25
Devices
26-32
Devices

16. U.S Index Q2 2015
Nexus
Devices
Legacy
Devices

17. UK Index Q2

18. UK Index Q2
iPhones & Samsung
– Top 5
Top Windows Phone
Devices

19. Germany Index Q2

20. Germany Index Q2 2015
Legacy & Critical
Emerging In EMEA
Samsung Dominates
In Germany

21. Sony Xperia M5
Sony Xperia C5 Ultra

22. Test Coverage Optimization Process
2. Lab Sizing
Me
Analytics
Teams Projects
SDLC
Cycle
Requirements
v
Market
My Space
Popular & emerging
The
Index
1. Coverage
Industry trends & insights

23. Which device types to include in the mix?
Reference
Devices/OS
Popular
Devices/OS
Legacy
Devices/OS
Emerging
Devices/OS

24. v
Analytics-based
profiling
Product/ marketing
requirements
“ Look inside yourself and you Can see the universe.”
- Brian Herbert

25. Case Studies
• Large European Company
– Preliminary Index overview
– Analytics received & Analyzed
– Enhanced Index/Coverage achieved(Merge &
Complement) with focus on:
• New & Upcoming devices & OS’s
• Android Tablets
• Refresh Rate

26. v
22%
64%
14%
Visits
Android iOS Blank
32%
56%
12%
Logins
Android iOS Blank
Transactions OS Breakdown

27. Recommended
List --------------
With 25% Device
Refresh Rate
(Quarterly)

28. What does it take to cover the REAL
end user experience?
v
Device & Platform
Model
OS Version
Screen Size
Form Factors v
Environment
Location
Network
v
Conditions
Signal Strength
Load
Others

29. Stay Engaged
• Mobile Test Coverage Download Page
– http://go.perfectomobile.com/test-coverage-index/
• LinkedIn Group
– https://www.linkedin.com/grp/home?gid=8358292

30. Thank You
Please Remember To Complete The Survey