Mobile Testing With Confidence

•

5 likes•2,389 views

Amy Phillips

Mobile testing can appear to be an impossible task. These slides talk through the aspects that need to be considered.

Technology

Mobile Testing with
Conﬁdence
Amy Phillips
@itjustbroke

• Fragmentation
• Reduced control over versions being used
• Release process can be slow
• Less control over environment (settings, other
apps, etc)
Conﬁdence
ˈkɒnfɪd(ə)ns/
Belief in oneself and
one’s powers or abilities

Reduced Control
• Releases
• Environment

What is Testing?
An empirical, technical, investigation
conducted to provide stakeholders
with information about the quality of
the product or service under test.
- James Bach

What is Quality?
“value to some person
who matters”
- Michael Bolton

What Are We Trying To Do?
• Have we built the right thing?
• Have we broken stuff that used to
work?
• Have we introduced unintended
behaviour?

Develop Test
Bug Fix
Test As We Go
Develop Test

Choose The Right Approach
• The right approach is the one that
works for you
• It might change over time
• Do what’s right for your users

Features
• Do they look right? • Do they work correctly?

Memory Usage
• Download size
• Runtime size
• Memory
management

Connectivity
• 4G
• 3G
• WIFI
• GPRS
• No Service

Uninstalling
• Remove all data
• Leave device in
state that allows
re-install

Plan Your Testing
• Pick and choose test areas
• Focus on risk
• Monitor coverage

Test Environment
Test
Environment
Live
Environment

Mobile Testing
• Plan your testing in advance
• Focus on risk
• Learn from your mistakes
• Make it easy for the user to
recover from problems

What's hot

Accessibility Team of ZeroMelissa Brooks

Paul Ellarby - Why do scrum?Paul Ellarby

Become a Quality Enabler99X Technology

Adventures in QADirk Haun

Be More Salmon - Agile Manchester 2016Duncan Nisbet

Creating change from within - Agile Practitioners 2012Dror Helper

Automation vs. intelligence - "follow me if you want to live"Viktor Slavchev

Build FAST with parallel_calabashThoughtworks

Shawn Wallace - Test automation in brownfield applicationsQA or the Highway

Is Test Planning a lost art in Agile? by Michelle WilliamsQA or the Highway

How engineering practices help businessAndrey Rebrov

Agile Success Story -Tester & Developer Working Together for Higher Quality M...XBOSoft

Building better agile processesGil Zilberfeld

Testing! Be More Salmon! - Agile NorthDuncan Nisbet

Growing a Company Test Community: Roles and Paths for TestersTEST Huddle

Exploring with AutomationJames Thomas

Omaha UX Group - Conducting Expert Reviews 6/5/14UXOMA

Automation in the Bug Flow - Machine Learning for Triaging and TracingMarkus Borg

Machine learning in software testingThoughtworks

Exploratory Testing Basics, Experiences, and Future in SSTC2016Kari Kakkonen

What's hot (20)

Accessibility Team of Zero

Paul Ellarby - Why do scrum?

Become a Quality Enabler

Adventures in QA

Be More Salmon - Agile Manchester 2016

Creating change from within - Agile Practitioners 2012

Automation vs. intelligence - "follow me if you want to live"

Build FAST with parallel_calabash

Shawn Wallace - Test automation in brownfield applications

Is Test Planning a lost art in Agile? by Michelle Williams

How engineering practices help business

Agile Success Story -Tester & Developer Working Together for Higher Quality M...

Building better agile processes

Testing! Be More Salmon! - Agile North

Growing a Company Test Community: Roles and Paths for Testers

Exploring with Automation

Omaha UX Group - Conducting Expert Reviews 6/5/14

Automation in the Bug Flow - Machine Learning for Triaging and Tracing

Machine learning in software testing

Exploratory Testing Basics, Experiences, and Future in SSTC2016

Viewers also liked

Stacey MacNaught's presentation SAScon 2016Tecmark UK

Nobody Pays the Bills in Social Shares - Content Marketing with Real Value by...Tecmark UK

Quality Content On ScaleTecmark UK

Attitudes to smartphone voting - Tecmark/YouGov researchTecmark UK

Exploring design with AgileMichael Le

13 trends of outperforming inc.com headlinesLindsay Blakely

Content promotion to win and retain audiences by @staceycav at #learninboundStacey MacNaught

Your Content is Awesome – Now What? By @staceycav at #brightonseoStacey MacNaught

Link Building Through Data Driven Storytelling by @staceycav #fos16Stacey MacNaught

Making Content Marketing More Efficient - #mozcon 2014 by @staceycavStacey MacNaught

The $10,000 Paid Content + Paid Linking Test that is 100% Google SafeWil Reynolds

Viewers also liked (11)

Stacey MacNaught's presentation SAScon 2016

Nobody Pays the Bills in Social Shares - Content Marketing with Real Value by...

Quality Content On Scale

Attitudes to smartphone voting - Tecmark/YouGov research

Exploring design with Agile

13 trends of outperforming inc.com headlines

Content promotion to win and retain audiences by @staceycav at #learninbound

Your Content is Awesome – Now What? By @staceycav at #brightonseo

Link Building Through Data Driven Storytelling by @staceycav #fos16

Making Content Marketing More Efficient - #mozcon 2014 by @staceycav

The $10,000 Paid Content + Paid Linking Test that is 100% Google Safe

Similar to Mobile Testing With Confidence

Dallas TechologiesDallasTechnologies

Mal12 qa tand-automatedtestingandytinkham

01 software testing_introductionManishJha237

Software Testing’s Future—According to Lee CopelandTechWell

SOFTWARE TESTINGRaju Raaj

Rapid turnaround usability testing: not just a pipe dreamKyle Soucy

Software TestingAnkit Bahuguna

How to get what you really want from Testing' with Michael BoltonTEST Huddle

Hacker News Meetup April 2014Dan Quine

An introduction to Software Testing and Test ManagementAnuraj S.L

ISTQB - CTFL Summary v1.0Samer Desouky

Beyond "Quality Assurance"Jason Benton

Software Testing Presentation in Cegonsoft Pvt Ltd...ChithraCegon

A Software Testing IntroEvozon Test Lab

Things Could Get Worse: Ideas About Regression TestingTechWell

Test Strategy-The real silver bullet in testing by Matthew EakinQA or the Highway

Lean Startup 301Lean Startup Co.

Will The Test Leaders Stand Up?Paul Gerrard

Usability Testing & YouCate Kompare

How did i miss that bug rtcGerieOwen

Similar to Mobile Testing With Confidence (20)

Dallas Techologies

Mal12 qa tand-automatedtesting

01 software testing_introduction

Software Testing’s Future—According to Lee Copeland

SOFTWARE TESTING

Rapid turnaround usability testing: not just a pipe dream

Software Testing

How to get what you really want from Testing' with Michael Bolton

Hacker News Meetup April 2014

An introduction to Software Testing and Test Management

ISTQB - CTFL Summary v1.0

Beyond "Quality Assurance"

Software Testing Presentation in Cegonsoft Pvt Ltd...

A Software Testing Intro

Things Could Get Worse: Ideas About Regression Testing

Test Strategy-The real silver bullet in testing by Matthew Eakin

Lean Startup 301

Will The Test Leaders Stand Up?

Usability Testing & You

How did i miss that bug rtc

Recently uploaded

Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructureitnewsafrica

Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3

Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3

Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3

The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech

Generative AI - Gitex v1Generative AI - Gitex v1.pptxfnnc6jmgwh

How to write a Business Continuity PlanDatabarracks

Zeshan Sattar- Assessing the skill requirements and industry expectations for...itnewsafrica

Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda

A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3

Scale your database traffic with Read & Write split using MySQL RouterMydbops

So einfach geht modernes Roaming fuer Notes und Nomad.pdfpanagenda

Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integrationmarketing932765

How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes

Connecting the Dots for Information Discovery.pdfNeo4j

Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen

Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani

QCon London: Mastering long-running processes in modern architecturesBernd Ruecker

The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney

Data governance with Unity Catalog PresentationKnoldus Inc.

Recently uploaded (20)

Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure

Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx

Digital Identity is Under Attack: FIDO Paris Seminar.pptx

Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx

The Ultimate Guide to Choosing WordPress Pros and Cons

Generative AI - Gitex v1Generative AI - Gitex v1.pptx

How to write a Business Continuity Plan

Zeshan Sattar- Assessing the skill requirements and industry expectations for...

Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger

A Deep Dive on Passkeys: FIDO Paris Seminar.pptx

Scale your database traffic with Read & Write split using MySQL Router

So einfach geht modernes Roaming fuer Notes und Nomad.pdf

Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration

How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes

Connecting the Dots for Information Discovery.pdf

Testing tools and AI - ideas what to try with some tool examples

Potential of AI (Generative AI) in Business: Learnings and Insights

QCon London: Mastering long-running processes in modern architectures

The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...

Data governance with Unity Catalog Presentation

Mobile Testing With Confidence

1. Mobile Testing with Conﬁdence Amy Phillips @itjustbroke

2. • Fragmentation • Reduced control over versions being used • Release process can be slow • Less control over environment (settings, other apps, etc) Conﬁdence ˈkɒnfɪd(ə)ns/ Belief in oneself and one’s powers or abilities

3. • Fragmentation

4. • Fragmentation

5. Releases can be slow

6. Reduced Control • Releases • Environment

7. PANIC!!!

8. DON’T PANIC!!!

9. What is Testing? An empirical, technical, investigation conducted to provide stakeholders with information about the quality of the product or service under test. - James Bach

10. What is Quality? “value to some person who matters” - Michael Bolton

11. What Makes A Tester?

12. What Are We Trying To Do? • Have we built the right thing? • Have we broken stuff that used to work? • Have we introduced unintended behaviour?

13. Test Approach

14. Don’t Test Develop

15. Test At The End Develop Test Bug Fix

16. Develop Test Bug Fix Test As We Go Develop Test

17. Choose The Right Approach • The right approach is the one that works for you • It might change over time • Do what’s right for your users

18. What To Test?

19. Features • Do they look right? • Do they work correctly?

20. Memory Usage • Download size • Runtime size • Memory management

21. Crashes