SlideShare une entreprise Scribd logo
1  sur  14
Automation and
Testing
Stephen Janaway
Who am I?
Stephen Janaway
• Testing for the last 14 years.
• Mobile phones, mobile networks, mobile
applications, web and web services.
• Ericsson, Motorola, Nokia.
• Test Coach, Trainer and Strategist at the NET-A-
PORTER GROUP.
www.stephenjanaway.co.uk @stephenjanaway
www.testinginthepub.com
@testinginthepub
Search for “Testing In The Pub’” on iTunes or YouTube
Everyone Is
Responsible For
Quality
What Does It Mean?
Trying the software to see if it works...
What does “try” mean?
How do you know what
“works” means?
It’s actually...
Questioning and investigating the software…
...to infer from it’s observed behaviour how it will
behave in the field, and to identify important problems
in the product…
...so that stakeholders can make an informed decision
on it’s suitability for release.
Checking vs. Testing
Testing is “the process of evaluating a product
by learning about it through experimentation,
which includes to some degree: questioning,
study, modeling, observation and inference.”
Checking is “the process of making evaluations
by applying algorithmic decision rules to
specific observations of a product.”
Automation (unit,
functional, etc) is
checking
Testing is not just
checking
So Can Automation Replace Testing?
➔Testing is more than checking.
➔Automation scripts only do what they are
instructed to do.
You can only check what you know and
expect. Customers don’t always do what
you expect.
We Can’t Automate
Thought patterns
Exploratory testing
Usability
User reactions
Compatibility
Claims testing
Performance
Look and feel
Unknown behaviours
Accessibility
So Who Does the Automation?
➔Developers
➔Testers
➔Developers in Test (if you have to)
➔Different people focus at different levels.
Not separate ‘automation’ teams
My Ideal Setup
➔6 developers, 1 tester in a cross
functional team.
➔Automation primarily a ‘development’
activity.
➔A thin layer of UI tests.
➔A thick layer of unit tests.
➔Quality owned by the team.
Questions?
“Hang on Steve - you haven’t talked about TDD, BDD, Selenium,
Appium,....”
Stephen Janaway
@stephenjanaway
www.stephenjanaway.co.uk

Contenu connexe

Similaire à Automation and Testing

Chapter 7 - Evaluation Tekhnique
Chapter 7 - Evaluation TekhniqueChapter 7 - Evaluation Tekhnique
Chapter 7 - Evaluation TekhniqueMuhammad Najib
 
7 mobile app usability testing best practices by UserTesting
7 mobile app usability testing best practices by UserTesting7 mobile app usability testing best practices by UserTesting
7 mobile app usability testing best practices by UserTestingUserTesting
 
Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience UserZoom
 
Mobile Testing, That's Just a Smaller Screen, Right? Stephen Janaway
Mobile Testing, That's Just a Smaller Screen, Right?   Stephen JanawayMobile Testing, That's Just a Smaller Screen, Right?   Stephen Janaway
Mobile Testing, That's Just a Smaller Screen, Right? Stephen JanawayStephen Janaway
 
And i thoughtiknewqtp_preview
And i thoughtiknewqtp_previewAnd i thoughtiknewqtp_preview
And i thoughtiknewqtp_previewSaurabh Singh
 
And I thought I knew QTP - QTP Concepts Unplugged
And I thought I knew QTP - QTP Concepts UnpluggedAnd I thought I knew QTP - QTP Concepts Unplugged
And I thought I knew QTP - QTP Concepts UnpluggedTarun Lalwani
 
User Testing- guiding the way to success
User Testing- guiding the way to successUser Testing- guiding the way to success
User Testing- guiding the way to successDMI
 
An Introduction To Mobile Software Testing
An Introduction To Mobile Software TestingAn Introduction To Mobile Software Testing
An Introduction To Mobile Software TestingStephen Janaway
 
Testing in the Wild: Practices for Testing Beyond the Lab
Testing in the Wild: Practices for Testing Beyond the LabTesting in the Wild: Practices for Testing Beyond the Lab
Testing in the Wild: Practices for Testing Beyond the LabTechWell
 
Appurify Performance Automation Whitepaper FINAL
Appurify Performance Automation Whitepaper FINALAppurify Performance Automation Whitepaper FINAL
Appurify Performance Automation Whitepaper FINALJennifer Shambroom
 
Usability testing for mobile apps - Touch Tour Chennai
Usability testing for mobile apps - Touch Tour ChennaiUsability testing for mobile apps - Touch Tour Chennai
Usability testing for mobile apps - Touch Tour ChennaiRIA RUI Society
 
Pearson_Psych_Assessment_Platform_Marion_Buchenau
Pearson_Psych_Assessment_Platform_Marion_BuchenauPearson_Psych_Assessment_Platform_Marion_Buchenau
Pearson_Psych_Assessment_Platform_Marion_BuchenauMarion Buchenau
 
Stanfy Publications: How to Conduct Quick Usability Tests for iOS & Android A...
Stanfy Publications: How to Conduct Quick Usability Tests for iOS & Android A...Stanfy Publications: How to Conduct Quick Usability Tests for iOS & Android A...
Stanfy Publications: How to Conduct Quick Usability Tests for iOS & Android A...Stanfy
 
A comprehensive guide to mobile app usability testing
A comprehensive guide to mobile app usability testingA comprehensive guide to mobile app usability testing
A comprehensive guide to mobile app usability testingWebGuru Infosystems Pvt. Ltd.
 
How to do usability testing and eye tracking
How to do usability testing and eye trackingHow to do usability testing and eye tracking
How to do usability testing and eye trackingObjective Experience
 
Online Software Testing Course
Online Software Testing CourseOnline Software Testing Course
Online Software Testing Coursejaymicrosoftva
 

Similaire à Automation and Testing (20)

Chapter 7 - Evaluation Tekhnique
Chapter 7 - Evaluation TekhniqueChapter 7 - Evaluation Tekhnique
Chapter 7 - Evaluation Tekhnique
 
Testing As An Activity
Testing As An ActivityTesting As An Activity
Testing As An Activity
 
7 mobile app usability testing best practices by UserTesting
7 mobile app usability testing best practices by UserTesting7 mobile app usability testing best practices by UserTesting
7 mobile app usability testing best practices by UserTesting
 
Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience Harness Mobile Usability Testing to Improve Your Mobile Experience
Harness Mobile Usability Testing to Improve Your Mobile Experience
 
Mobile Testing, That's Just a Smaller Screen, Right? Stephen Janaway
Mobile Testing, That's Just a Smaller Screen, Right?   Stephen JanawayMobile Testing, That's Just a Smaller Screen, Right?   Stephen Janaway
Mobile Testing, That's Just a Smaller Screen, Right? Stephen Janaway
 
CKS_Adianta_talk.ppt
CKS_Adianta_talk.pptCKS_Adianta_talk.ppt
CKS_Adianta_talk.ppt
 
And i thoughtiknewqtp_preview
And i thoughtiknewqtp_previewAnd i thoughtiknewqtp_preview
And i thoughtiknewqtp_preview
 
And I thought I knew QTP - QTP Concepts Unplugged
And I thought I knew QTP - QTP Concepts UnpluggedAnd I thought I knew QTP - QTP Concepts Unplugged
And I thought I knew QTP - QTP Concepts Unplugged
 
Usability Testing.docx
Usability Testing.docxUsability Testing.docx
Usability Testing.docx
 
User Testing- guiding the way to success
User Testing- guiding the way to successUser Testing- guiding the way to success
User Testing- guiding the way to success
 
An Introduction To Mobile Software Testing
An Introduction To Mobile Software TestingAn Introduction To Mobile Software Testing
An Introduction To Mobile Software Testing
 
Types of User Testing
Types of User TestingTypes of User Testing
Types of User Testing
 
Testing in the Wild: Practices for Testing Beyond the Lab
Testing in the Wild: Practices for Testing Beyond the LabTesting in the Wild: Practices for Testing Beyond the Lab
Testing in the Wild: Practices for Testing Beyond the Lab
 
Appurify Performance Automation Whitepaper FINAL
Appurify Performance Automation Whitepaper FINALAppurify Performance Automation Whitepaper FINAL
Appurify Performance Automation Whitepaper FINAL
 
Usability testing for mobile apps - Touch Tour Chennai
Usability testing for mobile apps - Touch Tour ChennaiUsability testing for mobile apps - Touch Tour Chennai
Usability testing for mobile apps - Touch Tour Chennai
 
Pearson_Psych_Assessment_Platform_Marion_Buchenau
Pearson_Psych_Assessment_Platform_Marion_BuchenauPearson_Psych_Assessment_Platform_Marion_Buchenau
Pearson_Psych_Assessment_Platform_Marion_Buchenau
 
Stanfy Publications: How to Conduct Quick Usability Tests for iOS & Android A...
Stanfy Publications: How to Conduct Quick Usability Tests for iOS & Android A...Stanfy Publications: How to Conduct Quick Usability Tests for iOS & Android A...
Stanfy Publications: How to Conduct Quick Usability Tests for iOS & Android A...
 
A comprehensive guide to mobile app usability testing
A comprehensive guide to mobile app usability testingA comprehensive guide to mobile app usability testing
A comprehensive guide to mobile app usability testing
 
How to do usability testing and eye tracking
How to do usability testing and eye trackingHow to do usability testing and eye tracking
How to do usability testing and eye tracking
 
Online Software Testing Course
Online Software Testing CourseOnline Software Testing Course
Online Software Testing Course
 

Plus de Stephen Janaway

Check This - Test Automation, A Development Managers View
Check This - Test Automation, A Development Managers ViewCheck This - Test Automation, A Development Managers View
Check This - Test Automation, A Development Managers ViewStephen Janaway
 
Understanding Your Mobile User
Understanding Your Mobile UserUnderstanding Your Mobile User
Understanding Your Mobile UserStephen Janaway
 
Why I Lost My Job As a Test Manager and What I Learnt As a Result
Why I Lost My Job As a Test Manager and What I Learnt As a ResultWhy I Lost My Job As a Test Manager and What I Learnt As a Result
Why I Lost My Job As a Test Manager and What I Learnt As a ResultStephen Janaway
 
Mobile Users Are Different
Mobile Users Are DifferentMobile Users Are Different
Mobile Users Are DifferentStephen Janaway
 
Mobile Testing, That's Just a Smaller Screen, Right
Mobile Testing, That's Just a Smaller Screen, RightMobile Testing, That's Just a Smaller Screen, Right
Mobile Testing, That's Just a Smaller Screen, RightStephen Janaway
 
London Tester Gathering Workshops - Mobile Software Testing - Stephen Janaway
London Tester Gathering Workshops - Mobile Software Testing - Stephen JanawayLondon Tester Gathering Workshops - Mobile Software Testing - Stephen Janaway
London Tester Gathering Workshops - Mobile Software Testing - Stephen JanawayStephen Janaway
 
Mobile Testing, That's Just A Smaller Screen, Right?
Mobile Testing, That's Just A Smaller Screen, Right?Mobile Testing, That's Just A Smaller Screen, Right?
Mobile Testing, That's Just A Smaller Screen, Right?Stephen Janaway
 
A Testers Hierarchy Of Needs
A Testers Hierarchy Of NeedsA Testers Hierarchy Of Needs
A Testers Hierarchy Of NeedsStephen Janaway
 

Plus de Stephen Janaway (9)

Check This - Test Automation, A Development Managers View
Check This - Test Automation, A Development Managers ViewCheck This - Test Automation, A Development Managers View
Check This - Test Automation, A Development Managers View
 
Understanding Your Mobile User
Understanding Your Mobile UserUnderstanding Your Mobile User
Understanding Your Mobile User
 
Why I Lost My Job As a Test Manager and What I Learnt As a Result
Why I Lost My Job As a Test Manager and What I Learnt As a ResultWhy I Lost My Job As a Test Manager and What I Learnt As a Result
Why I Lost My Job As a Test Manager and What I Learnt As a Result
 
Mobile Users Are Different
Mobile Users Are DifferentMobile Users Are Different
Mobile Users Are Different
 
Mobile Testing, That's Just a Smaller Screen, Right
Mobile Testing, That's Just a Smaller Screen, RightMobile Testing, That's Just a Smaller Screen, Right
Mobile Testing, That's Just a Smaller Screen, Right
 
London Tester Gathering Workshops - Mobile Software Testing - Stephen Janaway
London Tester Gathering Workshops - Mobile Software Testing - Stephen JanawayLondon Tester Gathering Workshops - Mobile Software Testing - Stephen Janaway
London Tester Gathering Workshops - Mobile Software Testing - Stephen Janaway
 
Testing Your Emotions
Testing Your EmotionsTesting Your Emotions
Testing Your Emotions
 
Mobile Testing, That's Just A Smaller Screen, Right?
Mobile Testing, That's Just A Smaller Screen, Right?Mobile Testing, That's Just A Smaller Screen, Right?
Mobile Testing, That's Just A Smaller Screen, Right?
 
A Testers Hierarchy Of Needs
A Testers Hierarchy Of NeedsA Testers Hierarchy Of Needs
A Testers Hierarchy Of Needs
 

Dernier

%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...masabamasaba
 
WSO2Con2024 - Enabling Transactional System's Exponential Growth With Simplicity
WSO2Con2024 - Enabling Transactional System's Exponential Growth With SimplicityWSO2Con2024 - Enabling Transactional System's Exponential Growth With Simplicity
WSO2Con2024 - Enabling Transactional System's Exponential Growth With SimplicityWSO2
 
%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrandmasabamasaba
 
What Goes Wrong with Language Definitions and How to Improve the Situation
What Goes Wrong with Language Definitions and How to Improve the SituationWhat Goes Wrong with Language Definitions and How to Improve the Situation
What Goes Wrong with Language Definitions and How to Improve the SituationJuha-Pekka Tolvanen
 
WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...
WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...
WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...WSO2
 
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2
 
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...Jittipong Loespradit
 
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park %in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park masabamasaba
 
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrainmasabamasaba
 
tonesoftg
tonesoftgtonesoftg
tonesoftglanshi9
 
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...Shane Coughlan
 
WSO2CON 2024 Slides - Open Source to SaaS
WSO2CON 2024 Slides - Open Source to SaaSWSO2CON 2024 Slides - Open Source to SaaS
WSO2CON 2024 Slides - Open Source to SaaSWSO2
 
%in ivory park+277-882-255-28 abortion pills for sale in ivory park
%in ivory park+277-882-255-28 abortion pills for sale in ivory park %in ivory park+277-882-255-28 abortion pills for sale in ivory park
%in ivory park+277-882-255-28 abortion pills for sale in ivory park masabamasaba
 
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...masabamasaba
 
WSO2Con204 - Hard Rock Presentation - Keynote
WSO2Con204 - Hard Rock Presentation - KeynoteWSO2Con204 - Hard Rock Presentation - Keynote
WSO2Con204 - Hard Rock Presentation - KeynoteWSO2
 
WSO2CON 2024 - Does Open Source Still Matter?
WSO2CON 2024 - Does Open Source Still Matter?WSO2CON 2024 - Does Open Source Still Matter?
WSO2CON 2024 - Does Open Source Still Matter?WSO2
 
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisamasabamasaba
 
%in Benoni+277-882-255-28 abortion pills for sale in Benoni
%in Benoni+277-882-255-28 abortion pills for sale in Benoni%in Benoni+277-882-255-28 abortion pills for sale in Benoni
%in Benoni+277-882-255-28 abortion pills for sale in Benonimasabamasaba
 
Announcing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK SoftwareAnnouncing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK SoftwareJim McKeeth
 

Dernier (20)

%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
 
WSO2Con2024 - Enabling Transactional System's Exponential Growth With Simplicity
WSO2Con2024 - Enabling Transactional System's Exponential Growth With SimplicityWSO2Con2024 - Enabling Transactional System's Exponential Growth With Simplicity
WSO2Con2024 - Enabling Transactional System's Exponential Growth With Simplicity
 
%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand
 
What Goes Wrong with Language Definitions and How to Improve the Situation
What Goes Wrong with Language Definitions and How to Improve the SituationWhat Goes Wrong with Language Definitions and How to Improve the Situation
What Goes Wrong with Language Definitions and How to Improve the Situation
 
WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...
WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...
WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...
 
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital TransformationWSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
WSO2Con2024 - WSO2's IAM Vision: Identity-Led Digital Transformation
 
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
 
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park %in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
 
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
%in Bahrain+277-882-255-28 abortion pills for sale in Bahrain
 
tonesoftg
tonesoftgtonesoftg
tonesoftg
 
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
 
WSO2CON 2024 Slides - Open Source to SaaS
WSO2CON 2024 Slides - Open Source to SaaSWSO2CON 2024 Slides - Open Source to SaaS
WSO2CON 2024 Slides - Open Source to SaaS
 
%in ivory park+277-882-255-28 abortion pills for sale in ivory park
%in ivory park+277-882-255-28 abortion pills for sale in ivory park %in ivory park+277-882-255-28 abortion pills for sale in ivory park
%in ivory park+277-882-255-28 abortion pills for sale in ivory park
 
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
 
WSO2Con204 - Hard Rock Presentation - Keynote
WSO2Con204 - Hard Rock Presentation - KeynoteWSO2Con204 - Hard Rock Presentation - Keynote
WSO2Con204 - Hard Rock Presentation - Keynote
 
WSO2CON 2024 - Does Open Source Still Matter?
WSO2CON 2024 - Does Open Source Still Matter?WSO2CON 2024 - Does Open Source Still Matter?
WSO2CON 2024 - Does Open Source Still Matter?
 
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
 
%in Benoni+277-882-255-28 abortion pills for sale in Benoni
%in Benoni+277-882-255-28 abortion pills for sale in Benoni%in Benoni+277-882-255-28 abortion pills for sale in Benoni
%in Benoni+277-882-255-28 abortion pills for sale in Benoni
 
Abortion Pills In Pretoria ](+27832195400*)[ 🏥 Women's Abortion Clinic In Pre...
Abortion Pills In Pretoria ](+27832195400*)[ 🏥 Women's Abortion Clinic In Pre...Abortion Pills In Pretoria ](+27832195400*)[ 🏥 Women's Abortion Clinic In Pre...
Abortion Pills In Pretoria ](+27832195400*)[ 🏥 Women's Abortion Clinic In Pre...
 
Announcing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK SoftwareAnnouncing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK Software
 

Automation and Testing

  • 2. Who am I? Stephen Janaway • Testing for the last 14 years. • Mobile phones, mobile networks, mobile applications, web and web services. • Ericsson, Motorola, Nokia. • Test Coach, Trainer and Strategist at the NET-A- PORTER GROUP. www.stephenjanaway.co.uk @stephenjanaway
  • 5. What Does It Mean? Trying the software to see if it works... What does “try” mean? How do you know what “works” means?
  • 6. It’s actually... Questioning and investigating the software… ...to infer from it’s observed behaviour how it will behave in the field, and to identify important problems in the product… ...so that stakeholders can make an informed decision on it’s suitability for release.
  • 7. Checking vs. Testing Testing is “the process of evaluating a product by learning about it through experimentation, which includes to some degree: questioning, study, modeling, observation and inference.” Checking is “the process of making evaluations by applying algorithmic decision rules to specific observations of a product.”
  • 8. Automation (unit, functional, etc) is checking Testing is not just checking
  • 9.
  • 10. So Can Automation Replace Testing? ➔Testing is more than checking. ➔Automation scripts only do what they are instructed to do. You can only check what you know and expect. Customers don’t always do what you expect.
  • 11. We Can’t Automate Thought patterns Exploratory testing Usability User reactions Compatibility Claims testing Performance Look and feel Unknown behaviours Accessibility
  • 12. So Who Does the Automation? ➔Developers ➔Testers ➔Developers in Test (if you have to) ➔Different people focus at different levels. Not separate ‘automation’ teams
  • 13. My Ideal Setup ➔6 developers, 1 tester in a cross functional team. ➔Automation primarily a ‘development’ activity. ➔A thin layer of UI tests. ➔A thick layer of unit tests. ➔Quality owned by the team.
  • 14. Questions? “Hang on Steve - you haven’t talked about TDD, BDD, Selenium, Appium,....” Stephen Janaway @stephenjanaway www.stephenjanaway.co.uk

Notes de l'éditeur

  1. I’ve been working in the mobile world for 14 years. Tested mobile networks, mobile devices and applications, web and web services. Worked for Nokia, Ericsson, Motorola. Currently at NAP - global ecomm fashion retailing group with 3 brands. High tech, very exciting. Approx 40 testers currently in IT team of 300. I blog regularly and here’s my website link. You can follow me on Twitter.
  2. Sometime we talk about what’s important to us in the software testing world. Other times we interview other people. If you want to be involved then let me know :) So - what is Testing?
  3. Let’s get this out of the way first. Testing does not equal quality. You can’t test quality into a product. Nokia Quality Gate example. Don’t throw work at testers. Testers are not responsible for quality. I hate the term QA. Testers not being the quality police either. Everyone is.
  4. Now we’ve got that out of the way then let’s talk about what testing is. Here’s what most people think it is. But…...
  5. This is what testing actually is. So it’s about Questions - Identification - Suitability We can ask these questions using automation or manually. More later.
  6. It’s also important to define what Testing is. And what it is not. So first - some wordy definitions.
  7. Which mean….
  8. I find the testing pyramid a good way to describe what a team should do. Note that there’s automation and manual testing shown. That’s important. Mention - what’s done at each level. Who does testing at each level. Smooth flow.
  9. So - there was more automation on that last slide than manual testing?
  10. But automation is excellent for repeatable tests. It’s excellent for test data setup. Its excellent for acceptance testing. We Need Both Manual Testing and Automation