SlideShare une entreprise Scribd logo
1  sur  55
Tests are Nothing

Testing is Everything
The Dark Side of Test Scripts
Ian Pestelos
ian@averageup.ph



@averageupph
/in/ianpestelos
—————
#testing
meet…



ME :)
photo credit: http://memecrunch.com/meme/7UQP/scratch-head/image.jpg
Why are we trying to 

control the future?
photo credits: https://www.facebook.com/biglaanglakad
photo credit: http://forevertwentysomethings.com/wp-content/uploads/2014/07/change_sign1.jpg
Reliance on Certainty
PROBLEM 1
meet…



RALPH
27 Bugs Found

2 Hours Testing
12 Bugs Found

4 Hours “Testing”
Bugs are Missed
PROBLEM 2
meet…



MARI
photo credit: http://www.copyblogger.com/common-blogging-mistakes/
Focus Away from Value
PROBLEM 3
"Test scripting is a practice 

that many of us still think 

is the best one. 

Or is the only one."
The Law of the Instrument
photo credit: http://www.180360720.no/wp-content/uploads/2010/04/hammer-nail1-420x315.jpg
We should let testers…
DIE
Discover. Investigate. Explore.
— is not a tool or methodology
— is not just for agile
— is a complementary technique
Exploratory Testing
…simultaneously learning about the system 

while designing and executing tests, 

using feedback from the last test 

to inform the next."
photo credit: http://less.works/img/test_automation/xet_scripted_difference.png.pagespeed.ic.X0uMS-HZ2g.png
“The Freedom Scale” - Jon Bach
“The Learning Scale” - Ian Pestelos
EXPLORATORY = AD-HOC TESTING ?
ad hoc testing is performed 

without a plan of action and 

any actions taken are not typically documented
Your mission, should you choose to accept it, 

is to PENETRATE the highly-secured archive 

inside THE KREMLIN and retrieve COBALT’S FILE

BEFORE he can destroy it.
explore <Target>
using <Resources>
discover <Information>
What’s a Good Test Charter?
It offers DIRECTION
Without Over-specification
What’s a Good Test Charter?
Too	
  Specific:	
  It’s	
  a	
  different	
  (and	
  weird)	
  way	
  
of	
  expressing	
  individual	
  tests.	
  
What’s a Good Test Charter?
Too	
  Broad:	
  Not	
  providing	
  enough	
  focus;	
  you	
  
won’t	
  know	
  how	
  to	
  tell	
  when	
  you’re	
  done	
  
A “Special” Test Charter?
Reconnaissance:	
  It	
  is	
  a	
  special	
  charter	
  to	
  
survey	
  or	
  understand	
  something	
  

you	
  don’t	
  know	
  how	
  to	
  test	
  yet
photo credit: http://offload.goarmy.com/special-forces/primary-missions/special-reconnaissance/jcr:content/contentpar/header.png
A “Special” Test Charter?
“explore	
  <TARGET>	
  using	
  my	
  brain	
  and	
  my	
  
senses	
  to	
  understand	
  how	
  it	
  works”	
  
photo credit: http://offload.goarmy.com/special-forces/primary-missions/special-reconnaissance/jcr:content/contentpar/header.png
DEBRIEFING
Debriefing catches “gaps”
photo credit: http://www.sorryformarketing.com/blog/weird-things-business-people-do-on-twitter
Debriefing promotes learning
Debriefing rattles people
Case Studies
Case Studies
We NEED testers to…
DIE
Discover. Investigate. Explore.
Everyday
where to 

begin?
Quick Start Guide
Start SMALL
Quick Start Guide
Find your “VISIONARIES”
Quick Start Guide
Promote 

GENERALISING SPECIALISTS
Quick Start Guide
Try DEBRIEFING… ASAP
Quick Start Guide
Do periodic RETROSPECTIVES
Tests are Nothing

Testing is Everything
?
Focus on 

PRODUCT quality



(not the Artefacts)
Agility & Flexibility

to Changes & New Info



(not assuming certainty)
Maximum opportunities

for Bug Hunting



(not blind checking)
Exploratory Testing
Do More TESTS
Find More PROBLEMS
Get More LEARNING
Quality, in the end, is in the product, 

not in paper documentation. 



Paper documentation allows 

lies and illusions of quality,
working software doesn’t.
— Gunther Verheyen

Contenu connexe

Tendances

Main task 9 key words
Main task   9 key wordsMain task   9 key words
Main task 9 key words
Chris Hildrew
 
5 Why Training Slides Oct 14, 2009
5 Why Training Slides Oct 14, 20095 Why Training Slides Oct 14, 2009
5 Why Training Slides Oct 14, 2009
ExerciseLeanLLC
 
How to keep creative ideas alive
How to keep creative ideas alive How to keep creative ideas alive
How to keep creative ideas alive
Scott Armstrong
 
Sechs Jahre Erfahrungen mit Scrum & Tools - eine Retrospektive
Sechs Jahre Erfahrungen mit Scrum & Tools - eine RetrospektiveSechs Jahre Erfahrungen mit Scrum & Tools - eine Retrospektive
Sechs Jahre Erfahrungen mit Scrum & Tools - eine Retrospektive
mkloss
 

Tendances (20)

Confessions of an Accidental Security Tester
Confessions of an Accidental Security TesterConfessions of an Accidental Security Tester
Confessions of an Accidental Security Tester
 
Mob Testing
Mob TestingMob Testing
Mob Testing
 
Claudiu Draghia ITEM 2018
Claudiu Draghia ITEM 2018Claudiu Draghia ITEM 2018
Claudiu Draghia ITEM 2018
 
Main task 9 key words
Main task   9 key wordsMain task   9 key words
Main task 9 key words
 
James thomas
James thomasJames thomas
James thomas
 
Four Stages of Automated Testing by Bradley Temple
Four Stages of Automated Testing by Bradley TempleFour Stages of Automated Testing by Bradley Temple
Four Stages of Automated Testing by Bradley Temple
 
Baltimore UX Meetup - Usability Testing: Tips, Tools, and More
Baltimore UX Meetup - Usability Testing: Tips, Tools, and MoreBaltimore UX Meetup - Usability Testing: Tips, Tools, and More
Baltimore UX Meetup - Usability Testing: Tips, Tools, and More
 
Seth Okai - Proving the Benefits of Beta Testing, To B or Not To B - EuroSTAR...
Seth Okai - Proving the Benefits of Beta Testing, To B or Not To B - EuroSTAR...Seth Okai - Proving the Benefits of Beta Testing, To B or Not To B - EuroSTAR...
Seth Okai - Proving the Benefits of Beta Testing, To B or Not To B - EuroSTAR...
 
5 Why Training Slides Oct 14, 2009
5 Why Training Slides Oct 14, 20095 Why Training Slides Oct 14, 2009
5 Why Training Slides Oct 14, 2009
 
How to Test Anything
How to Test AnythingHow to Test Anything
How to Test Anything
 
The 5 whys system
The 5 whys systemThe 5 whys system
The 5 whys system
 
Exploring with Automation
Exploring with AutomationExploring with Automation
Exploring with Automation
 
Alan Page: On Testing
Alan Page: On TestingAlan Page: On Testing
Alan Page: On Testing
 
How Not Php
How Not PhpHow Not Php
How Not Php
 
How to keep creative ideas alive
How to keep creative ideas alive How to keep creative ideas alive
How to keep creative ideas alive
 
5 why analysis
5 why analysis5 why analysis
5 why analysis
 
Presentation on Presentations
Presentation on PresentationsPresentation on Presentations
Presentation on Presentations
 
Sechs Jahre Erfahrungen mit Scrum & Tools - eine Retrospektive
Sechs Jahre Erfahrungen mit Scrum & Tools - eine RetrospektiveSechs Jahre Erfahrungen mit Scrum & Tools - eine Retrospektive
Sechs Jahre Erfahrungen mit Scrum & Tools - eine Retrospektive
 
Checklists + Team Collaboration = Excellent Results
Checklists + Team Collaboration = Excellent ResultsChecklists + Team Collaboration = Excellent Results
Checklists + Team Collaboration = Excellent Results
 
Easy Bolt-on Docs Using React Styleguidist
Easy Bolt-on Docs Using React StyleguidistEasy Bolt-on Docs Using React Styleguidist
Easy Bolt-on Docs Using React Styleguidist
 

Similaire à Tests are Nothing, Testing is Everything

Breathing the breath of the monster combining agile and context-driven
Breathing the breath of the monster   combining agile and context-drivenBreathing the breath of the monster   combining agile and context-driven
Breathing the breath of the monster combining agile and context-driven
Ilari Henrik Aegerter
 
Experimentation from the real world
Experimentation from the real worldExperimentation from the real world
Experimentation from the real world
Andrew Rusling
 
Experimentation from the real world; move from outputs to outcomes
Experimentation from the real world; move from outputs to outcomesExperimentation from the real world; move from outputs to outcomes
Experimentation from the real world; move from outputs to outcomes
Scrum Australia Pty Ltd
 
Shorter Version of BbWorld 09 Forensics Presentation
Shorter Version of BbWorld 09 Forensics PresentationShorter Version of BbWorld 09 Forensics Presentation
Shorter Version of BbWorld 09 Forensics Presentation
Steve Feldman
 

Similaire à Tests are Nothing, Testing is Everything (20)

Breathing the breath of the monster combining agile and context-driven
Breathing the breath of the monster   combining agile and context-drivenBreathing the breath of the monster   combining agile and context-driven
Breathing the breath of the monster combining agile and context-driven
 
Building a Testing Playbook by Andrew Richardson
Building a Testing Playbook by Andrew RichardsonBuilding a Testing Playbook by Andrew Richardson
Building a Testing Playbook by Andrew Richardson
 
Things Could Get Worse: Ideas About Regression Testing
Things Could Get Worse: Ideas About Regression TestingThings Could Get Worse: Ideas About Regression Testing
Things Could Get Worse: Ideas About Regression Testing
 
Rockstars & Consultants, who needs 'em
Rockstars & Consultants, who needs 'emRockstars & Consultants, who needs 'em
Rockstars & Consultants, who needs 'em
 
Psychology and Engineering of Testing
Psychology and Engineering of TestingPsychology and Engineering of Testing
Psychology and Engineering of Testing
 
Combinatorial software test design beyond pairwise testing
Combinatorial software test design beyond pairwise testingCombinatorial software test design beyond pairwise testing
Combinatorial software test design beyond pairwise testing
 
A Happy Marriage between Context-Driven and Agile
A Happy Marriage between Context-Driven and AgileA Happy Marriage between Context-Driven and Agile
A Happy Marriage between Context-Driven and Agile
 
Do Screencasts Really Work? Assessing Student Learning through Instructional ...
Do Screencasts Really Work? Assessing Student Learning through Instructional ...Do Screencasts Really Work? Assessing Student Learning through Instructional ...
Do Screencasts Really Work? Assessing Student Learning through Instructional ...
 
Exploratory testing
Exploratory testingExploratory testing
Exploratory testing
 
Break to build - the mindset of the modern day tester
Break to build - the mindset of the modern day testerBreak to build - the mindset of the modern day tester
Break to build - the mindset of the modern day tester
 
Improve Testing with a Zone Defense
Improve Testing with a Zone DefenseImprove Testing with a Zone Defense
Improve Testing with a Zone Defense
 
Exploratory Testing Explained
Exploratory Testing ExplainedExploratory Testing Explained
Exploratory Testing Explained
 
Refactoring Test Collaboration
Refactoring Test CollaborationRefactoring Test Collaboration
Refactoring Test Collaboration
 
Experimentation from the real world
Experimentation from the real worldExperimentation from the real world
Experimentation from the real world
 
Experimentation from the real world; move from outputs to outcomes
Experimentation from the real world; move from outputs to outcomesExperimentation from the real world; move from outputs to outcomes
Experimentation from the real world; move from outputs to outcomes
 
Where does success come from?
Where does success come from?Where does success come from?
Where does success come from?
 
Shorter Version of BbWorld 09 Forensics Presentation
Shorter Version of BbWorld 09 Forensics PresentationShorter Version of BbWorld 09 Forensics Presentation
Shorter Version of BbWorld 09 Forensics Presentation
 
No Time for Testing: Strategies to Keep Testing Inside Your Sprints
No Time for Testing: Strategies to Keep Testing Inside Your SprintsNo Time for Testing: Strategies to Keep Testing Inside Your Sprints
No Time for Testing: Strategies to Keep Testing Inside Your Sprints
 
Requirementless testing
Requirementless testingRequirementless testing
Requirementless testing
 
Agile Testing: Where We Are, Where We're Heading #PHTestCon2017
Agile Testing: Where We Are, Where We're Heading #PHTestCon2017 Agile Testing: Where We Are, Where We're Heading #PHTestCon2017
Agile Testing: Where We Are, Where We're Heading #PHTestCon2017
 

Plus de Ian Pestelos #MovetheAverageUp

Plus de Ian Pestelos #MovetheAverageUp (9)

Agile Values and Mindset
Agile Values and MindsetAgile Values and Mindset
Agile Values and Mindset
 
Agile: Building Beyond Fast and Slow
Agile: Building Beyond Fast and SlowAgile: Building Beyond Fast and Slow
Agile: Building Beyond Fast and Slow
 
Leading Agility - How Might We Co-Facilitate Self-Organization
Leading Agility - How Might We Co-Facilitate Self-OrganizationLeading Agility - How Might We Co-Facilitate Self-Organization
Leading Agility - How Might We Co-Facilitate Self-Organization
 
Collaborative Test Designing through Mindmaps
Collaborative Test Designing through MindmapsCollaborative Test Designing through Mindmaps
Collaborative Test Designing through Mindmaps
 
Progression from Regression Testing - An 8-year Journey
Progression from Regression Testing - An 8-year JourneyProgression from Regression Testing - An 8-year Journey
Progression from Regression Testing - An 8-year Journey
 
New Contexts of Software Testing
New Contexts of Software TestingNew Contexts of Software Testing
New Contexts of Software Testing
 
Speaking Engagements (Ian Pestelos)
Speaking Engagements (Ian Pestelos)Speaking Engagements (Ian Pestelos)
Speaking Engagements (Ian Pestelos)
 
Begin with Risk in Mind
Begin with Risk in MindBegin with Risk in Mind
Begin with Risk in Mind
 
UXSG2014 and UX in Software Testing
UXSG2014 and UX in Software TestingUXSG2014 and UX in Software Testing
UXSG2014 and UX in Software Testing
 

Dernier

Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
Medical / Health Care (+971588192166) Mifepristone and Misoprostol tablets 200mg
 
%+27788225528 love spells in Knoxville Psychic Readings, Attraction spells,Br...
%+27788225528 love spells in Knoxville Psychic Readings, Attraction spells,Br...%+27788225528 love spells in Knoxville Psychic Readings, Attraction spells,Br...
%+27788225528 love spells in Knoxville Psychic Readings, Attraction spells,Br...
masabamasaba
 
Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024
Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024
Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024
VictoriaMetrics
 

Dernier (20)

Artyushina_Guest lecture_YorkU CS May 2024.pptx
Artyushina_Guest lecture_YorkU CS May 2024.pptxArtyushina_Guest lecture_YorkU CS May 2024.pptx
Artyushina_Guest lecture_YorkU CS May 2024.pptx
 
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
 
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
 
%+27788225528 love spells in Knoxville Psychic Readings, Attraction spells,Br...
%+27788225528 love spells in Knoxville Psychic Readings, Attraction spells,Br...%+27788225528 love spells in Knoxville Psychic Readings, Attraction spells,Br...
%+27788225528 love spells in Knoxville Psychic Readings, Attraction spells,Br...
 
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
 
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
 
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
Direct Style Effect Systems -The Print[A] Example- A Comprehension AidDirect Style Effect Systems -The Print[A] Example- A Comprehension Aid
Direct Style Effect Systems - The Print[A] Example - A Comprehension Aid
 
Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024
Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024
Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024
 
WSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open Source
WSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open SourceWSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open Source
WSO2CON 2024 - Freedom First—Unleashing Developer Potential with Open Source
 
WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...
WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...
WSO2CON 2024 - Cloud Native Middleware: Domain-Driven Design, Cell-Based Arch...
 
WSO2CON 2024 - Navigating API Complexity: REST, GraphQL, gRPC, Websocket, Web...
WSO2CON 2024 - Navigating API Complexity: REST, GraphQL, gRPC, Websocket, Web...WSO2CON 2024 - Navigating API Complexity: REST, GraphQL, gRPC, Websocket, Web...
WSO2CON 2024 - Navigating API Complexity: REST, GraphQL, gRPC, Websocket, Web...
 
%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein
%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein
%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein
 
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
 
tonesoftg
tonesoftgtonesoftg
tonesoftg
 
WSO2Con2024 - Enabling Transactional System's Exponential Growth With Simplicity
WSO2Con2024 - Enabling Transactional System's Exponential Growth With SimplicityWSO2Con2024 - Enabling Transactional System's Exponential Growth With Simplicity
WSO2Con2024 - Enabling Transactional System's Exponential Growth With Simplicity
 
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
Crypto Cloud Review - How To Earn Up To $500 Per DAY Of Bitcoin 100% On AutoP...
 
%in Benoni+277-882-255-28 abortion pills for sale in Benoni
%in Benoni+277-882-255-28 abortion pills for sale in Benoni%in Benoni+277-882-255-28 abortion pills for sale in Benoni
%in Benoni+277-882-255-28 abortion pills for sale in Benoni
 
VTU technical seminar 8Th Sem on Scikit-learn
VTU technical seminar 8Th Sem on Scikit-learnVTU technical seminar 8Th Sem on Scikit-learn
VTU technical seminar 8Th Sem on Scikit-learn
 
WSO2CON2024 - It's time to go Platformless
WSO2CON2024 - It's time to go PlatformlessWSO2CON2024 - It's time to go Platformless
WSO2CON2024 - It's time to go Platformless
 
%in Soweto+277-882-255-28 abortion pills for sale in soweto
%in Soweto+277-882-255-28 abortion pills for sale in soweto%in Soweto+277-882-255-28 abortion pills for sale in soweto
%in Soweto+277-882-255-28 abortion pills for sale in soweto
 

Tests are Nothing, Testing is Everything