SlideShare une entreprise Scribd logo
1  sur  59
Cognitive Biases in Testing 
Srikanth Krishnan, Oracle 
www.eurostarconferences.com 
@esconfs 
#esconfs
Cognitive Biases in Testing 
Srikanth S Krishnan 
Sr. Director QA 
Oracle India
Guess the percentage of 
African Nations in the UN.
What is a Cognitive Bias ?
It is the human tendency to make systematic 
errors in certain circumstances based on 
cognitive factors rather than evidence.
Heuristics Statistical mis-estimates 
Memory errors Social Constructs
Tester’s Delusion Spots 
Test Planning 
Test Design 
Test Advocacy
Anchoring
Guess the percentage of 
African Nations in the UN.
Will you be happier if you get a 
100% hike? 
Anchoring
Bidding after stating the last 2 
digits of social security number
Why are black pearls more expensive?
occurs when people consider a particular 
value for an unknown quantity before 
estimating that quantity
Effect on Estimation 
New Feature vs. regression testing of existing features
Effect on Negotiation
Relativity
Would you mind walking 5 min 
to save Rs 100 on a Rs 500 pen?
Would you mind walking 
5 min to save Rs 100 on a 
Rs 7000 suite?
Decoy Effect or Asymmetric 
dominance effect
Option A Option B 
Features 400 300 
Cost 3800 2000
Option A Option B Option C 
Features 400 300 350 
Cost 3800 2000 4500
People not only compare things, but also 
compare things that are easily comparable.
The Price of Ownership 
Endowment Effect
How much would you pay for a 
Coffee Mug ?
Applies to ideas as well as objects.
People not only compare things, but also 
compare things that are easily comparable.
The more effort you put into something the more 
ownership you feel. IKEA Effect
Ex. Manager from Finance
Test repository clean up 
Suite1 Created with 100 man days effort 
Suite2 Created with 30 man days effort 
Which one will you get rid of? 
(assume same coverage)
Effect of Expectation 
Confirmation bias: Self-Fulfilling Prophesy
How do you get more women in the orchestra?
Positive vs. negative Test cases.
Seeing patterns where none exist.
e 
xi 
st. 
e 
xis 
t. 
20 
12 
4 
31
Influence of great UI.
Negativity Bias 
More attention is given to negative than 
positive experiences
The lingering effect of a nasty bug.
Sunk Costs
Concorde Fallacy 
“I have spent so much time doing the setups.”
Concorde Fallacy 
Why test a project that has been scrapped?
Cost of Zero
Amazon’s free shipping
AOL’s unlimited plan
Concorde Fallacy 
No Cost to QA
Paradox of Choice
Concorde Fallacy 
More is not always better
Burn your bridges
Concorde Fallacy 
Why don’t we keep this server just in case?
Procrastination
Concorde Fallacy 
Choose your own deadline
Concorde Fallacy 
The hockey-stick effort curve
Concorde Fallacy 
Milestones and distributed deadlines
Resurrection to Rationality
overcoming 
channeling
References and Acknowledgements 
Predictably Irrational – Dan Ariely 
Nudge – Thaler & Sunstein 
Blink – Malcolm Gladwell 
Sway – Brafman (Ori & Rom) 
Wikipedia
Concorde Fallacy 
Thank You

Contenu connexe

Similaire à Srikanth Krishnan - Cognitive Biases in Testing - EuroSTAR 2012

Design Fixation and conformity with examples
Design Fixation and conformity with examplesDesign Fixation and conformity with examples
Design Fixation and conformity with examples
Baskar Rethinasabapathi
 
Exploratory Testing in an Agile Context
Exploratory Testing in an Agile ContextExploratory Testing in an Agile Context
Exploratory Testing in an Agile Context
Elisabeth Hendrickson
 
I Smell A RAT- Rapid Application Testing
I Smell A RAT- Rapid Application TestingI Smell A RAT- Rapid Application Testing
I Smell A RAT- Rapid Application Testing
Peter Presnell
 
How to build the wrong thing faster and learn from it keynote by David Hussma...
How to build the wrong thing faster and learn from it keynote by David Hussma...How to build the wrong thing faster and learn from it keynote by David Hussma...
How to build the wrong thing faster and learn from it keynote by David Hussma...
ProductCamp Twin Cities
 
Bringing Science to Software Development
Bringing Science to Software DevelopmentBringing Science to Software Development
Bringing Science to Software Development
Arty Starr
 

Similaire à Srikanth Krishnan - Cognitive Biases in Testing - EuroSTAR 2012 (20)

Exploratory Testing in Practice
Exploratory Testing in PracticeExploratory Testing in Practice
Exploratory Testing in Practice
 
Fantastic Tests - The Crimes of Bad Test Design
Fantastic Tests - The Crimes of Bad Test DesignFantastic Tests - The Crimes of Bad Test Design
Fantastic Tests - The Crimes of Bad Test Design
 
Michael Bolton - Two futures of software testing - Sept 2010
Michael Bolton - Two futures of software testing - Sept 2010Michael Bolton - Two futures of software testing - Sept 2010
Michael Bolton - Two futures of software testing - Sept 2010
 
Design Fixation and conformity with examples
Design Fixation and conformity with examplesDesign Fixation and conformity with examples
Design Fixation and conformity with examples
 
AI Models For Fun and Profit by Walmart Director of Artificial Intelligence
AI Models For Fun and Profit by Walmart Director of Artificial IntelligenceAI Models For Fun and Profit by Walmart Director of Artificial Intelligence
AI Models For Fun and Profit by Walmart Director of Artificial Intelligence
 
Adopting A Whole Team Approach To Quality
Adopting  A  Whole  Team  Approach  To  QualityAdopting  A  Whole  Team  Approach  To  Quality
Adopting A Whole Team Approach To Quality
 
Exploratory Testing Explained
Exploratory Testing ExplainedExploratory Testing Explained
Exploratory Testing Explained
 
Tester’s fate in an agile
Tester’s fate in an agileTester’s fate in an agile
Tester’s fate in an agile
 
Exploratory Testing in an Agile Context
Exploratory Testing in an Agile ContextExploratory Testing in an Agile Context
Exploratory Testing in an Agile Context
 
I Smell A RAT- Rapid Application Testing
I Smell A RAT- Rapid Application TestingI Smell A RAT- Rapid Application Testing
I Smell A RAT- Rapid Application Testing
 
How to build the wrong thing faster and learn from it keynote by David Hussma...
How to build the wrong thing faster and learn from it keynote by David Hussma...How to build the wrong thing faster and learn from it keynote by David Hussma...
How to build the wrong thing faster and learn from it keynote by David Hussma...
 
Combining statistics and human judgement
Combining statistics and human judgementCombining statistics and human judgement
Combining statistics and human judgement
 
Brad Klingenberg, Director of Styling Algorithms, Stitch Fix at MLconf SF - 1...
Brad Klingenberg, Director of Styling Algorithms, Stitch Fix at MLconf SF - 1...Brad Klingenberg, Director of Styling Algorithms, Stitch Fix at MLconf SF - 1...
Brad Klingenberg, Director of Styling Algorithms, Stitch Fix at MLconf SF - 1...
 
Chaos engineering
Chaos engineering Chaos engineering
Chaos engineering
 
assertYourself - Breaking the Theories and Assumptions of Unit Testing in Flex
assertYourself - Breaking the Theories and Assumptions of Unit Testing in FlexassertYourself - Breaking the Theories and Assumptions of Unit Testing in Flex
assertYourself - Breaking the Theories and Assumptions of Unit Testing in Flex
 
Creating a culture that provokes failure and boosts improvement
Creating a culture that provokes failure and boosts improvementCreating a culture that provokes failure and boosts improvement
Creating a culture that provokes failure and boosts improvement
 
[CXL Live 16] The Grand Unified Theory of Conversion Optimization by John Ekman
[CXL Live 16] The Grand Unified Theory of Conversion Optimization by John Ekman[CXL Live 16] The Grand Unified Theory of Conversion Optimization by John Ekman
[CXL Live 16] The Grand Unified Theory of Conversion Optimization by John Ekman
 
Julian Harty - Alternatives To Testing - EuroSTAR 2010
Julian Harty - Alternatives To Testing - EuroSTAR 2010Julian Harty - Alternatives To Testing - EuroSTAR 2010
Julian Harty - Alternatives To Testing - EuroSTAR 2010
 
Exploratory Testing Explained
Exploratory Testing ExplainedExploratory Testing Explained
Exploratory Testing Explained
 
Bringing Science to Software Development
Bringing Science to Software DevelopmentBringing Science to Software Development
Bringing Science to Software Development
 

Plus de TEST Huddle

Plus de TEST Huddle (20)

Why We Need Diversity in Testing- Accenture
Why We Need Diversity in Testing- AccentureWhy We Need Diversity in Testing- Accenture
Why We Need Diversity in Testing- Accenture
 
Keys to continuous testing for faster delivery euro star webinar
Keys to continuous testing for faster delivery euro star webinar Keys to continuous testing for faster delivery euro star webinar
Keys to continuous testing for faster delivery euro star webinar
 
Why you Shouldnt Automated But You Will Anyway
Why you Shouldnt Automated But You Will Anyway Why you Shouldnt Automated But You Will Anyway
Why you Shouldnt Automated But You Will Anyway
 
Being a Tester in Scrum
Being a Tester in ScrumBeing a Tester in Scrum
Being a Tester in Scrum
 
Leveraging Visual Testing with Your Functional Tests
Leveraging Visual Testing with Your Functional TestsLeveraging Visual Testing with Your Functional Tests
Leveraging Visual Testing with Your Functional Tests
 
Using Test Trees to get an Overview of Test Work
Using Test Trees to get an Overview of Test WorkUsing Test Trees to get an Overview of Test Work
Using Test Trees to get an Overview of Test Work
 
Big Data: The Magic to Attain New Heights
Big Data:  The Magic to Attain New HeightsBig Data:  The Magic to Attain New Heights
Big Data: The Magic to Attain New Heights
 
Will Robots Replace Testers?
Will Robots Replace Testers?Will Robots Replace Testers?
Will Robots Replace Testers?
 
TDD For The Rest Of Us
TDD For The Rest Of UsTDD For The Rest Of Us
TDD For The Rest Of Us
 
Scaling Agile with LeSS (Large Scale Scrum)
Scaling Agile with LeSS (Large Scale Scrum)Scaling Agile with LeSS (Large Scale Scrum)
Scaling Agile with LeSS (Large Scale Scrum)
 
Creating Agile Test Strategies for Larger Enterprises
Creating Agile Test Strategies for Larger EnterprisesCreating Agile Test Strategies for Larger Enterprises
Creating Agile Test Strategies for Larger Enterprises
 
Is There A Risk?
Is There A Risk?Is There A Risk?
Is There A Risk?
 
Are Your Tests Well-Travelled? Thoughts About Test Coverage
Are Your Tests Well-Travelled? Thoughts About Test CoverageAre Your Tests Well-Travelled? Thoughts About Test Coverage
Are Your Tests Well-Travelled? Thoughts About Test Coverage
 
Growing a Company Test Community: Roles and Paths for Testers
Growing a Company Test Community: Roles and Paths for TestersGrowing a Company Test Community: Roles and Paths for Testers
Growing a Company Test Community: Roles and Paths for Testers
 
Do we need testers on agile teams?
Do we need testers on agile teams?Do we need testers on agile teams?
Do we need testers on agile teams?
 
How to use selenium successfully
How to use selenium successfullyHow to use selenium successfully
How to use selenium successfully
 
Testers & Teams on the Agile Fluency™ Journey
Testers & Teams on the Agile Fluency™ Journey Testers & Teams on the Agile Fluency™ Journey
Testers & Teams on the Agile Fluency™ Journey
 
Practical Test Strategy Using Heuristics
Practical Test Strategy Using HeuristicsPractical Test Strategy Using Heuristics
Practical Test Strategy Using Heuristics
 
Thinking Through Your Role
Thinking Through Your RoleThinking Through Your Role
Thinking Through Your Role
 
Using Selenium 3 0
Using Selenium 3 0Using Selenium 3 0
Using Selenium 3 0
 

Dernier

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Dernier (20)

From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 

Srikanth Krishnan - Cognitive Biases in Testing - EuroSTAR 2012

Notes de l'éditeur

  1. The first section “Tester’s reality describes the common pain points in Test Design. The second section describes the concept of a mind map and how to create one. The third section describes an approach to leverage mind maps for test design.
  2. The first section “Tester’s reality describes the common pain points in Test Design. The second section describes the concept of a mind map and how to create one. The third section describes an approach to leverage mind maps for test design.
  3. Strategies for rationality -Overcoming -Channeling Checklists in a complex environment, Gawande states that experts are up against 2 difficulties - the fallibility of human memory when it comes to mundane, routine matters that are easily overlooked under the strain of more pressing events and secondly, people can lull themselves into skipping steps even when they remember them - after all certain steps don't always matter...until one day they do. Black Hat Thinking Within Edward de Bono's Six Thinking Hats process, Black Hat Thinking explores ways that an idea may not fit the situation, problems we may need to overcome, faults, or why something may not work. During Black Hat Thinking we consider obstacles, existing or potential downsides, and concerns. The single word that best describes the nature of the Black Hat is “caution.” If we are not cautious, we risk damage, danger, and disaster both for ourselves and for others. Black Thinking Hat protects us from harm. Premortem (overcomes groupthink) when the organization has almost come to an important decision but has not formally committed itself, gather for a brief session a group of individuals who are knowledgeable about the decision. The premise of the session is a short speech "Imagine that we are a year into the future .We implemented the plan now as it now exists. The outcome was a disaster. Please take 5-10 mins to write a brief history of that disaster. Reference class forecasting Using distributional information from other ventures similar to that being forecasted is called taking an "outside view" and is a cure to the planning fallacy. A large database of project plans and outcomes. Channeling Choice architecture It describes the way in which decisions are influenced by how the choices are presented. It is in arranging the choice architecture in a certain way that individuals can be nudged in a certain way without taking away their freedom of choice. A simple example of a nudge would be placing healthy foods in a school cafeteria at eye level, while putting less healthy junk food in harder to reach places. Individuals are not prevented from eating whatever they want, but the arranging of the food choices in that way has the effect of decreasing consumption of junk food and increasing consumption of healthier foods.