SlideShare une entreprise Scribd logo
1  sur  11
Confidential




                   Information Overflow

                 Is too much information a bad thing?




       Rev PA1                2011-12-07   1
Introduction

  A tester’s job is to generate information and decision material for different
  stakeholders

  What happens if the tester generates too much information which the
  stakeholder has to analyze, preventing the stakeholder from doing much
  else, such as correcting defects in the case of a developer?

  This is not a right/wrong situation – if the tester withholds information that is
  deemed low priority or not important, that same information could be
  extremely critical from a stakeholder perspective
Practical Example

    A developer has 8 hours in a day
    Each defect takes 30 minutes to analyze
    Each defect takes 4 hours to fix

    A tester submits 8 issues  developer has time to fix 3 issues
    A tester submits 24 issues  developer has time to fix 1 issue
Triage

  Of course you can have a Triage team which looks at the defects
  and prioritize them for the developers, so that the most critical
  defects are fixed first

  The problem is that the developer still has to analyze all the defects
  before the Triage team can prioritize them
Problem?

  Information Overflow becomes a problem when the inflow of
  defects is much higher than the correction rate

  If the developers have to spend all their time analyzing a mountain
  of defects, they will not have time to fix anything

  The tester must support the developer in this task by filtering the
  information they provide to their stakeholders!
Solution?

  A tester does not provide unfiltered information to the stakeholders
  either way – filtering is always performed when deciding what
  defects to report, what information to include in the defects, and
  what information to include in test reports and similar

  When the tester filters the information to the stakeholders, the tester
  must be aware of this information overflow problem, and take
  actions accordingly

  But how do you know which information to omit?


  What can we do to solve this information overflow problem?
Basic Remedy

  A few basic bullets that must always be taken into consideration
  before any other solutions are discussed
    Reports must always be accurate and understandable
    Testers must understand what information their stakeholders need, and provide
     that information in a usable format
    Testers must understand the requirements and their priority


  But even with the basics in place, how should the tester handle the
  information overflow problem?
Information Overflow Remedy

  When a defect is found, but before it is submitted to the
  stakeholders, the tester should prioritize the defect using the same
  model as the Triage Team would

  If the defect has high priority it should always be reported


  If the defect has low priority it should only be reported if the tester
  believes there are available resources to fix the problem

  If the tester cannot prioritize the defect, it should be submitted, and
  the information gained if the defect is not fixed should be used for
  future prioritizations
What about the low priority defects?

  Information should not be forgotten – even low priority defects can
  be valuable in a greater context

  Even if a defect is not submitted, the information should still be
  saved somewhere – low priority defects could show patterns, or
  give important leads to other higher priority defects

  A separate database for low priority issues that are not submitted
  should be maintained – a database which most stakeholders will
  never look into - but which is of great value to testers and selected
  stakeholders
Solution Overview

                                Provide the right
                               information in the
                                     Defect
                                                                       Testers must perform these
                                                                       actions




                                Prioritize Defect



                          Will be fixed     Will not be
                                            fixed

      Defect Database                                     Information Database




                                                               Testers use
     Developer Analysis                                   information for future
                                                                analysis
Conclusion

  Testers must take the information overflow problem into account
  when submitting defects and providing stakeholders with
  information

  A tester always filters information, but it must be done in a formal
  way to combat the information overflow problem

  No information should be lost, even though it is not reported to
  stakeholders

Contenu connexe

Tendances

Explainable Artificial Intelligence (XAI) 
to Predict and Explain Future Soft...
Explainable Artificial Intelligence (XAI) 
to Predict and Explain Future Soft...Explainable Artificial Intelligence (XAI) 
to Predict and Explain Future Soft...
Explainable Artificial Intelligence (XAI) 
to Predict and Explain Future Soft...
Chakkrit (Kla) Tantithamthavorn
 

Tendances (9)

Creating Meaningful Defect Metrics by Harmony Brenner
Creating Meaningful Defect Metrics by Harmony BrennerCreating Meaningful Defect Metrics by Harmony Brenner
Creating Meaningful Defect Metrics by Harmony Brenner
 
#ATAGTR2021 Presentation : "Use of AI and ML in Performance Testing" by Adolf...
#ATAGTR2021 Presentation : "Use of AI and ML in Performance Testing" by Adolf...#ATAGTR2021 Presentation : "Use of AI and ML in Performance Testing" by Adolf...
#ATAGTR2021 Presentation : "Use of AI and ML in Performance Testing" by Adolf...
 
tool support for testing
tool support for testingtool support for testing
tool support for testing
 
Calculating a Sample Size
Calculating a Sample SizeCalculating a Sample Size
Calculating a Sample Size
 
Defining Performance Objectives
Defining Performance ObjectivesDefining Performance Objectives
Defining Performance Objectives
 
Proman
PromanProman
Proman
 
Identify Root Causes – C&E Diagram
Identify Root Causes – C&E DiagramIdentify Root Causes – C&E Diagram
Identify Root Causes – C&E Diagram
 
Software engineering 22 error detection and debugging
Software engineering 22 error detection and debuggingSoftware engineering 22 error detection and debugging
Software engineering 22 error detection and debugging
 
Explainable Artificial Intelligence (XAI) 
to Predict and Explain Future Soft...
Explainable Artificial Intelligence (XAI) 
to Predict and Explain Future Soft...Explainable Artificial Intelligence (XAI) 
to Predict and Explain Future Soft...
Explainable Artificial Intelligence (XAI) 
to Predict and Explain Future Soft...
 

Similaire à Information overflow

Seven steps for Use Routine Information to Improve HIV/AIDS Program_Snyder_5....
Seven steps for Use Routine Information to Improve HIV/AIDS Program_Snyder_5....Seven steps for Use Routine Information to Improve HIV/AIDS Program_Snyder_5....
Seven steps for Use Routine Information to Improve HIV/AIDS Program_Snyder_5....
CORE Group
 
Bug best practice
Bug best practiceBug best practice
Bug best practice
gaoliang641
 
Implementing Vulnerability Management
Implementing Vulnerability Management Implementing Vulnerability Management
Implementing Vulnerability Management
Argyle Executive Forum
 
Testing Data & Data-Centric Applications - Whitepaper
Testing Data & Data-Centric Applications - WhitepaperTesting Data & Data-Centric Applications - Whitepaper
Testing Data & Data-Centric Applications - Whitepaper
Ryan Dowd
 

Similaire à Information overflow (20)

Defect MgmtBugDay Bangkok 2009: Defect Management
Defect MgmtBugDay Bangkok 2009: Defect ManagementDefect MgmtBugDay Bangkok 2009: Defect Management
Defect MgmtBugDay Bangkok 2009: Defect Management
 
Keynote at Big Data Tech Con SF 2014
Keynote at Big Data Tech Con SF 2014Keynote at Big Data Tech Con SF 2014
Keynote at Big Data Tech Con SF 2014
 
Seven steps for Use Routine Information to Improve HIV/AIDS Program_Snyder_5....
Seven steps for Use Routine Information to Improve HIV/AIDS Program_Snyder_5....Seven steps for Use Routine Information to Improve HIV/AIDS Program_Snyder_5....
Seven steps for Use Routine Information to Improve HIV/AIDS Program_Snyder_5....
 
Problem Solving1.pptx
Problem Solving1.pptxProblem Solving1.pptx
Problem Solving1.pptx
 
Operating Excellence is built on Corrective & Preventive Actions
Operating Excellence is built on Corrective & Preventive ActionsOperating Excellence is built on Corrective & Preventive Actions
Operating Excellence is built on Corrective & Preventive Actions
 
Testing Intelligence
Testing IntelligenceTesting Intelligence
Testing Intelligence
 
Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...
Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...
Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...
 
Planning and Deploying an Effective Vulnerability Management Program
Planning and Deploying an Effective Vulnerability Management ProgramPlanning and Deploying an Effective Vulnerability Management Program
Planning and Deploying an Effective Vulnerability Management Program
 
thegrowingimportanceofdatacleaning-211202141902.pptx
thegrowingimportanceofdatacleaning-211202141902.pptxthegrowingimportanceofdatacleaning-211202141902.pptx
thegrowingimportanceofdatacleaning-211202141902.pptx
 
Four ways to combat non actionable alerts
Four ways to combat non actionable alertsFour ways to combat non actionable alerts
Four ways to combat non actionable alerts
 
The Growing Importance of Data Cleaning
The Growing Importance of Data CleaningThe Growing Importance of Data Cleaning
The Growing Importance of Data Cleaning
 
Dow Chemical presentation at the Chief Analytics Officer Forum East Coast USA...
Dow Chemical presentation at the Chief Analytics Officer Forum East Coast USA...Dow Chemical presentation at the Chief Analytics Officer Forum East Coast USA...
Dow Chemical presentation at the Chief Analytics Officer Forum East Coast USA...
 
How to Load Data More Quickly and Accurately into Oracle's Life Sciences Data...
How to Load Data More Quickly and Accurately into Oracle's Life Sciences Data...How to Load Data More Quickly and Accurately into Oracle's Life Sciences Data...
How to Load Data More Quickly and Accurately into Oracle's Life Sciences Data...
 
Bug best practice
Bug best practiceBug best practice
Bug best practice
 
Building an Open Source AppSec Pipeline
Building an Open Source AppSec PipelineBuilding an Open Source AppSec Pipeline
Building an Open Source AppSec Pipeline
 
Introducing Puppet Remediate™
Introducing Puppet Remediate™Introducing Puppet Remediate™
Introducing Puppet Remediate™
 
Implementing Vulnerability Management
Implementing Vulnerability Management Implementing Vulnerability Management
Implementing Vulnerability Management
 
Testing Data & Data-Centric Applications - Whitepaper
Testing Data & Data-Centric Applications - WhitepaperTesting Data & Data-Centric Applications - Whitepaper
Testing Data & Data-Centric Applications - Whitepaper
 
H2O World - Top 10 Data Science Pitfalls - Mark Landry
H2O World - Top 10 Data Science Pitfalls - Mark LandryH2O World - Top 10 Data Science Pitfalls - Mark Landry
H2O World - Top 10 Data Science Pitfalls - Mark Landry
 
Testing metrics webinar
Testing metrics webinarTesting metrics webinar
Testing metrics webinar
 

Plus de Johan Hoberg

Plus de Johan Hoberg (20)

Approaches to unraveling a complex test problem
Approaches to unraveling a complex test problemApproaches to unraveling a complex test problem
Approaches to unraveling a complex test problem
 
A business case for a modern QA organization
A business case for a modern QA organizationA business case for a modern QA organization
A business case for a modern QA organization
 
Signing off on Quality
Signing off on QualitySigning off on Quality
Signing off on Quality
 
Quality Information Coverage - A QI Concept
Quality Information Coverage - A QI ConceptQuality Information Coverage - A QI Concept
Quality Information Coverage - A QI Concept
 
The Bug Backlog - An Evergrowing Mountain
The Bug Backlog - An Evergrowing MountainThe Bug Backlog - An Evergrowing Mountain
The Bug Backlog - An Evergrowing Mountain
 
Quality Intelligence: Transparency & Visibility
Quality Intelligence: Transparency & VisibilityQuality Intelligence: Transparency & Visibility
Quality Intelligence: Transparency & Visibility
 
Building a QA Mindset
Building a QA Mindset Building a QA Mindset
Building a QA Mindset
 
What is QI?
What is QI?What is QI?
What is QI?
 
Building High Quality Software
Building High Quality Software Building High Quality Software
Building High Quality Software
 
Testit 2017 - Exploratory Testing for Everyone
Testit 2017 - Exploratory Testing for EveryoneTestit 2017 - Exploratory Testing for Everyone
Testit 2017 - Exploratory Testing for Everyone
 
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
Don’t celebrate failure. Don’t celebrate success. Celebrate commitment, owner...
 
Moving from scripted regression testing to exploratory testing
Moving from scripted regression testing to exploratory testingMoving from scripted regression testing to exploratory testing
Moving from scripted regression testing to exploratory testing
 
Building High Quality Software
Building High Quality SoftwareBuilding High Quality Software
Building High Quality Software
 
Quality, Testing & Agile Methodologies
Quality, Testing & Agile MethodologiesQuality, Testing & Agile Methodologies
Quality, Testing & Agile Methodologies
 
QI, not QA
QI, not QAQI, not QA
QI, not QA
 
Defining Test Competence
Defining Test CompetenceDefining Test Competence
Defining Test Competence
 
Why all deadlines are bad for quality
Why all deadlines are bad for qualityWhy all deadlines are bad for quality
Why all deadlines are bad for quality
 
QI, not QA
QI, not QAQI, not QA
QI, not QA
 
Do we really need game testers?
Do we really need game testers?Do we really need game testers?
Do we really need game testers?
 
Hardware/Software Integration Testing
Hardware/Software Integration TestingHardware/Software Integration Testing
Hardware/Software Integration Testing
 

Dernier

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Dernier (20)

Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 

Information overflow

  • 1. Confidential Information Overflow Is too much information a bad thing? Rev PA1 2011-12-07 1
  • 2. Introduction  A tester’s job is to generate information and decision material for different stakeholders  What happens if the tester generates too much information which the stakeholder has to analyze, preventing the stakeholder from doing much else, such as correcting defects in the case of a developer?  This is not a right/wrong situation – if the tester withholds information that is deemed low priority or not important, that same information could be extremely critical from a stakeholder perspective
  • 3. Practical Example  A developer has 8 hours in a day  Each defect takes 30 minutes to analyze  Each defect takes 4 hours to fix  A tester submits 8 issues  developer has time to fix 3 issues  A tester submits 24 issues  developer has time to fix 1 issue
  • 4. Triage  Of course you can have a Triage team which looks at the defects and prioritize them for the developers, so that the most critical defects are fixed first  The problem is that the developer still has to analyze all the defects before the Triage team can prioritize them
  • 5. Problem?  Information Overflow becomes a problem when the inflow of defects is much higher than the correction rate  If the developers have to spend all their time analyzing a mountain of defects, they will not have time to fix anything  The tester must support the developer in this task by filtering the information they provide to their stakeholders!
  • 6. Solution?  A tester does not provide unfiltered information to the stakeholders either way – filtering is always performed when deciding what defects to report, what information to include in the defects, and what information to include in test reports and similar  When the tester filters the information to the stakeholders, the tester must be aware of this information overflow problem, and take actions accordingly  But how do you know which information to omit?  What can we do to solve this information overflow problem?
  • 7. Basic Remedy  A few basic bullets that must always be taken into consideration before any other solutions are discussed  Reports must always be accurate and understandable  Testers must understand what information their stakeholders need, and provide that information in a usable format  Testers must understand the requirements and their priority  But even with the basics in place, how should the tester handle the information overflow problem?
  • 8. Information Overflow Remedy  When a defect is found, but before it is submitted to the stakeholders, the tester should prioritize the defect using the same model as the Triage Team would  If the defect has high priority it should always be reported  If the defect has low priority it should only be reported if the tester believes there are available resources to fix the problem  If the tester cannot prioritize the defect, it should be submitted, and the information gained if the defect is not fixed should be used for future prioritizations
  • 9. What about the low priority defects?  Information should not be forgotten – even low priority defects can be valuable in a greater context  Even if a defect is not submitted, the information should still be saved somewhere – low priority defects could show patterns, or give important leads to other higher priority defects  A separate database for low priority issues that are not submitted should be maintained – a database which most stakeholders will never look into - but which is of great value to testers and selected stakeholders
  • 10. Solution Overview Provide the right information in the Defect Testers must perform these actions Prioritize Defect Will be fixed Will not be fixed Defect Database Information Database Testers use Developer Analysis information for future analysis
  • 11. Conclusion  Testers must take the information overflow problem into account when submitting defects and providing stakeholders with information  A tester always filters information, but it must be done in a formal way to combat the information overflow problem  No information should be lost, even though it is not reported to stakeholders