SlideShare une entreprise Scribd logo
1  sur  42
Télécharger pour lire hors ligne
F*ck
Quality
@mpilaeten
% of requirements covered
% of code covered
% of test cases executed
% of test cases passed
# of open defects
Unreachable
expectations
about quality
So ?
To abjure
Tantamount
To proscribe
Officious
Limpid
To reject
Equivalent in value
To condemn, tooutlaw
Offering unwanted services
Clear, transparent
Overestimate
our own level of
quality
So ?
Defect Percentage = # defects
KLOC
50% (and higher) Passed
65% (and higher) With Honor (Cum Laude)
75% (and higher) With Great Honor (Magna Cum Laude)
85% (and higher) With Highest Honor (Summa Cum Laude)
50,2% Not Passed
32,6% Passed
10,7% With Honor
5,9% With Great Honor
0,6% With Highest Honor
Source: Vlaams Instituut voor Economie en Samenleving ism KU Leuven
To become an MD, only 60% is required
Perfection may/must
not be within reach
So ?
Quality is
Contextual
So ?
How can we
determine quality?
But …
Introducing…
The Cone of Quality
Budget
Time
Inverse of
Scope
More time - possible higher quality
Higher budget - possible higher quality
Increased scope - possible lower quality
The quality we hope for
The quality we get
Requirements
S.M.A.R.T.
Expensive
Requirements
means
The quality equilibrium
What the business wants
to pay
for quality
What you have
to invest
in quality
How to determine the
quality investment?
But …
Thinking Risk
=
Being Afraid
How to determine the
quality investment?
But …
better
Must Be Quality
= Dissatisfiers
One Dimensional Quality
= Satisfiers
Attractive Quality
= Delighters
How to make decisions
regarding quality?
Wait …
Karl E. Wiegers
Step 1: Determine the requirements
Feature Relative Benefit Relative Penalty Value Value %
Registration Module
Update content
Facebook Integration
Customer migration
New look and feel
Step 2: Assess the Benefit
Feature Relative Benefit Relative Penalty Value Value %
Registration Module 1
Update content 5
Facebook Integration 6
Customer migration 5
New look and feel 7
Total: 24
Step 3: Assess the Penalty
Feature Relative Benefit Relative Penalty Value Value %
Registration Module 1 3
Update content 5 8
Facebook Integration 6 5
Customer migration 5 3
New look and feel 7 4
Total: 24 23
Step 4: Calculate the Value
Feature Relative Benefit Relative Penalty Value Value %
Registration Module 1 3 4
Update content 5 8 13
Facebook Integration 6 5 11
Customer migration 5 3 8
New look and feel 7 4 11
Total: 24 23 47
Value : Benefit + Penalty
Step 5: Calculate the Value %
Feature Relative Benefit Relative Penalty Value Value %
Registration Module 1 3 4 8,51
Update content 5 8 13 27,66
Facebook Integration 6 5 11 23,40
Customer migration 5 3 8 17,02
New look and feel 7 4 11 23,40
Total: 24 23 47
Value % : Value / Total Value
Step 6: Assess the Relative Cost
Feature Value % Relative Cost Cost % Relative Risk Risk %
Registration Module 8,51 2
Update content 27,66 10
Facebook Integration 23,40 4
Customer migration 17,02 3
New look and feel 23,40 8
Total: 27
Step 7: Calculate the Cost %
Feature Value % Relative Cost Cost % Relative Risk Risk %
Registration Module 8,51 2 7,41
Update content 27,66 10 37,04
Facebook Integration 23,40 4 14,81
Customer migration 17,02 3 11,11
New look and feel 23,40 8 29,63
Total: 27
Cost% : Relative Cost / Total Cost
Step 8: Assess the Relative Risk
Feature Value % Relative Cost Cost % Relative Risk Risk %
Registration Module 8,51 2 7,41 2
Update content 27,66 10 37,04 4
Facebook Integration 23,40 4 14,81 4
Customer migration 17,02 3 11,11 10
New look and feel 23,40 8 29,63 8
Total: 27 28
Step 9: Calculate the Risk %
Feature Value % Relative Cost Cost % Relative Risk Risk %
Registration Module 8,51 2 7,41 2 7,14
Update content 27,66 10 37,04 4 14,28
Facebook Integration 23,40 4 14,81 4 14,28
Customer migration 17,02 3 11,11 10 35,71
New look and feel 23,40 8 29,63 8 28,57
Total: 27 28
Risk% : Relative Risk / Total Risk
Step 10: Calculate the Priority
Feature Value % Cost % Risk % Priority Order
Registration Module 8,51 7,41 7,14 0,58 2
Update content 27,66 37,04 14,28 0,54 3
Facebook Integration 23,40 14,81 14,28 0,80 1
Customer migration 17,02 11,11 35,71 0,36 5
New look and feel 23,40 29,63 28,57 0,40 4
Priority: Value % / (Cost % + Risk %)
Better prioritization
means
Higher quality
means
Happier customers
A final word

Contenu connexe

Tendances

Automation testing strategy, approach & planning
Automation testing  strategy, approach & planningAutomation testing  strategy, approach & planning
Automation testing strategy, approach & planningSivaprasanthRentala1975
 
Test Automation Architecture in Microservices
Test Automation Architecture in MicroservicesTest Automation Architecture in Microservices
Test Automation Architecture in MicroservicesAlper Mermer
 
Developing a test automation strategy by Brian Bayer
Developing a test automation strategy by Brian BayerDeveloping a test automation strategy by Brian Bayer
Developing a test automation strategy by Brian BayerQA or the Highway
 
Myth vs Reality: Understanding AI/ML for QA Automation - w/ Jonathan Lipps
Myth vs Reality: Understanding AI/ML for QA Automation - w/ Jonathan LippsMyth vs Reality: Understanding AI/ML for QA Automation - w/ Jonathan Lipps
Myth vs Reality: Understanding AI/ML for QA Automation - w/ Jonathan LippsApplitools
 
How agile performance testing helps automate and scale test processes
How agile performance testing helps automate and scale test processesHow agile performance testing helps automate and scale test processes
How agile performance testing helps automate and scale test processesApica
 
Automated Visual Regression Testing by Dave Sadlon
Automated Visual Regression Testing by Dave SadlonAutomated Visual Regression Testing by Dave Sadlon
Automated Visual Regression Testing by Dave SadlonQA or the Highway
 
Going Scriptless: Implementing Model-Based Test Automation in a Large Enterpr...
Going Scriptless: Implementing Model-Based Test Automation in a Large Enterpr...Going Scriptless: Implementing Model-Based Test Automation in a Large Enterpr...
Going Scriptless: Implementing Model-Based Test Automation in a Large Enterpr...QA or the Highway
 
Mobile Apps development best practices. TDD, CI, CD
Mobile Apps development best practices. TDD, CI, CDMobile Apps development best practices. TDD, CI, CD
Mobile Apps development best practices. TDD, CI, CDGlobalLogic Ukraine
 
Load Testing and Continuous Integration
Load Testing and Continuous IntegrationLoad Testing and Continuous Integration
Load Testing and Continuous IntegrationApica
 
An Introduction To Software Development - Final Review
An Introduction To Software Development - Final ReviewAn Introduction To Software Development - Final Review
An Introduction To Software Development - Final ReviewBlue Elephant Consulting
 
Nonfunctional Testing: Examine the Other Side of the Coin
Nonfunctional Testing: Examine the Other Side of the CoinNonfunctional Testing: Examine the Other Side of the Coin
Nonfunctional Testing: Examine the Other Side of the CoinTechWell
 
Become a Performance Diagnostics Hero
Become a Performance Diagnostics HeroBecome a Performance Diagnostics Hero
Become a Performance Diagnostics HeroTechWell
 
Test Driven Development
Test Driven DevelopmentTest Driven Development
Test Driven DevelopmentZendCon
 
ReportPortal.io - Open Source experience. Showcase, benefits
ReportPortal.io - Open Source experience. Showcase, benefits ReportPortal.io - Open Source experience. Showcase, benefits
ReportPortal.io - Open Source experience. Showcase, benefits COMAQA.BY
 
Diffy : Automatic Testing of Microservices @ Twitter
Diffy : Automatic Testing of Microservices @ TwitterDiffy : Automatic Testing of Microservices @ Twitter
Diffy : Automatic Testing of Microservices @ TwitterPuneet Khanduri
 
The 3 Top Techniques for Web Security Testing Using a Proxy
The 3 Top Techniques for Web Security Testing Using a ProxyThe 3 Top Techniques for Web Security Testing Using a Proxy
The 3 Top Techniques for Web Security Testing Using a ProxyTEST Huddle
 

Tendances (20)

Automation testing strategy, approach & planning
Automation testing  strategy, approach & planningAutomation testing  strategy, approach & planning
Automation testing strategy, approach & planning
 
Test Automation Architecture in Microservices
Test Automation Architecture in MicroservicesTest Automation Architecture in Microservices
Test Automation Architecture in Microservices
 
Developing a test automation strategy by Brian Bayer
Developing a test automation strategy by Brian BayerDeveloping a test automation strategy by Brian Bayer
Developing a test automation strategy by Brian Bayer
 
Automation Testing
Automation TestingAutomation Testing
Automation Testing
 
Myth vs Reality: Understanding AI/ML for QA Automation - w/ Jonathan Lipps
Myth vs Reality: Understanding AI/ML for QA Automation - w/ Jonathan LippsMyth vs Reality: Understanding AI/ML for QA Automation - w/ Jonathan Lipps
Myth vs Reality: Understanding AI/ML for QA Automation - w/ Jonathan Lipps
 
How agile performance testing helps automate and scale test processes
How agile performance testing helps automate and scale test processesHow agile performance testing helps automate and scale test processes
How agile performance testing helps automate and scale test processes
 
Automated Visual Regression Testing by Dave Sadlon
Automated Visual Regression Testing by Dave SadlonAutomated Visual Regression Testing by Dave Sadlon
Automated Visual Regression Testing by Dave Sadlon
 
Going Scriptless: Implementing Model-Based Test Automation in a Large Enterpr...
Going Scriptless: Implementing Model-Based Test Automation in a Large Enterpr...Going Scriptless: Implementing Model-Based Test Automation in a Large Enterpr...
Going Scriptless: Implementing Model-Based Test Automation in a Large Enterpr...
 
Mobile Apps development best practices. TDD, CI, CD
Mobile Apps development best practices. TDD, CI, CDMobile Apps development best practices. TDD, CI, CD
Mobile Apps development best practices. TDD, CI, CD
 
Load Testing and Continuous Integration
Load Testing and Continuous IntegrationLoad Testing and Continuous Integration
Load Testing and Continuous Integration
 
An Introduction To Software Development - Final Review
An Introduction To Software Development - Final ReviewAn Introduction To Software Development - Final Review
An Introduction To Software Development - Final Review
 
Nonfunctional Testing: Examine the Other Side of the Coin
Nonfunctional Testing: Examine the Other Side of the CoinNonfunctional Testing: Examine the Other Side of the Coin
Nonfunctional Testing: Examine the Other Side of the Coin
 
Become a Performance Diagnostics Hero
Become a Performance Diagnostics HeroBecome a Performance Diagnostics Hero
Become a Performance Diagnostics Hero
 
Test Driven Development
Test Driven DevelopmentTest Driven Development
Test Driven Development
 
Automation With A Tool Demo
Automation With A Tool DemoAutomation With A Tool Demo
Automation With A Tool Demo
 
ReportPortal.io - Open Source experience. Showcase, benefits
ReportPortal.io - Open Source experience. Showcase, benefits ReportPortal.io - Open Source experience. Showcase, benefits
ReportPortal.io - Open Source experience. Showcase, benefits
 
Agile test practices
Agile test practicesAgile test practices
Agile test practices
 
Diffy : Automatic Testing of Microservices @ Twitter
Diffy : Automatic Testing of Microservices @ TwitterDiffy : Automatic Testing of Microservices @ Twitter
Diffy : Automatic Testing of Microservices @ Twitter
 
Automation testing
Automation testingAutomation testing
Automation testing
 
The 3 Top Techniques for Web Security Testing Using a Proxy
The 3 Top Techniques for Web Security Testing Using a ProxyThe 3 Top Techniques for Web Security Testing Using a Proxy
The 3 Top Techniques for Web Security Testing Using a Proxy
 

En vedette

10 signs your testing is not enough
10 signs your testing is not enough10 signs your testing is not enough
10 signs your testing is not enoughSQALab
 
A New Model for Testing
A New Model for TestingA New Model for Testing
A New Model for TestingSQALab
 
Test Cases - are they dead?
Test Cases - are they dead?Test Cases - are they dead?
Test Cases - are they dead?SQALab
 
Help Me, I got a team of junior testers!
Help Me, I got a team of junior testers!Help Me, I got a team of junior testers!
Help Me, I got a team of junior testers!SQALab
 
How to reduce your test cases... magically!
How to reduce your test cases... magically!How to reduce your test cases... magically!
How to reduce your test cases... magically!SQALab
 
Examples how to move towards Zero Defects
Examples how to move towards Zero DefectsExamples how to move towards Zero Defects
Examples how to move towards Zero DefectsSQALab
 
Git хуки на страже качества кода
Git хуки на страже качества кодаGit хуки на страже качества кода
Git хуки на страже качества кодаBadoo Development
 
Risks of Risk-Based Testing
Risks of Risk-Based TestingRisks of Risk-Based Testing
Risks of Risk-Based Testingrrice2000
 
Put Risk Based Testing in place right now!
Put Risk Based Testing in place right now!Put Risk Based Testing in place right now!
Put Risk Based Testing in place right now!SQALab
 
Requirements Driven Risk Based Testing
Requirements Driven Risk Based TestingRequirements Driven Risk Based Testing
Requirements Driven Risk Based TestingJeff Findlay
 
Practical Application Of Risk Based Testing Methods
Practical Application Of Risk Based Testing MethodsPractical Application Of Risk Based Testing Methods
Practical Application Of Risk Based Testing MethodsReuben Korngold
 
What to do with the problems you cannot solve?
What to do with the problems you cannot solve?What to do with the problems you cannot solve?
What to do with the problems you cannot solve?SQALab
 
Risk-based Testing
Risk-based TestingRisk-based Testing
Risk-based TestingJohan Hoberg
 
The emotional intellect in testing
The emotional intellect in testingThe emotional intellect in testing
The emotional intellect in testingSQALab
 
risk based testing and regression testing
risk based testing and regression testingrisk based testing and regression testing
risk based testing and regression testingToshi Patel
 
DevOps модное слово или следующая ступень эволюции
DevOps модное слово или следующая ступень эволюцииDevOps модное слово или следующая ступень эволюции
DevOps модное слово или следующая ступень эволюцииAndrey Rebrov
 
Better Page Object Handling with Loadable Component Pattern
Better Page Object Handling with Loadable Component PatternBetter Page Object Handling with Loadable Component Pattern
Better Page Object Handling with Loadable Component PatternSQALab
 
Psychology and testing
Psychology and testingPsychology and testing
Psychology and testingSQALab
 
DevOps от и до - что, зачем и почему
DevOps от и до - что, зачем и почемуDevOps от и до - что, зачем и почему
DevOps от и до - что, зачем и почемуAndrey Rebrov
 

En vedette (20)

10 signs your testing is not enough
10 signs your testing is not enough10 signs your testing is not enough
10 signs your testing is not enough
 
A New Model for Testing
A New Model for TestingA New Model for Testing
A New Model for Testing
 
Test Cases - are they dead?
Test Cases - are they dead?Test Cases - are they dead?
Test Cases - are they dead?
 
Help Me, I got a team of junior testers!
Help Me, I got a team of junior testers!Help Me, I got a team of junior testers!
Help Me, I got a team of junior testers!
 
How to reduce your test cases... magically!
How to reduce your test cases... magically!How to reduce your test cases... magically!
How to reduce your test cases... magically!
 
Examples how to move towards Zero Defects
Examples how to move towards Zero DefectsExamples how to move towards Zero Defects
Examples how to move towards Zero Defects
 
Git хуки на страже качества кода
Git хуки на страже качества кодаGit хуки на страже качества кода
Git хуки на страже качества кода
 
Risks of Risk-Based Testing
Risks of Risk-Based TestingRisks of Risk-Based Testing
Risks of Risk-Based Testing
 
Put Risk Based Testing in place right now!
Put Risk Based Testing in place right now!Put Risk Based Testing in place right now!
Put Risk Based Testing in place right now!
 
Requirements Driven Risk Based Testing
Requirements Driven Risk Based TestingRequirements Driven Risk Based Testing
Requirements Driven Risk Based Testing
 
Practical Application Of Risk Based Testing Methods
Practical Application Of Risk Based Testing MethodsPractical Application Of Risk Based Testing Methods
Practical Application Of Risk Based Testing Methods
 
What to do with the problems you cannot solve?
What to do with the problems you cannot solve?What to do with the problems you cannot solve?
What to do with the problems you cannot solve?
 
Risk-based Testing
Risk-based TestingRisk-based Testing
Risk-based Testing
 
The emotional intellect in testing
The emotional intellect in testingThe emotional intellect in testing
The emotional intellect in testing
 
risk based testing and regression testing
risk based testing and regression testingrisk based testing and regression testing
risk based testing and regression testing
 
The Barracks Park
The Barracks ParkThe Barracks Park
The Barracks Park
 
DevOps модное слово или следующая ступень эволюции
DevOps модное слово или следующая ступень эволюцииDevOps модное слово или следующая ступень эволюции
DevOps модное слово или следующая ступень эволюции
 
Better Page Object Handling with Loadable Component Pattern
Better Page Object Handling with Loadable Component PatternBetter Page Object Handling with Loadable Component Pattern
Better Page Object Handling with Loadable Component Pattern
 
Psychology and testing
Psychology and testingPsychology and testing
Psychology and testing
 
DevOps от и до - что, зачем и почему
DevOps от и до - что, зачем и почемуDevOps от и до - что, зачем и почему
DevOps от и до - что, зачем и почему
 

Similaire à Forget Quality!

Data-Driven Product Management by Shutterfly Director of Product
Data-Driven Product Management by Shutterfly Director of ProductData-Driven Product Management by Shutterfly Director of Product
Data-Driven Product Management by Shutterfly Director of ProductProduct School
 
Intro to A/B Testing by Spark Networks former Sr. Product Manager
Intro to A/B Testing by Spark Networks former Sr. Product ManagerIntro to A/B Testing by Spark Networks former Sr. Product Manager
Intro to A/B Testing by Spark Networks former Sr. Product ManagerProduct School
 
Vendor Selection
Vendor SelectionVendor Selection
Vendor SelectionPMG-I
 
Vendor Selection
Vendor SelectionVendor Selection
Vendor SelectionPMG-I
 
Build a Winning Conversion Optimization Strategy
Build a Winning Conversion Optimization StrategyBuild a Winning Conversion Optimization Strategy
Build a Winning Conversion Optimization StrategySavage Marketing
 
KPIs & Metrics - Innlab RM 2013
KPIs & Metrics - Innlab RM 2013KPIs & Metrics - Innlab RM 2013
KPIs & Metrics - Innlab RM 2013matteopanfilo
 
Know the Best Cost Reduction & Performance Management Strategies
Know the Best Cost Reduction & Performance Management StrategiesKnow the Best Cost Reduction & Performance Management Strategies
Know the Best Cost Reduction & Performance Management StrategiesNext Level Purchasing
 
The guide to A/B testing
The guide to A/B testingThe guide to A/B testing
The guide to A/B testingSarah Dentes
 
Lean Analytics Cycle
Lean Analytics CycleLean Analytics Cycle
Lean Analytics CycleHiten Shah
 
Company valuation report sample
Company valuation report sampleCompany valuation report sample
Company valuation report sampleEquidam
 
KPI, Metriche e Customer Acquisition
KPI, Metriche e Customer AcquisitionKPI, Metriche e Customer Acquisition
KPI, Metriche e Customer AcquisitionGiTItaly
 
7 Habits of Highly Effective B2B Marketing Teams
7 Habits of Highly Effective B2B Marketing Teams7 Habits of Highly Effective B2B Marketing Teams
7 Habits of Highly Effective B2B Marketing TeamsSocedo
 
Retrospective data analytics slides
Retrospective data analytics slidesRetrospective data analytics slides
Retrospective data analytics slidesJim Kaplan CIA CFE
 
Saas bootcamp sales and marketing processes 2016
Saas bootcamp sales and marketing processes 2016Saas bootcamp sales and marketing processes 2016
Saas bootcamp sales and marketing processes 2016SaaSBootcamp
 
Maximizing Subscription Revenue: How 3 businesses increased their subscriptio...
Maximizing Subscription Revenue: How 3 businesses increased their subscriptio...Maximizing Subscription Revenue: How 3 businesses increased their subscriptio...
Maximizing Subscription Revenue: How 3 businesses increased their subscriptio...MarketingExperiments
 
LCMC Session: Email and Web Conversion Success
LCMC Session: Email and Web Conversion SuccessLCMC Session: Email and Web Conversion Success
LCMC Session: Email and Web Conversion SuccessBlueHornet
 
Evolution of the DevOps Quality Management Office
Evolution of the DevOps Quality Management OfficeEvolution of the DevOps Quality Management Office
Evolution of the DevOps Quality Management OfficeCapgemini
 

Similaire à Forget Quality! (20)

Data-Driven Product Management by Shutterfly Director of Product
Data-Driven Product Management by Shutterfly Director of ProductData-Driven Product Management by Shutterfly Director of Product
Data-Driven Product Management by Shutterfly Director of Product
 
Eventroi
EventroiEventroi
Eventroi
 
Intro to A/B Testing by Spark Networks former Sr. Product Manager
Intro to A/B Testing by Spark Networks former Sr. Product ManagerIntro to A/B Testing by Spark Networks former Sr. Product Manager
Intro to A/B Testing by Spark Networks former Sr. Product Manager
 
Vendor Selection
Vendor SelectionVendor Selection
Vendor Selection
 
Vendor Selection
Vendor SelectionVendor Selection
Vendor Selection
 
Build a Winning Conversion Optimization Strategy
Build a Winning Conversion Optimization StrategyBuild a Winning Conversion Optimization Strategy
Build a Winning Conversion Optimization Strategy
 
KPIs & Metrics - Innlab RM 2013
KPIs & Metrics - Innlab RM 2013KPIs & Metrics - Innlab RM 2013
KPIs & Metrics - Innlab RM 2013
 
Know the Best Cost Reduction & Performance Management Strategies
Know the Best Cost Reduction & Performance Management StrategiesKnow the Best Cost Reduction & Performance Management Strategies
Know the Best Cost Reduction & Performance Management Strategies
 
The guide to A/B testing
The guide to A/B testingThe guide to A/B testing
The guide to A/B testing
 
Lean Analytics Cycle
Lean Analytics CycleLean Analytics Cycle
Lean Analytics Cycle
 
Company valuation report sample
Company valuation report sampleCompany valuation report sample
Company valuation report sample
 
KPI, Metriche e Customer Acquisition
KPI, Metriche e Customer AcquisitionKPI, Metriche e Customer Acquisition
KPI, Metriche e Customer Acquisition
 
7 Habits of Highly Effective B2B Marketing Teams
7 Habits of Highly Effective B2B Marketing Teams7 Habits of Highly Effective B2B Marketing Teams
7 Habits of Highly Effective B2B Marketing Teams
 
Retrospective data analytics slides
Retrospective data analytics slidesRetrospective data analytics slides
Retrospective data analytics slides
 
Saas bootcamp sales and marketing processes 2016
Saas bootcamp sales and marketing processes 2016Saas bootcamp sales and marketing processes 2016
Saas bootcamp sales and marketing processes 2016
 
Maximizing Subscription Revenue: How 3 businesses increased their subscriptio...
Maximizing Subscription Revenue: How 3 businesses increased their subscriptio...Maximizing Subscription Revenue: How 3 businesses increased their subscriptio...
Maximizing Subscription Revenue: How 3 businesses increased their subscriptio...
 
LCMC Session: Email and Web Conversion Success
LCMC Session: Email and Web Conversion SuccessLCMC Session: Email and Web Conversion Success
LCMC Session: Email and Web Conversion Success
 
Lean introduction
Lean introductionLean introduction
Lean introduction
 
Evolution of the DevOps Quality Management Office
Evolution of the DevOps Quality Management OfficeEvolution of the DevOps Quality Management Office
Evolution of the DevOps Quality Management Office
 
Modul 3.2: Improve Phase
Modul 3.2: Improve PhaseModul 3.2: Improve Phase
Modul 3.2: Improve Phase
 

Plus de SQALab

Готовим стажировку
Готовим стажировкуГотовим стажировку
Готовим стажировкуSQALab
 
Куда приводят мечты? или Искусство развития тестировщика
Куда приводят мечты? или Искусство развития тестировщикаКуда приводят мечты? или Искусство развития тестировщика
Куда приводят мечты? или Искусство развития тестировщикаSQALab
 
Оптимизация Selenium тестов и ускорение их поддержки
Оптимизация Selenium тестов и ускорение их поддержкиОптимизация Selenium тестов и ускорение их поддержки
Оптимизация Selenium тестов и ускорение их поддержкиSQALab
 
Автоматизация 0.0: 0 - бюджет, 0 - опыт программирования
Автоматизация 0.0: 0 - бюджет, 0 - опыт программированияАвтоматизация 0.0: 0 - бюджет, 0 - опыт программирования
Автоматизация 0.0: 0 - бюджет, 0 - опыт программированияSQALab
 
Нагрузочное тестирование нестандартных протоколов с использованием Citrix и J...
Нагрузочное тестирование нестандартных протоколов с использованием Citrix и J...Нагрузочное тестирование нестандартных протоколов с использованием Citrix и J...
Нагрузочное тестирование нестандартных протоколов с использованием Citrix и J...SQALab
 
Continuous performance testing
Continuous performance testingContinuous performance testing
Continuous performance testingSQALab
 
Конфиги вместо костылей. Pytestconfig и зачем он нужен
Конфиги вместо костылей. Pytestconfig и зачем он нуженКонфиги вместо костылей. Pytestconfig и зачем он нужен
Конфиги вместо костылей. Pytestconfig и зачем он нуженSQALab
 
Команда чемпионов в ИТ стихии
Команда чемпионов в ИТ стихииКоманда чемпионов в ИТ стихии
Команда чемпионов в ИТ стихииSQALab
 
API. Серебряная пуля в магазине советов
API. Серебряная пуля в магазине советовAPI. Серебряная пуля в магазине советов
API. Серебряная пуля в магазине советовSQALab
 
Добиваемся эффективности каждого из 9000+ UI-тестов
Добиваемся эффективности каждого из 9000+ UI-тестовДобиваемся эффективности каждого из 9000+ UI-тестов
Добиваемся эффективности каждого из 9000+ UI-тестовSQALab
 
Делаем автоматизацию проектных KPIs
Делаем автоматизацию проектных KPIsДелаем автоматизацию проектных KPIs
Делаем автоматизацию проектных KPIsSQALab
 
Вредные привычки в тест-менеджменте
Вредные привычки в тест-менеджментеВредные привычки в тест-менеджменте
Вредные привычки в тест-менеджментеSQALab
 
Мощь переполняет с JDI 2.0 - новая эра UI автоматизации
Мощь переполняет с JDI 2.0 - новая эра UI автоматизацииМощь переполняет с JDI 2.0 - новая эра UI автоматизации
Мощь переполняет с JDI 2.0 - новая эра UI автоматизацииSQALab
 
Как hh.ru дошли до 500 релизов в квартал без потери в качестве
Как hh.ru дошли до 500 релизов в квартал без потери в качествеКак hh.ru дошли до 500 релизов в квартал без потери в качестве
Как hh.ru дошли до 500 релизов в квартал без потери в качествеSQALab
 
Стили лидерства и тестирование
Стили лидерства и тестированиеСтили лидерства и тестирование
Стили лидерства и тестированиеSQALab
 
"Давайте не будем про качество"
"Давайте не будем про качество""Давайте не будем про качество"
"Давайте не будем про качество"SQALab
 
Apache.JMeter для .NET-проектов
Apache.JMeter для .NET-проектовApache.JMeter для .NET-проектов
Apache.JMeter для .NET-проектовSQALab
 
Тестирование геолокационных систем
Тестирование геолокационных системТестирование геолокационных систем
Тестирование геолокационных системSQALab
 
Лидер или босс? Вот в чем вопрос
Лидер или босс? Вот в чем вопросЛидер или босс? Вот в чем вопрос
Лидер или босс? Вот в чем вопросSQALab
 
От Зефира в коробке к Structure Zephyr или как тест-менеджеру перекроить внут...
От Зефира в коробке к Structure Zephyr или как тест-менеджеру перекроить внут...От Зефира в коробке к Structure Zephyr или как тест-менеджеру перекроить внут...
От Зефира в коробке к Structure Zephyr или как тест-менеджеру перекроить внут...SQALab
 

Plus de SQALab (20)

Готовим стажировку
Готовим стажировкуГотовим стажировку
Готовим стажировку
 
Куда приводят мечты? или Искусство развития тестировщика
Куда приводят мечты? или Искусство развития тестировщикаКуда приводят мечты? или Искусство развития тестировщика
Куда приводят мечты? или Искусство развития тестировщика
 
Оптимизация Selenium тестов и ускорение их поддержки
Оптимизация Selenium тестов и ускорение их поддержкиОптимизация Selenium тестов и ускорение их поддержки
Оптимизация Selenium тестов и ускорение их поддержки
 
Автоматизация 0.0: 0 - бюджет, 0 - опыт программирования
Автоматизация 0.0: 0 - бюджет, 0 - опыт программированияАвтоматизация 0.0: 0 - бюджет, 0 - опыт программирования
Автоматизация 0.0: 0 - бюджет, 0 - опыт программирования
 
Нагрузочное тестирование нестандартных протоколов с использованием Citrix и J...
Нагрузочное тестирование нестандартных протоколов с использованием Citrix и J...Нагрузочное тестирование нестандартных протоколов с использованием Citrix и J...
Нагрузочное тестирование нестандартных протоколов с использованием Citrix и J...
 
Continuous performance testing
Continuous performance testingContinuous performance testing
Continuous performance testing
 
Конфиги вместо костылей. Pytestconfig и зачем он нужен
Конфиги вместо костылей. Pytestconfig и зачем он нуженКонфиги вместо костылей. Pytestconfig и зачем он нужен
Конфиги вместо костылей. Pytestconfig и зачем он нужен
 
Команда чемпионов в ИТ стихии
Команда чемпионов в ИТ стихииКоманда чемпионов в ИТ стихии
Команда чемпионов в ИТ стихии
 
API. Серебряная пуля в магазине советов
API. Серебряная пуля в магазине советовAPI. Серебряная пуля в магазине советов
API. Серебряная пуля в магазине советов
 
Добиваемся эффективности каждого из 9000+ UI-тестов
Добиваемся эффективности каждого из 9000+ UI-тестовДобиваемся эффективности каждого из 9000+ UI-тестов
Добиваемся эффективности каждого из 9000+ UI-тестов
 
Делаем автоматизацию проектных KPIs
Делаем автоматизацию проектных KPIsДелаем автоматизацию проектных KPIs
Делаем автоматизацию проектных KPIs
 
Вредные привычки в тест-менеджменте
Вредные привычки в тест-менеджментеВредные привычки в тест-менеджменте
Вредные привычки в тест-менеджменте
 
Мощь переполняет с JDI 2.0 - новая эра UI автоматизации
Мощь переполняет с JDI 2.0 - новая эра UI автоматизацииМощь переполняет с JDI 2.0 - новая эра UI автоматизации
Мощь переполняет с JDI 2.0 - новая эра UI автоматизации
 
Как hh.ru дошли до 500 релизов в квартал без потери в качестве
Как hh.ru дошли до 500 релизов в квартал без потери в качествеКак hh.ru дошли до 500 релизов в квартал без потери в качестве
Как hh.ru дошли до 500 релизов в квартал без потери в качестве
 
Стили лидерства и тестирование
Стили лидерства и тестированиеСтили лидерства и тестирование
Стили лидерства и тестирование
 
"Давайте не будем про качество"
"Давайте не будем про качество""Давайте не будем про качество"
"Давайте не будем про качество"
 
Apache.JMeter для .NET-проектов
Apache.JMeter для .NET-проектовApache.JMeter для .NET-проектов
Apache.JMeter для .NET-проектов
 
Тестирование геолокационных систем
Тестирование геолокационных системТестирование геолокационных систем
Тестирование геолокационных систем
 
Лидер или босс? Вот в чем вопрос
Лидер или босс? Вот в чем вопросЛидер или босс? Вот в чем вопрос
Лидер или босс? Вот в чем вопрос
 
От Зефира в коробке к Structure Zephyr или как тест-менеджеру перекроить внут...
От Зефира в коробке к Structure Zephyr или как тест-менеджеру перекроить внут...От Зефира в коробке к Structure Zephyr или как тест-менеджеру перекроить внут...
От Зефира в коробке к Structure Zephyr или как тест-менеджеру перекроить внут...
 

Dernier

Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentInMediaRes1
 
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991RKavithamani
 
URLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppURLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppCeline George
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxGaneshChakor2
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesFatimaKhan178732
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfchloefrazer622
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAssociation for Project Management
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdfssuser54595a
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13Steve Thomason
 
PSYCHIATRIC History collection FORMAT.pptx
PSYCHIATRIC   History collection FORMAT.pptxPSYCHIATRIC   History collection FORMAT.pptx
PSYCHIATRIC History collection FORMAT.pptxPoojaSen20
 
MENTAL STATUS EXAMINATION format.docx
MENTAL     STATUS EXAMINATION format.docxMENTAL     STATUS EXAMINATION format.docx
MENTAL STATUS EXAMINATION format.docxPoojaSen20
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionSafetyChain Software
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxOH TEIK BIN
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxpboyjonauth
 

Dernier (20)

Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media Component
 
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
 
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
 
URLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website AppURLs and Routing in the Odoo 17 Website App
URLs and Routing in the Odoo 17 Website App
 
Staff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSDStaff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSD
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptx
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and Actinides
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdf
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
PSYCHIATRIC History collection FORMAT.pptx
PSYCHIATRIC   History collection FORMAT.pptxPSYCHIATRIC   History collection FORMAT.pptx
PSYCHIATRIC History collection FORMAT.pptx
 
MENTAL STATUS EXAMINATION format.docx
MENTAL     STATUS EXAMINATION format.docxMENTAL     STATUS EXAMINATION format.docx
MENTAL STATUS EXAMINATION format.docx
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory Inspection
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptx
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptx
 

Forget Quality!

  • 2.
  • 3. % of requirements covered % of code covered % of test cases executed % of test cases passed # of open defects
  • 4.
  • 6.
  • 7. To abjure Tantamount To proscribe Officious Limpid To reject Equivalent in value To condemn, tooutlaw Offering unwanted services Clear, transparent
  • 8. Overestimate our own level of quality So ?
  • 9.
  • 10. Defect Percentage = # defects KLOC
  • 11. 50% (and higher) Passed 65% (and higher) With Honor (Cum Laude) 75% (and higher) With Great Honor (Magna Cum Laude) 85% (and higher) With Highest Honor (Summa Cum Laude) 50,2% Not Passed 32,6% Passed 10,7% With Honor 5,9% With Great Honor 0,6% With Highest Honor Source: Vlaams Instituut voor Economie en Samenleving ism KU Leuven To become an MD, only 60% is required
  • 12. Perfection may/must not be within reach So ?
  • 13.
  • 14.
  • 16. How can we determine quality? But …
  • 17. Introducing… The Cone of Quality Budget Time Inverse of Scope More time - possible higher quality Higher budget - possible higher quality Increased scope - possible lower quality
  • 18. The quality we hope for The quality we get
  • 21. The quality equilibrium What the business wants to pay for quality What you have to invest in quality
  • 22. How to determine the quality investment? But …
  • 23.
  • 24.
  • 26. How to determine the quality investment? But … better
  • 27.
  • 28.
  • 29. Must Be Quality = Dissatisfiers One Dimensional Quality = Satisfiers Attractive Quality = Delighters
  • 30. How to make decisions regarding quality? Wait …
  • 32. Step 1: Determine the requirements Feature Relative Benefit Relative Penalty Value Value % Registration Module Update content Facebook Integration Customer migration New look and feel
  • 33. Step 2: Assess the Benefit Feature Relative Benefit Relative Penalty Value Value % Registration Module 1 Update content 5 Facebook Integration 6 Customer migration 5 New look and feel 7 Total: 24
  • 34. Step 3: Assess the Penalty Feature Relative Benefit Relative Penalty Value Value % Registration Module 1 3 Update content 5 8 Facebook Integration 6 5 Customer migration 5 3 New look and feel 7 4 Total: 24 23
  • 35. Step 4: Calculate the Value Feature Relative Benefit Relative Penalty Value Value % Registration Module 1 3 4 Update content 5 8 13 Facebook Integration 6 5 11 Customer migration 5 3 8 New look and feel 7 4 11 Total: 24 23 47 Value : Benefit + Penalty
  • 36. Step 5: Calculate the Value % Feature Relative Benefit Relative Penalty Value Value % Registration Module 1 3 4 8,51 Update content 5 8 13 27,66 Facebook Integration 6 5 11 23,40 Customer migration 5 3 8 17,02 New look and feel 7 4 11 23,40 Total: 24 23 47 Value % : Value / Total Value
  • 37. Step 6: Assess the Relative Cost Feature Value % Relative Cost Cost % Relative Risk Risk % Registration Module 8,51 2 Update content 27,66 10 Facebook Integration 23,40 4 Customer migration 17,02 3 New look and feel 23,40 8 Total: 27
  • 38. Step 7: Calculate the Cost % Feature Value % Relative Cost Cost % Relative Risk Risk % Registration Module 8,51 2 7,41 Update content 27,66 10 37,04 Facebook Integration 23,40 4 14,81 Customer migration 17,02 3 11,11 New look and feel 23,40 8 29,63 Total: 27 Cost% : Relative Cost / Total Cost
  • 39. Step 8: Assess the Relative Risk Feature Value % Relative Cost Cost % Relative Risk Risk % Registration Module 8,51 2 7,41 2 Update content 27,66 10 37,04 4 Facebook Integration 23,40 4 14,81 4 Customer migration 17,02 3 11,11 10 New look and feel 23,40 8 29,63 8 Total: 27 28
  • 40. Step 9: Calculate the Risk % Feature Value % Relative Cost Cost % Relative Risk Risk % Registration Module 8,51 2 7,41 2 7,14 Update content 27,66 10 37,04 4 14,28 Facebook Integration 23,40 4 14,81 4 14,28 Customer migration 17,02 3 11,11 10 35,71 New look and feel 23,40 8 29,63 8 28,57 Total: 27 28 Risk% : Relative Risk / Total Risk
  • 41. Step 10: Calculate the Priority Feature Value % Cost % Risk % Priority Order Registration Module 8,51 7,41 7,14 0,58 2 Update content 27,66 37,04 14,28 0,54 3 Facebook Integration 23,40 14,81 14,28 0,80 1 Customer migration 17,02 11,11 35,71 0,36 5 New look and feel 23,40 29,63 28,57 0,40 4 Priority: Value % / (Cost % + Risk %)