SlideShare une entreprise Scribd logo
1  sur  34
Definition of
Quality
Natalya Rukol, Quality Lab.
Introduction

About speaker
• 10+ years in IT
• 9 years in quality
management
• PM, TM, CEO
• She is cool!

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Introduction

About speech
1. Why to measure
2. What to measure
3. How to measure

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Why measure?

Don’t measure!

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Don’t measure!

No visible fail

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Don’t measure!

Meet your fate

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Don’t measure!

Make a real job!

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Don’t measure!

Kill a weak team

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Leave it:
Don’t measure??

XP days Ukraine

Kiev

Projects are usually dead
without measurements

11/10/2013

Natalya Rukol

Definition of Qua
What to
measure?
XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
What to measure?
Product quality

Project status

Kiev

11/10/2013

• Control
• React in time

Team efficacy

XP days Ukraine

• Make clear
decisions
• Visualize your
goals

• Better planning
• Improvement
strategy

Natalya Rukol

Definition of Qua
What to measure

Product quality
How it
looks

XP days Ukraine

What’s
inside

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Product quality

External quality
• Customers’
satisfaction
• Business results
• Refunds (N & %)
• Support & Hotline
statistics

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Product quality

External quality

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Product external quality

Examples
Metric

6.5 Release

7.0 Release

Customers’ satisfaction

4.4

4.2

Refunds

115

109

Refunds %

0,06%

0,11%

Support time per client, hours

6

8

Support tickets amount per
month

4112

3640

Support tickets in %
(bugs/questions/praises)

27/61/12

19/79/2

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Status

?

Definition of Qua
Product external quality

Examples
Metric

6.5 Release

7.0 Release

Customers’ satisfaction

4.4

4.2

Refunds

115

109

Refunds %

0,06%

0,11%

Support time per client, hours

6

8

Support tickets amount per
month

4112

3640

Support tickets in %
(bugs/questions/praises)

27/61/12

19/79/2

Status

?

OK, and what???
XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Product external quality

How to use
• Track changes
while it’s not too
late
• Investigate WHY
problems?
• Ask boss for
increase 

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Product external quality

Too late…

Your
software is
shit!
XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Product quality

Let’s go inside
• Functionality
(what?)
• Non-functional
requirements
(how?)
• Usability
• Performance
• Etc.

• Stability (when?)
XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Product quality

Measure inside
What

How to measure

Functionality
(What?)

• Requirements
accepted
• Users scenarios
execution

Non-functional
requirements
(How?)

• Load results
• Performance results
• Usability scenarios pass
ratio

Stability (When?)

• Tests pass rate
• Builds stability
statistics
• Bugs

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Product quality

Internal quality

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Product internal quality

Examples
Metric

7-11/09

14-18/09

20-24/09

Tests pass rate (% OK/Fail/Bugs)

70/12/18

68/13/19

69/12/19

Bugs total / criticals

612 / 28

654 / 19

602 / 24

Bugs average severity

3,7

3,2

3,8

Builds stable / unstable

11 / 0

9/4

6/7

Features accepted

19/21

17/21

20/22

Usability scenarios passed

9/10

n/a

8/10

Load results

18K

18K

6K

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Product internal quality

Not relevant

100% pass rate,
no criticals, blah
blah

Your
software is
still shit!
XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Product quality

Consequences
What’s
inside

How it
looks
Customers satisfaction

•
•
•
•

Refunds

• Why refunds?
• Collect critics

• Critical bugs
• Features accepted

Support tickets

• What bothers most?

• Usability scenarios

1.
2.

What do they like?
What they use mostly?
What they don’t like?
Pain features?

•
•
•
•

Critical bugs
Testing pass rate
Usability scenarios
Features accepted

You have to find your own consequences!
First find, then prove!

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Product quality

Consequences
External quality

Internal quality
XP days Ukraine

Kiev

11/10/2013

• Sales, Refunds
• Satisfaction
• Support cost

• Design
• Code
• Testing

Natalya Rukol

Definition of Qua
Product quality

Why external first?
• CLOKs & bugs are
useless w/o
customers &
sales
• No way to forget
priorities
• Think big!
• Tech depends on
business, not vice
versa!
XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
How to
measure?
XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
How to measure

Do it right!
• Pre-analysis
• Introduction
• Measurement
• Control
• Continuous
improvements

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
How to measure

Pre-analysis
• Collaborate with
the whole team
• Remember The
Great Goal (TGG)
• Find your strategy
together

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
How to measure

Soft introduction
• Don’t force
• Share
responsibility
• Find enough time
• Provide with
enough resources
• Inside out

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
How to measure

Discipline
• Automate all the
measurements
• Show your
respect
• Grow a habit
• Stand it for 2
months

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
How to measure

PDCA

• Plan, Do, Check, Act
• Post-Mortems
• Accept mistakes

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Quality Definition:

Results
• Clear view
• Achievements
• Team
collaboration
• Karma increase

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua
Quality Definition:

What’s next
Contact with any
questions:

Additional
materials:

http://natalyarukol.ru

http://natalyarukol.ru/definitionof-quality

http://nrukol.moikrug.ru
http://software-testing.ru
Skype: natalya.rukol
mailto: natalya@quality-lab.ru

XP days Ukraine

Kiev

11/10/2013

Natalya Rukol

Definition of Qua

Contenu connexe

Tendances

No such thing called agile testing
No such thing called agile testingNo such thing called agile testing
No such thing called agile testingShrinivas Kulkarni
 
Experience sharing-in-scrum
Experience sharing-in-scrumExperience sharing-in-scrum
Experience sharing-in-scrumJen-Chieh Ko
 
Help Me, I got a team of junior testers!
Help Me, I got a team of junior testers!Help Me, I got a team of junior testers!
Help Me, I got a team of junior testers!SQALab
 
Agile Implementation Challenges – Testing and more…
Agile Implementation Challenges – Testing and more…Agile Implementation Challenges – Testing and more…
Agile Implementation Challenges – Testing and more…SQALab
 
We did it!!? There is place for QAs in Agile!!?
We did it!!? There is place for QAs in Agile!!?We did it!!? There is place for QAs in Agile!!?
We did it!!? There is place for QAs in Agile!!?mkujalowicz
 
Requirements: Whose job are they anyway?
Requirements: Whose job are they anyway?Requirements: Whose job are they anyway?
Requirements: Whose job are they anyway?allan kelly
 
How To Get Quality People On Your QA Team Webinar
How To Get Quality People On Your QA Team WebinarHow To Get Quality People On Your QA Team Webinar
How To Get Quality People On Your QA Team WebinarXBOSoft
 
Назар Дідик qa lead - super hero or trouble maker
Назар Дідик qa lead - super hero or trouble makerНазар Дідик qa lead - super hero or trouble maker
Назар Дідик qa lead - super hero or trouble makerDakiry
 

Tendances (8)

No such thing called agile testing
No such thing called agile testingNo such thing called agile testing
No such thing called agile testing
 
Experience sharing-in-scrum
Experience sharing-in-scrumExperience sharing-in-scrum
Experience sharing-in-scrum
 
Help Me, I got a team of junior testers!
Help Me, I got a team of junior testers!Help Me, I got a team of junior testers!
Help Me, I got a team of junior testers!
 
Agile Implementation Challenges – Testing and more…
Agile Implementation Challenges – Testing and more…Agile Implementation Challenges – Testing and more…
Agile Implementation Challenges – Testing and more…
 
We did it!!? There is place for QAs in Agile!!?
We did it!!? There is place for QAs in Agile!!?We did it!!? There is place for QAs in Agile!!?
We did it!!? There is place for QAs in Agile!!?
 
Requirements: Whose job are they anyway?
Requirements: Whose job are they anyway?Requirements: Whose job are they anyway?
Requirements: Whose job are they anyway?
 
How To Get Quality People On Your QA Team Webinar
How To Get Quality People On Your QA Team WebinarHow To Get Quality People On Your QA Team Webinar
How To Get Quality People On Your QA Team Webinar
 
Назар Дідик qa lead - super hero or trouble maker
Назар Дідик qa lead - super hero or trouble makerНазар Дідик qa lead - super hero or trouble maker
Назар Дідик qa lead - super hero or trouble maker
 

En vedette

10 definition of quality
10 definition of quality10 definition of quality
10 definition of qualityinapurba
 
Importance of Quality
Importance of QualityImportance of Quality
Importance of Qualityjscover
 
ITBrunch: неполиткорректный рассказ про поиск тестировщиков
ITBrunch: неполиткорректный рассказ про поиск тестировщиковITBrunch: неполиткорректный рассказ про поиск тестировщиков
ITBrunch: неполиткорректный рассказ про поиск тестировщиковNatalya Rukol
 
Quality definition
Quality  definitionQuality  definition
Quality definitionMohit Singla
 
Техники тест дизайна для черноящичного тестирования
Техники тест дизайна для черноящичного тестированияТехники тест дизайна для черноящичного тестирования
Техники тест дизайна для черноящичного тестированияDmytro Protsenko
 
Quality — how it is important
Quality — how it is importantQuality — how it is important
Quality — how it is importantlionsleaders
 
Guru's of Quality (ad's)
Guru's of Quality (ad's)Guru's of Quality (ad's)
Guru's of Quality (ad's)Ankur Doda
 

En vedette (14)

10 definition of quality
10 definition of quality10 definition of quality
10 definition of quality
 
Importance of Quality
Importance of QualityImportance of Quality
Importance of Quality
 
Quality Improvement. What Is it and How Can It Help Me?
Quality Improvement. What Is it and How Can It Help Me?Quality Improvement. What Is it and How Can It Help Me?
Quality Improvement. What Is it and How Can It Help Me?
 
ITBrunch: неполиткорректный рассказ про поиск тестировщиков
ITBrunch: неполиткорректный рассказ про поиск тестировщиковITBrunch: неполиткорректный рассказ про поиск тестировщиков
ITBrunch: неполиткорректный рассказ про поиск тестировщиков
 
Definition of quality upload
Definition of quality uploadDefinition of quality upload
Definition of quality upload
 
Quality control
Quality controlQuality control
Quality control
 
Quality definition
Quality  definitionQuality  definition
Quality definition
 
Техники тест дизайна для черноящичного тестирования
Техники тест дизайна для черноящичного тестированияТехники тест дизайна для черноящичного тестирования
Техники тест дизайна для черноящичного тестирования
 
Quality — how it is important
Quality — how it is importantQuality — how it is important
Quality — how it is important
 
Guru's of Quality (ad's)
Guru's of Quality (ad's)Guru's of Quality (ad's)
Guru's of Quality (ad's)
 
Quality gurus
Quality gurusQuality gurus
Quality gurus
 
Quality principles and concepts
Quality principles and conceptsQuality principles and concepts
Quality principles and concepts
 
Quality concepts
Quality conceptsQuality concepts
Quality concepts
 
Tqm power point
Tqm power pointTqm power point
Tqm power point
 

Similaire à Definition of Quality (XP Days Ukraine)

Anton Muzhailo - Practical Test Process Improvement using ISTQB
Anton Muzhailo - Practical Test Process Improvement using ISTQBAnton Muzhailo - Practical Test Process Improvement using ISTQB
Anton Muzhailo - Practical Test Process Improvement using ISTQBIevgenii Katsan
 
Introducing QA Into an Agile Environment
Introducing QA Into an Agile EnvironmentIntroducing QA Into an Agile Environment
Introducing QA Into an Agile EnvironmentJoseph Beale
 
A confused tester in agile world finalversion
A confused tester in agile world finalversionA confused tester in agile world finalversion
A confused tester in agile world finalversionAshish Kumar
 
Transitioning from Timeboxes to Continuous Product Delivery (by Steve Stolt a...
Transitioning from Timeboxes to Continuous Product Delivery (by Steve Stolt a...Transitioning from Timeboxes to Continuous Product Delivery (by Steve Stolt a...
Transitioning from Timeboxes to Continuous Product Delivery (by Steve Stolt a...André Faria Gomes
 
ZcCsXvjIRFKcqd2Yzt4d_Shallahamer-MLPoorPerf-3d.pdf
ZcCsXvjIRFKcqd2Yzt4d_Shallahamer-MLPoorPerf-3d.pdfZcCsXvjIRFKcqd2Yzt4d_Shallahamer-MLPoorPerf-3d.pdf
ZcCsXvjIRFKcqd2Yzt4d_Shallahamer-MLPoorPerf-3d.pdfcookie1969
 
My Experiments In Agile Testing in Yahoo.pptx
My Experiments In Agile Testing in Yahoo.pptxMy Experiments In Agile Testing in Yahoo.pptx
My Experiments In Agile Testing in Yahoo.pptxBaiju Joseph
 
Agile masterclass - The Most Important Agile Concepts to Know and the Critica...
Agile masterclass - The Most Important Agile Concepts to Know and the Critica...Agile masterclass - The Most Important Agile Concepts to Know and the Critica...
Agile masterclass - The Most Important Agile Concepts to Know and the Critica...Striking Group Pty Ltd
 
Sprinkle on Just Enough Process
Sprinkle on Just Enough ProcessSprinkle on Just Enough Process
Sprinkle on Just Enough ProcessTechWell
 
Agile Testing and BDD with Gauge
Agile Testing and BDD with GaugeAgile Testing and BDD with Gauge
Agile Testing and BDD with GaugeOnur Erdogan
 
Agile Testing and BDD with Gauge
Agile Testing and BDD with GaugeAgile Testing and BDD with Gauge
Agile Testing and BDD with GaugeTestinium
 
An Introduction to Agile Testing Agile Tour Kaunas 2013
An Introduction to Agile Testing  Agile Tour Kaunas 2013An Introduction to Agile Testing  Agile Tour Kaunas 2013
An Introduction to Agile Testing Agile Tour Kaunas 2013Clement Pickering
 
Agile testing experiments
Agile testing experimentsAgile testing experiments
Agile testing experimentsBaiju Joseph
 
The Issues Agile Exposes and What To Do about Them
The Issues Agile Exposes and What To Do about ThemThe Issues Agile Exposes and What To Do about Them
The Issues Agile Exposes and What To Do about ThemTechWell
 
Becoming agile in an agile way - ITMPI webinar by Ben Linders
Becoming agile in an agile way - ITMPI webinar by Ben LindersBecoming agile in an agile way - ITMPI webinar by Ben Linders
Becoming agile in an agile way - ITMPI webinar by Ben LindersBen Linders
 
Getting By Without "QA"
Getting By Without "QA"Getting By Without "QA"
Getting By Without "QA"Dave King
 
How do we fix testing
How do we fix testingHow do we fix testing
How do we fix testingPeter Varhol
 

Similaire à Definition of Quality (XP Days Ukraine) (20)

Quality is a Mindset
Quality is a MindsetQuality is a Mindset
Quality is a Mindset
 
Anton Muzhailo - Practical Test Process Improvement using ISTQB
Anton Muzhailo - Practical Test Process Improvement using ISTQBAnton Muzhailo - Practical Test Process Improvement using ISTQB
Anton Muzhailo - Practical Test Process Improvement using ISTQB
 
Introducing QA Into an Agile Environment
Introducing QA Into an Agile EnvironmentIntroducing QA Into an Agile Environment
Introducing QA Into an Agile Environment
 
A confused tester in agile world finalversion
A confused tester in agile world finalversionA confused tester in agile world finalversion
A confused tester in agile world finalversion
 
Transitioning from Timeboxes to Continuous Product Delivery (by Steve Stolt a...
Transitioning from Timeboxes to Continuous Product Delivery (by Steve Stolt a...Transitioning from Timeboxes to Continuous Product Delivery (by Steve Stolt a...
Transitioning from Timeboxes to Continuous Product Delivery (by Steve Stolt a...
 
ZcCsXvjIRFKcqd2Yzt4d_Shallahamer-MLPoorPerf-3d.pdf
ZcCsXvjIRFKcqd2Yzt4d_Shallahamer-MLPoorPerf-3d.pdfZcCsXvjIRFKcqd2Yzt4d_Shallahamer-MLPoorPerf-3d.pdf
ZcCsXvjIRFKcqd2Yzt4d_Shallahamer-MLPoorPerf-3d.pdf
 
My Experiments In Agile Testing in Yahoo.pptx
My Experiments In Agile Testing in Yahoo.pptxMy Experiments In Agile Testing in Yahoo.pptx
My Experiments In Agile Testing in Yahoo.pptx
 
scrum-talk
scrum-talkscrum-talk
scrum-talk
 
Scrum101
Scrum101Scrum101
Scrum101
 
Agile masterclass - The Most Important Agile Concepts to Know and the Critica...
Agile masterclass - The Most Important Agile Concepts to Know and the Critica...Agile masterclass - The Most Important Agile Concepts to Know and the Critica...
Agile masterclass - The Most Important Agile Concepts to Know and the Critica...
 
Sprinkle on Just Enough Process
Sprinkle on Just Enough ProcessSprinkle on Just Enough Process
Sprinkle on Just Enough Process
 
Agile Testing and BDD with Gauge
Agile Testing and BDD with GaugeAgile Testing and BDD with Gauge
Agile Testing and BDD with Gauge
 
Agile Testing and BDD with Gauge
Agile Testing and BDD with GaugeAgile Testing and BDD with Gauge
Agile Testing and BDD with Gauge
 
An Introduction to Agile Testing Agile Tour Kaunas 2013
An Introduction to Agile Testing  Agile Tour Kaunas 2013An Introduction to Agile Testing  Agile Tour Kaunas 2013
An Introduction to Agile Testing Agile Tour Kaunas 2013
 
Agile testing experiments
Agile testing experimentsAgile testing experiments
Agile testing experiments
 
The Issues Agile Exposes and What To Do about Them
The Issues Agile Exposes and What To Do about ThemThe Issues Agile Exposes and What To Do about Them
The Issues Agile Exposes and What To Do about Them
 
Andriy bahlay
Andriy bahlay   Andriy bahlay
Andriy bahlay
 
Becoming agile in an agile way - ITMPI webinar by Ben Linders
Becoming agile in an agile way - ITMPI webinar by Ben LindersBecoming agile in an agile way - ITMPI webinar by Ben Linders
Becoming agile in an agile way - ITMPI webinar by Ben Linders
 
Getting By Without "QA"
Getting By Without "QA"Getting By Without "QA"
Getting By Without "QA"
 
How do we fix testing
How do we fix testingHow do we fix testing
How do we fix testing
 

Dernier

Pitch Deck Teardown: Geodesic.Life's $500k Pre-seed deck
Pitch Deck Teardown: Geodesic.Life's $500k Pre-seed deckPitch Deck Teardown: Geodesic.Life's $500k Pre-seed deck
Pitch Deck Teardown: Geodesic.Life's $500k Pre-seed deckHajeJanKamps
 
Marketplace and Quality Assurance Presentation - Vincent Chirchir
Marketplace and Quality Assurance Presentation - Vincent ChirchirMarketplace and Quality Assurance Presentation - Vincent Chirchir
Marketplace and Quality Assurance Presentation - Vincent Chirchirictsugar
 
Flow Your Strategy at Flight Levels Day 2024
Flow Your Strategy at Flight Levels Day 2024Flow Your Strategy at Flight Levels Day 2024
Flow Your Strategy at Flight Levels Day 2024Kirill Klimov
 
Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...Seta Wicaksana
 
Keppel Ltd. 1Q 2024 Business Update Presentation Slides
Keppel Ltd. 1Q 2024 Business Update  Presentation SlidesKeppel Ltd. 1Q 2024 Business Update  Presentation Slides
Keppel Ltd. 1Q 2024 Business Update Presentation SlidesKeppelCorporation
 
International Business Environments and Operations 16th Global Edition test b...
International Business Environments and Operations 16th Global Edition test b...International Business Environments and Operations 16th Global Edition test b...
International Business Environments and Operations 16th Global Edition test b...ssuserf63bd7
 
Cybersecurity Awareness Training Presentation v2024.03
Cybersecurity Awareness Training Presentation v2024.03Cybersecurity Awareness Training Presentation v2024.03
Cybersecurity Awareness Training Presentation v2024.03DallasHaselhorst
 
Digital Transformation in the PLM domain - distrib.pdf
Digital Transformation in the PLM domain - distrib.pdfDigital Transformation in the PLM domain - distrib.pdf
Digital Transformation in the PLM domain - distrib.pdfJos Voskuil
 
Lowrate Call Girls In Sector 18 Noida ❤️8860477959 Escorts 100% Genuine Servi...
Lowrate Call Girls In Sector 18 Noida ❤️8860477959 Escorts 100% Genuine Servi...Lowrate Call Girls In Sector 18 Noida ❤️8860477959 Escorts 100% Genuine Servi...
Lowrate Call Girls In Sector 18 Noida ❤️8860477959 Escorts 100% Genuine Servi...lizamodels9
 
Contemporary Economic Issues Facing the Filipino Entrepreneur (1).pptx
Contemporary Economic Issues Facing the Filipino Entrepreneur (1).pptxContemporary Economic Issues Facing the Filipino Entrepreneur (1).pptx
Contemporary Economic Issues Facing the Filipino Entrepreneur (1).pptxMarkAnthonyAurellano
 
Market Sizes Sample Report - 2024 Edition
Market Sizes Sample Report - 2024 EditionMarket Sizes Sample Report - 2024 Edition
Market Sizes Sample Report - 2024 EditionMintel Group
 
Call Us 📲8800102216📞 Call Girls In DLF City Gurgaon
Call Us 📲8800102216📞 Call Girls In DLF City GurgaonCall Us 📲8800102216📞 Call Girls In DLF City Gurgaon
Call Us 📲8800102216📞 Call Girls In DLF City Gurgaoncallgirls2057
 
BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,
BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,
BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,noida100girls
 
The CMO Survey - Highlights and Insights Report - Spring 2024
The CMO Survey - Highlights and Insights Report - Spring 2024The CMO Survey - Highlights and Insights Report - Spring 2024
The CMO Survey - Highlights and Insights Report - Spring 2024christinemoorman
 
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort ServiceCall US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort Servicecallgirls2057
 
Case study on tata clothing brand zudio in detail
Case study on tata clothing brand zudio in detailCase study on tata clothing brand zudio in detail
Case study on tata clothing brand zudio in detailAriel592675
 
2024 Numerator Consumer Study of Cannabis Usage
2024 Numerator Consumer Study of Cannabis Usage2024 Numerator Consumer Study of Cannabis Usage
2024 Numerator Consumer Study of Cannabis UsageNeil Kimberley
 
APRIL2024_UKRAINE_xml_0000000000000 .pdf
APRIL2024_UKRAINE_xml_0000000000000 .pdfAPRIL2024_UKRAINE_xml_0000000000000 .pdf
APRIL2024_UKRAINE_xml_0000000000000 .pdfRbc Rbcua
 
Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...
Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...
Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...lizamodels9
 

Dernier (20)

Corporate Profile 47Billion Information Technology
Corporate Profile 47Billion Information TechnologyCorporate Profile 47Billion Information Technology
Corporate Profile 47Billion Information Technology
 
Pitch Deck Teardown: Geodesic.Life's $500k Pre-seed deck
Pitch Deck Teardown: Geodesic.Life's $500k Pre-seed deckPitch Deck Teardown: Geodesic.Life's $500k Pre-seed deck
Pitch Deck Teardown: Geodesic.Life's $500k Pre-seed deck
 
Marketplace and Quality Assurance Presentation - Vincent Chirchir
Marketplace and Quality Assurance Presentation - Vincent ChirchirMarketplace and Quality Assurance Presentation - Vincent Chirchir
Marketplace and Quality Assurance Presentation - Vincent Chirchir
 
Flow Your Strategy at Flight Levels Day 2024
Flow Your Strategy at Flight Levels Day 2024Flow Your Strategy at Flight Levels Day 2024
Flow Your Strategy at Flight Levels Day 2024
 
Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...Ten Organizational Design Models to align structure and operations to busines...
Ten Organizational Design Models to align structure and operations to busines...
 
Keppel Ltd. 1Q 2024 Business Update Presentation Slides
Keppel Ltd. 1Q 2024 Business Update  Presentation SlidesKeppel Ltd. 1Q 2024 Business Update  Presentation Slides
Keppel Ltd. 1Q 2024 Business Update Presentation Slides
 
International Business Environments and Operations 16th Global Edition test b...
International Business Environments and Operations 16th Global Edition test b...International Business Environments and Operations 16th Global Edition test b...
International Business Environments and Operations 16th Global Edition test b...
 
Cybersecurity Awareness Training Presentation v2024.03
Cybersecurity Awareness Training Presentation v2024.03Cybersecurity Awareness Training Presentation v2024.03
Cybersecurity Awareness Training Presentation v2024.03
 
Digital Transformation in the PLM domain - distrib.pdf
Digital Transformation in the PLM domain - distrib.pdfDigital Transformation in the PLM domain - distrib.pdf
Digital Transformation in the PLM domain - distrib.pdf
 
Lowrate Call Girls In Sector 18 Noida ❤️8860477959 Escorts 100% Genuine Servi...
Lowrate Call Girls In Sector 18 Noida ❤️8860477959 Escorts 100% Genuine Servi...Lowrate Call Girls In Sector 18 Noida ❤️8860477959 Escorts 100% Genuine Servi...
Lowrate Call Girls In Sector 18 Noida ❤️8860477959 Escorts 100% Genuine Servi...
 
Contemporary Economic Issues Facing the Filipino Entrepreneur (1).pptx
Contemporary Economic Issues Facing the Filipino Entrepreneur (1).pptxContemporary Economic Issues Facing the Filipino Entrepreneur (1).pptx
Contemporary Economic Issues Facing the Filipino Entrepreneur (1).pptx
 
Market Sizes Sample Report - 2024 Edition
Market Sizes Sample Report - 2024 EditionMarket Sizes Sample Report - 2024 Edition
Market Sizes Sample Report - 2024 Edition
 
Call Us 📲8800102216📞 Call Girls In DLF City Gurgaon
Call Us 📲8800102216📞 Call Girls In DLF City GurgaonCall Us 📲8800102216📞 Call Girls In DLF City Gurgaon
Call Us 📲8800102216📞 Call Girls In DLF City Gurgaon
 
BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,
BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,
BEST Call Girls In Old Faridabad ✨ 9773824855 ✨ Escorts Service In Delhi Ncr,
 
The CMO Survey - Highlights and Insights Report - Spring 2024
The CMO Survey - Highlights and Insights Report - Spring 2024The CMO Survey - Highlights and Insights Report - Spring 2024
The CMO Survey - Highlights and Insights Report - Spring 2024
 
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort ServiceCall US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
Call US-88OO1O2216 Call Girls In Mahipalpur Female Escort Service
 
Case study on tata clothing brand zudio in detail
Case study on tata clothing brand zudio in detailCase study on tata clothing brand zudio in detail
Case study on tata clothing brand zudio in detail
 
2024 Numerator Consumer Study of Cannabis Usage
2024 Numerator Consumer Study of Cannabis Usage2024 Numerator Consumer Study of Cannabis Usage
2024 Numerator Consumer Study of Cannabis Usage
 
APRIL2024_UKRAINE_xml_0000000000000 .pdf
APRIL2024_UKRAINE_xml_0000000000000 .pdfAPRIL2024_UKRAINE_xml_0000000000000 .pdf
APRIL2024_UKRAINE_xml_0000000000000 .pdf
 
Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...
Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...
Call Girls In Sikandarpur Gurgaon ❤️8860477959_Russian 100% Genuine Escorts I...
 

Definition of Quality (XP Days Ukraine)

  • 2. Introduction About speaker • 10+ years in IT • 9 years in quality management • PM, TM, CEO • She is cool! XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 3. Introduction About speech 1. Why to measure 2. What to measure 3. How to measure XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 4. Why measure? Don’t measure! XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 5. Don’t measure! No visible fail XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 6. Don’t measure! Meet your fate XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 7. Don’t measure! Make a real job! XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 8. Don’t measure! Kill a weak team XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 9. Leave it: Don’t measure?? XP days Ukraine Kiev Projects are usually dead without measurements 11/10/2013 Natalya Rukol Definition of Qua
  • 10. What to measure? XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 11. What to measure? Product quality Project status Kiev 11/10/2013 • Control • React in time Team efficacy XP days Ukraine • Make clear decisions • Visualize your goals • Better planning • Improvement strategy Natalya Rukol Definition of Qua
  • 12. What to measure Product quality How it looks XP days Ukraine What’s inside Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 13. Product quality External quality • Customers’ satisfaction • Business results • Refunds (N & %) • Support & Hotline statistics XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 14. Product quality External quality XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 15. Product external quality Examples Metric 6.5 Release 7.0 Release Customers’ satisfaction 4.4 4.2 Refunds 115 109 Refunds % 0,06% 0,11% Support time per client, hours 6 8 Support tickets amount per month 4112 3640 Support tickets in % (bugs/questions/praises) 27/61/12 19/79/2 XP days Ukraine Kiev 11/10/2013 Natalya Rukol Status ? Definition of Qua
  • 16. Product external quality Examples Metric 6.5 Release 7.0 Release Customers’ satisfaction 4.4 4.2 Refunds 115 109 Refunds % 0,06% 0,11% Support time per client, hours 6 8 Support tickets amount per month 4112 3640 Support tickets in % (bugs/questions/praises) 27/61/12 19/79/2 Status ? OK, and what??? XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 17. Product external quality How to use • Track changes while it’s not too late • Investigate WHY problems? • Ask boss for increase  XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 18. Product external quality Too late… Your software is shit! XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 19. Product quality Let’s go inside • Functionality (what?) • Non-functional requirements (how?) • Usability • Performance • Etc. • Stability (when?) XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 20. Product quality Measure inside What How to measure Functionality (What?) • Requirements accepted • Users scenarios execution Non-functional requirements (How?) • Load results • Performance results • Usability scenarios pass ratio Stability (When?) • Tests pass rate • Builds stability statistics • Bugs XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 21. Product quality Internal quality XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 22. Product internal quality Examples Metric 7-11/09 14-18/09 20-24/09 Tests pass rate (% OK/Fail/Bugs) 70/12/18 68/13/19 69/12/19 Bugs total / criticals 612 / 28 654 / 19 602 / 24 Bugs average severity 3,7 3,2 3,8 Builds stable / unstable 11 / 0 9/4 6/7 Features accepted 19/21 17/21 20/22 Usability scenarios passed 9/10 n/a 8/10 Load results 18K 18K 6K XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 23. Product internal quality Not relevant 100% pass rate, no criticals, blah blah Your software is still shit! XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 24. Product quality Consequences What’s inside How it looks Customers satisfaction • • • • Refunds • Why refunds? • Collect critics • Critical bugs • Features accepted Support tickets • What bothers most? • Usability scenarios 1. 2. What do they like? What they use mostly? What they don’t like? Pain features? • • • • Critical bugs Testing pass rate Usability scenarios Features accepted You have to find your own consequences! First find, then prove! XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 25. Product quality Consequences External quality Internal quality XP days Ukraine Kiev 11/10/2013 • Sales, Refunds • Satisfaction • Support cost • Design • Code • Testing Natalya Rukol Definition of Qua
  • 26. Product quality Why external first? • CLOKs & bugs are useless w/o customers & sales • No way to forget priorities • Think big! • Tech depends on business, not vice versa! XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 27. How to measure? XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 28. How to measure Do it right! • Pre-analysis • Introduction • Measurement • Control • Continuous improvements XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 29. How to measure Pre-analysis • Collaborate with the whole team • Remember The Great Goal (TGG) • Find your strategy together XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 30. How to measure Soft introduction • Don’t force • Share responsibility • Find enough time • Provide with enough resources • Inside out XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 31. How to measure Discipline • Automate all the measurements • Show your respect • Grow a habit • Stand it for 2 months XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 32. How to measure PDCA • Plan, Do, Check, Act • Post-Mortems • Accept mistakes XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 33. Quality Definition: Results • Clear view • Achievements • Team collaboration • Karma increase XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua
  • 34. Quality Definition: What’s next Contact with any questions: Additional materials: http://natalyarukol.ru http://natalyarukol.ru/definitionof-quality http://nrukol.moikrug.ru http://software-testing.ru Skype: natalya.rukol mailto: natalya@quality-lab.ru XP days Ukraine Kiev 11/10/2013 Natalya Rukol Definition of Qua