SlideShare une entreprise Scribd logo
1  sur  15
Télécharger pour lire hors ligne
W6
Special Topics
5/1/2013 11:30:00 AM

Yin and Yang: Metrics within Agile and
Traditional Lifecycles
Presented by:
Shaun Bradshaw, Zenergy Technologies, Inc.
Bob Galen, Rgalen Consulting

Brought to you by:

340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
Shaun Bradshaw
Cofounder of Zenergy Technologies, Inc., a QA and agile solutions consulting firm
(zenergytechnologies.com), Shaun Bradshaw has spent the past fifteen years advising, teaching, and
mentoring clients to improve their QA and test processes with effective testing and test management
techniques. He is the coauthor, editor, and trainer of a suite of methodologies covering testing, test
management, and test metrics. A popular speaker at many of the major QA industry conferences, Shaun
is known for his presentations on test metrics, the S-Curve, and the Zero Bug Bounce.

Bob Galen
Bob Galen is an agile coach at RGalen Consulting and director of agile solutions at Zenergy
Technologies, a North Carolina-based firm specializing in agile testing and leading agile adoption
initiatives. Bob regularly speaks at international conferences and professional groups on topics related to
software development, project management, software testing, and team leadership. He is a Certified
Scrum Master Practicing (CSC), Certified Scrum Product Owner (CSPO), and an active member of the
Agile Alliance and Scrum Alliance. Bob published Scrum Product Ownership–Balancing Value from the
Inside Out, which addresses the gap in guidance toward effective agile product management. Contact Bob
at bob@rgalen.com or bob.galen@zenergytechnologies.com.
4/16/2013

The Yin & Yang
Title
of Software Metrics

STAREAST 2013
Presented By:
Bob Galen and Shaun Bradshaw

Slide 1

Software Peace of Mind in Action

???
Introductions
Bob Galen & Shaun Bradshaw

Director, Agile Solutions – Zenergy
Technologies
Determined agile adoption coach, trainer,
and consultant
10+ years of agile experience across
Software, QA/Test, and Project Management
Specialty in Agile at-Scale challenges
bob.galen@zenergytechnologies.com

Slide 2

VP of Consulting Solutions – Zenergy
Technologies
Experienced test manager, consultant,
trainer
IT Testing strategist
15 years of multi-domain experience
Agile experience; Scrum Master
shaun.bradshaw@zenergytechnologies.com

Software Peace of Mind in Action

1
4/16/2013

???
Format For This Session
Focus for this session: QA & Testing Metrics
Panel format
15 minutes for Shaun
15 minutes for Bob

Write down your questions, ideas, metrics, etc. on 3x5
cards
30 minutes of Q&A interaction and debate
Slide 3

Software Peace of Mind in Action

What is Measurement?

• “Measurement is the process by which numbers
or symbols are assigned to attributes of entities
in the real world in such a way as to
characterize them according to clearly defined
rules.”
• “Measurement is the empirical, objective
assignment of numbers, according to a rule
derived from a model or theory, to attributes of
objects or events with the intent of describing
them.”

2
4/16/2013

???
Software Metrics Traps
Karl Wiegers 1.
2.
3.
4.
5.
6.
7.
8.
9.
10.

http://www.processimpact.com/articles/mtraps.html

Lack of Management Commitment
Measuring Too Much, Too Soon
Measuring Too Little, Too Late
Measuring the Wrong Things
Imprecise Metrics Definitions
Using Metrics Data to Evaluate Individuals
Using Metrics to Motivate, Rather than to Understand
Collecting Data That is Not Used
Lack of Communication & Training
Misinterpreting Metrics Data

Slide 5

Software Peace of Mind in Action

???
Case Study
Large, traditional financial / insurance organization
100 year company, traditionally staffed IT organization
Regulatory support
Large-scale project; joint with other consulting firms

Slide 6

Software Peace of Mind in Action

3
4/16/2013

???
Waterfall is ‘Real’
Not every project can be broken down into 2-week
‘chunks’
Not every company wants to be agile
Scale of the project impacts everything
We’ll know we’re done when we’re done is NOT an
acceptable answer in many contexts
Waterfall and Agile

Slide 7

Software Peace of Mind in Action

???
Monitoring Phases & Transitions
The overriding goal was to plan a series of maturation
phases
Testing would serve as the guide between phases
Qualifying progress
Verifying functionality
Measuring variation / defects
Guiding next steps

Slide 8

Software Peace of Mind in Action

4
4/16/2013

???
Risk-Based Testing

All testing was focused towards what
Was delivered
Worked
Was planned
Was considered Higher Priority features
Was considered Higher Risk items

Slide 9

Software Peace of Mind in Action

???
Key Metrics – “Exit Criteria”
Test Execution by priority
Have we tested enough? Did we cover our plans?

Overall pass rates
Is the software working? Where are we ‘Blocked’?
Are there any ‘Patterns’ to the failures

Percent of defects corrected by severity
Are we catching up on repairs?
Is the software maturing at a sufficient rate to support the plan?
Slide 10

Software Peace of Mind in Action

5
4/16/2013

???
Customer Override…
Basically, the customer has the final authority to adjust
Metrics
Analysis
(Re)Actions
Goals
So, ’agility’ from a leadership & governance perspective

Slide 11

Slide 12

Software Peace of Mind in Action

Software Peace of Mind in Action

6
4/16/2013

Transition…

Slide 13

Software Peace of Mind in Action

???
Agile Metrics
Agile methods are generally not metrics centered,
They’re much more team-centered and progress or
outcome centered
Rarely do you want to examine the individual; leave that to the
team
Exceptions – experienced coaches

Avoid “Metrics Dysfunction” metrics
Lines of code produced
Bugs found
Estimate vs. Actual
Slide 14

Software Peace of Mind in Action

7
4/16/2013

???
Big 4 Agile Metrics
1.
2.
3.
4.

Value Delivered
Velocity & Throughput
Quality
Team Morale & Satisfaction

Slide 15

Software Peace of Mind in Action

???
Value-Delivered
Prioritization
Always deliver the highest priority work first
Earned value – it’s “Done”

Customer Acceptance
User Story sign-off
Active customer demonstration; embrace changes

ROI – Usage
Sales & usage targets; confirm
Did we make the right decisions on value? Adjustments?
Slide 16

Software Peace of Mind in Action

8
4/16/2013

???
Velocity & Throughput
Productivity matters in agile teams
First, the software is only accepted if it meets clear Done-Ness
criteria
Velocity – the number of Story Points produced per Sprint
Throughput – the number of ‘Days’ that a story was InProgress, relative to it’s size; also a risk play

Continuous improvement
Velocity – UP; Throughput - DOWN
Slide 17

Software Peace of Mind in Action

???
Quality
Test Automation
Continuous Integration & Continuous Deployment
Every check-in…run automation; Stop-the-Line

Defect ‘Escapes’
Escaping your Done-Ness
Escaping your Sprint
Escaping into the wild…Customer Escapes

Pairing, inspections, RCA
Continuous Improvement – downward trending
Slide 18

Software Peace of Mind in Action

9
4/16/2013

???
Team Morale & Satisfaction
Self-directed; Team autonomy; Listened to
Attrition is analyzed; New hire onboarding
Sustainable pace
Periodic surveys
Team overall health & satisfaction
Feedback on adjustments
Agile values

Make the survey and the actions Transparent
Make it clear—people are central to your success

Slide 19

Software Peace of Mind in Action

???
That’s it…
Aligned with Goals
Sprint Goals & Release Goals
Organizational Goals & Company Goals

Attributes:
They’re all important…perhaps “People First”
There are no “fixed targets”
Keep them simple; everyone is aware of the goal

Measure as a team
Stop the individual metrics dysfunction
Slide 20

Software Peace of Mind in Action

10
4/16/2013

Transition…

Slide 21

Software Peace of Mind in Action

Now It’s YOUR
Turn
Questions?
Debate!

Slide 22

Software Peace of Mind in Action

11
4/16/2013

???
Questions for your Consideration
What ‘healthy’ metrics have you personally experienced?
What about stories of dysfunctional metrics?
Challenges you’ve seen in moving from Waterfall to Agile
or vice versa?
If you only had 1-3 metrics to measure software in your
own company, what would they be?

Slide 23

Software Peace of Mind in Action

???
Questions for your Consideration
Example of what we could discuss
Estimation vs. Actuals
Planning Poker & ‘Relative’ estimation

Anyone use GQM?

Slide 24

Software Peace of Mind in Action

12
4/16/2013

Any other questions?

Thank you!

Slide 25

Software Peace of Mind in Action

13

Contenu connexe

Tendances

Zero Defects Through Lean six Sigma
Zero Defects Through Lean six SigmaZero Defects Through Lean six Sigma
Zero Defects Through Lean six SigmaRamesh Victor
 
Contracting for Agile Software Development
Contracting for Agile Software DevelopmentContracting for Agile Software Development
Contracting for Agile Software Developmentcspag67
 
ISTQB Agile Extension
ISTQB Agile ExtensionISTQB Agile Extension
ISTQB Agile ExtensionDavis Thomas
 
8d training slides
8d training slides 8d training slides
8d training slides Rohit Singh
 
Agile Framework
Agile FrameworkAgile Framework
Agile Frameworkhshamim
 
Requirementless testing
Requirementless testingRequirementless testing
Requirementless testingJulen Mohanty
 
Balanced Measurement Sets: Criteria for Improving Project Management Practices
Balanced Measurement Sets: Criteria for Improving  Project Management PracticesBalanced Measurement Sets: Criteria for Improving  Project Management Practices
Balanced Measurement Sets: Criteria for Improving Project Management PracticesLuigi Buglione
 
Tackling software testing challenges in the agile era
Tackling software testing challenges in the agile eraTackling software testing challenges in the agile era
Tackling software testing challenges in the agile eraQASymphony
 
The 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary Thorn
The 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary ThornThe 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary Thorn
The 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary ThornTEST Huddle
 
PMI-ACP Exam Lessons from Those Who Have Been There
PMI-ACP Exam Lessons from Those Who Have Been TherePMI-ACP Exam Lessons from Those Who Have Been There
PMI-ACP Exam Lessons from Those Who Have Been ThereOSP International LLC
 
Agile Project Management in a Waterfall World: Managing Sprints with Predicti...
Agile Project Management in a Waterfall World: Managing Sprints with Predicti...Agile Project Management in a Waterfall World: Managing Sprints with Predicti...
Agile Project Management in a Waterfall World: Managing Sprints with Predicti...John Carter
 
Root Cause Analysis, The 5 Why’s, and The Fishbone Diagram
Root Cause Analysis, The 5 Why’s, and The Fishbone DiagramRoot Cause Analysis, The 5 Why’s, and The Fishbone Diagram
Root Cause Analysis, The 5 Why’s, and The Fishbone DiagramInvensis Learning
 
Understanding Agile Project Management (APM)
Understanding Agile Project Management (APM)Understanding Agile Project Management (APM)
Understanding Agile Project Management (APM)Ahmed Alnaqaa
 
Agile transformation best practices
Agile transformation best practicesAgile transformation best practices
Agile transformation best practicesAllyson Chiarini
 
Scrum Master Interview Questions SlideShare
Scrum Master Interview Questions SlideShareScrum Master Interview Questions SlideShare
Scrum Master Interview Questions SlideShareInvensis Learning
 
Agile & SCRUM
Agile & SCRUMAgile & SCRUM
Agile & SCRUMejlp12
 
About Agile & PMI Agile Certified Practitioner (PMI-ACP) Overview
About Agile & PMI Agile Certified Practitioner (PMI-ACP) OverviewAbout Agile & PMI Agile Certified Practitioner (PMI-ACP) Overview
About Agile & PMI Agile Certified Practitioner (PMI-ACP) OverviewAleem Khan
 

Tendances (20)

Zero Defects Through Lean six Sigma
Zero Defects Through Lean six SigmaZero Defects Through Lean six Sigma
Zero Defects Through Lean six Sigma
 
Contracting for Agile Software Development
Contracting for Agile Software DevelopmentContracting for Agile Software Development
Contracting for Agile Software Development
 
ISTQB Agile Extension
ISTQB Agile ExtensionISTQB Agile Extension
ISTQB Agile Extension
 
8d training slides
8d training slides 8d training slides
8d training slides
 
Agile Framework
Agile FrameworkAgile Framework
Agile Framework
 
Requirementless testing
Requirementless testingRequirementless testing
Requirementless testing
 
Balanced Measurement Sets: Criteria for Improving Project Management Practices
Balanced Measurement Sets: Criteria for Improving  Project Management PracticesBalanced Measurement Sets: Criteria for Improving  Project Management Practices
Balanced Measurement Sets: Criteria for Improving Project Management Practices
 
Tackling software testing challenges in the agile era
Tackling software testing challenges in the agile eraTackling software testing challenges in the agile era
Tackling software testing challenges in the agile era
 
The 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary Thorn
The 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary ThornThe 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary Thorn
The 3 Pillars Approach to Agile Testing Strategy with Bob Galen & Mary Thorn
 
PMI-ACP Exam Lessons from Those Who Have Been There
PMI-ACP Exam Lessons from Those Who Have Been TherePMI-ACP Exam Lessons from Those Who Have Been There
PMI-ACP Exam Lessons from Those Who Have Been There
 
Agile Project Management in a Waterfall World: Managing Sprints with Predicti...
Agile Project Management in a Waterfall World: Managing Sprints with Predicti...Agile Project Management in a Waterfall World: Managing Sprints with Predicti...
Agile Project Management in a Waterfall World: Managing Sprints with Predicti...
 
Root Cause Analysis, The 5 Why’s, and The Fishbone Diagram
Root Cause Analysis, The 5 Why’s, and The Fishbone DiagramRoot Cause Analysis, The 5 Why’s, and The Fishbone Diagram
Root Cause Analysis, The 5 Why’s, and The Fishbone Diagram
 
Understanding Agile Project Management (APM)
Understanding Agile Project Management (APM)Understanding Agile Project Management (APM)
Understanding Agile Project Management (APM)
 
Agile Methodologies
Agile MethodologiesAgile Methodologies
Agile Methodologies
 
Agile transformation best practices
Agile transformation best practicesAgile transformation best practices
Agile transformation best practices
 
Scrum Master Interview Questions SlideShare
Scrum Master Interview Questions SlideShareScrum Master Interview Questions SlideShare
Scrum Master Interview Questions SlideShare
 
Agile & SCRUM
Agile & SCRUMAgile & SCRUM
Agile & SCRUM
 
Introduction to Scrum for Project Managers
Introduction to Scrum for Project ManagersIntroduction to Scrum for Project Managers
Introduction to Scrum for Project Managers
 
About Agile & PMI Agile Certified Practitioner (PMI-ACP) Overview
About Agile & PMI Agile Certified Practitioner (PMI-ACP) OverviewAbout Agile & PMI Agile Certified Practitioner (PMI-ACP) Overview
About Agile & PMI Agile Certified Practitioner (PMI-ACP) Overview
 
The Zen of Scrum
The Zen of ScrumThe Zen of Scrum
The Zen of Scrum
 

Similaire à Yin and Yang: Metrics within Agile and Traditional Lifecycles

A Dozen Keys to Agile Testing Maturity
A Dozen Keys to Agile Testing MaturityA Dozen Keys to Agile Testing Maturity
A Dozen Keys to Agile Testing MaturityTechWell
 
Seven Keys to Navigating Your Agile Testing Transition
Seven Keys to Navigating Your Agile Testing TransitionSeven Keys to Navigating Your Agile Testing Transition
Seven Keys to Navigating Your Agile Testing TransitionTechWell
 
March APLN: Agile development- Measure & Analyze by Garry Rowland
March APLN: Agile development- Measure & Analyze by Garry RowlandMarch APLN: Agile development- Measure & Analyze by Garry Rowland
March APLN: Agile development- Measure & Analyze by Garry RowlandConscires Agile Practices
 
Introducton to Scrum
Introducton to ScrumIntroducton to Scrum
Introducton to ScrumTenForce
 
Methodologies 3: Using Spira for Waterfall
Methodologies 3: Using Spira for WaterfallMethodologies 3: Using Spira for Waterfall
Methodologies 3: Using Spira for WaterfallInflectra
 
The Three Pillars Approach to Your Agile Test Strategy
The Three Pillars Approach to Your Agile Test Strategy The Three Pillars Approach to Your Agile Test Strategy
The Three Pillars Approach to Your Agile Test Strategy Brian Estep
 
Cross Functional Teams: Looking Beyond Development
Cross Functional Teams: Looking Beyond DevelopmentCross Functional Teams: Looking Beyond Development
Cross Functional Teams: Looking Beyond DevelopmentScott Gilbert
 
Seven Keys to Navigating Your Agile Testing Transition
Seven Keys to Navigating Your Agile Testing TransitionSeven Keys to Navigating Your Agile Testing Transition
Seven Keys to Navigating Your Agile Testing TransitionTechWell
 
Root Cause and Corrective Action (RCCA) Workshop
Root Cause and Corrective Action (RCCA) WorkshopRoot Cause and Corrective Action (RCCA) Workshop
Root Cause and Corrective Action (RCCA) WorkshopAccendo Reliability
 
Agile testing practice
Agile testing practiceAgile testing practice
Agile testing practiceMary Jiang
 
Why Agile? Why Now? IPMA Forum 2009
Why Agile? Why Now?   IPMA Forum 2009Why Agile? Why Now?   IPMA Forum 2009
Why Agile? Why Now? IPMA Forum 2009skipangel
 
Deploying a data centric approach to enterprise agility
Deploying a data centric approach to enterprise agilityDeploying a data centric approach to enterprise agility
Deploying a data centric approach to enterprise agilityComparative Agility
 
Test Automation Strategies for the Agile World
Test Automation Strategies for the Agile WorldTest Automation Strategies for the Agile World
Test Automation Strategies for the Agile WorldTechWell
 
Rana Mansoor Ahmed
Rana Mansoor AhmedRana Mansoor Ahmed
Rana Mansoor AhmedRana Mansoor
 
[Webinar] Visa's Journey to a Culture of Experimentation
[Webinar] Visa's Journey to a Culture of Experimentation[Webinar] Visa's Journey to a Culture of Experimentation
[Webinar] Visa's Journey to a Culture of ExperimentationOptimizely
 

Similaire à Yin and Yang: Metrics within Agile and Traditional Lifecycles (20)

A Dozen Keys to Agile Testing Maturity
A Dozen Keys to Agile Testing MaturityA Dozen Keys to Agile Testing Maturity
A Dozen Keys to Agile Testing Maturity
 
Tk
TkTk
Tk
 
Seven Keys to Navigating Your Agile Testing Transition
Seven Keys to Navigating Your Agile Testing TransitionSeven Keys to Navigating Your Agile Testing Transition
Seven Keys to Navigating Your Agile Testing Transition
 
Agile Software Process Improvement
Agile Software Process ImprovementAgile Software Process Improvement
Agile Software Process Improvement
 
Agile foundation online - slide share
Agile  foundation   online - slide shareAgile  foundation   online - slide share
Agile foundation online - slide share
 
Sanitized tb swstmppp1516july
Sanitized tb swstmppp1516julySanitized tb swstmppp1516july
Sanitized tb swstmppp1516july
 
March APLN: Agile development- Measure & Analyze by Garry Rowland
March APLN: Agile development- Measure & Analyze by Garry RowlandMarch APLN: Agile development- Measure & Analyze by Garry Rowland
March APLN: Agile development- Measure & Analyze by Garry Rowland
 
Introducton to Scrum
Introducton to ScrumIntroducton to Scrum
Introducton to Scrum
 
Methodologies 3: Using Spira for Waterfall
Methodologies 3: Using Spira for WaterfallMethodologies 3: Using Spira for Waterfall
Methodologies 3: Using Spira for Waterfall
 
The Three Pillars Approach to Your Agile Test Strategy
The Three Pillars Approach to Your Agile Test Strategy The Three Pillars Approach to Your Agile Test Strategy
The Three Pillars Approach to Your Agile Test Strategy
 
Cross Functional Teams: Looking Beyond Development
Cross Functional Teams: Looking Beyond DevelopmentCross Functional Teams: Looking Beyond Development
Cross Functional Teams: Looking Beyond Development
 
Seven Keys to Navigating Your Agile Testing Transition
Seven Keys to Navigating Your Agile Testing TransitionSeven Keys to Navigating Your Agile Testing Transition
Seven Keys to Navigating Your Agile Testing Transition
 
Root Cause and Corrective Action (RCCA) Workshop
Root Cause and Corrective Action (RCCA) WorkshopRoot Cause and Corrective Action (RCCA) Workshop
Root Cause and Corrective Action (RCCA) Workshop
 
Agile testing practice
Agile testing practiceAgile testing practice
Agile testing practice
 
Why Agile? Why Now? IPMA Forum 2009
Why Agile? Why Now?   IPMA Forum 2009Why Agile? Why Now?   IPMA Forum 2009
Why Agile? Why Now? IPMA Forum 2009
 
[Paul Holland] Trends in Software Testing
[Paul Holland] Trends in Software Testing[Paul Holland] Trends in Software Testing
[Paul Holland] Trends in Software Testing
 
Deploying a data centric approach to enterprise agility
Deploying a data centric approach to enterprise agilityDeploying a data centric approach to enterprise agility
Deploying a data centric approach to enterprise agility
 
Test Automation Strategies for the Agile World
Test Automation Strategies for the Agile WorldTest Automation Strategies for the Agile World
Test Automation Strategies for the Agile World
 
Rana Mansoor Ahmed
Rana Mansoor AhmedRana Mansoor Ahmed
Rana Mansoor Ahmed
 
[Webinar] Visa's Journey to a Culture of Experimentation
[Webinar] Visa's Journey to a Culture of Experimentation[Webinar] Visa's Journey to a Culture of Experimentation
[Webinar] Visa's Journey to a Culture of Experimentation
 

Plus de TechWell

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and RecoveringTechWell
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization TechWell
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTechWell
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartTechWell
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyTechWell
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTechWell
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowTechWell
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityTechWell
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyTechWell
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTechWell
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipTechWell
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsTechWell
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GameTechWell
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsTechWell
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationTechWell
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessTechWell
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateTechWell
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessTechWell
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTechWell
 

Plus de TechWell (20)

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
 
Ma 15
Ma 15Ma 15
Ma 15
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
 

Dernier

AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarPrecisely
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxUdaiappa Ramachandran
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...DianaGray10
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfJamie (Taka) Wang
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDELiveplex
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8DianaGray10
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.YounusS2
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopBachir Benyammi
 

Dernier (20)

AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptx
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
201610817 - edge part1
201610817 - edge part1201610817 - edge part1
201610817 - edge part1
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
20150722 - AGV
20150722 - AGV20150722 - AGV
20150722 - AGV
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8UiPath Studio Web workshop series - Day 8
UiPath Studio Web workshop series - Day 8
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 Workshop
 

Yin and Yang: Metrics within Agile and Traditional Lifecycles

  • 1. W6 Special Topics 5/1/2013 11:30:00 AM Yin and Yang: Metrics within Agile and Traditional Lifecycles Presented by: Shaun Bradshaw, Zenergy Technologies, Inc. Bob Galen, Rgalen Consulting Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
  • 2. Shaun Bradshaw Cofounder of Zenergy Technologies, Inc., a QA and agile solutions consulting firm (zenergytechnologies.com), Shaun Bradshaw has spent the past fifteen years advising, teaching, and mentoring clients to improve their QA and test processes with effective testing and test management techniques. He is the coauthor, editor, and trainer of a suite of methodologies covering testing, test management, and test metrics. A popular speaker at many of the major QA industry conferences, Shaun is known for his presentations on test metrics, the S-Curve, and the Zero Bug Bounce. Bob Galen Bob Galen is an agile coach at RGalen Consulting and director of agile solutions at Zenergy Technologies, a North Carolina-based firm specializing in agile testing and leading agile adoption initiatives. Bob regularly speaks at international conferences and professional groups on topics related to software development, project management, software testing, and team leadership. He is a Certified Scrum Master Practicing (CSC), Certified Scrum Product Owner (CSPO), and an active member of the Agile Alliance and Scrum Alliance. Bob published Scrum Product Ownership–Balancing Value from the Inside Out, which addresses the gap in guidance toward effective agile product management. Contact Bob at bob@rgalen.com or bob.galen@zenergytechnologies.com.
  • 3. 4/16/2013 The Yin & Yang Title of Software Metrics STAREAST 2013 Presented By: Bob Galen and Shaun Bradshaw Slide 1 Software Peace of Mind in Action ??? Introductions Bob Galen & Shaun Bradshaw Director, Agile Solutions – Zenergy Technologies Determined agile adoption coach, trainer, and consultant 10+ years of agile experience across Software, QA/Test, and Project Management Specialty in Agile at-Scale challenges bob.galen@zenergytechnologies.com Slide 2 VP of Consulting Solutions – Zenergy Technologies Experienced test manager, consultant, trainer IT Testing strategist 15 years of multi-domain experience Agile experience; Scrum Master shaun.bradshaw@zenergytechnologies.com Software Peace of Mind in Action 1
  • 4. 4/16/2013 ??? Format For This Session Focus for this session: QA & Testing Metrics Panel format 15 minutes for Shaun 15 minutes for Bob Write down your questions, ideas, metrics, etc. on 3x5 cards 30 minutes of Q&A interaction and debate Slide 3 Software Peace of Mind in Action What is Measurement? • “Measurement is the process by which numbers or symbols are assigned to attributes of entities in the real world in such a way as to characterize them according to clearly defined rules.” • “Measurement is the empirical, objective assignment of numbers, according to a rule derived from a model or theory, to attributes of objects or events with the intent of describing them.” 2
  • 5. 4/16/2013 ??? Software Metrics Traps Karl Wiegers 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. http://www.processimpact.com/articles/mtraps.html Lack of Management Commitment Measuring Too Much, Too Soon Measuring Too Little, Too Late Measuring the Wrong Things Imprecise Metrics Definitions Using Metrics Data to Evaluate Individuals Using Metrics to Motivate, Rather than to Understand Collecting Data That is Not Used Lack of Communication & Training Misinterpreting Metrics Data Slide 5 Software Peace of Mind in Action ??? Case Study Large, traditional financial / insurance organization 100 year company, traditionally staffed IT organization Regulatory support Large-scale project; joint with other consulting firms Slide 6 Software Peace of Mind in Action 3
  • 6. 4/16/2013 ??? Waterfall is ‘Real’ Not every project can be broken down into 2-week ‘chunks’ Not every company wants to be agile Scale of the project impacts everything We’ll know we’re done when we’re done is NOT an acceptable answer in many contexts Waterfall and Agile Slide 7 Software Peace of Mind in Action ??? Monitoring Phases & Transitions The overriding goal was to plan a series of maturation phases Testing would serve as the guide between phases Qualifying progress Verifying functionality Measuring variation / defects Guiding next steps Slide 8 Software Peace of Mind in Action 4
  • 7. 4/16/2013 ??? Risk-Based Testing All testing was focused towards what Was delivered Worked Was planned Was considered Higher Priority features Was considered Higher Risk items Slide 9 Software Peace of Mind in Action ??? Key Metrics – “Exit Criteria” Test Execution by priority Have we tested enough? Did we cover our plans? Overall pass rates Is the software working? Where are we ‘Blocked’? Are there any ‘Patterns’ to the failures Percent of defects corrected by severity Are we catching up on repairs? Is the software maturing at a sufficient rate to support the plan? Slide 10 Software Peace of Mind in Action 5
  • 8. 4/16/2013 ??? Customer Override… Basically, the customer has the final authority to adjust Metrics Analysis (Re)Actions Goals So, ’agility’ from a leadership & governance perspective Slide 11 Slide 12 Software Peace of Mind in Action Software Peace of Mind in Action 6
  • 9. 4/16/2013 Transition… Slide 13 Software Peace of Mind in Action ??? Agile Metrics Agile methods are generally not metrics centered, They’re much more team-centered and progress or outcome centered Rarely do you want to examine the individual; leave that to the team Exceptions – experienced coaches Avoid “Metrics Dysfunction” metrics Lines of code produced Bugs found Estimate vs. Actual Slide 14 Software Peace of Mind in Action 7
  • 10. 4/16/2013 ??? Big 4 Agile Metrics 1. 2. 3. 4. Value Delivered Velocity & Throughput Quality Team Morale & Satisfaction Slide 15 Software Peace of Mind in Action ??? Value-Delivered Prioritization Always deliver the highest priority work first Earned value – it’s “Done” Customer Acceptance User Story sign-off Active customer demonstration; embrace changes ROI – Usage Sales & usage targets; confirm Did we make the right decisions on value? Adjustments? Slide 16 Software Peace of Mind in Action 8
  • 11. 4/16/2013 ??? Velocity & Throughput Productivity matters in agile teams First, the software is only accepted if it meets clear Done-Ness criteria Velocity – the number of Story Points produced per Sprint Throughput – the number of ‘Days’ that a story was InProgress, relative to it’s size; also a risk play Continuous improvement Velocity – UP; Throughput - DOWN Slide 17 Software Peace of Mind in Action ??? Quality Test Automation Continuous Integration & Continuous Deployment Every check-in…run automation; Stop-the-Line Defect ‘Escapes’ Escaping your Done-Ness Escaping your Sprint Escaping into the wild…Customer Escapes Pairing, inspections, RCA Continuous Improvement – downward trending Slide 18 Software Peace of Mind in Action 9
  • 12. 4/16/2013 ??? Team Morale & Satisfaction Self-directed; Team autonomy; Listened to Attrition is analyzed; New hire onboarding Sustainable pace Periodic surveys Team overall health & satisfaction Feedback on adjustments Agile values Make the survey and the actions Transparent Make it clear—people are central to your success Slide 19 Software Peace of Mind in Action ??? That’s it… Aligned with Goals Sprint Goals & Release Goals Organizational Goals & Company Goals Attributes: They’re all important…perhaps “People First” There are no “fixed targets” Keep them simple; everyone is aware of the goal Measure as a team Stop the individual metrics dysfunction Slide 20 Software Peace of Mind in Action 10
  • 13. 4/16/2013 Transition… Slide 21 Software Peace of Mind in Action Now It’s YOUR Turn Questions? Debate! Slide 22 Software Peace of Mind in Action 11
  • 14. 4/16/2013 ??? Questions for your Consideration What ‘healthy’ metrics have you personally experienced? What about stories of dysfunctional metrics? Challenges you’ve seen in moving from Waterfall to Agile or vice versa? If you only had 1-3 metrics to measure software in your own company, what would they be? Slide 23 Software Peace of Mind in Action ??? Questions for your Consideration Example of what we could discuss Estimation vs. Actuals Planning Poker & ‘Relative’ estimation Anyone use GQM? Slide 24 Software Peace of Mind in Action 12
  • 15. 4/16/2013 Any other questions? Thank you! Slide 25 Software Peace of Mind in Action 13