SlideShare une entreprise Scribd logo
1  sur  70
Télécharger pour lire hors ligne
Estimating and Reporting
Agile Projects using the
SRDR and EarnedValue
Management
Glen B. Alleman
Thomas J. Coonce
PSM Users’ Group 2017
Measurement: Measurement in a Complex
Environment
12‒16 June 2017, Crystal City,Virginia
2
Do Agile
Is the set of Agile
Practices
§ Scrum
§ eXtreme
Programming
§ DSDM
§ Crystal
§ Prince2 Agile
Be Agile
Is an Agile
Mindset
§ Emergent
Requirements
§ Iterative
development
§ Incremental
deployment
What Do We Mean When We Read the NDIA
“An Industry Practice Guide for Agile on Earned
Value Management Programs?”
Doing Agile is NOT the Same as Being Agile
PSM Users’ Group 2017, Crystal City, VA
Why We’re Here? Told as an Agile User Story†
n As a <type of user>, I want <some goal> so that
<some reason>
n As a Government Technical Software Manager I want
to Properly Estimate the Features in the CONOPS so
that I have a Credible Baseline
n As a Government Technical Software Manager I want
assure that Features in ConOps can be delivered
within Cost and Schedule so that we’re delivering
capability according to plan
3
Before Contract Award
After Contract Award
† User Stories Applied for Agile Software Development, Mike Cohn, Addison Wesley
PSM Users’ Group 2017, Crystal City, VA
Some Understanding Before We Start
4
n SRDR is applicable to all MDAPs greater than $25M.
n For Earned Value Management to be applicable, the
program is Large compared to the typical software
development project,
n $20M for self-assessment (SA).
n $100M for DCMA Validation (VR).
n For typical commercial Agile development effort, a small
team of 5 to 7 developers ‒ at typical burden rates ‒ runs
$600K to $800K (Burdened) a year for the team.
n The typical commercial agile project is 30 to 125 times
smaller then the entry points of an EVMS IAW 748-C.
n So Agile + Earned Value Management starts at the
Enterprise and At Scale environment. In this domain,
process compliance is king.
+
Developing a
Credible Plan
Before Contract
Award
n Decomposing the ConOps into
Capabilities and Features
n Background on Agile Software
Development (Scrum)
n NDIA framework for integrating EVM
with Agile
n Start by estimating Capabilities
n What’s the purpose of Estimates on
Agile programs
n Story Points are Not meaningful
measures of Time, Cost, or Physical
Percent Complete
At this point in time, we have little to
base estimates on other than past
similar projects.
5PSM Users’ Group 2017, Crystal City, VA
PSM Users’ Group 2017, Crystal City, VA
Decompose of the ConOps into
Capabilities and Features
6
ConOps
Goal/Outcome # 1 Goal/Outcome # 2
Capability
Feature Feature Feature
Story Story Story
Feature Feature
Capability
Source: David Bulkin, Lithespeed.com
Capabilities
Needed before
Contract Award
Features
further
refined after
Contract
Award
Task TaskTask
PSM Users’ Group 2017, Crystal City, VA
Some Understanding of Agile
Software Development (1)
n Product Roadmap defines what Capabilities are
need.
n Release Plan states when Features are available to
fulfill the Capabilities.
n Product Backlog contains Features to be
implemented in Sprints.
n Stories define the outcomes for the Features.
n Tasks define the work to produce the Story.
7
PSM Users’ Group 2017, Crystal City, VA
Some Understanding of Agile
Software Development (2)
n Physical Percent Complete defined by the 100%
completion of a Story with it’s exit criteria.
n BCWS is the flat spread of the Labor for the Sprint.
n BCWP = BCWS × Physical Percent Complete.
n Estimating in Agile answers the question Can we
deliver the Features for the Budget?
n Estimating in Traditional EVMS answers the question
What is the Cost for the needed Features?
8
9
Framework for Integrating Agile and Earned Value
Management Before and After Contract Award
EVM Reporting
from Work
Package
Performance
EVM
Performance
• PV – from Basis
of Estimate
• AC – from time
cards
• EV – from
Physical %
Complete
Release 1 Release n
Feature 1,2,3
Feature 4, .. ,8
Feature 9, …,12
Release 2 PP’s
WP
PP
in IMS
CA
Features
and Stories
in Sprints
Time Now
Performance Measurement Baseline
Agile Software Development Lifecycle
Feature n’s
Milestones
Data Items
Releases
Capabilities in a Release
Agile Development Control Account
Task
Task
Task
Task
Task
Task
Task
Task
Task
…
Physical Percent Complete, captured at Task and Story level is Rolled to IMS to Features in
Work Packages to produce Earned Value metrics used for Estimate At Completion
Release Plan
Product Road Map for Needed Capabilities from Capabilities Based Plan
PSM Users’ Group 2017, Crystal City, VA
Our Notional Program starts with
Capabilities Based Planning
10
Our needed Capabilities are provided through a Software Intensive System
of Systems (SISoS).
This program is a software program, we can buy the hardware out of a
catalog.
PSM Users’ Group 2017, Crystal City, VA
Example of Capability Statements
for a Surveillance Quadcopter
1. Be commanded to autonomously fly to an area of
interest.
2. Loiter in the area of interest for 2 hours.
3. Discover what’s going on in an area of interest.
4. Redirect to new area of interest from Ground Station.
5. Transmit information to ground station in real-time.
6. Return home automatically or when commanded.
11
Capabilities Based Planning is about MOEs and MOPs NOT technical requirements first. JSA-TP-3-CBP
These Capabilities will be Implemented by Features in an
emergent, agile manner, not constrained by early requirements
12
The primary purpose of software
Planning, Budgeting, and Estimating on
Agile software programs is to
determine whether a project’s targets
are realistic enough to allow the
project to be controlled to meet them.
This is the inverse of the Estimating
processes on traditional EVM
programs, where the Baselined work
is summarized to produce the BCWS.
From the Government’s point of view, On Agile Programs, BCWS is flat spread
across each Sprint that implements each Feature in each Work Package in each
Control Account.
On Agile Programs, we need to know if we have enough money and time to
deliver the Capabilities without knowing the detailed Requirements.
PSM Users’ Group 2017, Crystal City, VA
PSM Users’ Group 2017, Crystal City, VA
Top Level Agile Acquisition Process
Prior to Contract Award, the Government develops a Credible
Estimate based on a desired Product Roadmap for the needed
Capabilities to Accomplish the Mission
After Contract Award, the Government iterates with the
Contractor on the Product Roadmap as the Features emerge
that fulfill the needed Capabilities
13
PSM Users’ Group 2017, Crystal City, VA
Building the Governments’ Credible
Plan Before Award
n Using reference class data,
n Build Government Product Roadmap, and
n Build Government Release Plan showing what
Capabilities are contained in each Release.
n Build a cost profile for needed staff (FTE) for period
of performance for the Features for each Release
14
PSM Users’ Group 2017, Crystal City, VA
How Do We Estimate the Capabilities
Before we Know the Needed Features?
n Start with a Notional plan of what Features are
contained in Capabilities from past work.
n Use actual hours for these Features to develop a
Reference Class (past SRDR).
n We need a Feature Breakdown Structure just like the WBS in
MIL-STD-881C
n Use the Reference Class for model emerging
Features.
15
PSM Users’ Group 2017, Crystal City, VA
Starting Point for Estimating Agile Projects
n For a proposed future agile application for a given operating
environment and application domain and stated features, the
estimator should be able to query on a standardize feature list
and obtain:
n Actual staff hours to produce the feature
n Actual duration to produce the feature
n Extent of software reuse and sources
n Extent of use of automated tools
n Team experience
n For each feature, estimator would array historical dependent
effort and durations and other attributes and compare to
targeted feature
n For proposed new feature with given planned library and
automated tool use, find nearest neighbor with similar reuse
and tool use and extract effort and duration
n If no knowledge of reuse and automated tool use, use the means
16
PSM Users’ Group 2017, Crystal City, VA
Executing the Program After
Contract Award
n Using reference class data,
n Compare actual performance with planned
performance, and
n Identify corrective actions needed to keep the
program on plan.
17
Story Points are NOT Meaningful
Measures of Time, Cost, or Physical
Percent Complete
https://www.mountaingoatsoftware.com/blog/its-effort-not-complexity
In Agile,
Story Point-based
measures are about
the Relative effort the
work will take, not the
Actual effort or
duration.
The customer needs
to know how much and
how long.
18PSM Users’ Group 2017, Crystal City, VA
PSM Users’ Group 2017, Crystal City, VA
Let’s Pause to Address the Cardinal
and Ordinal Estimating Problem
19
§ When	we	use	a	measure	of	something	we	
need	to	know	if	it	is	Cardinal or	Ordinal.
§ Ordinal measures	tell	us	the	relative	
difference	between	items.	
§ Uncle	Scrooge	is	relatively	rich
compared	to	Huey,	Dewey,	and	Louie	
is	an	Ordinal measure.
§ Cardinal measures	are	numbers that	say	how	many	of	something	there	
are,	they	are	counting	numbers	‒	one,	two,	three,	four,	five.
§ Uncle	Scrooge	has	$1,250,000,000	dollars	of	Gold	
§ In	Project	Performance	Management	we	use	Cardinal	numbers,	
measured	in	Dollars,	Hours,	Technical	Performance	compliance.
§ Story	Points	are	NOT a	unit	of	measure	used	in	Project	Performance	
Management	in	the	DI-MGMT-81861	IPMR
PSM Users’ Group 2017, Crystal City, VA
A Caution for Using Story Points to Measures
Anything Beyond a Single Feature on a Single
Team
Ordinal
numbers
ONLY have
meaning for
their current
use ‒ unless
calibrated to a
reference that
does not
change over
time
Without Calibrated values, the numbers have no meaning when collected at higher
levels of the program ‒ WP’s and Control Account. 20
PSM Users’ Group 2017, Crystal City, VA
Ordinal Story Points Cannot Be The Basis
of Higher Than A Single Feature
Feature 1
Story 1
Story 2
Story 3
Story 4
Story 5
Story 6
Team 1’s
Uncalibrated
Ordinal SP
estimates
Feature n
Team 2’s
Uncalibrated
Ordinal SP
estimates
∑ F1(SP) ∑ Fn(SP)
Release 1 ∑ of SP’s
• • •
§ At	the	Story	level,	
relative	effort	defines	
individual	estimates.
§ At	the	Feature	level,	
lower	level	SP’s	don’t	
have	the	same	unit	of	
measure in	the	way	
Dollars	do.	
§ When	Features	
summed	to	the	
Release,	relative	
measures	do	not	
provide	basis	of	
Physical	Percent	
Complete.
These	are	Not the	same	units	of	measure	
between	Features	– Uncalibrated	SP’s
Story 1
Story 2
Story 3
Story 4
Story 5
Story 6• • •
Using Ordinal (uncalibrated values) outside the domain of agreement prevents comparison of
higher levels on the program. My Story Points aren’t Your Story Points. 21
PSM Users’ Group 2017, Crystal City, VA
Stories and Story Points are NOT Measures
of Cost, Schedule, or Performance
§ Story	Points	are	Ordinal numbers	‒	relative	measures	of	effort	or	complexity	
defined	by	the	Scrum	Team	members	for	a	specific	Sprint,	Feature,	and	
perhaps	a	Release.
§ Story	Points	are	not	scope,	they	are	calibrated	to	Time	and	Money	outside	an	
individual	Scrum	Team.
§ Counting	Story	Points	is	like	counting	Tasks in	the	IMS
§ We	have	40	tasks	to	do	for	this	delivery	which	is	9	weeks	long	(3,	3	week	
Sprints).
§ We’ve	done	20	Tasks	so	far.
§ Are	we	50%	complete	for	the	planned	task	work?
§ Not	likely	unless	each	Task	is	of	the	same	effort	and	duration.
…	Beyond	a	single	Scrum	Team,	with	calibrated	Story	Points	for	their	
own	usage	and	need	…
Let’s keep reminding ourselves Story Points are Ordinal measures.
Useful for relative sizing but not sizing in units of dollars and hours. 22
PSM Users’ Group 2017, Crystal City, VA
In this afternoon’s workshop we’re
going to lead participants to …
n Develop the Performance Measurement Baseline for
the the needed Capabilities
n Develop the Features that fulfill those Capabilities.
n Product Roadmap
n Release Plan
n Measure progress to plan using EVM data
n Physical Percent Complete at the Feature level in the Product
Roadmap
n Develop scenarios for statusing and forecasting the
program
23
24PSM Users’ Group 2017, Crystal City, VA
PSM Users’ Group 2017, Crystal City, VA
Workshop Agenda
n Present the Features of a notional UAS with a Release
Planning following a Product Roadmap
n Explain the principles of measuring Physical Percent
Complete at the Feature level used to inform EIA-
748-C Earned Value (BCWP)
n Demonstrate this on the notional program, with two
scenarios, one from Change, one from Forecast
update
n Lead the students to evaluate progress and EAC
using two scenarios
25
+
After Contract
Award
n Agile estimating starts with
Capabilities Based Planning
n The Capabilities of the Quadcopter
and the Features for each Release in
the Product Roadmap
n A quick overview of Scrum
n 10 Step Integration of Agile on EVM
Programs
n 5 Baseline Change Scenarios
n 7 Forecasting Scenarios
The contract for the quadcopter has
been award.
Now the government needs
assurance that progress to plan be
being made in units of measure
meaningful to the decision makers
26PSM Users’ Group 2017, Crystal City, VA
PSM Users’ Group 2017, Crystal City, VA
Example Capability Statements for
Surveillance using Quadcopter
1. Be commanded to autonomously fly to an area of
interest.
2. Loiter in the area of interest for 2 hours.
3. Discover what’s going on in an area of interest.
4. Redirect to new area of interest from Ground Station.
5. Transmit information to ground station in real-time.
6. Return home automatically or when commanded.
27
Capabilities Based Planning is about MOEs and MOPs NOT technical requirements first. JSA-TP-3-CBP
These Capabilities will be Implemented by Features in an
emergent, agile manner, not constrained by early requirements
PSM Users’ Group 2017, Crystal City, VA
Our Program starts with Capabilities
Based Planning
28
Our needed Capabilities are provided by a Software Intensive System of
Systems (SISoS).
This program is a software program, we can buy the hardware out of a
catalog
PSM Users’ Group 2017, Crystal City, VA
Product Roadmap for the
Quadcopter
29
Release 1 Release 3Release 2
§ Autonomously takeoff
§ Accept mission
coordinates
§ Fly to mission
coordinates (are of
interest)
§ Loiter over area of
interest
§ Pilot controlled return
to home
§ Collect basic
surveillance data over
area of interest
§ Transmit data to
ground station
§ Accept ground station
redirection to new
area of interest
§ Collect advanced
surveillance data
§ Autonomously return
home on command
Features Features Features
PSM Users’ Group 2017, Crystal City, VA
Product Roadmap for the
Quadcopter
30
Release 1 Release 3Release 2
§ Autonomously takeoff
§ Accept mission
coordinates
§ Fly to mission
coordinates (are of
interest)
§ Loiter over area of
interest
§ Pilot controlled return
to home
§ Collect surveillance
data over area of
interest
§ Transmit data to
ground station
§ Accept ground station
redirection to new
area of interest
§ Collect advanced
surveillance data
§ Autonomously return
home on command
Features Features Features
PSM Users’ Group 2017, Crystal City, VA
Loiter Over Area of Interest
n Discover topology of the terrain at the area of interest to
avoid collision with terrain
n Discover the flying conditions at the area of interest to
assess stability of platform
n Define the loiter pattern given the terrain at the area of
interest (race track pattern– figure 8’s) to confirm loiter
time possible
n Determine altitude for best surveillance to match needed
resolution
n Determine in real-time, the remaining loiter time with fuel
return to ground station, to assure mission can be
accomplished.
31
As a <type of user>, I want <some goal> so that <some reason>
+Product Roadmap for the
Quadcopter
32
Release 1 Release 3Release 2
§ Autonomously takeoff
§ Accept mission
coordinates
§ Fly to mission
coordinates (are of
interest)
§ Loiter over area of
interest
§ Pilot controlled return
to home
§ Collect surveillance
data over area of
interest
§ Transmit data to
ground station
§ Accept ground station
redirection to new
area of interest
§ Collect advanced
surveillance data
§ Autonomously return
home on command
Features Features Features
PSM Users’ Group 2017, Crystal City, VA
PSM Users’ Group 2017, Crystal City, VA
Collect surveillance data over area
of interest
n Collect and store EO/IR, to look for humans walking
on the ground for threat assessment.
n Collect and store SAR data for stationary or moving
equipment on the ground for terrain assessment.
n Collect and store SIGINT and ELINT data to classify
radiation sources (radar and target tracking) to
identify potential targets for Electronic Warfare
attack (jamming) for building Electronic Order of
Battle (EOB).
33
As a <type of user>, I want <some goal> so that <some reason>
+Product Roadmap for the
Quadcopter
34
Release 1 Release 3Release 2
§ Autonomously takeoff
§ Accept mission
coordinates
§ Fly to mission
coordinates (are of
interest)
§ Loiter over area of
interest
§ Pilot controlled return
to home
§ Collect surveillance
data over area of
interest
§ Transmit data to
ground station
§ Accept ground station
redirection to new
area of interest
§ Collect advanced
surveillance data
§ Autonomously return
home on command
Features Features Features
PSM Users’ Group 2017, Crystal City, VA
PSM Users’ Group 2017, Crystal City, VA
Collect Advanced Surveillance Data
n Collect Full Motion Video (FMV) Data to identify
moving targets and their paths.
n Compress and store FMV data to wait for best
transmission opportunities.
n Transmit FMV data when maximum bandwidth is
available.
35
As a <type of user>, I want <some goal> so that <some reason>
PSM Users’ Group 2017, Crystal City, VA
Quick Overview of Scrum Software
Development
n Product Roadmap defines what Capabilities are need
n Release Plan states when Features are available to fulfill
the Capabilities
n Product Backlog contains Features to be implemented in
Sprints
n Stories define the outcomes for the Features
n Tasks define the work to produce the Story
n Physical Percent Complete defined by the 100%
completion of a Story with it’s exit criteria
n BCWS is the flat spread of the Labor for the Sprint
n BCWP = BCWS × Physical Percent Complete
36
PSM Users’ Group 2017, Crystal City, VA
Critical Success Factors for Agile
and EVMS
n Every Story, that implements at Feature must have
testable exist criteria …
n This means we MUST know what DONE looks before starting
the work.
n This knowledge MUST be in units of measure meaningful to
the decision makers.
n Measures of Effectiveness ‒ Operational measures of success
that are closely related to the achievements of the mission or
operational objectives evaluated in the operational
environment, under a specific set of conditions.
n Measures of Performance ‒ characterize physical or
functional attributes relating to the system operation,
measured or estimated under specific conditions.
37
PSM Users’ Group 2017, Crystal City, VA
10 Steps to Integration of Agile on
Earned Value Management Programs
38
Closed Loop Feedback Control
for Agile at Scale
❶ Engineering
Estimate
❷ Product
Roadmap
❸ Release
Plan
❺ Backlog
❻ Sprint Backlog
Plan
❹ IMS with
Features
in WP
❼ Task Estimates
During Sprint
❽ TO DO Updates Produce
Physical Percent
Complete
❿ Update Physical
Percent
Complete in
EVMS
❾ Update Feature in
IMS with Physical
Percent Complete
Plan
Do
Check
Act
Continuous feedback at each step with
corrective actions for Root Cause of
Performance Variances
39
➊ Engineering Estimate of
requested Features to deliver
needed business Capabilities
for needed budget and time
➋ Roadmap of those Features
laid out in needed order
➌ Release Plan for those
Features
➍ IMS with Features in Work
Packages with PV for FTE and
ODC
➎ Features in the Backlog in
Agile Development System
➏ Sprint Plan for Features and
Stories
➐ Task Estimates of Stories and
Tasks During Sprint
➑ TO DO Updates During Daily
Standup
➒ Features in IMS statused with
Physical Percent Complete
from Rally
➓ Status from IMS sent to
Cobra®
From Estimate to Backlog From Sprint to Status
10 Step Integration of Agile with
Earned Value Management
+
PSM Users’ Group 2017, Crystal City, VA
40
1. Decompose needed
Capabilities into Features
2. Estimate effort in hours to
deliver the Feature
3. Determine uncertainties
around that estimate
1. Reducible uncertainty
2. Irreducible uncertainty
4. Model these uncertainties with
Crystal Ball® to 80%
confidence
§ Use Triangle distribution if
actual distribution not known
5. Establish Change Control
process for updates to this
estimate as the project
progresses
1. Assess past performance for
similar Features used for
estimates
2. Rank Feature with Ordinal
measure if needed (Story
Points)
3. Focus of Cardinal estimates
in hours
4. Assure Features include all
exit criteria and risks
5. Assure Features have
minimal dependencies
6. Define sequence of
deliverables, in preparation
for Product Roadmap
Earned Value Agile
Engineering Estimate
❶
+
PSM Users’ Group 2017, Crystal City, VA
41
1. In the WBS Dictionary, define
Capabilities of each Feature
(DoD = definition of done)
with measures of:
§ Effectiveness
§ Performance
§ Technical
§ Key Performance
Parameters
2. Assign PV in Hours for FTE to
each period of performance
to the Features in the
assigned Work Package
1. Build Roadmap from ROM
and Engineering Estimate for
sequence of Features
accepted by customer
2. Put the Features in the
proper order in the Roadmap
in Rally
3. Publish Roadmap for the
Scrum Team in hardcopy
Earned Value Agile
Product Roadmap
❷
+
PSM Users’ Group 2017, Crystal City, VA
42
1. In the IMS, layout and
sequence Features in Work
Packages for the number of
Sprints to produce each
Feature
2. Establish Change Control for
modifying the Release Plan in
the IMS as the project
progresses
1. Assign Features to Releases
2. Code this information in Rally
3. Update Roadmap with
Release Information for each
Feature from the final
accepted ROM
Earned Value Agile
Release Plan
❸
+
PSM Users’ Group 2017, Crystal City, VA
43
1. Obtain hours, core and non-
core, and LCAT by Feature
from the ROM
2. Validate PV against the
Release Plan
3. Baseline Work Packages with
PV and period of
performance for each Feature
1. Feature Period of
Performance shown in with
Release Plan
2. Original Estimates from ROM
recorded in Backlog traceable
to IMS
Earned Value Agile
IMS with Features in Work
Packages
+
❹
PSM Users’ Group 2017, Crystal City, VA
44
1. The Features in the Backlog
are traceable to the
Engineering Estimate and to
the Planned Value in the PMB
2. Use the Backlog as source
material for Roadmap, along
with the PV for each Feature
§ Story Points can be
assigned in the PBL for
prioritization purposes
1. Backlog built from Roadmap
using Features from
Engineering Estimate and
any further decomposition
into Stories
2. Effort estimate in Hours, can
be augmented with Story
Points to improve confidence
in proper estimate
Earned Value Agile
Product Backlog
❺
+
PSM Users’ Group 2017, Crystal City, VA
45
1. Confirm PV above the line is
in lock step with the work
planned below the line.
2. Confirm FTE spread for
Period of Performance for
Work Packages in the IMS
1. Capacity for work is primary
Sprint Planning process
2. Confirm needed skill set to
complete the work and
remove blocking factors
within Sprint
Earned Value Agile
Sprint Backlog
❻
+
PSM Users’ Group 2017, Crystal City, VA
46
1. Confirm TASK EST is still
proper value for the Feature
being executed in the Sprint
§ If not, update the Forecast
in IMS and Cobra
2. The role of the Planner is to
update the Forecast in the
IMS and Cobra to reflect
Sprint and Feature planning
and execution
§ This foot and ties the
Forecast with the Physical
Percent Complete
§ They are complements of
each other
1. Decompose Features into Stories and
Tasks
2. Estimate Tasks in TASK EST field in
Rally
§ Once Sprint starts this field is
frozen
§ Initially TO DO = TASK EST
3. When Sprint starts, update TO DO
field as work progresses
§ TO DO goes down as work is
completed
§ TO DO goes up as new more work
is discovered
4. Update FEATURE FORECAST if
§ Current estimated work > TASK
EST
§ Remaining work is expected to take
longer than the initial estimate
§ Note: Forecast should only include
in-scope changes
Earned Value Agile
Task Estimating for the Sprint
❼
+
PSM Users’ Group 2017, Crystal City, VA
47
1. The updated TO DO from the
Daily Standup is used to
calculate Physical Percent
Complete
2. This is used to calculate
Percent Complete on a daily
basis, as well as at month
end:
§ Current performance is
available daily
§ This reporting path assures
accurate month end status
that relies on TO DO
updates from the Daily
Standup
1. TO DO should be updated at
the Daily Standup
2. When the estimated effort
changes to be different than
baselined in the TASK EST
field – TO DO is updated
3. TO DO value
§ Goes down as the work is
completed
§ Goes up when new work (in
scope) is discovered for the
Task, Story, therefore for
the Feature
Earned Value Agile
TO DO Updates of Sprint Work
❽
+
PSM Users’ Group 2017, Crystal City, VA
48
1. No need to ask anyone what
the status is, Rally has the
status at the lowest level of
the project ‒ live on a daily
basis
2. Feature Physical Percent
Complete values are imported
to the IMS and used to status
Features in Work Packages
3. Use the custom report to
extract performance from Agile
in the form of Physical Percent
Complete
4. Feature Physical Percent
Complete on the report is a
rollup from Tasks to the
Feature level
1. The Physical Percent
Complete values are
exported from Rally in a
custom report
2. Feature Physical Percent
Complete is calculated from
the rollup of the TO DO field
and the Feature Forecast
Earned Value Agile
Feature Physical Percent
Complete in the IMS
❾
+
(∑ TASK EST – ∑ TO DO) / Feature Forecast
PSM Users’ Group 2017, Crystal City, VA
PSM Users’ Group 2017, Crystal City, VA
Earned Value Calculated by Physical
Percent Complete
n EIA-748-C,	page	1,	bullet	5	says	…
Objectively	assess	accomplishments	at	the	work	performance	level – Tasks	in	the	Sprint.
n Story Points CAN be used for relative assessment in prioritizing work in the Product
Backlog ‒ Ordinal numbers.
n Hours used to define actual effort and
duration during Story Time, Tasking, and
Sprint Execution ‒ Cardinal numbers.
n Mixing the Story Points with Hours is fine
when prioritizing the work in the Product
Backlog and Sprint Backlog.
n Measuring progress to plan needs to be with Cardinal values meaningful to the
decision makers.
n The IPMR (DI-MGMT-81861) has NO units of measure in Stories or Story Points.
n Measures of Physical Percent Complete MUST used Cardinal Values as well.
Story Points are useful for prioritizing work, we don’t need them for calculating Physical Percent
Complete. Because we have hour estimates on the contract. 49
PSM Users’ Group 2017, Crystal City, VA
Physical Percent Complete During
Sprints
50
Original	
Engineering	
Estimate
Estimate	of	User	
Stories	in	Sprint	
Remaining	Work	
for	Story	
0	Remaining	Means	
Story	Done
10	of	10	Remaining	Means	
Story	Not	Stated
Sprint	1	‒	50%	Complete
After	Sprint	1	Feature	18%	
Complete,	with	58	Hrs	remains
Sprint	2	‒	9%	Complete
At	this	point	in	Sprint	2,	Features	
20%	Complete
51
1. Update ETC in Cobra
§ Periodically update ETC by
LCAT for Work Packages in
Cobra
§ Verify that the resulting ETC
hours still match the IMS and
the Sprint work to do
2. Update EV in Cobra
§ Physical Percent Complete
from Agile is also used in
Cobra
§ Based on the Business
Rhythm, update Physical
Percent Complete for Work
Packages in Cobra
§ Calculate EV
1. Confirm reported Physical
Percent Complete in Cobra®
foot and ties with Physical
Percent Complete in Rally to
acceptable degree of
accuracy and precision
§ This is an eye ball
assessment, the number
may or may not be exactly
the same, so close enough
is a value judgement of
the Planners and PM
2. As part of the EV analysis
processes, provide
performance assessment and
suggested corrective actions
Earned Value Agile
Earned Value Updates of Work
Packages in EVMS
❿
+
PSM Users’ Group 2017, Crystal City, VA
5 Baseline Change Scenarios
❶ Feature in PMB not
opened and moved to
new work package.
❷ Open feature incomplete
at end of planned Sprint.
❸ Feature in current release moved to another
release.
❹ Planned initiative and resulting feature removed
from baseline.
❺ Feature completion criteria updated with additional
functionality.
52PSM Users’ Group 2017, Crystal City, VA
❶ Feature in PMB Not Opened and
Moved to New Work Package
Scenario PMB Action Agile Action
§ Feature in the PMB Work
Package is not open and
has not started .
§ The Feature is not
needed in the current
release.
§ Customer approves
moving the Feature to
another Release.
§ Replan the PMB’s work
package budget (BCWS)
to a Planning Package in
a future Release.
§ If the baseline start for
the Feature is inside the
program’s Freeze Period,
customer must approve
the baseline change.
§ Feature and related
Stories are returned to
the Backlog and
assigned to a future
Release.
§ The Planning Package
for that release is
updated.
§ Customer approves the
moving of the Feature to
the future Release.
53PSM Users’ Group 2017, Crystal City, VA
❷ Open Feature Incomplete at end of
Planned Sprint
Scenario PMB Action Agile Action
§ Feature in an Open Work
Package is 30%
complete.
§ The Sprint completion
date arrives and Feature
is not complete.
§ The Sprint completes
without this Feature.
§ Keep Work Package
open and report a
schedule variance
§ Possibly report a Cost
Variance as well
§ Work Package stays
open until all planned
work is completed.
§ Unfinished work
returned to Backlog and
planned for future
Release
§ Work stops at end of
Sprint
54PSM Users’ Group 2017, Crystal City, VA
❸ Feature in Current Release Moved to
Another Release
Scenario PMB Action Agile Action
§ Feature in current
Release reprioritized
and moved to another
Release.
§ Planned Feature is
exchanged for a
different Feature from the
Backlog of similar size
placed in a future
release.
§ Planned Feature placed
back on the Backlog.
§ Overall budget and
schedule is unchanged.
§ This is a Replan of the
PMB.
§ Budget for the Feature
follows the Feature.
§ Features and related
Stories reassigned to a
WP and Release PP
§ WP and PP traceability
updated in the PMB.
§ Backlog updated with
planned Release
removed
55PSM Users’ Group 2017, Crystal City, VA
❹ Planned Initiative Removed from Baseline
Scenario PMB Action Agile Action
§ Initiative removed from
baseline through a
contract change.
§ Change impacts a
Feature
§ Removed Feature is in an
open Work Package
§ Baseline change,
because Scope has
changed.
§ Close Work Package with
unfinished work.
§ Unclaimed BCWS moved
to Undistributed Budget
(UB)
§ Unfinished Features
returned to Backlog
§ Remove Feature and any
Stories from Backlog
56PSM Users’ Group 2017, Crystal City, VA
❺Feature Completion Criteria Updated with
Additional Functionality
Scenario PMB Action Agile Action
§ Exit criteria for Work
Package containing a
Feature is updated with
additionally functionality
§ Scope of the Feature is
updated to reflect
changes.
§ If new scope budget can
come from UB.
§ If unplanned scope
change, budget can
come from MR.
§ Exit criteria for the
Feature is updated to
reflect changes
§ New Feature added to
the Backlog.
57PSM Users’ Group 2017, Crystal City, VA
7 Forecast Update and Change
Scenarios
❶ Stories planned for a 3 sprint
feature will not complete as
planned.
❷ Stories planned for 3 sprint
feature are move to 4th sprint.
❸ Planned feature will not complete by formal delivery date.
❹ Story determined not to be necessary for feature.
❺ Determined a user story needs to be added to a Feature.
❻ After feature and stories accepted, problem found.
❼ Feature assigned to release reprioritized to future release.
58PSM Users’ Group 2017, Crystal City, VA
❶ Stories Planned for a 3 Sprint Feature Will Not
Complete As Planned
Scenario PMB Action Agile Action
§ Feature planned for 3
Sprints has started work
§ Team determines some
Stories for the Feature
will not be completed in
their planned Sprint
§ Stories are moved to the
next Sprint
§ Stories remain inside the
Baseline Feature release
date.
§ No change in the PMB
Work Package
§ Stories can be moved
inside the Feature
§ Moving the Story has no
impact on the PV
§ Backlog is updated to
move incomplete Stories
from 1st Sprint to the 3rd
Sprint
§ Recording the
assignment of the Story
to a Feature, but has no
impact on the Work
Package containing the
Feature
§ Assigning the Story to
the new Feature is done
in the Agile management
tool
59PSM Users’ Group 2017, Crystal City, VA
❷ Stories Planned for 3 Sprint Feature Are Move
to 4th Sprint
Scenario PMB Action Agile Action
§ Feature planned to be
completed in 3 Sprints
has started
§ Some Stories will not
complete as planned in
3rd Sprint.
§ Those Stories moved to a
4th Sprint beyond the
planned Finish of the 3
Sprints.
§ No change to the Work
Package containing the
Feature or the PV of that
Work Package
§ Stories can be moved
from Sprint to Sprint
within Work Package
containing the Features.
§ PV for the Work Package
is flat spread, so moving
work has no impact on
PV.
§ EV claimed only when
Stories complete, so this
claim has no knowledge
of specific Stories
§ Backlog is updated to
move the Stories not
completed in the 1st
Sprint is moved to the
3rd Sprint
60PSM Users’ Group 2017, Crystal City, VA
❸ Planned Feature will not Complete by Formal
Delivery Date
Scenario PMB Action Agile Action
§ Feature has started but
will not complete by
planned delivery date.
§ Customer has stated the
Feature is needed by the
planned delivery date.
§ No change to Feature
Work Package in
Baseline schedule
§ Feature is forecast to slip
beyond the delivery date
‒ at the end of the last
Sprint.
§ The IMS shows the late
date (forecast update).
§ The Critical Path for the
Feature sequence is
impacted with reduced
float (if there was any)
§ Float, EAC are updated
in the IMS.
§ Unfinished Stories are
moved to a Sprint in the
next release cycle
§ In that cycle, they are
forecast to completed.
§ Move the Story Points or
Ideal Days with the Story
to the release cycle.
61PSM Users’ Group 2017, Crystal City, VA
❹ Determined a Story is not Necessary for
Feature to be Completed
Scenario PMB Action Agile Action
§ Story in a Feature has been
determined to be
unnecessary.
§ The Feature Work Package is
open.
§ QBD’s for the Feature include
the unneeded Story.
§ No change to Work Package
containing the Feature
§ No change to the PMB
§ QBD for the Feature updated
to remove the Story.
§ Adjust Physical Percent
Complete for the Feature and
the Work Package for the
work no longer being
performed ‒ the unfinished
work is decreased, raising
the Physical Percent
Complete.
§ Adjust the EAC and Forecast
in the IMS.
§ Remove the Story from the
Backlog.
§ Remove the Story Points or
Ideal Days from the Backlog
62PSM Users’ Group 2017, Crystal City, VA
❺ Determined a User Story Needs to be Added
to a Feature
Scenario PMB Action Agile Action
§ Work Package for the
Feature is open.
§ New Story needed for a
Feature produced by in
open Work Package that
came from an increased
understanding of the
Feature.
§ Exit Criteria (QBD) of the
Feature is unchanged
with this new Story.
§ No change to Work
Package containing the
Feature.
§ The QBD for the Feature
is updated with the
addition of the Story
§ The Story is added to the
Sprint Backlog
63PSM Users’ Group 2017, Crystal City, VA
❻ After Feature and Stories Accepted, Problem
Found
Scenario PMB Action Agile Action
§ Feature and Stories
accepted and 100% of the
Value recorded.
§ Problem with delivered
Feature is found.
§ Defect must be corrected
before release of Feature
§ There is a Work Package
for Defect Reports in the
current Release, the DR is
added to the Exit Criteria
(QBD) for that Work
Package.
§ EV can be unclaimed in
current reporting period
for the Work Package when
the planned worked now
requires rework .
§ Or, cost and schedule is
used to deprecate EV with
additional ‒ unplanned –
work inside the Work
Package.Work Package
overruns due to unplanned
and unbudgeted work. [13]
§ The DR Story is added to
the Backlog and mapped to
a DR Work Package ‒ if
there is a separate Work
Package
§ The DR Story is added to
the Backlog and mapped to
a Feature Work Package, if
there is no DR Work
Package
64PSM Users’ Group 2017, Crystal City, VA
❼ Feature Assigned to Release Reprioritized to
Future Release
Scenario PMB Action Agile Action
§ Features assigned to one
future Release are
reprioritized to another
future Release.
§ Budget for the future
Feature Release is held in
a Planning Package.
§ Budget moved with
reprioritized Feature and
its move to a future
Release.
§ No change in BAC or
schedule, because work
is not detail planned.
§ Backlog updated.
§ Feature mapped to new
Release.
§ Road Map updated with
new Feature.
65PSM Users’ Group 2017, Crystal City, VA
+
Walk Through of
Two Scenarios for
the Notional UAS
n Defer a Feature (Autonomous Takeoff)
from Release 1 to Release 2
n Replace the 1 Feature with a new
Feature (Pilot Controlled Takeoff in
place of Autonomous) to Release 1
66PSM Users’ Group 2017, Crystal City, VA
5 Baseline Change Scenarios
❶ Feature in PMB not
opened and moved to
new work package.
❷ Open feature incomplete
at end of planned Sprint.
❸ Feature in current release moved to another
release.
❹ Planned initiative and resulting feature removed
from baseline.
❺ Feature completion criteria updated with additional
functionality.
67PSM Users’ Group 2017, Crystal City, VA
+
Student Scenarios
for the Notional UAS
n Defer a Feature (Autonomous Takeoff)
from Release 1 to Release 2
n Replace the 1 Feature with a new
Feature (Pilot Controlled Takeoff in
place of Autonomous) to Release 1
68PSM Users’ Group 2017, Crystal City, VA
7 Forecast Update and Change
Scenarios – Student Exercise
❶ Stories planned for a 3 sprint
feature will not complete as
planned.
❷ Stories planned for 3 sprint
feature are move to 4th sprint.
❸ Planned feature will not complete by formal delivery
date.
❹ Story determined not to be necessary for feature.
❺ Determined a user story needs to be added to a Feature.
❻ After feature and stories accepted, problem found.
❼ Feature assigned to release reprioritized to future release.
69PSM Users’ Group 2017, Crystal City, VA
70
Questions?
Comments?
Ideas?
Concerns?

Contenu connexe

Tendances

Calculating Physical Percent Complete on Agile Projects
Calculating Physical Percent Complete on Agile ProjectsCalculating Physical Percent Complete on Agile Projects
Calculating Physical Percent Complete on Agile ProjectsGlen Alleman
 
Scrum lifecycle for Enterprise IT
Scrum lifecycle for Enterprise ITScrum lifecycle for Enterprise IT
Scrum lifecycle for Enterprise ITGlen Alleman
 
Integrated Master Plan Development
Integrated Master Plan DevelopmentIntegrated Master Plan Development
Integrated Master Plan DevelopmentGlen Alleman
 
Deliverables Based Planning
Deliverables Based PlanningDeliverables Based Planning
Deliverables Based PlanningGlen Alleman
 
Increasing the Probability of Project Success with Five Principles and Practices
Increasing the Probability of Project Success with Five Principles and PracticesIncreasing the Probability of Project Success with Five Principles and Practices
Increasing the Probability of Project Success with Five Principles and PracticesGlen Alleman
 
Earned value, XP and government contracts
Earned value, XP and government contractsEarned value, XP and government contracts
Earned value, XP and government contractsGlen Alleman
 
SOLVING PROJECT ALLOCATION RESOURCE PROBLEMS WITH AEROSPACE ERP
SOLVING PROJECT ALLOCATION RESOURCE PROBLEMS WITH AEROSPACE ERPSOLVING PROJECT ALLOCATION RESOURCE PROBLEMS WITH AEROSPACE ERP
SOLVING PROJECT ALLOCATION RESOURCE PROBLEMS WITH AEROSPACE ERPKevin West
 
The 5 Immutable principles of project management
The 5 Immutable principles of project managementThe 5 Immutable principles of project management
The 5 Immutable principles of project managementGlen Alleman
 
5 Immutable Principles of Capital Project SUccess
5 Immutable Principles of Capital Project SUccess5 Immutable Principles of Capital Project SUccess
5 Immutable Principles of Capital Project SUccessGlen Alleman
 
The integrated master plan and integrated master schedule
The integrated master plan and integrated master scheduleThe integrated master plan and integrated master schedule
The integrated master plan and integrated master scheduleGlen Alleman
 
Agile Business Rhythm
Agile Business RhythmAgile Business Rhythm
Agile Business RhythmGlen Alleman
 
Agile project management is systems management
Agile project management is systems managementAgile project management is systems management
Agile project management is systems managementGlen Alleman
 
Credible Plans, Integrated Reporting, and Control Systems
Credible Plans, Integrated Reporting, and Control SystemsCredible Plans, Integrated Reporting, and Control Systems
Credible Plans, Integrated Reporting, and Control SystemsGlen Alleman
 
Improving Project Performance in the DOE
Improving Project Performance in the DOEImproving Project Performance in the DOE
Improving Project Performance in the DOEGlen Alleman
 
Integrated Agile Software Development with Earned Value Management
Integrated Agile Software Development with Earned Value ManagementIntegrated Agile Software Development with Earned Value Management
Integrated Agile Software Development with Earned Value ManagementGlen Alleman
 
Integrated Master Plan Development
Integrated Master Plan DevelopmentIntegrated Master Plan Development
Integrated Master Plan DevelopmentGlen Alleman
 
Measurement News Webinar
Measurement News WebinarMeasurement News Webinar
Measurement News WebinarGlen Alleman
 
Agile+EVM bibliography (v2)
Agile+EVM bibliography (v2)Agile+EVM bibliography (v2)
Agile+EVM bibliography (v2)Glen Alleman
 
Building work packages from requirements (from mm)(larger version)
Building work packages from requirements (from mm)(larger version)Building work packages from requirements (from mm)(larger version)
Building work packages from requirements (from mm)(larger version)Glen Alleman
 

Tendances (20)

Calculating Physical Percent Complete on Agile Projects
Calculating Physical Percent Complete on Agile ProjectsCalculating Physical Percent Complete on Agile Projects
Calculating Physical Percent Complete on Agile Projects
 
Scrum lifecycle for Enterprise IT
Scrum lifecycle for Enterprise ITScrum lifecycle for Enterprise IT
Scrum lifecycle for Enterprise IT
 
Integrated Master Plan Development
Integrated Master Plan DevelopmentIntegrated Master Plan Development
Integrated Master Plan Development
 
Deliverables Based Planning
Deliverables Based PlanningDeliverables Based Planning
Deliverables Based Planning
 
Increasing the Probability of Project Success with Five Principles and Practices
Increasing the Probability of Project Success with Five Principles and PracticesIncreasing the Probability of Project Success with Five Principles and Practices
Increasing the Probability of Project Success with Five Principles and Practices
 
Earned value, XP and government contracts
Earned value, XP and government contractsEarned value, XP and government contracts
Earned value, XP and government contracts
 
SOLVING PROJECT ALLOCATION RESOURCE PROBLEMS WITH AEROSPACE ERP
SOLVING PROJECT ALLOCATION RESOURCE PROBLEMS WITH AEROSPACE ERPSOLVING PROJECT ALLOCATION RESOURCE PROBLEMS WITH AEROSPACE ERP
SOLVING PROJECT ALLOCATION RESOURCE PROBLEMS WITH AEROSPACE ERP
 
The 5 Immutable principles of project management
The 5 Immutable principles of project managementThe 5 Immutable principles of project management
The 5 Immutable principles of project management
 
5 Immutable Principles of Capital Project SUccess
5 Immutable Principles of Capital Project SUccess5 Immutable Principles of Capital Project SUccess
5 Immutable Principles of Capital Project SUccess
 
The integrated master plan and integrated master schedule
The integrated master plan and integrated master scheduleThe integrated master plan and integrated master schedule
The integrated master plan and integrated master schedule
 
Agile Business Rhythm
Agile Business RhythmAgile Business Rhythm
Agile Business Rhythm
 
Agile project management is systems management
Agile project management is systems managementAgile project management is systems management
Agile project management is systems management
 
Credible Plans, Integrated Reporting, and Control Systems
Credible Plans, Integrated Reporting, and Control SystemsCredible Plans, Integrated Reporting, and Control Systems
Credible Plans, Integrated Reporting, and Control Systems
 
Improving Project Performance in the DOE
Improving Project Performance in the DOEImproving Project Performance in the DOE
Improving Project Performance in the DOE
 
Integrated Agile Software Development with Earned Value Management
Integrated Agile Software Development with Earned Value ManagementIntegrated Agile Software Development with Earned Value Management
Integrated Agile Software Development with Earned Value Management
 
Integrated Master Plan Development
Integrated Master Plan DevelopmentIntegrated Master Plan Development
Integrated Master Plan Development
 
Measurement News Webinar
Measurement News WebinarMeasurement News Webinar
Measurement News Webinar
 
Ev+agile=success
Ev+agile=successEv+agile=success
Ev+agile=success
 
Agile+EVM bibliography (v2)
Agile+EVM bibliography (v2)Agile+EVM bibliography (v2)
Agile+EVM bibliography (v2)
 
Building work packages from requirements (from mm)(larger version)
Building work packages from requirements (from mm)(larger version)Building work packages from requirements (from mm)(larger version)
Building work packages from requirements (from mm)(larger version)
 

Similaire à Estimating and Reporting Agile Projects

How should we estimates agile projects (CAST)
How should we estimates agile projects (CAST)How should we estimates agile projects (CAST)
How should we estimates agile projects (CAST)Glen Alleman
 
Practical agile analytics: Measure predictability and quantify risk with cycl...
Practical agile analytics: Measure predictability and quantify risk with cycl...Practical agile analytics: Measure predictability and quantify risk with cycl...
Practical agile analytics: Measure predictability and quantify risk with cycl...Steven J. Peters, PhD
 
Resume-Anupam Phanse
Resume-Anupam PhanseResume-Anupam Phanse
Resume-Anupam PhanseAnupam Phanse
 
Agile in an ANSI-748-C environment
Agile in an ANSI-748-C environmentAgile in an ANSI-748-C environment
Agile in an ANSI-748-C environmentGlen Alleman
 
Harish software engineer (rpa) 4+ yrs exp
Harish software engineer (rpa) 4+ yrs expHarish software engineer (rpa) 4+ yrs exp
Harish software engineer (rpa) 4+ yrs expHarish M
 
Chp 9.0 pb&e agile+evm (v10.3)
Chp 9.0   pb&e agile+evm (v10.3)Chp 9.0   pb&e agile+evm (v10.3)
Chp 9.0 pb&e agile+evm (v10.3)Glen Alleman
 
Process Flow and Narrative for Agile+PPM
Process Flow and Narrative for Agile+PPMProcess Flow and Narrative for Agile+PPM
Process Flow and Narrative for Agile+PPMGlen Alleman
 
RajivRanjan_Resume
RajivRanjan_ResumeRajivRanjan_Resume
RajivRanjan_ResumeRajiv Ranjan
 
Resume SAGAR DHAKATE
Resume  SAGAR DHAKATEResume  SAGAR DHAKATE
Resume SAGAR DHAKATESagarDhakate1
 
GOKULAN SANKARANARAYANAN Resume_ August 2015
GOKULAN SANKARANARAYANAN Resume_ August 2015GOKULAN SANKARANARAYANAN Resume_ August 2015
GOKULAN SANKARANARAYANAN Resume_ August 2015Gokulan Sankaranarayanan
 
The Intersection of Earned Value Management and Agile Software Development
The Intersection of Earned Value Management and Agile Software DevelopmentThe Intersection of Earned Value Management and Agile Software Development
The Intersection of Earned Value Management and Agile Software DevelopmentGlen Alleman
 
Agile in the government
Agile in the government Agile in the government
Agile in the government Glen Alleman
 
Shantanu Singh - Resume
Shantanu Singh - ResumeShantanu Singh - Resume
Shantanu Singh - ResumeShantanu Singh
 

Similaire à Estimating and Reporting Agile Projects (20)

How should we estimates agile projects (CAST)
How should we estimates agile projects (CAST)How should we estimates agile projects (CAST)
How should we estimates agile projects (CAST)
 
Practical agile analytics: Measure predictability and quantify risk with cycl...
Practical agile analytics: Measure predictability and quantify risk with cycl...Practical agile analytics: Measure predictability and quantify risk with cycl...
Practical agile analytics: Measure predictability and quantify risk with cycl...
 
Kajari_Resume
Kajari_ResumeKajari_Resume
Kajari_Resume
 
Resume-Anupam Phanse
Resume-Anupam PhanseResume-Anupam Phanse
Resume-Anupam Phanse
 
Agile in an ANSI-748-C environment
Agile in an ANSI-748-C environmentAgile in an ANSI-748-C environment
Agile in an ANSI-748-C environment
 
Harish software engineer (rpa) 4+ yrs exp
Harish software engineer (rpa) 4+ yrs expHarish software engineer (rpa) 4+ yrs exp
Harish software engineer (rpa) 4+ yrs exp
 
Chp 9.0 pb&e agile+evm (v10.3)
Chp 9.0   pb&e agile+evm (v10.3)Chp 9.0   pb&e agile+evm (v10.3)
Chp 9.0 pb&e agile+evm (v10.3)
 
Resume_GuptaKPK
Resume_GuptaKPKResume_GuptaKPK
Resume_GuptaKPK
 
Avinash_ Resume_
Avinash_ Resume_Avinash_ Resume_
Avinash_ Resume_
 
Process Flow and Narrative for Agile+PPM
Process Flow and Narrative for Agile+PPMProcess Flow and Narrative for Agile+PPM
Process Flow and Narrative for Agile+PPM
 
fakhar abbas cv abc
fakhar abbas cv abcfakhar abbas cv abc
fakhar abbas cv abc
 
RajivRanjan_Resume
RajivRanjan_ResumeRajivRanjan_Resume
RajivRanjan_Resume
 
Vikas Resume
Vikas ResumeVikas Resume
Vikas Resume
 
Profile Seema Wadhwa
Profile Seema WadhwaProfile Seema Wadhwa
Profile Seema Wadhwa
 
Resume SAGAR DHAKATE
Resume  SAGAR DHAKATEResume  SAGAR DHAKATE
Resume SAGAR DHAKATE
 
GOKULAN SANKARANARAYANAN Resume_ August 2015
GOKULAN SANKARANARAYANAN Resume_ August 2015GOKULAN SANKARANARAYANAN Resume_ August 2015
GOKULAN SANKARANARAYANAN Resume_ August 2015
 
Resume - Anil Kumar Krishna
Resume - Anil Kumar KrishnaResume - Anil Kumar Krishna
Resume - Anil Kumar Krishna
 
The Intersection of Earned Value Management and Agile Software Development
The Intersection of Earned Value Management and Agile Software DevelopmentThe Intersection of Earned Value Management and Agile Software Development
The Intersection of Earned Value Management and Agile Software Development
 
Agile in the government
Agile in the government Agile in the government
Agile in the government
 
Shantanu Singh - Resume
Shantanu Singh - ResumeShantanu Singh - Resume
Shantanu Singh - Resume
 

Plus de Glen Alleman

Managing risk with deliverables planning
Managing risk with deliverables planningManaging risk with deliverables planning
Managing risk with deliverables planningGlen Alleman
 
A Gentle Introduction to the IMP/IMS
A Gentle Introduction to the IMP/IMSA Gentle Introduction to the IMP/IMS
A Gentle Introduction to the IMP/IMSGlen Alleman
 
Increasing the Probability of Project Success
Increasing the Probability of Project SuccessIncreasing the Probability of Project Success
Increasing the Probability of Project SuccessGlen Alleman
 
Practices of risk management
Practices of risk managementPractices of risk management
Practices of risk managementGlen Alleman
 
Principles of Risk Management
Principles of Risk ManagementPrinciples of Risk Management
Principles of Risk ManagementGlen Alleman
 
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...Glen Alleman
 
From Principles to Strategies for Systems Engineering
From Principles to Strategies for Systems EngineeringFrom Principles to Strategies for Systems Engineering
From Principles to Strategies for Systems EngineeringGlen Alleman
 
NAVAIR Integrated Master Schedule Guide guide
NAVAIR Integrated Master Schedule Guide guideNAVAIR Integrated Master Schedule Guide guide
NAVAIR Integrated Master Schedule Guide guideGlen Alleman
 
Building a Credible Performance Measurement Baseline
Building a Credible Performance Measurement BaselineBuilding a Credible Performance Measurement Baseline
Building a Credible Performance Measurement BaselineGlen Alleman
 
Integrated master plan methodology (v2)
Integrated master plan methodology (v2)Integrated master plan methodology (v2)
Integrated master plan methodology (v2)Glen Alleman
 
IMP / IMS Step by Step
IMP / IMS Step by StepIMP / IMS Step by Step
IMP / IMS Step by StepGlen Alleman
 
DHS - Using functions points to estimate agile development programs (v2)
DHS - Using functions points to estimate agile development programs (v2)DHS - Using functions points to estimate agile development programs (v2)
DHS - Using functions points to estimate agile development programs (v2)Glen Alleman
 
Making the impossible possible
Making the impossible possibleMaking the impossible possible
Making the impossible possibleGlen Alleman
 
Heliotropic Abundance
Heliotropic AbundanceHeliotropic Abundance
Heliotropic AbundanceGlen Alleman
 
Capabilities based planning
Capabilities based planningCapabilities based planning
Capabilities based planningGlen Alleman
 
Process Flow and Narrative for Agile
Process Flow and Narrative for AgileProcess Flow and Narrative for Agile
Process Flow and Narrative for AgileGlen Alleman
 
Building the Performance Measurement Baseline
Building the Performance Measurement BaselineBuilding the Performance Measurement Baseline
Building the Performance Measurement BaselineGlen Alleman
 
Program Management Office Lean Software Development and Six Sigma
Program Management Office Lean Software Development and Six SigmaProgram Management Office Lean Software Development and Six Sigma
Program Management Office Lean Software Development and Six SigmaGlen Alleman
 
Policy and Procedure Rollout
Policy and Procedure RolloutPolicy and Procedure Rollout
Policy and Procedure RolloutGlen Alleman
 
Project Management Theory
Project Management TheoryProject Management Theory
Project Management TheoryGlen Alleman
 

Plus de Glen Alleman (20)

Managing risk with deliverables planning
Managing risk with deliverables planningManaging risk with deliverables planning
Managing risk with deliverables planning
 
A Gentle Introduction to the IMP/IMS
A Gentle Introduction to the IMP/IMSA Gentle Introduction to the IMP/IMS
A Gentle Introduction to the IMP/IMS
 
Increasing the Probability of Project Success
Increasing the Probability of Project SuccessIncreasing the Probability of Project Success
Increasing the Probability of Project Success
 
Practices of risk management
Practices of risk managementPractices of risk management
Practices of risk management
 
Principles of Risk Management
Principles of Risk ManagementPrinciples of Risk Management
Principles of Risk Management
 
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...
Deliverables Based Planning, PMBOK® and 5 Immutable Principles of Project Suc...
 
From Principles to Strategies for Systems Engineering
From Principles to Strategies for Systems EngineeringFrom Principles to Strategies for Systems Engineering
From Principles to Strategies for Systems Engineering
 
NAVAIR Integrated Master Schedule Guide guide
NAVAIR Integrated Master Schedule Guide guideNAVAIR Integrated Master Schedule Guide guide
NAVAIR Integrated Master Schedule Guide guide
 
Building a Credible Performance Measurement Baseline
Building a Credible Performance Measurement BaselineBuilding a Credible Performance Measurement Baseline
Building a Credible Performance Measurement Baseline
 
Integrated master plan methodology (v2)
Integrated master plan methodology (v2)Integrated master plan methodology (v2)
Integrated master plan methodology (v2)
 
IMP / IMS Step by Step
IMP / IMS Step by StepIMP / IMS Step by Step
IMP / IMS Step by Step
 
DHS - Using functions points to estimate agile development programs (v2)
DHS - Using functions points to estimate agile development programs (v2)DHS - Using functions points to estimate agile development programs (v2)
DHS - Using functions points to estimate agile development programs (v2)
 
Making the impossible possible
Making the impossible possibleMaking the impossible possible
Making the impossible possible
 
Heliotropic Abundance
Heliotropic AbundanceHeliotropic Abundance
Heliotropic Abundance
 
Capabilities based planning
Capabilities based planningCapabilities based planning
Capabilities based planning
 
Process Flow and Narrative for Agile
Process Flow and Narrative for AgileProcess Flow and Narrative for Agile
Process Flow and Narrative for Agile
 
Building the Performance Measurement Baseline
Building the Performance Measurement BaselineBuilding the Performance Measurement Baseline
Building the Performance Measurement Baseline
 
Program Management Office Lean Software Development and Six Sigma
Program Management Office Lean Software Development and Six SigmaProgram Management Office Lean Software Development and Six Sigma
Program Management Office Lean Software Development and Six Sigma
 
Policy and Procedure Rollout
Policy and Procedure RolloutPolicy and Procedure Rollout
Policy and Procedure Rollout
 
Project Management Theory
Project Management TheoryProject Management Theory
Project Management Theory
 

Dernier

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessPixlogix Infotech
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 

Dernier (20)

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 

Estimating and Reporting Agile Projects

  • 1. Estimating and Reporting Agile Projects using the SRDR and EarnedValue Management Glen B. Alleman Thomas J. Coonce PSM Users’ Group 2017 Measurement: Measurement in a Complex Environment 12‒16 June 2017, Crystal City,Virginia
  • 2. 2 Do Agile Is the set of Agile Practices § Scrum § eXtreme Programming § DSDM § Crystal § Prince2 Agile Be Agile Is an Agile Mindset § Emergent Requirements § Iterative development § Incremental deployment What Do We Mean When We Read the NDIA “An Industry Practice Guide for Agile on Earned Value Management Programs?” Doing Agile is NOT the Same as Being Agile
  • 3. PSM Users’ Group 2017, Crystal City, VA Why We’re Here? Told as an Agile User Story† n As a <type of user>, I want <some goal> so that <some reason> n As a Government Technical Software Manager I want to Properly Estimate the Features in the CONOPS so that I have a Credible Baseline n As a Government Technical Software Manager I want assure that Features in ConOps can be delivered within Cost and Schedule so that we’re delivering capability according to plan 3 Before Contract Award After Contract Award † User Stories Applied for Agile Software Development, Mike Cohn, Addison Wesley
  • 4. PSM Users’ Group 2017, Crystal City, VA Some Understanding Before We Start 4 n SRDR is applicable to all MDAPs greater than $25M. n For Earned Value Management to be applicable, the program is Large compared to the typical software development project, n $20M for self-assessment (SA). n $100M for DCMA Validation (VR). n For typical commercial Agile development effort, a small team of 5 to 7 developers ‒ at typical burden rates ‒ runs $600K to $800K (Burdened) a year for the team. n The typical commercial agile project is 30 to 125 times smaller then the entry points of an EVMS IAW 748-C. n So Agile + Earned Value Management starts at the Enterprise and At Scale environment. In this domain, process compliance is king.
  • 5. + Developing a Credible Plan Before Contract Award n Decomposing the ConOps into Capabilities and Features n Background on Agile Software Development (Scrum) n NDIA framework for integrating EVM with Agile n Start by estimating Capabilities n What’s the purpose of Estimates on Agile programs n Story Points are Not meaningful measures of Time, Cost, or Physical Percent Complete At this point in time, we have little to base estimates on other than past similar projects. 5PSM Users’ Group 2017, Crystal City, VA
  • 6. PSM Users’ Group 2017, Crystal City, VA Decompose of the ConOps into Capabilities and Features 6 ConOps Goal/Outcome # 1 Goal/Outcome # 2 Capability Feature Feature Feature Story Story Story Feature Feature Capability Source: David Bulkin, Lithespeed.com Capabilities Needed before Contract Award Features further refined after Contract Award Task TaskTask
  • 7. PSM Users’ Group 2017, Crystal City, VA Some Understanding of Agile Software Development (1) n Product Roadmap defines what Capabilities are need. n Release Plan states when Features are available to fulfill the Capabilities. n Product Backlog contains Features to be implemented in Sprints. n Stories define the outcomes for the Features. n Tasks define the work to produce the Story. 7
  • 8. PSM Users’ Group 2017, Crystal City, VA Some Understanding of Agile Software Development (2) n Physical Percent Complete defined by the 100% completion of a Story with it’s exit criteria. n BCWS is the flat spread of the Labor for the Sprint. n BCWP = BCWS × Physical Percent Complete. n Estimating in Agile answers the question Can we deliver the Features for the Budget? n Estimating in Traditional EVMS answers the question What is the Cost for the needed Features? 8
  • 9. 9 Framework for Integrating Agile and Earned Value Management Before and After Contract Award EVM Reporting from Work Package Performance EVM Performance • PV – from Basis of Estimate • AC – from time cards • EV – from Physical % Complete Release 1 Release n Feature 1,2,3 Feature 4, .. ,8 Feature 9, …,12 Release 2 PP’s WP PP in IMS CA Features and Stories in Sprints Time Now Performance Measurement Baseline Agile Software Development Lifecycle Feature n’s Milestones Data Items Releases Capabilities in a Release Agile Development Control Account Task Task Task Task Task Task Task Task Task … Physical Percent Complete, captured at Task and Story level is Rolled to IMS to Features in Work Packages to produce Earned Value metrics used for Estimate At Completion Release Plan Product Road Map for Needed Capabilities from Capabilities Based Plan
  • 10. PSM Users’ Group 2017, Crystal City, VA Our Notional Program starts with Capabilities Based Planning 10 Our needed Capabilities are provided through a Software Intensive System of Systems (SISoS). This program is a software program, we can buy the hardware out of a catalog.
  • 11. PSM Users’ Group 2017, Crystal City, VA Example of Capability Statements for a Surveillance Quadcopter 1. Be commanded to autonomously fly to an area of interest. 2. Loiter in the area of interest for 2 hours. 3. Discover what’s going on in an area of interest. 4. Redirect to new area of interest from Ground Station. 5. Transmit information to ground station in real-time. 6. Return home automatically or when commanded. 11 Capabilities Based Planning is about MOEs and MOPs NOT technical requirements first. JSA-TP-3-CBP These Capabilities will be Implemented by Features in an emergent, agile manner, not constrained by early requirements
  • 12. 12 The primary purpose of software Planning, Budgeting, and Estimating on Agile software programs is to determine whether a project’s targets are realistic enough to allow the project to be controlled to meet them. This is the inverse of the Estimating processes on traditional EVM programs, where the Baselined work is summarized to produce the BCWS. From the Government’s point of view, On Agile Programs, BCWS is flat spread across each Sprint that implements each Feature in each Work Package in each Control Account. On Agile Programs, we need to know if we have enough money and time to deliver the Capabilities without knowing the detailed Requirements. PSM Users’ Group 2017, Crystal City, VA
  • 13. PSM Users’ Group 2017, Crystal City, VA Top Level Agile Acquisition Process Prior to Contract Award, the Government develops a Credible Estimate based on a desired Product Roadmap for the needed Capabilities to Accomplish the Mission After Contract Award, the Government iterates with the Contractor on the Product Roadmap as the Features emerge that fulfill the needed Capabilities 13
  • 14. PSM Users’ Group 2017, Crystal City, VA Building the Governments’ Credible Plan Before Award n Using reference class data, n Build Government Product Roadmap, and n Build Government Release Plan showing what Capabilities are contained in each Release. n Build a cost profile for needed staff (FTE) for period of performance for the Features for each Release 14
  • 15. PSM Users’ Group 2017, Crystal City, VA How Do We Estimate the Capabilities Before we Know the Needed Features? n Start with a Notional plan of what Features are contained in Capabilities from past work. n Use actual hours for these Features to develop a Reference Class (past SRDR). n We need a Feature Breakdown Structure just like the WBS in MIL-STD-881C n Use the Reference Class for model emerging Features. 15
  • 16. PSM Users’ Group 2017, Crystal City, VA Starting Point for Estimating Agile Projects n For a proposed future agile application for a given operating environment and application domain and stated features, the estimator should be able to query on a standardize feature list and obtain: n Actual staff hours to produce the feature n Actual duration to produce the feature n Extent of software reuse and sources n Extent of use of automated tools n Team experience n For each feature, estimator would array historical dependent effort and durations and other attributes and compare to targeted feature n For proposed new feature with given planned library and automated tool use, find nearest neighbor with similar reuse and tool use and extract effort and duration n If no knowledge of reuse and automated tool use, use the means 16
  • 17. PSM Users’ Group 2017, Crystal City, VA Executing the Program After Contract Award n Using reference class data, n Compare actual performance with planned performance, and n Identify corrective actions needed to keep the program on plan. 17
  • 18. Story Points are NOT Meaningful Measures of Time, Cost, or Physical Percent Complete https://www.mountaingoatsoftware.com/blog/its-effort-not-complexity In Agile, Story Point-based measures are about the Relative effort the work will take, not the Actual effort or duration. The customer needs to know how much and how long. 18PSM Users’ Group 2017, Crystal City, VA
  • 19. PSM Users’ Group 2017, Crystal City, VA Let’s Pause to Address the Cardinal and Ordinal Estimating Problem 19 § When we use a measure of something we need to know if it is Cardinal or Ordinal. § Ordinal measures tell us the relative difference between items. § Uncle Scrooge is relatively rich compared to Huey, Dewey, and Louie is an Ordinal measure. § Cardinal measures are numbers that say how many of something there are, they are counting numbers ‒ one, two, three, four, five. § Uncle Scrooge has $1,250,000,000 dollars of Gold § In Project Performance Management we use Cardinal numbers, measured in Dollars, Hours, Technical Performance compliance. § Story Points are NOT a unit of measure used in Project Performance Management in the DI-MGMT-81861 IPMR
  • 20. PSM Users’ Group 2017, Crystal City, VA A Caution for Using Story Points to Measures Anything Beyond a Single Feature on a Single Team Ordinal numbers ONLY have meaning for their current use ‒ unless calibrated to a reference that does not change over time Without Calibrated values, the numbers have no meaning when collected at higher levels of the program ‒ WP’s and Control Account. 20
  • 21. PSM Users’ Group 2017, Crystal City, VA Ordinal Story Points Cannot Be The Basis of Higher Than A Single Feature Feature 1 Story 1 Story 2 Story 3 Story 4 Story 5 Story 6 Team 1’s Uncalibrated Ordinal SP estimates Feature n Team 2’s Uncalibrated Ordinal SP estimates ∑ F1(SP) ∑ Fn(SP) Release 1 ∑ of SP’s • • • § At the Story level, relative effort defines individual estimates. § At the Feature level, lower level SP’s don’t have the same unit of measure in the way Dollars do. § When Features summed to the Release, relative measures do not provide basis of Physical Percent Complete. These are Not the same units of measure between Features – Uncalibrated SP’s Story 1 Story 2 Story 3 Story 4 Story 5 Story 6• • • Using Ordinal (uncalibrated values) outside the domain of agreement prevents comparison of higher levels on the program. My Story Points aren’t Your Story Points. 21
  • 22. PSM Users’ Group 2017, Crystal City, VA Stories and Story Points are NOT Measures of Cost, Schedule, or Performance § Story Points are Ordinal numbers ‒ relative measures of effort or complexity defined by the Scrum Team members for a specific Sprint, Feature, and perhaps a Release. § Story Points are not scope, they are calibrated to Time and Money outside an individual Scrum Team. § Counting Story Points is like counting Tasks in the IMS § We have 40 tasks to do for this delivery which is 9 weeks long (3, 3 week Sprints). § We’ve done 20 Tasks so far. § Are we 50% complete for the planned task work? § Not likely unless each Task is of the same effort and duration. … Beyond a single Scrum Team, with calibrated Story Points for their own usage and need … Let’s keep reminding ourselves Story Points are Ordinal measures. Useful for relative sizing but not sizing in units of dollars and hours. 22
  • 23. PSM Users’ Group 2017, Crystal City, VA In this afternoon’s workshop we’re going to lead participants to … n Develop the Performance Measurement Baseline for the the needed Capabilities n Develop the Features that fulfill those Capabilities. n Product Roadmap n Release Plan n Measure progress to plan using EVM data n Physical Percent Complete at the Feature level in the Product Roadmap n Develop scenarios for statusing and forecasting the program 23
  • 24. 24PSM Users’ Group 2017, Crystal City, VA
  • 25. PSM Users’ Group 2017, Crystal City, VA Workshop Agenda n Present the Features of a notional UAS with a Release Planning following a Product Roadmap n Explain the principles of measuring Physical Percent Complete at the Feature level used to inform EIA- 748-C Earned Value (BCWP) n Demonstrate this on the notional program, with two scenarios, one from Change, one from Forecast update n Lead the students to evaluate progress and EAC using two scenarios 25
  • 26. + After Contract Award n Agile estimating starts with Capabilities Based Planning n The Capabilities of the Quadcopter and the Features for each Release in the Product Roadmap n A quick overview of Scrum n 10 Step Integration of Agile on EVM Programs n 5 Baseline Change Scenarios n 7 Forecasting Scenarios The contract for the quadcopter has been award. Now the government needs assurance that progress to plan be being made in units of measure meaningful to the decision makers 26PSM Users’ Group 2017, Crystal City, VA
  • 27. PSM Users’ Group 2017, Crystal City, VA Example Capability Statements for Surveillance using Quadcopter 1. Be commanded to autonomously fly to an area of interest. 2. Loiter in the area of interest for 2 hours. 3. Discover what’s going on in an area of interest. 4. Redirect to new area of interest from Ground Station. 5. Transmit information to ground station in real-time. 6. Return home automatically or when commanded. 27 Capabilities Based Planning is about MOEs and MOPs NOT technical requirements first. JSA-TP-3-CBP These Capabilities will be Implemented by Features in an emergent, agile manner, not constrained by early requirements
  • 28. PSM Users’ Group 2017, Crystal City, VA Our Program starts with Capabilities Based Planning 28 Our needed Capabilities are provided by a Software Intensive System of Systems (SISoS). This program is a software program, we can buy the hardware out of a catalog
  • 29. PSM Users’ Group 2017, Crystal City, VA Product Roadmap for the Quadcopter 29 Release 1 Release 3Release 2 § Autonomously takeoff § Accept mission coordinates § Fly to mission coordinates (are of interest) § Loiter over area of interest § Pilot controlled return to home § Collect basic surveillance data over area of interest § Transmit data to ground station § Accept ground station redirection to new area of interest § Collect advanced surveillance data § Autonomously return home on command Features Features Features
  • 30. PSM Users’ Group 2017, Crystal City, VA Product Roadmap for the Quadcopter 30 Release 1 Release 3Release 2 § Autonomously takeoff § Accept mission coordinates § Fly to mission coordinates (are of interest) § Loiter over area of interest § Pilot controlled return to home § Collect surveillance data over area of interest § Transmit data to ground station § Accept ground station redirection to new area of interest § Collect advanced surveillance data § Autonomously return home on command Features Features Features
  • 31. PSM Users’ Group 2017, Crystal City, VA Loiter Over Area of Interest n Discover topology of the terrain at the area of interest to avoid collision with terrain n Discover the flying conditions at the area of interest to assess stability of platform n Define the loiter pattern given the terrain at the area of interest (race track pattern– figure 8’s) to confirm loiter time possible n Determine altitude for best surveillance to match needed resolution n Determine in real-time, the remaining loiter time with fuel return to ground station, to assure mission can be accomplished. 31 As a <type of user>, I want <some goal> so that <some reason>
  • 32. +Product Roadmap for the Quadcopter 32 Release 1 Release 3Release 2 § Autonomously takeoff § Accept mission coordinates § Fly to mission coordinates (are of interest) § Loiter over area of interest § Pilot controlled return to home § Collect surveillance data over area of interest § Transmit data to ground station § Accept ground station redirection to new area of interest § Collect advanced surveillance data § Autonomously return home on command Features Features Features PSM Users’ Group 2017, Crystal City, VA
  • 33. PSM Users’ Group 2017, Crystal City, VA Collect surveillance data over area of interest n Collect and store EO/IR, to look for humans walking on the ground for threat assessment. n Collect and store SAR data for stationary or moving equipment on the ground for terrain assessment. n Collect and store SIGINT and ELINT data to classify radiation sources (radar and target tracking) to identify potential targets for Electronic Warfare attack (jamming) for building Electronic Order of Battle (EOB). 33 As a <type of user>, I want <some goal> so that <some reason>
  • 34. +Product Roadmap for the Quadcopter 34 Release 1 Release 3Release 2 § Autonomously takeoff § Accept mission coordinates § Fly to mission coordinates (are of interest) § Loiter over area of interest § Pilot controlled return to home § Collect surveillance data over area of interest § Transmit data to ground station § Accept ground station redirection to new area of interest § Collect advanced surveillance data § Autonomously return home on command Features Features Features PSM Users’ Group 2017, Crystal City, VA
  • 35. PSM Users’ Group 2017, Crystal City, VA Collect Advanced Surveillance Data n Collect Full Motion Video (FMV) Data to identify moving targets and their paths. n Compress and store FMV data to wait for best transmission opportunities. n Transmit FMV data when maximum bandwidth is available. 35 As a <type of user>, I want <some goal> so that <some reason>
  • 36. PSM Users’ Group 2017, Crystal City, VA Quick Overview of Scrum Software Development n Product Roadmap defines what Capabilities are need n Release Plan states when Features are available to fulfill the Capabilities n Product Backlog contains Features to be implemented in Sprints n Stories define the outcomes for the Features n Tasks define the work to produce the Story n Physical Percent Complete defined by the 100% completion of a Story with it’s exit criteria n BCWS is the flat spread of the Labor for the Sprint n BCWP = BCWS × Physical Percent Complete 36
  • 37. PSM Users’ Group 2017, Crystal City, VA Critical Success Factors for Agile and EVMS n Every Story, that implements at Feature must have testable exist criteria … n This means we MUST know what DONE looks before starting the work. n This knowledge MUST be in units of measure meaningful to the decision makers. n Measures of Effectiveness ‒ Operational measures of success that are closely related to the achievements of the mission or operational objectives evaluated in the operational environment, under a specific set of conditions. n Measures of Performance ‒ characterize physical or functional attributes relating to the system operation, measured or estimated under specific conditions. 37
  • 38. PSM Users’ Group 2017, Crystal City, VA 10 Steps to Integration of Agile on Earned Value Management Programs 38 Closed Loop Feedback Control for Agile at Scale ❶ Engineering Estimate ❷ Product Roadmap ❸ Release Plan ❺ Backlog ❻ Sprint Backlog Plan ❹ IMS with Features in WP ❼ Task Estimates During Sprint ❽ TO DO Updates Produce Physical Percent Complete ❿ Update Physical Percent Complete in EVMS ❾ Update Feature in IMS with Physical Percent Complete Plan Do Check Act Continuous feedback at each step with corrective actions for Root Cause of Performance Variances
  • 39. 39 ➊ Engineering Estimate of requested Features to deliver needed business Capabilities for needed budget and time ➋ Roadmap of those Features laid out in needed order ➌ Release Plan for those Features ➍ IMS with Features in Work Packages with PV for FTE and ODC ➎ Features in the Backlog in Agile Development System ➏ Sprint Plan for Features and Stories ➐ Task Estimates of Stories and Tasks During Sprint ➑ TO DO Updates During Daily Standup ➒ Features in IMS statused with Physical Percent Complete from Rally ➓ Status from IMS sent to Cobra® From Estimate to Backlog From Sprint to Status 10 Step Integration of Agile with Earned Value Management + PSM Users’ Group 2017, Crystal City, VA
  • 40. 40 1. Decompose needed Capabilities into Features 2. Estimate effort in hours to deliver the Feature 3. Determine uncertainties around that estimate 1. Reducible uncertainty 2. Irreducible uncertainty 4. Model these uncertainties with Crystal Ball® to 80% confidence § Use Triangle distribution if actual distribution not known 5. Establish Change Control process for updates to this estimate as the project progresses 1. Assess past performance for similar Features used for estimates 2. Rank Feature with Ordinal measure if needed (Story Points) 3. Focus of Cardinal estimates in hours 4. Assure Features include all exit criteria and risks 5. Assure Features have minimal dependencies 6. Define sequence of deliverables, in preparation for Product Roadmap Earned Value Agile Engineering Estimate ❶ + PSM Users’ Group 2017, Crystal City, VA
  • 41. 41 1. In the WBS Dictionary, define Capabilities of each Feature (DoD = definition of done) with measures of: § Effectiveness § Performance § Technical § Key Performance Parameters 2. Assign PV in Hours for FTE to each period of performance to the Features in the assigned Work Package 1. Build Roadmap from ROM and Engineering Estimate for sequence of Features accepted by customer 2. Put the Features in the proper order in the Roadmap in Rally 3. Publish Roadmap for the Scrum Team in hardcopy Earned Value Agile Product Roadmap ❷ + PSM Users’ Group 2017, Crystal City, VA
  • 42. 42 1. In the IMS, layout and sequence Features in Work Packages for the number of Sprints to produce each Feature 2. Establish Change Control for modifying the Release Plan in the IMS as the project progresses 1. Assign Features to Releases 2. Code this information in Rally 3. Update Roadmap with Release Information for each Feature from the final accepted ROM Earned Value Agile Release Plan ❸ + PSM Users’ Group 2017, Crystal City, VA
  • 43. 43 1. Obtain hours, core and non- core, and LCAT by Feature from the ROM 2. Validate PV against the Release Plan 3. Baseline Work Packages with PV and period of performance for each Feature 1. Feature Period of Performance shown in with Release Plan 2. Original Estimates from ROM recorded in Backlog traceable to IMS Earned Value Agile IMS with Features in Work Packages + ❹ PSM Users’ Group 2017, Crystal City, VA
  • 44. 44 1. The Features in the Backlog are traceable to the Engineering Estimate and to the Planned Value in the PMB 2. Use the Backlog as source material for Roadmap, along with the PV for each Feature § Story Points can be assigned in the PBL for prioritization purposes 1. Backlog built from Roadmap using Features from Engineering Estimate and any further decomposition into Stories 2. Effort estimate in Hours, can be augmented with Story Points to improve confidence in proper estimate Earned Value Agile Product Backlog ❺ + PSM Users’ Group 2017, Crystal City, VA
  • 45. 45 1. Confirm PV above the line is in lock step with the work planned below the line. 2. Confirm FTE spread for Period of Performance for Work Packages in the IMS 1. Capacity for work is primary Sprint Planning process 2. Confirm needed skill set to complete the work and remove blocking factors within Sprint Earned Value Agile Sprint Backlog ❻ + PSM Users’ Group 2017, Crystal City, VA
  • 46. 46 1. Confirm TASK EST is still proper value for the Feature being executed in the Sprint § If not, update the Forecast in IMS and Cobra 2. The role of the Planner is to update the Forecast in the IMS and Cobra to reflect Sprint and Feature planning and execution § This foot and ties the Forecast with the Physical Percent Complete § They are complements of each other 1. Decompose Features into Stories and Tasks 2. Estimate Tasks in TASK EST field in Rally § Once Sprint starts this field is frozen § Initially TO DO = TASK EST 3. When Sprint starts, update TO DO field as work progresses § TO DO goes down as work is completed § TO DO goes up as new more work is discovered 4. Update FEATURE FORECAST if § Current estimated work > TASK EST § Remaining work is expected to take longer than the initial estimate § Note: Forecast should only include in-scope changes Earned Value Agile Task Estimating for the Sprint ❼ + PSM Users’ Group 2017, Crystal City, VA
  • 47. 47 1. The updated TO DO from the Daily Standup is used to calculate Physical Percent Complete 2. This is used to calculate Percent Complete on a daily basis, as well as at month end: § Current performance is available daily § This reporting path assures accurate month end status that relies on TO DO updates from the Daily Standup 1. TO DO should be updated at the Daily Standup 2. When the estimated effort changes to be different than baselined in the TASK EST field – TO DO is updated 3. TO DO value § Goes down as the work is completed § Goes up when new work (in scope) is discovered for the Task, Story, therefore for the Feature Earned Value Agile TO DO Updates of Sprint Work ❽ + PSM Users’ Group 2017, Crystal City, VA
  • 48. 48 1. No need to ask anyone what the status is, Rally has the status at the lowest level of the project ‒ live on a daily basis 2. Feature Physical Percent Complete values are imported to the IMS and used to status Features in Work Packages 3. Use the custom report to extract performance from Agile in the form of Physical Percent Complete 4. Feature Physical Percent Complete on the report is a rollup from Tasks to the Feature level 1. The Physical Percent Complete values are exported from Rally in a custom report 2. Feature Physical Percent Complete is calculated from the rollup of the TO DO field and the Feature Forecast Earned Value Agile Feature Physical Percent Complete in the IMS ❾ + (∑ TASK EST – ∑ TO DO) / Feature Forecast PSM Users’ Group 2017, Crystal City, VA
  • 49. PSM Users’ Group 2017, Crystal City, VA Earned Value Calculated by Physical Percent Complete n EIA-748-C, page 1, bullet 5 says … Objectively assess accomplishments at the work performance level – Tasks in the Sprint. n Story Points CAN be used for relative assessment in prioritizing work in the Product Backlog ‒ Ordinal numbers. n Hours used to define actual effort and duration during Story Time, Tasking, and Sprint Execution ‒ Cardinal numbers. n Mixing the Story Points with Hours is fine when prioritizing the work in the Product Backlog and Sprint Backlog. n Measuring progress to plan needs to be with Cardinal values meaningful to the decision makers. n The IPMR (DI-MGMT-81861) has NO units of measure in Stories or Story Points. n Measures of Physical Percent Complete MUST used Cardinal Values as well. Story Points are useful for prioritizing work, we don’t need them for calculating Physical Percent Complete. Because we have hour estimates on the contract. 49
  • 50. PSM Users’ Group 2017, Crystal City, VA Physical Percent Complete During Sprints 50 Original Engineering Estimate Estimate of User Stories in Sprint Remaining Work for Story 0 Remaining Means Story Done 10 of 10 Remaining Means Story Not Stated Sprint 1 ‒ 50% Complete After Sprint 1 Feature 18% Complete, with 58 Hrs remains Sprint 2 ‒ 9% Complete At this point in Sprint 2, Features 20% Complete
  • 51. 51 1. Update ETC in Cobra § Periodically update ETC by LCAT for Work Packages in Cobra § Verify that the resulting ETC hours still match the IMS and the Sprint work to do 2. Update EV in Cobra § Physical Percent Complete from Agile is also used in Cobra § Based on the Business Rhythm, update Physical Percent Complete for Work Packages in Cobra § Calculate EV 1. Confirm reported Physical Percent Complete in Cobra® foot and ties with Physical Percent Complete in Rally to acceptable degree of accuracy and precision § This is an eye ball assessment, the number may or may not be exactly the same, so close enough is a value judgement of the Planners and PM 2. As part of the EV analysis processes, provide performance assessment and suggested corrective actions Earned Value Agile Earned Value Updates of Work Packages in EVMS ❿ + PSM Users’ Group 2017, Crystal City, VA
  • 52. 5 Baseline Change Scenarios ❶ Feature in PMB not opened and moved to new work package. ❷ Open feature incomplete at end of planned Sprint. ❸ Feature in current release moved to another release. ❹ Planned initiative and resulting feature removed from baseline. ❺ Feature completion criteria updated with additional functionality. 52PSM Users’ Group 2017, Crystal City, VA
  • 53. ❶ Feature in PMB Not Opened and Moved to New Work Package Scenario PMB Action Agile Action § Feature in the PMB Work Package is not open and has not started . § The Feature is not needed in the current release. § Customer approves moving the Feature to another Release. § Replan the PMB’s work package budget (BCWS) to a Planning Package in a future Release. § If the baseline start for the Feature is inside the program’s Freeze Period, customer must approve the baseline change. § Feature and related Stories are returned to the Backlog and assigned to a future Release. § The Planning Package for that release is updated. § Customer approves the moving of the Feature to the future Release. 53PSM Users’ Group 2017, Crystal City, VA
  • 54. ❷ Open Feature Incomplete at end of Planned Sprint Scenario PMB Action Agile Action § Feature in an Open Work Package is 30% complete. § The Sprint completion date arrives and Feature is not complete. § The Sprint completes without this Feature. § Keep Work Package open and report a schedule variance § Possibly report a Cost Variance as well § Work Package stays open until all planned work is completed. § Unfinished work returned to Backlog and planned for future Release § Work stops at end of Sprint 54PSM Users’ Group 2017, Crystal City, VA
  • 55. ❸ Feature in Current Release Moved to Another Release Scenario PMB Action Agile Action § Feature in current Release reprioritized and moved to another Release. § Planned Feature is exchanged for a different Feature from the Backlog of similar size placed in a future release. § Planned Feature placed back on the Backlog. § Overall budget and schedule is unchanged. § This is a Replan of the PMB. § Budget for the Feature follows the Feature. § Features and related Stories reassigned to a WP and Release PP § WP and PP traceability updated in the PMB. § Backlog updated with planned Release removed 55PSM Users’ Group 2017, Crystal City, VA
  • 56. ❹ Planned Initiative Removed from Baseline Scenario PMB Action Agile Action § Initiative removed from baseline through a contract change. § Change impacts a Feature § Removed Feature is in an open Work Package § Baseline change, because Scope has changed. § Close Work Package with unfinished work. § Unclaimed BCWS moved to Undistributed Budget (UB) § Unfinished Features returned to Backlog § Remove Feature and any Stories from Backlog 56PSM Users’ Group 2017, Crystal City, VA
  • 57. ❺Feature Completion Criteria Updated with Additional Functionality Scenario PMB Action Agile Action § Exit criteria for Work Package containing a Feature is updated with additionally functionality § Scope of the Feature is updated to reflect changes. § If new scope budget can come from UB. § If unplanned scope change, budget can come from MR. § Exit criteria for the Feature is updated to reflect changes § New Feature added to the Backlog. 57PSM Users’ Group 2017, Crystal City, VA
  • 58. 7 Forecast Update and Change Scenarios ❶ Stories planned for a 3 sprint feature will not complete as planned. ❷ Stories planned for 3 sprint feature are move to 4th sprint. ❸ Planned feature will not complete by formal delivery date. ❹ Story determined not to be necessary for feature. ❺ Determined a user story needs to be added to a Feature. ❻ After feature and stories accepted, problem found. ❼ Feature assigned to release reprioritized to future release. 58PSM Users’ Group 2017, Crystal City, VA
  • 59. ❶ Stories Planned for a 3 Sprint Feature Will Not Complete As Planned Scenario PMB Action Agile Action § Feature planned for 3 Sprints has started work § Team determines some Stories for the Feature will not be completed in their planned Sprint § Stories are moved to the next Sprint § Stories remain inside the Baseline Feature release date. § No change in the PMB Work Package § Stories can be moved inside the Feature § Moving the Story has no impact on the PV § Backlog is updated to move incomplete Stories from 1st Sprint to the 3rd Sprint § Recording the assignment of the Story to a Feature, but has no impact on the Work Package containing the Feature § Assigning the Story to the new Feature is done in the Agile management tool 59PSM Users’ Group 2017, Crystal City, VA
  • 60. ❷ Stories Planned for 3 Sprint Feature Are Move to 4th Sprint Scenario PMB Action Agile Action § Feature planned to be completed in 3 Sprints has started § Some Stories will not complete as planned in 3rd Sprint. § Those Stories moved to a 4th Sprint beyond the planned Finish of the 3 Sprints. § No change to the Work Package containing the Feature or the PV of that Work Package § Stories can be moved from Sprint to Sprint within Work Package containing the Features. § PV for the Work Package is flat spread, so moving work has no impact on PV. § EV claimed only when Stories complete, so this claim has no knowledge of specific Stories § Backlog is updated to move the Stories not completed in the 1st Sprint is moved to the 3rd Sprint 60PSM Users’ Group 2017, Crystal City, VA
  • 61. ❸ Planned Feature will not Complete by Formal Delivery Date Scenario PMB Action Agile Action § Feature has started but will not complete by planned delivery date. § Customer has stated the Feature is needed by the planned delivery date. § No change to Feature Work Package in Baseline schedule § Feature is forecast to slip beyond the delivery date ‒ at the end of the last Sprint. § The IMS shows the late date (forecast update). § The Critical Path for the Feature sequence is impacted with reduced float (if there was any) § Float, EAC are updated in the IMS. § Unfinished Stories are moved to a Sprint in the next release cycle § In that cycle, they are forecast to completed. § Move the Story Points or Ideal Days with the Story to the release cycle. 61PSM Users’ Group 2017, Crystal City, VA
  • 62. ❹ Determined a Story is not Necessary for Feature to be Completed Scenario PMB Action Agile Action § Story in a Feature has been determined to be unnecessary. § The Feature Work Package is open. § QBD’s for the Feature include the unneeded Story. § No change to Work Package containing the Feature § No change to the PMB § QBD for the Feature updated to remove the Story. § Adjust Physical Percent Complete for the Feature and the Work Package for the work no longer being performed ‒ the unfinished work is decreased, raising the Physical Percent Complete. § Adjust the EAC and Forecast in the IMS. § Remove the Story from the Backlog. § Remove the Story Points or Ideal Days from the Backlog 62PSM Users’ Group 2017, Crystal City, VA
  • 63. ❺ Determined a User Story Needs to be Added to a Feature Scenario PMB Action Agile Action § Work Package for the Feature is open. § New Story needed for a Feature produced by in open Work Package that came from an increased understanding of the Feature. § Exit Criteria (QBD) of the Feature is unchanged with this new Story. § No change to Work Package containing the Feature. § The QBD for the Feature is updated with the addition of the Story § The Story is added to the Sprint Backlog 63PSM Users’ Group 2017, Crystal City, VA
  • 64. ❻ After Feature and Stories Accepted, Problem Found Scenario PMB Action Agile Action § Feature and Stories accepted and 100% of the Value recorded. § Problem with delivered Feature is found. § Defect must be corrected before release of Feature § There is a Work Package for Defect Reports in the current Release, the DR is added to the Exit Criteria (QBD) for that Work Package. § EV can be unclaimed in current reporting period for the Work Package when the planned worked now requires rework . § Or, cost and schedule is used to deprecate EV with additional ‒ unplanned – work inside the Work Package.Work Package overruns due to unplanned and unbudgeted work. [13] § The DR Story is added to the Backlog and mapped to a DR Work Package ‒ if there is a separate Work Package § The DR Story is added to the Backlog and mapped to a Feature Work Package, if there is no DR Work Package 64PSM Users’ Group 2017, Crystal City, VA
  • 65. ❼ Feature Assigned to Release Reprioritized to Future Release Scenario PMB Action Agile Action § Features assigned to one future Release are reprioritized to another future Release. § Budget for the future Feature Release is held in a Planning Package. § Budget moved with reprioritized Feature and its move to a future Release. § No change in BAC or schedule, because work is not detail planned. § Backlog updated. § Feature mapped to new Release. § Road Map updated with new Feature. 65PSM Users’ Group 2017, Crystal City, VA
  • 66. + Walk Through of Two Scenarios for the Notional UAS n Defer a Feature (Autonomous Takeoff) from Release 1 to Release 2 n Replace the 1 Feature with a new Feature (Pilot Controlled Takeoff in place of Autonomous) to Release 1 66PSM Users’ Group 2017, Crystal City, VA
  • 67. 5 Baseline Change Scenarios ❶ Feature in PMB not opened and moved to new work package. ❷ Open feature incomplete at end of planned Sprint. ❸ Feature in current release moved to another release. ❹ Planned initiative and resulting feature removed from baseline. ❺ Feature completion criteria updated with additional functionality. 67PSM Users’ Group 2017, Crystal City, VA
  • 68. + Student Scenarios for the Notional UAS n Defer a Feature (Autonomous Takeoff) from Release 1 to Release 2 n Replace the 1 Feature with a new Feature (Pilot Controlled Takeoff in place of Autonomous) to Release 1 68PSM Users’ Group 2017, Crystal City, VA
  • 69. 7 Forecast Update and Change Scenarios – Student Exercise ❶ Stories planned for a 3 sprint feature will not complete as planned. ❷ Stories planned for 3 sprint feature are move to 4th sprint. ❸ Planned feature will not complete by formal delivery date. ❹ Story determined not to be necessary for feature. ❺ Determined a user story needs to be added to a Feature. ❻ After feature and stories accepted, problem found. ❼ Feature assigned to release reprioritized to future release. 69PSM Users’ Group 2017, Crystal City, VA