14. Q5. How Do We Know If We Are Making
The Progress We Planned To Make?
The only credible measure of progress is the Physical
Percent Complete for the planned deliverables.
A
Physical Percent Complete means tangible evidence of
the outcomes that were planned – measured at the time
they were planned to be delivered.
B
This is the basis for full Earned Value Management with
physical percent complete.
This is also a natural a fit with the agile approaches to
software development.
C
All successful methods measure the evidentiary
outcomes in units meaningful to the stakeholders.
These units are usually “money” and “time.”
D
14/36
21. 16 Program Management Processes
21
Program Enablers
Program Process
Capabilities
Business Enablers
Chapter0
Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012 Booz Allen Hamilton PM framework
22. The 4+1 Questions
Every Project Must
Answer to be
Successful
Capabilities Requirements Plans Execution
2. What technical and operational requirements are
needed to deliver these capabilities?
1. What capabilities are needed to fulfill the Concept of Operations†,
the Mission and Vision, or the Business System Requirements?
3. What schedule delivers the product or
services on time to meet the requirements?
4. What periodic measures of
physical percent complete
assure progress to plan?
What impediments to success, their mitigations, retirement plans,
or “buy downs are in place to increase the probability of success?”
+ Continuous Risk Management
† A Concept of Operations (ConOps) describes the characteristics of a system from the point of view of an individual who will use
that system. It is used to communicate the quantitative and qualitative system characteristics to all stakeholders.
Chapter 022 Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
23. What Should We Do?
Where Are We Now?
Identifying Needed System Capabilities
Abstracted from:
“Capabilities‒Based Planning – How It Is
Intended To Work And Challenges To Its
Successful Implementation,” Col. Stephen K.
Walker, United States Army, U. S. Army War
College, March 2005
Identifying Needed System Capabilities
23
Chapter0
Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
25. Establishing the Three Elements of
the Performance Measurement
Baseline
Cost Baseline
Schedule Baseline
Technical Baseline
Determine
Scope and
Approach
Develop
Technical
Logic
Develop
Technical
Baseline
Develop
WBS
Define
Activities
Estimate
Time
Durations
Sequence
Activities
Finalize
Schedule
Identify
Apportioned
Milestones
Determine
Resource
Requireme
nt
Prepare
Cost
Estimate
Resource
Load
Schedule
Finalize
Apportioned
Milestones
Determine
Funding
Constraint
s
Approve
PMB
25
Chapter0
Perform
Functional
Analysis
Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
26. Program Events
Define the availability
of a Capability at a point in
time.
Accomplishments
Represent requirements
that enable Capabilities.
Criteria
Represent Work Packages
that deliver the Requirements.
Work
Package
Work
Package
Work
Package
Work
Package
Work
Package
Work
Package
Work
Package
Work
package
Performance Based Management(sm) describes of the increasing maturing of a product or
service through Events or Milestones, Accomplishments, Criteria, and Work Packages.
Each Event or Milestone represents the availability of one or more capabilities.
The presence of these capabilities is measured by the Accomplishments and their Criteria.
Accomplishments are the pre–conditions for the maturity assessment of the product or
service at each Event or Milestone.
This hierarchy decomposes the System Capabilities into Requirements, Work Packages, and
the activities the produce the deliverables. This hierarchy also describes increasing
program maturity resulting from the activities contained in the Work Packages.
Performance of the work activities, Work Packages, Criteria, Accomplishments, and Events
or Milestones is measured in units of “physical percent complete” by connecting Earned
Value with Technical Performance Measures.
The structure of a
Deliverables Based Plan
Chapter IChapter I26 Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
28. Analyze
Plan
Track
Control
Identify Risks, Issues, and
Concerns
Evaluate, classify, and
prioritize risks
Decide what should be done
about each risk
Monitor risk metrics and
verify/validate mitigations
Make risk decisions
Subproject and partner
data/constraints, hazard
analysis, FMEA, FTA, etc.
Risk data: test data,
expert opinion, hazard
analysis, FMEA, FTA,
lessons learned,
technical analysis
Resources
Replan Mitigation
Program/project data
(metrics information)
Statement of Risk
Risk classification, Likelihood
Consequence, Timeframe
Risk prioritization
Research, Watch (tracking
requirements)
Acceptance Rationale,
Mitigation Plans
Risk status reports on:
Risks
Risk Mitigation Plans
Close or Accept Risks
Invoke contingency plans
Continue to track
Perform Continuous Risk
Management
28
Chapter0
Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
29. 11 Critical Practices Needed to
Implement the 5 Immutable Principles
29
Define the Work
Breakdown
Structure(WBS).
Indentify the
Organizational
Breakdown Structure
(OBS).
Integrate the WBS and
OBS.
Organization
Schedule the work.
Identify the Products and
Milestones.
Set the time phased
budget.
Planning and Budgeting
Record direct costs.
Accounting
Determine variances.
Sum Data and variances.
Manage action plans.
Performance Analysis
Incorporate Changes.
Revision Management
Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
Chapter0
30. Performance Based Management(sm) Puts
You On the Road to Success …
Where are we going?
How do we get there?
Are there enough resources?
What are impediments to progress?
How do we measure progress?
Chapter 030 Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
31. 5 Practices Needed the Implement the
5 Immutable Principles
Identify Capabilities with
measurement units meaningful to
the customer
Identify Technical and Operational
Requirements to deliver
capabilities
Establish risk adjusted Technical,
Cost, and Schedule Baseline(s)
Execute PMB with measurement
units meaningful to the decision
makers
Apply Continuous Risk
Management
Chapter 031 Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
33. 33
How do you actually put these
principles and practices to work for
success?
As a Project Manager, You
have to be
Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
37. Identify
Needed
Capabilities
Indentify
Baseline
Requirements
Establish
Performance
Measurement
Baseline
Execute
Performance
Measurement
Baseline
Define Capabilities
Define ConOps
Assess Needs, Cost,
and Risk
Define Balanced and
Feasible Alternatives
Fact Finding
Gather And Classify
Evaluate And
Rationalize
Prioritize
Integrate And
Validate
Decompose Scope
Assign Accountability
Arrange Work
Develop BCWS
Assign Performance
Perform Work
Accumulate
Performance
Measures
Analyze
Performance
Take Corrective
Action
Continuous Risk Management (CRM)
Define the
Measurable
Capabilities of Project
Outcomes
Assure All
Requirements Are
Provided In Support of
Capabilities
Define Measures of
Performance and
Effectiveness
Ensure Cost,
Schedule, and
Technical
Performance
Compliance
Chapter0
37
Increasing the Maturity of Project Work
Processes and Deliverables
Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
39. Capabilities
Capabilities Based Planning starts with business
scenarios, the tasks needed to implement the scenarios,
and testable capability outcomes
Scenarios
The business units
operational needs in
scenario terms
Merge a General
Ledger from a 3rd party
database through a
data conversation
process for all recently
acquired companies
Work Tasks
The individual work
processes needed to
fulfill the scenarios
1. Define the data to
be acquired from
the new firm
2. Verify data
conversation can
take place
3. Verify that business
operations can
continue
Capabilities
The planned capability
of the Business Units at
each level of maturity
“Acquire a $100M
business unit in 90 days
or less”
“Process 100% AP
invoices from tier 1
vendors saving $9M
annually”
Business Process
Improvement
Strategy ManagementProject Management
39
Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
40. Capabilities
Top Level Steps in Identifying
Capabilities
40
Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
41. Capabilities
“End to end” delivery of business solutions rests on the
keystone of Capabilities Based Planning, buttressed by a
Balanced Scorecard and Portfolio Management
Business Mission and Vision drives
needed capabilities.
Balanced Scorecard defines the
testable strategies for delivering this
business value.
Capabilities Based Planning defines
business outcomes.
Portfolio Management enables
tradeoff decisions.
Event based tasks define increasing
maturity of each capability.
“Done”“Demand”
41
Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
42. Capabilities
The measure of an application effect’s is made visible at
each maturity assessment event.
Derive business effects from capabilities
Link capabilities to effects
Explicitly identify cross links and
interdependencies between capabilities
Highlight “enabler” capabilities
Sub–
Capability
Capability
Business
Effect
Business
Effect
CapabilityCapability
Sub–
Capability
Sub–
Capability
Sub–
Capability
Sub–
Capability
Functional decomposition of capabilities
Capabilities must be Collectively Exhaustive
and Mutually Exclusive
Provide a “menu” from which operations can
choose required capabilities
Capability 1 Capability 2
Sub–
Capability
Sub–
Capability
Sub–
Capability
Sub–Sub–
Capability
Sub–Sub–
Capability
Sub–Sub–
Capability
Sub–Sub–
Capability
Sub–Sub–
Capability
Sub–Sub–
Capability
42
Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
43. Capabilities
A “mini–Kaizen,” can be used to gather Assessment Points
(Events) along with the Significant Accomplishments and
Accomplishment Criteria
43
Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
44. Capabilities
A mini–Kaizen transfers “Sticky’s” to a Mind Map, then to a
Master Schedule, then to a Hanging PERT – producing a “Wall
of Truth” for the project
Working session Sticky’s
A Mind Map™ of the Sticky’s
MS Project™ export of
the Mind Map
PERT Chart Expert™ on the Wall of Truth
44
Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
46. The flow of deliverables describes the
increasing value of the project
Pilot
Data
Enrollment
Integrators
Quality Monitor
Internal
Router
Data Store Lookup
Data Warehouse
Data Marts
Data Marts
Portals and others
Billing
Demo conversion process, member reconciliation
Shared group matrix reports and interfaces
Shared member crosswalk and members to ERP
Integrators in ERP converted to inventory
Status and trigger conversions
Data in Marts for
ERP
Mtrl Mstr cvrtd from
legacy
External Interfaces Extrl Vendors
cvrtd
Finance Loss TBD
Resale's Vendors
from legacy
Emulations Material
converted
end–to–end
47. The flow of deliverables generates
business value or mission fulfillment
Pilot
Data
Enrollment
Integrators
Quality Monitor
Internal
Router
Data Store Lookup
Data Warehouse
Data Marts
Data Marts
Portals and others
Billing
Demo conversion process, member reconciliation
Shared group matrix reports and interfaces
Shared member crosswalk and members to ERP
Integrators in ERP converted to inventory
Data in Marts
for ERP
complete
Mtrl Mstr cvrtd from
legacy
External Interfaces Extrl Vendors
cvrtd
Finance Loss TBD
Resale's Vendors
from legacy
Emulations Material
converted
end–to–end
Milestone that
produces
business value
Significant Accomplishment
needed for the entry criteria to
the Event or Milestone
Accomplishment Criteria is the exit criteria for
the Work Package and its Tasks that produce
the outcomes defined in the Significant
Accomplishment
Status and trigger conversions
48. The perfect schedule
must …
Show what Done
looks like through
tangible evidence of
success.
Show the order of
the work needed to
get to Done at each
stage.
Define the needed
resources to reach
Done.
Identify risks to
Done and their
handling.
Measure physical progress toward Done in units
meaningful to the decision makers.
48/38Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
49. The REAL Problem For Every Schedule Is …
The Activities And Their Numbers Are Arranged In A
Probabilistic Network With Interdependent Connections
Between Work Elements
49/38
50. Business Need
Process Invoices for Top
Tier Suppliers
1st Level
Electronic Invoice
Submittal
1st Level
Routing to Payables
Department
2nd Level
Payables Account
Verification
2nd Level
Payment Scheduling
2nd Level
Material receipt
verification
2nd Level
“On hand” balance
Updates
Deliverables defined in WP
51. 1. Build the WBS
2. Define Project Events
3. Define Significant
Accomplishments
need for DONE
4. Define Success Criteria
for the Outcomes
5. Develop the Work
Packages for Outcomes
6. Identify
Interdependencies
between Work Packages
7. Assemble Integrated
Master Schedule
8. Iteratively and Incrementally tune the schedule in
the presence of risk retirement, mitigation activities,
and past performance, and emerging requirements.
Boyd
developed the concept to explain how to direct one's energies to defeat an adversary and survive. 51/38
52. PBM Execution Framework
Program ExecutionPMB for IBRProposal SubmittalDRFP & RFP
Performance Measurement Baseline
Tasks (T)
BOE
% Complete
Statement of Work
Program Deliverables
IMP
Accomplishments (A)
Criteria (C)
EVMS
Events (E)
Budget Spreads by CA & WPCAIV
Capabilities Based Requirements
X BCWS =
Probabilistic Risk Analysis
=
Time keeping and ODC =
Technical Performance Measure
BCWP
ACWP
Cost & Schedule Risk Model
BCWS
D ecreasing techni cal and programmatic ri sk usi ng R i sk Management Methods
IMS
Physical % Complete
Continuity and consistency from DRFP through Program Execution
ChapterX
52
Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
53. Variance
Planned Value
Planned Profile
Current Estimate
Milestones
Threshold
Upper Limit
Lower Limit
MeanToBetweenFailure
Time = Program Maturity
Achieved to Date
TPM
Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
54. Connecting the Dots with the
Performance Measurement Baseline
54
Risk
SOW
Cost
WBS
IMP/IMS
TPM
PMB
Named
Deliverables
defined in the WBS
BCWS at the Work
Package, rolled to the
Control Account
TPMs attached to each
critical deliverables in the
WBS and identified in
each Work Package in the
IMS, used to assess
maturity in the IMP
The Products and
Processes that produce
them in a “well structured”
decomposition in the WBS
IMS contains all
the Work
Packages, BCWS,
Risk mitigation
plans, and rolls to
the Integrated
Master Plan to
measure
increasing maturity
Technical and Programmatic
Risks Connected to the WBS
and IMS
ChapterX
Performance Based Management(sm), Copyright ® Glen B. Alleman, 2012
55. 55
Principles Connected to Practices
5 Immutable
Principles
5 Practices of Program Success
Capabilities
Requirement
s
Performance
Measuremen
t Baseline
PMB
Execution
Continuous
Risk
Management
Where are
we going?
ConOps,
SOO, SOW
Deliverables
Based
Planning
Incremental
Maturity
Assessment
Physical
Percent
Complete
Risk
Identification
How are we
going to get
there? Integrated
Master Plan
Work
Breakdown
Structure Integrated
Master
Schedule
Iterative and
Incremental
Delivery
Risk
Analysis
What do we
need along
the way?
Resource
Management
Plan
Future
Performance
Forecasting
Risk
Planning
What
impediments
will we
encounter?
4 Levels of
Uncertainty
Assessment
Risks
assigned to
deliverables
Risk
adjusted
cost and
schedule
Risk
adjusted
Earned
Value
Management
Risk
Tracking
How do we
measure
Measures of
Effectivenes
Measures of
Technical
Performance
Earned
Value
Risk