This document summarizes a keynote presentation about IBM's quality management products and strategies. The presentation discusses real challenges faced by development teams, real results achieved by IBM products in 2008, and real insights into improving quality management. It provides an overview of IBM's quality management portfolio and roadmap for continued enhancements.
2. IBM Rational Software Conference 2009
Quality Management Keynote
Welcome
Real Challenges for real Teams
Real Results
Real Insights
Wrap Up
QM 01 – Quality Management Keynote 2
3. IBM Rational Software Conference 2009
Quality Management Conference Overview
Tons of Content:
35 Sessions
3 Birds of a Feather Sessions
4 Hands on Workshops
Demos in Expo Hall
Previews in Rational Labs
Great new enhancements
QM 01 – Quality Management Keynote 3
4. IBM Rational Software Conference 2009
Quality Management Keynote
Welcome
Real Challenges for real Teams
Real Results
Real Insights
Wrap Up
QM 01 – Quality Management Keynote 4
5. IBM Rational Software Conference 2009
The Ten Challenges to Software Quality
Pressure to reduce cost
Competitive demand to deliver faster
More unpredictable use of application
Creation of more complex software
ecosystems
The rise of government standards
Lack of domain knowledge/content
Inability to find and reuse test assets
Lost knowledge from previous experience
Business view of the test
Lack of goal driven tests
QM 01 – Quality Management Keynote 5
6. IBM Rational Software Conference 2009
Today’s Challenges to Software Quality
Enterprise pressure to reduce cost
Competitive demand to deliver faster
Worldwide geographical dispersed development
Unpredictable/unknown use of application
Increasingly complex software ecosystems
New requirements for government standards
Lack of domain knowledge/content
Inability to search/reuse test assets
Lack of leveraging previous test experiences
Unclear business goals for test criteria
Limited use of real customer data in verification
Lack of published open standards for vendor integration
QM 01 – Quality Management Keynote
7. IBM Rational Software Conference 2009
The Application Quality Lifecycle Show me when the
project meets my
exit criteria and is
ready to ship.
Requirements Development Verification Production
Product Mgt/Analyst Architect/Developer Test Practitioner/Tester Production/Deployment Mgr
Requirement Design Test Service
Management /Model Plan Levels
Identify the best test
cases to automate
Show me the in my organization.
linkage of the test
cases to the
requirements in
the project. Requirement Build Test Final
Definition Cases Image
Show me what
changed in the last APARs
build so that I know RFEs
what function is now
available to test.
Defects Test Product
Results Limitations
Iteration 1 Use the information
Iteration 2 that was learned in the
Iteration N project test to help my
users (usage notes,
etc).
QM 01 – Quality Management Keynote
8. IBM Rational Software Conference 2009
Quality Management Keynote
Welcome
Real Challenges for real Teams
Real Results
Real Insights
Wrap Up
QM 01 – Quality Management Keynote 8
9. IBM Rational Software Conference 2009
Real results: 2008 Year in Review
Rational Service Tester
QM 01 – Quality Management Keynote 9
11. IBM Rational Software Conference 2009
Real results: 2008 Year in Review
Rational Service Tester
Rational Performance Tester
QM 01 – Quality Management Keynote 11
20. IBM Rational Software Conference 2009
Quality Management Imperatives
Collaborate Automate Report
Achieve common goals Increase control Continuously improve
by optimizing how and efficiency by by measuring progress
people work integrating workflows in real time
Improve knowledge and practice maturity with an
environment that develops individual and team talent.
QM 01 – Quality Management Keynote
21. IBM Rational Software Conference 2009
Quality Management Keynote
Welcome
Real Challenges for real Teams
Real Results
Real Insights
Wrap Up
QM 01 – Quality Management Keynote 21
22. IBM Rational Software Conference 2009
The increasing costs of fixing a defect
80% of development costs are spent identifying
and correcting defects!
$7,600/defect
$960/defect
Once released
$240/defect During the as a product
$80/defect QA/Testing phase
During the
During the design phase
requirements phase Traditional QA Testing
25 – 30 % delivery time in testing
Poor upstream quality yields rework
Compressed schedules make it worse
Source: GBS Industry standard study
Defect cost derived in assuming it takes 8 hrs to find, fix and repair a defect when found in code and unit test.
Defect FFR cost for other phases calculated by using the multiplier on a blended rate of $80/hr.
22
QM 01 – Quality Management Keynote
23. IBM Rational Software Conference 2009
Rain sensing wiper system design failure
Individual Systems Worked, But Failed When Integrated
Windshield provided by
local supplier
Incompatible with the
operation range of the sensor
Cars were sent to customers
with non-functioning wiper
system
Initial diagnostics designated
software as culprit for malfunction
Mechanics couldn’t test software behavior
Failure was not of individual components, but in the interaction
at a system level
QM 01 – Quality Management Keynote
24. IBM Rational Software Conference 2009
Unified platform for software delivery
Moving beyond individual tools
A unified platform can dramatically
improve the business process of
Analyst software delivery Tester
Requirements Quality
Management Management
Change &
Configuration
Management
Coordinate team Track builds and the impact
members of defects
Align teams on project Track status with C/ALM
plans Architect Developer
dashboard mashups
QM 01 – Quality Management Keynote 24
25. IBM Rational Software Conference 2009
Elements of Risk: Time, Quality, Cost
Time
Each of the vertices is
an embodiment of risk:
Time Risk
Cost Risk
Quality Risk
Risk Risk cannot be removed
But it can be understood
and controlled
Quality Cost
With IBM Rational Quality Management…
QM 01 – Quality Management Keynote
26. IBM Rational Software Conference 2009
Risk Management through Process Improvement
Business Reporting Requirements Driven Testing
Objective Progress Ensure that the project is
Measurement doing the right thing
Communication
Avoid Surprises
Risk Test Early
Ensure that the project is
doing things right
Management
Test Independence Planning
Ensure Good Governance Effective Implementation
Process Improvements and Tooling efficiencies Reduce your Risk and Cost
QM 01 – Quality Management Keynote
27. IBM Rational Software Conference 2009
Risk Management through Process Improvement
Time
Time
Risk
Risk Quality
Enables
Cost
•Faster Time to Market
Quality Cost •Expanded Feature Set
•Fine Grained Control of
Release Decisions
With IBM Rational Quality Management…
QM 01 – Quality Management Keynote
28. IBM Rational Software Conference 2009
Collaborative Application Lifecycle Management
IBM Collaborative Application Lifecycle Management
Rational Quality Manager
Quality Dashboard
Requirements Test Management
Management Defect
Management
Create Build Manage Execute Report
Plan Tests Test Lab Tests Results
Best Practice Processes
Administration: Users,
Collaboration projects, process
Presentation: Storage
Mashups Discovery Search & Query
Open Platform
SAP .NET
Java System z, i
Test Data Open Lifecycle Service Integrations
Quality Security and
Functional Compliance
Testing Performance Code
Web Service Quality
Testing Quality homegrown
QM 01 – Quality Management Keynote 28
29. IBM Rational Software Conference 2009
Rational Quality Manager Open Ecosystem Today
Provisioning
Automated Testing Requirements Reporting Tivoli Provisioning Manager (TPM)
Rational Functional Tester Rational ReqPro Rational Tivoli Service Request Manager
Rational Performance Tester Rational/Telelogic Doors Insight TADDM
Rational Service Tester for SOA Quality Builds, WorkItems and Defects
Rational AppScan Tester Edition Rational ClearQuest
Test RealTime Rational Team Concert
Rational Robot Rational BuildForge
Rational Rhapsody
Certify
RapidRep Quality Manager
Quick Test Professional
LoadRunner
Supporting bidirectional integration with the
Jira change management system
TMAP Process
Managing mobile applications testing across a global Enabling greater quality and productivity with
Accelerating test cycles with virtual machine
handset test environment automated SOA governance support
management and execution
QM 01 – Quality Management Keynote 29
30. IBM Rational Software Conference 2009
Integrating DOORS with IBM Rational Quality Manager
Enabling requirements driven testing
Requirements Tests based on requirements
Management ensure deliverables meet
customer expectations
Plan Tests Early
Test
Status
Risk Test
Planning
Conduct Tests Early
Relate Tests to Requirements
Management
Relate Defects to Requirements
Measure Progress against
Requirements
Test
Execution Test Design
QM 01 – Quality Management Keynote
32. IBM Rational Software Conference 2009
Quality Manager: Risk Based Testing
Ensure Quality Management goals address Business Objectives
Risk assessments captured in Test Case will contain a risk failure
Test Plan and Test Cases score and a risk priority score
Base project decisions on qualitative risk analysis
QM 01 – Quality Management Keynote 32
33. IBM Rational Software Conference 2009
Quality Manager: Closed Loop Analysis & Reporting
Reduce time to value Reduce Risk with Information Reporting
Customizable reports and dashboards
Reduce escalating cost of information
gathering
Reduce risk by identifying trends before
they become issues
Raise enterprise visibility and
transparency to reduce costs and
risk, and make the right decisions at
the right time
Measures the effectiveness of
processes and practices to improve
organizational and business
outcomes
QM 01 – Quality Management Keynote
34. IBM Rational Software Conference 2009
Performance Tester: Service Level Agreement Reporting
Linking performance results to business objectives
New reports summarize test run against performance requirements
“Supplemental” requirements can be defined and reported separately
Concept of “margin” helps visualize the quality of the results
34
QM 01 – Quality Management Keynote
35. IBM Rational Software Conference 2009
Functional Tester: Storyboard Testing
Visualize test actions through words and pictures
Simplified Test Authoring
Story board navigation of test flow
based on application screenshots
Natural language description of test
actions
Edit anywhere: Script, Text, Screen
QM 01 – Quality Management Keynote
37. IBM Rational Software Conference 2009
The Road Ahead
A peek into the Quality Management Labs
Beta Availability
Rational Service Tester
Rational Performance Tester
Rational Functional Tester
Rational Quality Manager
Rational Test Lab Manager
Visit: RationalTester.com
QM 01 – Quality Management Keynote 37
38. IBM Rational Software Conference 2009
The Road Ahead
A peek into the Quality Management Labs
Research & Development
SAP Integrations
Oracle Solution integrations
Centralized Data Management
Data Integrity
Cloud Computing
QM 01 – Quality Management Keynote 38
39. IBM Rational Software Conference 2009
Quality Management Keynote
Welcome
Real Challenges for real Teams
Real Results
Real Insights
Wrap Up
QM 01 – Quality Management Keynote 39
40. IBM Rational Software Conference 2009
MORE! MORE! MORE!
More Quality Manager
QM02: What's New in IBM Rational
Quality Manager
Today, 11:30, Australia 3
More Functional, Service
and Performance Tester AS SEEN AT
QM03: What's New in Rational
Functional, Service and
Performance Tester
Today, 1:45, Australia 3 RSC
QM 01 – Quality Management Keynote 40
41. IBM Rational Software Conference 2009
MORE! MORE! MORE!
Meet the Product Managers
and Product Engineers
Quality Management
Tonight, 6:00 – 7:00pm, Australia 3
Functional Testing
Tonight, 7:15 – 8:15, Australia 3 AS SEEN AT
Performance Testing
RSC
Tomorrow, 1:00 – 2:00, Australia 3
QM 01 – Quality Management Keynote 41
42. IBM Rational Software Conference 2009
MORE! MORE! MORE!
Previews in Rational Labs
RQM and DOORS
RQM/RPT integration on
service level reporting
Cloud computing and
software quality AS SEEN AT
Rational Product
Integrations with SAP
Demos in the Exhibit Hall
All current shipping versions
RSC
QM 01 – Quality Management Keynote 42
43. IBM Rational Software Conference 2009
MORE! MORE! MORE!
This Week
Share your Thoughts
Twitter: #RSCQM, #RSC2009
Next Week
Quality Management Betas AS SEEN AT
RationalTester.com
Conference Resources
ibm.com/rational/
rsdc/resources
RSC
QM 01 – Quality Management Keynote 43