1. © 2010 Seapine Software, Inc. All rights reserved. Monitoring Quality Metrics to Know When to Ship Seapine ALM Tour Huntsville, Alabama Peter VarholSolutions Evangelist, Seapine Software

2. Agenda Why we don’t know when to ship How we can know when to ship Data, reports, and shipping Demonstration Really knowing when to ship

3. When the schedule tells us to We All Know When to Ship

4. We All Know When to Ship The schedule isn’t a good metric for shipping We don’t know if the software is ready In fact, What does “ready to ship” really mean? And if we don’t know what it is, we can’t measure it.

5. We All Know When to Ship Ready to ship may mean: All features seem to be working properly Failures aren’t replicable We think it’s ready But there are more objective indicators: No P0 or P1 bugs New bug count is asymptotic All functional tests execute for 10 consecutive days

6. We All Know When to Ship Any definition will do: As long as it meets our needs And can be measured You need: A platform for data collection The ability to analyze data and create ongoing reports The ability to perform ad hoc queries The ability to share reports and data

7. We All Know When to Ship

8. We All Know When to Ship Data tells you when to ship You need reports on your data TestTrack provides a powerful facility for defining reports Built-in reports Custom reports Easily creatable Live charts

9. Building Reports in TestTrack Pro Open versus Closed defects Defects by type Defects by priority Live charts Custom reports

10. Open Versus Closed Defects

11. Defects by Type

12. Custom Reports

13. Custom Reports

14. Live Charts Live charts visually display information in real time: Within the TestTrack dashboard In a separate window Useful for: Sharing changing data across the team Focusing on the most important data

15. Live Charts

16. Summary Define your criteria for shipping Determine information you need about that criteria Generate reports and live charts Now you know when to ship

17. © 2010 Seapine Software, Inc. All rights reserved. Thank you