Always wanted to know how to build the best business case for setting up Test automation in Agile environments? This presentation focusses on the opportunities Test Automation can bring you and your organization or customers.

1. @BBEERSMA
Building
The Best Businesscase
For (Agile) Test Automation
@BBEERSMA

2. @BBEERSMA
e: bernd.beersma@squerist.nl
m: +31 6-11010659
tw: @bbeersma
Expertise Manager Test Automation
10+ years of experience in TA & PT
Senior Automation Specialist
Board Member TestNet & ATI Europe
Initiator Test Automation Day

3. @BBEERSMA@BBEERSMA

4. @BBEERSMA@BBEERSMA What is Test Automation?

5. @BBEERSMA A small selection of testtools@BBEERSMA

6. @BBEERSMA
Benefits of Test AutomationBenefits of Test Automation
@BBEERSMA
Process and test data in sight-> Auto-Magic Audit Trail
Faster and more often deploy->Decrease Time to Market
Continues Quality monitoring ->Increase Quality to Market
Testruns 24/7 -> Increase Test coverage
TestBasedMaintenance -> Less maintenance documentation
Future Reuse testcases / testdata -> Increase Efficiency
Free Humans from Checking -> Motivation growth

7. @BBEERSMA
Waterfall
@BBEERSMA

8. @BBEERSMA
Agile and Scrum
@BBEERSMA
Individuals and
interactions
Over
Working software
Over
Over
Customer
collaboration
Responding to
change
Over
Process and tools
Comprehensive
documentation
Contract
negotiation
Following a plan

9. @BBEERSMA Why do we need Test automation (in Agile)?@BBEERSMA

10. @BBEERSMA
9126
Maintainability
Portability
Efficiency
Functionality
Reliability
Usability
ISO 9126 ISO 25010

11. @BBEERSMA
25010 Maintainability
Portability
Performance
Efficiency
Security
Compatibility
Functional
Suitability
Reliability
Usability
ISO 9126 ISO 25010
@BBEERSMA

12. @BBEERSMA
Benefits of AgileBenefits of Agile
@BBEERSMA
More Enjoyable!
Boundaries between test & development vanish
Joint quality awareness
Flexibility / Agility
Risk Management
Effective cost spreading
Right Product

13. @BBEERSMA@BBEERSMA
Building the best Businesscase

14. @BBEERSMA
IST
Risks +/+ Costs
Soll
Risks +/+ Costs -/- Opportunities
<
IST -/- Soll
-----------------
IST
1
IST
Test (TTC)
= Soll
Test (TTC)
Return on Investment (ROI)

15. @BBEERSMA
IST
Risks
Soll
Costs
Risk Value (RV)
=
Chance
*
Damage
Test (TTC) Production
Losses (PDC)
Projects (PTC) Regression (RTC)
(25% AT / 75% MT)(10% AT / 90% MT)
Businesscase (1/2)

16. @BBEERSMA
IST
Risks
Soll
Costs
Risk Value (RV)
=
Chance
*
Damage
Test (TTC) Production
Losses (PDC)
Projects (PTC) Regression (RTC)
Opportunities
Implementation
& maintenance (IMC)
(70% AT / 30% MT) (95% AT / 5% MT)
Businesscase (2/2)

17. @BBEERSMA
Risk Value (RV) = Chance (%) * Damage (€)
Risk Chance Damage Risk Value Soll +/-
Loss of data 15% 100.000 15,000 -/- 40% 6.000
+
> 0
…….
Risk Value (RV)
IST / Soll

18. @BBEERSMA
Projects
(10% AT / 90% MT)
Testtime (develop / build)
# Testruns (CPU time)
ST / IAT / FT
Business / Development / Testers
(Tooling costs)
Projectstops
Testdata(management)
……….
# Testcases
# Issues (Blocking / Serious)
# Interfaces
# Screens / fields
# Databases
……….
ObjectsProjectTestCosts (PTC)
+
Total ProjectTestCosts TestCosts / Testcase
………..
(70% AT / 30% MT)
Costs – Test (TTC)
IST / Soll

19. @BBEERSMA
Regression (RTC)
(25% AT / 75% MT)
Testtime (maintenance)
# Testruns (CPU time)
Business / Testers / Maintenance
(Tooling costs)
Testdata(management)
# Releases
……….
# Testcases
# Issues (Blocking / Serious)
# Interfaces
# Screens / fields
# Databases
……….
ObjectsCosts
+
Total TestCosts (TTC) TestCosts / Testcase
………..
(95% AT / 5% MT)
Costs – Test (TTC)
IST / Soll

20. @BBEERSMA
Restore Time
Waiting Time Solutions
Bugs Fixing
ObjectsCosts
Production Losses (PDC)
User motivation
Legacy Dependency
Maintenance documentation
PDC (year) # Avg Time (days) Cost (day) Total Soll +/-
Bugs fix 8 8 1.000 64.000 -/- 40% 25.600
+
> 0
…….
Production Losses (PDC)
IST / Soll

21. @BBEERSMA
Licenses
Maintenance fee / year (15%)
Education
Design and implement structured testenvironment
Migrate / convert Regressiontests
Proof of concept(s)
Installation
Pilot
Consultancy
………….
Objects Costs
Implementation and maintenance (IMC)
+
> 0
…….
Implementation and maintenance (IMC)
Soll

22. @BBEERSMA
Faster and more often deploy
Continuous monitoring
Motivation growth
Better use Agile
Less dependency (suppliers)
Less maintenance documentation
TestBasedMaintenance
Testcoverage
Future Reuse testcases / testdata
Testruns 24/7 – unattended
Processdata in sight
………….
Objects Business Test Development Maintenance
Opportunities (OPP)
Opportunities (OPP)
Soll

23. @BBEERSMA
Building the best business case