In a business world where speed is the new imperative, everyone is talking about the need for transformation. As a result, the role of testing will change forever. Testing can no longer be the “protectors of production”. To stay relevant in a world where the line between business and technology becomes invisible, what must testing do to stay relevant?

1. TRANSFORMING
TESTING
@teknologika
Bruce McLeod
Principal Consultant, ThoughtWorks

2. WHY COMPANIES NEED TO TRANSFORM
WHAT “DIGITAL TRANSFORMATION” IS
WHAT THIS MEANS FOR TESTING
HOW YOU CAN TRANSFORM WHAT YOU DO

3. Emerging
Tech
Emerging
Competitors
Public
Perception
Regulatory
Impacts
Shareholder
Angst
Talent
Expectations
Marco-Economic
Conditions
Customer
Expectations

5. Apple Watch Announced
Apple Watch Ships

6. Net income
2014 $376.7M
2017 -$478.2M
227 %

7. DISRUPTION IS
CHANGING BUSINESS
MODELS

8. PERSONAL
INSURANCE
PREMIUM

9. COST TO SERVICE
CLAIMS POOL
OR PROFITS

11. POTENTIAL
DONATION
COST TO SERVICE
20% PROFIT

12. SPEED IS THE NEW
IMPERATIVE

13. AMAZON DEPLOYS CODE
EVERY 11.7 SECONDS

14. AMAZON PRIME
67 DAYS
FROM IDEA TO LAUNCH

15. TESLA
4 MONTHS
TO BUILD THEIR ERP IN HOUSE

16. The increased rate of
change in tech will
continue to create a gap
ENTERPRISE’S
ABILITY TO ABSORB
TECH EVOLUTION
OPPORTUNITIES
AVAILABLE
TO NEW
DISRUPTORS

17. LEGACY
IT APPROACH
NEW AGE
DIGITAL BUSINESS
• Project and factory
approach to software
delivery
• Shared services and service
provider
• Package-driven capability
• Evolutionary technology
platforms that power your
business strategy
• Software product excellence
to build the right thing, right
• Organisational agility to
respond and adapt with speed

18. WHAT IS
DIGITAL TRANSFORMATION ?

19. STRATEGY
CUSTOMER
EXPERIENCE
TECHNOLOGY
& DATA
DIGITAL TRANSFORMATION

20. INCREASED
OPEX
COSTS
PROJECT BASED
FUNDING
TEMPORARY
WORKFORCE
ANNUAL BUDGET
CYCLES
STAND &
ABANDON

21. CONTINUIOUS
IMPROVEMENT
VALUE BASED
PRIORTITSATION
AUTONOMOUS
TEAMS
INCREMENTAL
FUNDING
YOU BUILD IT
YOU RUN IT

22. BUDGETING
ANNUAL QUATERLY

23. GOAL
BET BET BET
BET
BET
BET
BET
BET
GOAL : Look great for the school
reunion
BET: Eat fewer doughnuts
MEASURE: Doughnuts consumed
per day (leading)
TARGET: Half a doughnut per day
PRIORITISATION

24. CONWAY’S LAW
“Organisations which design systems ... are
constrained to produce designs which are copies
of the communication structures of these
organisations …”

25. INVERSE CONWAY MANOEUVRE
Design your Organisation the way you
want your software to be

26. TEMPORARY PROJECT TEAMS
SPECIFICATION DRIVEN
WORK PASSED BETWEEN TEAMS
PART OF A LARGE RELEASE TRAIN
QUARTERLY OR BI-ANNUAL RELEASES
FROM

27. TEMPORARY PROJECT TEAMS
SPECIFICATION DRIVEN
WORK PASSED BETWEEN TEAMS
PART OF A LARGE RELEASE TRAIN
QUARTERLY OR BI-ANNUAL RELEASES
“STICKY” & STRATEGICALLY ALIGNED
CUSTOMER EXPERIENCE LED
AUTONOMOUS, NO HANDOFFS
CAN PUSH TO PROD WITHOUT ASSISTANCE
CAN CHOOSE THEIR RELEASE CADENCE
TO

28. CUSTOMER EXPERIENCE

29. Does customer value drive business
strategy? Are customer outcomes a key
measure for success?

30. INSTEAD OF SELLING LOANS

31. HELP CUSTOMERS GET A HOME

32. TECHNOLOGY

33. Does your technology accelerate
business innovation instead of
constraining it?

34. BUSINESS
TECH
SUPPORTING
ROLE
Formal walls
Tech creates
digital assets
COLLABORATION
Collaborative
execution
TECH LED
DIFFERENTATION
Tech + business
boundaries blur
TECH @ CORE
Tech pervades a
digital business

35. LEADING DIGITAL

36. LEADERSHIP
TECHNOLOGY
INVESTMENT
HIGHLOW
HIGH
LEADERSMAVERICKS
LATE
ADOPTERS
TRADITIONALISTS

37. +10%
-10%-4%
+6%
LEADERSHIP
TECHNOLOGY
INVESTMENT
HIGHLOW
HIGH
REVENUE
+10%
-10%-4%
+6%
LEADERSMAVERICKS
LATE
ADOPTERS
TRADITION

38. LEADERSHIP
TECHNOLOGY
INVESTMENT
HIGHLOW
HIGH
PROFIT
+26%
+9%-24%
-11%
LEADERSMAVERICKS
LATE
ADOPTERS
TRADITION

39. REDUCE
WASTE
CUSTOMER
EXPERIMENTS
CHAOS
ENGINEERING
THE 4TH TESTING REVOLUTION
EXPERIMENTATION AT SPEED

40. REDUCE WASTE

41. TEST PLANS
MANUAL REGRESSION TESTING
FOCUS ON LOGGING DEFECTS
DEDICATED TESTING PHASE
MANUAL RELEASE PROCESSES
FROM

42. TEST PLANS
MANUAL REGRESSION TESTING
FOCUS ON LOGGING DEFECTS
DEDICATED TESTING PHASE
MANUAL RELEASE PROCESSES
10 MIN TEST PLANS
TARGETED AUTOMATED REGRESSION
FOCUS ON DEFECTS PREVENTION
BUILDING QUALITY IN
CONTINUOUS DELIVERY
TO

43. CUSTOMER EXPERIMENTS

44. DISCOVER DEFINE DESIGN DELIVER
Research, explore and
understand
Divergent ideation,
prototype, validate ideas
Synthesise insights
define the opportunity
Iteratively build, test
with customers, refine

45. QUANTITATIVE DATA QUALITATIVE STORIES
WHO DOES WHAT?
HOW OFTEN?
WHY? HOW?

46. CHAOS ENGINEERING

47. BUILD A HYPOTHESIS
SIMULATE REAL WORLD EVENTS
RUN EXPERIMENTS IN PRODUCTION
AUTOMATE TO RUN CONTINUOUSLY
MINIMISE BLAST RADIUS

48. • Multi- Availability zones
• Multi-region
• Variable capacity and latency
• Scalable & dynamic
• Cloud infrastructure contains
operational logic
Cloud Native Architectures

49. • Auto-scaling events
- Terminating instances
- Adding instances
• Latency
• Traffic peaks and lows
• Errors
• Failed calls, duplicate messages
THINGS TO CONSIDER WHEN TESTING

50. AUTOMATED CANARY RELEASES

51. A
B
A
A 2.0
98%
1%
1%

52. DISRUPTION
IS
COMING
COMPANIES
MUST
TRANSFORM
EMBRACE
THE
OPPORTUNITY

53. WASTE
REDUCTION
CUSTOMER
EXPERIMENTS
CHAOS
ENGINEERING
THE 4TH TESTING REVOLUTION
EXPERIMENTATION AT SPEED

54. TO LEARN MORE