The document summarizes a webinar about how Infuse and Kumoco collaborated to build a quality engineering framework. They used business process modeling to generate test designs that increased test coverage by 50% and speed by 80%. This allowed generating 30-50 automated tests per day, a 15x increase in productivity. The approach democratized testing by enabling business users to utilize the automation. A demo showed generating tests from process models and integrating them into test management and automation tools. Benefits included increased coverage, speed, and productivity as well as democratized testing.
2. What you will get out of this Webinar
Learn how Infuse and Kumoco teamed up to build a Quality Engineering framework where BA’s,
Tester and Developers collaborate to build SIT and E2E testing through Business Process Models
The benefits were
• Test Coverage increased by 50% through automated analysis of BPMN and generation of test
designs into Jira/X-Ray using an inbuilt algorithm
• Speed increased by 80%: The analysis work of 5-testers for 4-weeks was reduced to 2-testers
for 1-week
15x increase in test automation productivity by generating 30-50 automated tests per day vs a
typical 2-4 automated tests per day
• The democratisation of testing by getting business users to use the automation
During this webinar, we will demonstrate the processes and tools in action as well as articulate the
benefits of this approach, and how you can apply this to your programmes
3. Presenters - Nalin - Infuse
Nalin founded Infuse in Feb 2002 - Infuse celebrated it’s
19th birthday 5-days ago !
Infuse’s mission and vision is to help customers get the
most of out their software. Infuse is focused on
modernising software delivery. Nalin has worked on
hundreds of projects across the globe and has over 21+
years of experience in software engineering delivery.
Nalin has a BSc in Statistics, Computers, Operational
Research and Mathematics and did his postgraduate
studies in Advanced Information Technology.
When not evangelising modern software delivery. Nalin
is married with 2 children living in Central London. He is
also a Rugby coach for Blackheath Rugby Club U11’s.
4. Presenters - Terry
Terry has more than 30 years in IT and from
developer origins has spent most of his career as a
leader and manager of delivery teams. He has
worked in the UK, USA, Oman, UAE, Scandinavia and
much of Europe in a wide range of industries
including Military, Healthcare, Telecoms, Retail,
Insurance, Banking, and Event Management.
COO and Co-Founder of Kumoco an international
Service Integrator and Transformation partner.
5. Presenters - James
• In 2017, Curiosity Software launched with technologies
and expertise built on decades of experience.
• We’ve built test data solutions since 1995, when our
MD founded the first of 5 pioneering vendors.
• We specialise in requirements modelling, test data
automation, and model-based testing, and are
launching the first Open Testing Platform.
6. Customer Business Background
• $300m Start up 5g telco business built
from the ground up
• Constantly evolving business
requirements and business process
modeling
• Complex system architecture
• 10 major vendors to integrate
• Demand from investors and
shareholders to launch on time
7. Technical Stack and Architecture
• Cloud first modern architecture, with
all sensitive data held on an on-prem
Openstack private cloud.
• Multiple saas products are in use with
a bespoke mobile application.
Digital Platform / Security Gateway / Active Directory
ERP Customer Data Hub
BSS
Payment Portal
Data
Warehouse
Fraud
Management
/ Revenue
Assurance
Data
Analytics /
Campaign
API Gateway
Comms Gateway
Network Domain / Provisioning
Gateway
Comms
Gateway
DMaaP Mediation
Interconnect
Billing
OCS
Paymen
t
Gatewa
y
LEGEND
Zentity
Mobileum
Ericsson 3rd Party
IconX
Openet
Kumoco Netcracker
Digital Platform / Security Gateway / Active Directory
ERP Customer Data Hub
BSS
Payment Portal
Data
Warehouse
Fraud
Management
/ Revenue
Assurance
Data
Analytics /
Campaign
API Gateway
Comms Gateway
Network Domain / Provisioning
Gateway
Comms
Gateway
DMaaP
Mediation
Interconnect
Billing
OCS
Payment
Gateway
LEGEND
Kumoco
Contact
Center
Police
8. The Challenge
• How do we
• Keeping up-to-date with End-to-End
Testing with changing requirements
• Test Quickly and and maximise the
opportunities in Test Automation
• How do I enable shift left ?
• Complex integration architecture
• 163 items in the Master integration list (and
counting)
Digital Platform / Security Gateway / Active Directory
ERP Customer Data Hub
BSS
Payment Portal
Data
Warehouse
Fraud
Management
/ Revenue
Assurance
Data
Analytics /
Campaign
API Gateway
Comms Gateway
Network Domain / Provisioning
Gateway
Comms
Gateway
DMaaP Mediation
Interconnect
Billing
OCS
Paymen
t
Gatewa
y
LEGEND
Zentity
Mobileum
Ericsson 3rd Party
IconX
Openet
Kumoco Netcracker
Digital Platform / Security Gateway / Active Directory
ERP Customer Data Hub
BSS
Payment Portal
Data
Warehouse
Fraud
Management
/ Revenue
Assurance
Data
Analytics /
Campaign
API Gateway
Comms Gateway
Network Domain / Provisioning
Gateway
Comms
Gateway
DMaaP
Mediation
Interconnect
Billing
OCS
Payment
Gateway
LEGEND
Kumoco
Contact
Center
Police
11. Tools
• Signavio - Business Process Modelling tool
• Modeller - Model based test design tool
• X-Ray Jira - Test Management System
• Confluence - Portal for sharing reports and dashboards
• useMango - Test Automation Tool & Framework
• Jenkins - Scheduling system for Test Automation
12. Managing End-to-End Testing with changing requirements
• Trust the business has got it
right
• Leverage the BPML as an
engineering artefact
• Generate the Test Designs in
X-Ray and useMango using a
risk based algorithm
13. Test Quickly
Outputs: Manual Test
✓Areas in red are auto generated
from the Signavio business process
data
✓If the business process changes the
test case can be regenerated
✓Consistent information across all
artefacts
✓Significantly reduce test
maintenance time
Signavio process generates test
design
14. Maximise the opportunities in Test Automation
✓ Everyone can automate, not
just high-skill, high cost
automation engineers
✓ Significant time-savings
compared to manually scripting
tests – generate test scripts in
one click!
✓ Maintain test scripts in minutes
✓ Automation saves more time
and cost than it requires
15. How do I enable shift left ?
• True shift left starts with
architecture business process
model design
• Critically modelling requirements
identifies bugs during the design
phase. “Shift left” reduces
remediation costs while avoiding
the time wasted on
miscommunication.
18. Democratisation: Business Users Reuse the automation
Move from building 1-2 automated tests per day to 30-50 automated tests per day
19. Risk based Testing
● Suggested categories
○ Impact of failure; financial, reputational; operational,
regulatory
○ Probability of failure (based on SIT data): Low, Medium, High
○ Stakeholder impact: Customers, Customers and Business,
Business
This algorithm will be setup in X-Ray based on input from
earlier test phases
Very High
High
Medium
Low
Very Often
Often
Sometimes
Rarely
PROBABILITY OF
FAILURE
FREQUENCY OF USE
1
2
3
4
5
6
7
21. Demo
1 – Showing process in Signavio
2 – Importing into Test Modeller
3 – Generating test cases from biz design and pushing to X-Ray and reviewing them
4 – Looping back to model – Introducing and overlaying useMango automation
5 – Test Execution in useMango
6 – What happens when things change?
22. Benefits
• Test Coverage increased by 50% through automated analysis of BPMN and generation of
test designs into Jira/X-Ray using an inbuilt algorithm
• Speed increased by 80%: The analysis work of 5-testers for 4-weeks was reduced to 2-
testers for 1-week
15x increase in test automation productivity by generating 30-50 automated tests per
day vs a typical 2-4 automated tests per day
• The democratisation of testing by getting business users to use the automation
25. Carry on the conversation
• Try what you’ve seen today - head to TestModeller.io and
useMango.co.uk for a free trial
• Book a web meeting with Curiosity or an Infuse expert.
• Get in touch with your questions and feedback
• James.Walker@Curiosity.Software
• Terry@Kumoco.com
• Nalin.Parbhu@Infuse.it
• We’ll email you the slides, webinar recording and a short demo
video. Please share with your friends and colleagues!