SlideShare une entreprise Scribd logo
1  sur  2
Télécharger pour lire hors ligne
CASE STUDY


 Reducing regression
 test time by 90%

                                                          STAG’s smart automation approach enables a
                                                           leading software provider of on-demand
                                                           enterprise compliance management solutions to
                                                           reduce regression test time by 90% and cut
                                                         down the number of QA releases by six times.




                            Domain - Governance/                                  Technology - Net, MSSQL, IIS,
                            Risk/Compliance                                       Windows 7, IE6, 7, and 8, QTP, and QC




CUSTOMER AND PRODUCT BACKGROUND
The customer is a leading software provider of on-demand enterprise governance, risk and compliance (GRC) management
solutions that are used by clients in highly regulated industries, such as life sciences, healthcare, financial services, insurance,
manufacturing, and energy. The industries use these solutions to minimize their exposure to compliance-related risks and
optimize business performance.


The product in question is a web-based audit management system that supports 22 languages. It streamlines and integrates all
aspects of the internal audit process, including risk assessment, scheduling, planning, execution, review, report generation,
trend analysis, committee reporting, and storage, and also improves the efficiency of the audit workflow, thereby enabling
auditors to spend more time providing value-added services and decreasing the amount of time spent in documentation and
review.


PROBLEM STATEMENT
The product was becoming increasingly complex due to the inclusion of additional functionality and also an increase in
browser and language support due to market considerations. The test automation coverage was highly inadequate, resulting
in severe quality issues. Another problem was the presence of legacy test cases that had not been updated for the past two
years. Besides, the entire application was developed using .Net and had a number of application objects that had limited
support from the QTP tool that was used by the customer.
SOLUTION
A 4-member STAG team initiated a Knowledge Transfer plan that                                         # Automated test scenarios: 448
would enable rapid understanding of the product and also the
test assets, which would help set up a good baseline for test
automation.                                                                                           # Module level scripts: 52

On the basis of the HBT-based principles of automation, the
STAG team adopted a keyword data driven architecture, with the
                                                                                                      # Library files: 1
objective that all future maintenance and extension of the
automation suite would be handled easily by the customer’s QA
team. The STAG team used QTP and QC toolsets to develop and
manage the automation scripts. The architecture designed was                                          # Automation files: 3
compatible with the Quality Centre-enabled data drive, and
allowed for scheduling and execution of the test scripts from
Quality Centre. The solution also provided multi-browser
                                                                                                      # Automation document files: 4
support – including multiple versions of the IE browser as well as
other browsers – and multilingual testing; the latter was enabled
by externalizing the UI control information into multiple
                                                                                                      # Automation script lines of code:
language property files.
                                                                                                      Approximately - 95,000

Another issue was that the dynamic nature of the product meant
the existence of some customized and non-standard UI controls, such as WebTreeView, Web Frames, and customer table grids.
The STAG team was able to resolve this issue by using smart workarounds. The problem of a dynamic UI was resolved using
descriptive programming, and the customized UI controls were mapped using the mapping feature of QTP.


In all, the STAG team automated 4 modules and 64 sub-modules, and automated 448 test scenarios. Most of the existing test
cases were improved for completeness and adequacy, while some were removed to avoid redundancy issues. The test cases
were categorized into appropriate levels for better organization and maintenance.




OUTCOME AND VALUE ADDITIONS
By developing an effective automation framework, the STAG team was able to ensure test enhancement and optimization,
with strict emphasis on sustainability and repeatability. Automated regression testing also enabled the customer to achieve
major as well as patch releases in a planned manner.


The STAG team was able to make quite a few value additions in the process as well, a major one being a drastic reduction in the
number of QA releases, from around 15-20 to just 3. It was also able to bring about a significant reduction in the regression
cycle time: bringing down the number of manual testing hours from 220 to 23 meant a staggering 90% reduction. Besides,
proper organization of the test assets allowed easy maintainability and also scalability on demand.




  Visit: www.stagsoftware.com | E-mail: marketing@stagsoftware.com
  Bangalore: +91 80 28495574 / 41263009 | Chennai: +91 44 4214 3469 / 2442 0396


  2012 © STAG Software Private Limited. All rights reserved. HBT is the IP of STAG Software Private Limited. All trademarks are acknowledged.

Contenu connexe

Plus de STAG Software Private Limited

Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)STAG Software Private Limited
 
Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)STAG Software Private Limited
 
Deliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization ToolDeliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization ToolSTAG Software Private Limited
 
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...STAG Software Private Limited
 
Think better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” ApproachThink better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” ApproachSTAG Software Private Limited
 
Test Process Transformation Protects Product Development Investment
Test Process Transformation Protects Product Development InvestmentTest Process Transformation Protects Product Development Investment
Test Process Transformation Protects Product Development InvestmentSTAG Software Private Limited
 
Agile Sutra "Do more by doing less, Prevent rather than detect"
Agile Sutra "Do more by doing less, Prevent rather than detect"Agile Sutra "Do more by doing less, Prevent rather than detect"
Agile Sutra "Do more by doing less, Prevent rather than detect"STAG Software Private Limited
 

Plus de STAG Software Private Limited (20)

Seven Thinking Tools to Test Rapidly
Seven Thinking Tools to Test RapidlySeven Thinking Tools to Test Rapidly
Seven Thinking Tools to Test Rapidly
 
How to test less and accomplish more
How to test less and accomplish moreHow to test less and accomplish more
How to test less and accomplish more
 
Is regression hindering your progression?
Is regression hindering your progression?Is regression hindering your progression?
Is regression hindering your progression?
 
The Power of Checklist
The Power of ChecklistThe Power of Checklist
The Power of Checklist
 
The power of checklist
The power of checklist The power of checklist
The power of checklist
 
Webinar - 'Test Case Immunity’- Optimize testing
Webinar - 'Test Case Immunity’- Optimize testing Webinar - 'Test Case Immunity’- Optimize testing
Webinar - 'Test Case Immunity’- Optimize testing
 
Design Scientifically (How to test a user story)
Design Scientifically (How to test a user story)Design Scientifically (How to test a user story)
Design Scientifically (How to test a user story)
 
Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)Setting a clear baseline (How to test an user story #2)
Setting a clear baseline (How to test an user story #2)
 
Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)Question to Understand (How to test an User Story #1)
Question to Understand (How to test an User Story #1)
 
Language shapes the way you think
Language shapes the way you thinkLanguage shapes the way you think
Language shapes the way you think
 
Deliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization ToolDeliver Superior Outcomes Using HBT Visualization Tool
Deliver Superior Outcomes Using HBT Visualization Tool
 
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
Hypothesis Based Testing – Application and Adaptation for testing Enterprise ...
 
Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?Are Your Test Cases Fit For Automation?
Are Your Test Cases Fit For Automation?
 
Think better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” ApproachThink better using “Descriptive-Prescriptive” Approach
Think better using “Descriptive-Prescriptive” Approach
 
Improving Defect Yield - a three step approach
Improving Defect Yield - a three step approachImproving Defect Yield - a three step approach
Improving Defect Yield - a three step approach
 
Regression Suite Optimization
Regression Suite OptimizationRegression Suite Optimization
Regression Suite Optimization
 
Reflect and Change
Reflect and ChangeReflect and Change
Reflect and Change
 
Test Process Transformation Protects Product Development Investment
Test Process Transformation Protects Product Development InvestmentTest Process Transformation Protects Product Development Investment
Test Process Transformation Protects Product Development Investment
 
Agile Sutra "Do more by doing less, Prevent rather than detect"
Agile Sutra "Do more by doing less, Prevent rather than detect"Agile Sutra "Do more by doing less, Prevent rather than detect"
Agile Sutra "Do more by doing less, Prevent rather than detect"
 
Intelligent Automation and Smart Tooling
Intelligent Automation and Smart ToolingIntelligent Automation and Smart Tooling
Intelligent Automation and Smart Tooling
 

Dernier

08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGSujit Pal
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 

Dernier (20)

08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAG
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 

Reducing regression test time by 90%

  • 1. CASE STUDY Reducing regression test time by 90% STAG’s smart automation approach enables a leading software provider of on-demand enterprise compliance management solutions to reduce regression test time by 90% and cut down the number of QA releases by six times. Domain - Governance/ Technology - Net, MSSQL, IIS, Risk/Compliance Windows 7, IE6, 7, and 8, QTP, and QC CUSTOMER AND PRODUCT BACKGROUND The customer is a leading software provider of on-demand enterprise governance, risk and compliance (GRC) management solutions that are used by clients in highly regulated industries, such as life sciences, healthcare, financial services, insurance, manufacturing, and energy. The industries use these solutions to minimize their exposure to compliance-related risks and optimize business performance. The product in question is a web-based audit management system that supports 22 languages. It streamlines and integrates all aspects of the internal audit process, including risk assessment, scheduling, planning, execution, review, report generation, trend analysis, committee reporting, and storage, and also improves the efficiency of the audit workflow, thereby enabling auditors to spend more time providing value-added services and decreasing the amount of time spent in documentation and review. PROBLEM STATEMENT The product was becoming increasingly complex due to the inclusion of additional functionality and also an increase in browser and language support due to market considerations. The test automation coverage was highly inadequate, resulting in severe quality issues. Another problem was the presence of legacy test cases that had not been updated for the past two years. Besides, the entire application was developed using .Net and had a number of application objects that had limited support from the QTP tool that was used by the customer.
  • 2. SOLUTION A 4-member STAG team initiated a Knowledge Transfer plan that # Automated test scenarios: 448 would enable rapid understanding of the product and also the test assets, which would help set up a good baseline for test automation. # Module level scripts: 52 On the basis of the HBT-based principles of automation, the STAG team adopted a keyword data driven architecture, with the # Library files: 1 objective that all future maintenance and extension of the automation suite would be handled easily by the customer’s QA team. The STAG team used QTP and QC toolsets to develop and manage the automation scripts. The architecture designed was # Automation files: 3 compatible with the Quality Centre-enabled data drive, and allowed for scheduling and execution of the test scripts from Quality Centre. The solution also provided multi-browser # Automation document files: 4 support – including multiple versions of the IE browser as well as other browsers – and multilingual testing; the latter was enabled by externalizing the UI control information into multiple # Automation script lines of code: language property files. Approximately - 95,000 Another issue was that the dynamic nature of the product meant the existence of some customized and non-standard UI controls, such as WebTreeView, Web Frames, and customer table grids. The STAG team was able to resolve this issue by using smart workarounds. The problem of a dynamic UI was resolved using descriptive programming, and the customized UI controls were mapped using the mapping feature of QTP. In all, the STAG team automated 4 modules and 64 sub-modules, and automated 448 test scenarios. Most of the existing test cases were improved for completeness and adequacy, while some were removed to avoid redundancy issues. The test cases were categorized into appropriate levels for better organization and maintenance. OUTCOME AND VALUE ADDITIONS By developing an effective automation framework, the STAG team was able to ensure test enhancement and optimization, with strict emphasis on sustainability and repeatability. Automated regression testing also enabled the customer to achieve major as well as patch releases in a planned manner. The STAG team was able to make quite a few value additions in the process as well, a major one being a drastic reduction in the number of QA releases, from around 15-20 to just 3. It was also able to bring about a significant reduction in the regression cycle time: bringing down the number of manual testing hours from 220 to 23 meant a staggering 90% reduction. Besides, proper organization of the test assets allowed easy maintainability and also scalability on demand. Visit: www.stagsoftware.com | E-mail: marketing@stagsoftware.com Bangalore: +91 80 28495574 / 41263009 | Chennai: +91 44 4214 3469 / 2442 0396 2012 © STAG Software Private Limited. All rights reserved. HBT is the IP of STAG Software Private Limited. All trademarks are acknowledged.