This document discusses improving the return on investment and efficiencies of software test case automation. It outlines the benefits of automation including reducing costs and improving test coverage and repeatability. It also discusses challenges such as maintaining automation scripts with frequent product changes. The document introduces the iLeap test automation framework which aims to simplify automation and reduce maintenance costs through features like keyword and data driven testing. It also provides an overview of Impetus' testing services including test automation, white box testing, and specialized testing services.
3. Why Automate?
Complex and demanding applications
Manual regression testing is costly
Manual regression results in cutting corners
Agile product development requires
Lesser time to market through better test repeatability
Already developed features are ignored in manual testing as focus
is more on new features
Fatigue sets into manual testing
Testers make mistakes
Manual testing gets expensive with time
3
4. Test Automation Challenges
Achieving positive ROI- many test automation initiatives do not
actually result in a positive ROI
Scope, Objectives and Expectations have to be clearly defined and
managed
Frequent product changes, enhancements, new features
Test cases can lag functionality being developed or they get out of
sync
Timely communication of changes to the automation team
Communication / Collaboration between manual and automation
engineers
Uniform and consistent automation platform not available
Training required for testing team to maintain the automated test
suite
4
5. Measure Success of Automation
At the onset clearly defined measures should be articulated and
made a part of the automation strategy
Success of automation can be termed as positive if automation
results in
Quick development
Low maintenance
Improved test coverage
Reduced test execution time
Improved test repeatability
Over a period of time the success criteria should be measured and
trended
5
6. Introducing iLeap
iLeap removes manual inefficiencies and provides full support for
Automated Software Testing
Simplified Automation that makes Test suite development as easy as
writing manual test cases
Object repository is maintained in a separate file to remove
redundancy
Action/Data values are maintained in Keyword Driven Tables
Core Engine converts the action sequences into Functional
Automation Tool (FAT) compatible scripts with the use of internal
framework components
FAT runs the scripts to execute automated test cases
Results are maintained in a separate repository with timestamps and
build numbers
6
7. Introducing iLeap
iLeap Key Features
Supports keyword/data/function driven testing paradigms
Data can reside in xls or other repository (future roadmap)
Easy migration from one test tool to another: Can work with any
Automation Tool
Unattended execution with inbuilt recovery mechanisms
Supports all major functional automation tools and technologies
including AJAX, Silver Light 3.0
Enable conditional execution feature to take care of complex real
time business scenarios
Publishes the test results in easy to read format
7
9. Advantage iLeap
Why iLeap?
Quick development
Follows industries best approaches including Keyword Driven, Data Driven and
Functional Decomposition
Pre built framework, resulting in a quick jumpstart
No Scripting - Rapid test development; productivity increases by up to 40%
9
10. Advantages (Contd…)
Low Maintenance
Data Driven Testing- Minimizes tool dependency and empowers manual test engineers
Effective handling of incremental changes results in upto 60% cut in maintenance
costs
10
11. Advantages (Contd…)
Improved test coverage
Data Driven testing, supports MS Excel/XML to define data and action sequences -
any test engineer can create automated tests; removes overhead of knowledge
transfer within team
Execution Strategy can be planned w.r.t specific builds
Execution Priority can be defined at module/logical unit level
Handles database validation effectively
Reduced test execution time
Supports execution in unattended mode – enabling 24/7 test cycle
Improved test repeatability
Highly robust and scalable solution; tests can run repeatedly without changes
Effective recovery scenario to manage unhandled situation; effectively handles both
application crash and tool crash
Web based ROI Calculations showcase the overall automation benefits for any
application
http://qlabs.impetus.co.in/automation_roi_calculator/
11
13. Test Organization and Approach
Quality & Test Engineering Group Strategic Approach to Product Testing
Research Group The critical questions: How to
Execution Group maintain a high quality of testing
Focus on Testing for Products minimize the cost of testing
In depth expertise across all aspects of minimize the time spent on testing
Test Engineering
Rich experience on a variety of tools,
techniques and methodologies
Proven processes and best practices for
high quality deliverables
13
14. Impetus Services
Test Engineering and Consulting
Product Testing Solution, Product Testing Service
Test Automation
Feasibility Study, Automation Strategy, iLeap Implementation
White Box Testing
API Testing, Web Services Testing, Code Coverage Analysis, Static Code Analysis
Specialized Testing
Web Application Security Testing, Migration Testing, Internationalization
Testing, Interoperability Testing, Backward Compatibility Testing
14