Test Automation Best Practices (with SOA test approach)

Software Test Automation-Best Practices Leonard Fingerman Email: lfingerman@gmail.com

Why Automate Testing ? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Common Types of Automated Testing ,[object Object],[object Object],[object Object],[object Object],Functional Testing (via UI, API, Web Services… ) Component- level System- level Integration- level

Common Functional Automated Test Tools ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Selenium RC & IDE ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],HP/Mercury Quick Test Pro (QTP) ,[object Object],[object Object],[object Object],[object Object],[object Object],IBM/Rational Functional Tester (RFT) Cons Pros Tool

Typical Test Automation Pitfalls ,[object Object],[object Object],[object Object],[object Object]

Tips for Test Automation Strategy ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Note: the testing tool is abstracted by higher-level framework component library

2 nd Generation Automation Frameworks “Data-driven” ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],MA Boston 02111 2332 Washington st Mick Jagger Jr. RollingStones Inc. GA Atlanta 30075 5775 Main st Phil Collins Genesis Inc. State City Zip Street PrimarySalesPerson CompanyName

Java Code Snipet of Data-Driven RFT Script ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

3 rd Generation Automation Framework “Keyword-Driven” ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Benefits of “Keyword-Driven” Approach ,[object Object],[object Object],[object Object],[object Object],[object Object],.url:=.*createdSalesPerStatus.html .id:=SubmitSalesPer Button Click CreateSalesPerson Click Submit 3 UserLogin Module .value:=User Created Successfully .id:=CreationStatus DIV VerifyExists CreateSalesPersonStatus Verify Sales Person Creation Successful 4 .value:=Phil Collins .text:=SalesPerName Field EnterText CreateSalesPerson Enter New Sales Person data 2 .text:=Login Successful .id:=LoginSubmit N/A Login Home Login 1 Expected Object Type Action Page Description Step

Java Code Snipet of Keyword Library Class ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Hybrid Test Automation Framework ,[object Object],[object Object],[object Object],[object Object]

Framework Type Recommendations ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Keyword-driven Takes the most effort to evolve and thus requires the most investment with design & implementation ,[object Object],[object Object],[object Object],[object Object],Hybrid ,[object Object],[object Object],[object Object],Data-driven Cons Pros Framework Type

Test Execution Phase ,[object Object],[object Object],[object Object]

Service Oriented Architecture ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],After SOA Application A DB Application B DB Application A Presentation Layer Application A DB Before SOA (3-tier architecture) Application A Biz Logic Layer Application B DB Application B Biz Logic Layer Application A SOA Services Application B

Web Service versus GUI-based Testing ,[object Object],[object Object],[object Object],Consuming Client GetWeatherInfoByLocation (‘Atlanta’,‘MA’,’Mexico’) Web Service ???

Challenges Testing SOA ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Layered Testing Approach ,[object Object],[object Object],[object Object],[object Object],[object Object]

Automating Testing of Web Service Components HP Service Test (WSDL-Generated TCs) Inbound Request Service Operation under test Ex: NameandAddress Service 1 ,[object Object],[object Object],[object Object],addressValidation 1 2 Outbound Response 2 Emulated Service Subscriber Or Calling Client Web Service Operation under test 3 3 Test/Defect Management System HP Quality Center Test Exec Result Log Validate

Methodology to Reduce Test LifeCycle and Accelerate Parallel Development - iTKO VSE DELAY Web Services (under construction) Time Time Front-End Dev & SOA Test Teams DELAY Back-end under development/ 3 rd Party Service dependencies Virtualized Web Services based on WSDL Web Services DEV & TEST Teams Web Services DEV Team Front-End Dev & Web Service Test Teams VSE Before After VSE

Calculating the ROI Time Cumulated Costs ($) Initial Investment Automated Testing Manual Testing Cumulative Cost Saving ROI= Net Value / Investment Cost * The maintenance cost of TA is usually not trivial but if you keep enhancing your TA framework, improve application testability and overall testing processes high ROI is very much achievable

[object Object],[object Object],[object Object],[object Object],[object Object],Resources

[object Object],[object Object],[object Object]

Bibliography ,[object Object],[object Object],[object Object]

Test Automation Best Practices (with SOA test approach)

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

Similaire à Test Automation Best Practices (with SOA test approach)

Similaire à Test Automation Best Practices (with SOA test approach) (20)

Dernier

Dernier (20)

Test Automation Best Practices (with SOA test approach)