Change Tyres In A Moving Car - Make Functional Test Automation Effective Keynote
•
0 j'aime•505 vues
https://confengine.com/conferences/selenium-conf-2022/proposal/17141/changing-tyres-in-a-moving-car-making-functional-test-automation-effective In my experience, I have seen teams struggle with more than one, and in many cases, all of the above statements. On retrospection, I have realized, that most of these challenges are because of a combination of the following issues: Lack of holistic vision, understanding, skills, and capabilities for taking on this seemingly easy activity of functional test automation Lack of time for design, implementation, and maintenance of the automated test code In this session, I will share, with examples, the features & capabilities that are not used right in Test Automation implementation resulting in you answering “NO” to the above statements. These are anti-patterns of functional automation implementation and have a negative impact on the quality of feedback from your automated tests. More importantly, I will share approaches and solutions of how you can avoid these anti-patterns and evolve to answer “YES” to each of the above statements.
Recommandé
Recommandé
Contenu connexe
Tendances
Tendances (20)
Similaire à Change Tyres In A Moving Car - Make Functional Test Automation Effective Keynote
Similaire à Change Tyres In A Moving Car - Make Functional Test Automation Effective Keynote (20)
Plus de Anand Bagmar
Plus de Anand Bagmar (20)
Dernier
Dernier (20)
Change Tyres In A Moving Car - Make Functional Test Automation Effective Keynote
- 1. @BagmarAnand 1 Changing Tyres In A Moving Car Making Functional Test Automation Effective Anand Bagmar Software Quality Evangelist
- 3. @BagmarAnand 3 • Automated tests run fast. • The automated test execution needs no manual intervention to run/complete successfully – across environments, in parallel, for all team members & CI execution. Raise your hand if you disagree
- 4. @BagmarAnand 4 • Automated tests are triggered automatically on any product change. • Automated tests can run, on-demand, on different (supported) browsers/devices with no changes in code or configuration. Raise your hand if you disagree
- 5. @BagmarAnand 5 • The automated test code is clean and easy to maintain, reuse and scale. • Your automated tests can run in any order, and in parallel. Raise your hand if you disagree
- 6. @BagmarAnand 6 • Consolidated reports and trends from test runs are available in a central reporting server for the team. • You have all the relevant information to do RCA of failed tests readily available. Raise your hand if you disagree
- 7. @BagmarAnand 7 • Your automated functional tests give deterministic feedback - i.e. no flaky/intermittent test failures. • As a result of your functional automation, manual testing efforts are reduced. Raise your hand if you disagree
- 8. @BagmarAnand 8 Why do you disagree? Why is your automation not effective?
- 9. @BagmarAnand 9 https://media.istockphoto.com/photos/hands-over-face-woman-hides-from-excess-of-business-buzzwords-picture-id155003877 Too many things to do
- 11. @BagmarAnand 11 Changing Tyres In A Moving Car
- 12. 12 @BagmarAnand Anti-Patterns Prevent desired outcome from your automated tests
- 13. @BagmarAnand 13 What is an anti-pattern?
- 14. @BagmarAnand 14 Ideas that seem good, but are not! https://likesmag.com/wp-content/uploads/2017/10/funny-design-fails.jpg
- 15. @BagmarAnand 15 Why do we do this? https://martech.org/wp-content/uploads/2015/08/shortcut-strategy-maze-path-direction-ss-1920.jpg
- 16. @BagmarAnand 16 Caught in the headlights! https://worlddeer.org/wp-content/uploads/elementor/thumbs/deer-in-headlights-meaning-pge44ctbg1qqspz7fp4erd9gy0dwohfbykadnxpp54.jpg
- 19. @BagmarAnand 19 Common anti-patterns & ways to address them
- 20. 20 @BagmarAnand Code Quality Code Quality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 21. @BagmarAnand 21
- 22. @BagmarAnand 22 Deeply nested code Assertions all over the place Impossible to understand
- 25. 26 @BagmarAnand Code Quality Code Quality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 28. 29 @BagmarAnand https://media.istockphoto.com/vectors/stitch-in-time-saves-nine-vector-id1341596037
- 29. 30 @BagmarAnand Waits Code Quality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 31. @BagmarAnand 32 https://octopus.com/blog/selenium/8-mixing-waits/mixing-waits Mixing Implicit & Explicit Waits
- 32. 33 @BagmarAnand Waits Code Quality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 36. @BagmarAnand 37 https://octopus.com/blog/selenium/8-mixing-waits/mixing-waits Do NOT mix Implicit & Explicit Waits
- 37. 38 @BagmarAnand Exception Handling Code Quality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 38. @BagmarAnand 39 Swallowed / ignored exceptions
- 39. @BagmarAnand 40 Assertions all over the place!
- 40. 41 @BagmarAnand Exception Handling Code Quality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 42. 43 @BagmarAnand https://www.selenium.dev/documentation/test_practices/encouraged/page_object_models/#support-in-webdriver No assertions in PageObjects
- 43. 44 @BagmarAnand https://www.baeldung.com/java-new-custom-exception Custom exceptions help in RCA
- 44. 45 @BagmarAnand Test Data & Data Provider Code Quality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 45. 46 @BagmarAnand
- 46. @BagmarAnand 47 https://i.pinimg.com/originals/a6/04/2c/a6042c1e63cc3dc35cdfb202aff42b8a.jpg The journey is not explicit RCA becomes challenging
- 47. 48 @BagmarAnand Code Quality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects Test Data & Data Provider
- 48. @BagmarAnand 49 Identify & automate unique journeys
- 49. @BagmarAnand 50 https://i.pinimg.com/originals/a6/04/2c/a6042c1e63cc3dc35cdfb202aff42b8a.jpg Make each journey explicit
- 50. @BagmarAnand 51 • Data is complex • Needs to mimic “real” data • Needs to be unique • Data can be nested • Though specified as static, may need to be Dynamic • Data can be shared and reused Criteria for Test Data
- 51. @BagmarAnand 52 • In Test implementation • In Test specification / intent • In code … separate data structures / classes / etc. • External files Different ways to specify Test Data
- 52. @BagmarAnand 53 • Automated tests should have dedicated test data • This data should not be mixed with data required for manual / exploratory testing • Test data approach: • Identify test data requirements to enable manual testing and automated testing • Parallel execution, and CI-based execution to be kept in mind! • Seed from Production / higher environments • Create using REST APIs Test Data for Automation
- 53. 54 @BagmarAnand Test Execution Priority Code Quality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 54. 55 @BagmarAnand https://media.istockphoto.com/photos/waiting-in-line-picture-id177129252 Executing Tests in Sequence
- 55. @BagmarAnand 56 https://miro.medium.com/max/1400/1*LnNYJCRPmmvybAbqBbrIfg.png Dependencies in Tests
- 57. 58 @BagmarAnand Code Quality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects Test Execution Priority
- 59. @BagmarAnand 60 Test Test Test Test Framework Test Execution Scheduler Optimised Test Execution
- 60. 61 @BagmarAnand Test execution configuration - testng.xml Code Quality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 63. @BagmarAnand 64 testng.xml Suites / Classes / Tests Parameters (test data)
- 64. 65 @BagmarAnand Test execution configuration - testng.xml Code Quality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 65. 66 @BagmarAnand Example: Smoke / Sanity / Regression Module / Component https://media.istockphoto.com/vectors/blank-tag-labels-vector-id585063630 Tag your tests
- 66. 67 @BagmarAnand Separate build/test configuration from test implementation example: gradle/groovy over maven https://www.cashanalytics.com/wp-content/uploads/2019/01/Understanding-Robotic-Process-Automation.png
- 67. 68 @BagmarAnand • Run specific subset of tests on demand, based on tag name • Configurable from command line • No code change required Configurable Test Execution
- 68. 69 @BagmarAnand Magic – Rerun failed tests, automatically Code Quality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 70. 71 @BagmarAnand DO NOT USE Retry Listener
- 71. 72 @BagmarAnand DO NOT Force actions
- 73. @BagmarAnand 74
- 74. 75 @BagmarAnand
- 75. 76 @BagmarAnand Magic – Rerun failed tests, automatically Code Quality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 76. 77 @BagmarAnand
- 78. @BagmarAnand 79 Do ‘proper’ RCA for failing & flaky tests
- 79. 80 @BagmarAnand Page Objects Code Quality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 82. @BagmarAnand 83 WebPage CommonUtils SettingsPage GlobalSearchPage HeadersPage CustomerHeadersPage RootCustomerPage CompanyPage CustomerOverviewPage Very Complex Page Object Design
- 83. @BagmarAnand 84 “Dad” is a “Human” ”Mom” is a “Human” Inheritance
- 84. @BagmarAnand 85 Is “SearchPage” a “BasePage?” Poor use of Inheritance
- 85. 86 @BagmarAnand Page Objects Code Quality Waits Exception Handling Test Data & Data Provider Test Execution Priority Test Execution configuration – testng.xml Magic – Rerun of failed tests, automatically Page Objects
- 87. @BagmarAnand 88
- 88. 89 @BagmarAnand Do not use PageFactory https://titusfortner.com/2021/02/03/page-factory-optimization.html
- 89. @BagmarAnand 90
- 92. @BagmarAnand 93 How can we avoid this trap? https://www.gallereo.com/clients/c4ca4238a0b923820dcc509a6f75849b/image/istock%20avoid.jpg
- 95. @BagmarAnand 96 Take a step back Think about the big picture https://study.com/cimages/course-image/big-picture-thinking-in-business_183979_large.jpg
- 97. @BagmarAnand 98 https://www.selenium.dev/documentation/test_practices/encouraged/ Understand and choose the right practices
- 99. @BagmarAnand 100 Tech Debt Understand, Track, Address https://strapi-appunite.s3.eu-central-1.amazonaws.com/r_1951381_w_F85_X_3f65c9a221.jpg