Visual Validation - The missing tip of the automation pyramid @AgileIndia2020
https://confengine.com/agile-india-2020/proposal/11065/visual-validation-the-missing-tip-of-the-automation-pyramid The top of the pyramid is our UI / end-2-end functional tests - which simulate end-user behavior and interactions with the product-under test. While Automation helps validate functionality of your product, aspects of UX validations can only be seen and captured by the human eye and is hence mostly a manual activity. This is an area where AI & ML can truly help. With everyone wanting to be Agile, make quick releases, the look & feel / UX validation, which is a slow, and error-prone activity, quickly becomes a huge bottleneck. In addition, with any UX related issues propping up cause huge brand-value and revenue loss, may lead to social-trolling and worse - dilute your user-base. In this session, using numerous examples, we will explore: Why Automated Visual Validation is essential to be part of your Test Strategy Potential solutions / options for Automated Visual Testing, with pros & cons of each How an AI-powered tool, Applitools Eyes, can solve this problem.
Recommandé
Contenu connexe
Tendances
Tendances (20)
Similaire à Visual Validation - The missing tip of the automation pyramid @AgileIndia2020
Similaire à Visual Validation - The missing tip of the automation pyramid @AgileIndia2020 (20)
Plus de Anand Bagmar
Plus de Anand Bagmar (9)
Dernier
Dernier (20)
Visual Validation - The missing tip of the automation pyramid @AgileIndia2020
- 1. Visual Validation The Missing Tip of the Automation Pyramid @BagmarAnand Anand Bagmar Software Quality Evangelist
- 3. How do you test …. @BagmarAnand
- 4. @BagmarAnand
- 5. • Pen writes properly • Cap closes properly • Looks as expected • Can hold the pen properly • … • … @BagmarAnand Typical answers
- 7. @BagmarAnand
- 9. What is missing here? @BagmarAnand
- 10. How do you ensure what was working before, is working now as well! @BagmarAnand
- 13. Unit (xUnit / JavaScript) Manual / Exploratory Web Service UI / e2e Business-facing Tests Technology-facing Tests @BagmarAnand Test Pyramid Slow More integration Expensive Fast More isolation Cheap
- 14. Unit (xUnit / JavaScript) Manual / Exploratory Web Service UI / e2e Technology-facing Tests @BagmarAnand Test Pyramid Slow More integration Expensive Fast More isolation Cheap Workflow API Contract Consumer Provide r Business-facing Tests
- 15. @BagmarAnand Test Pyramid – Includes NFRs Unit (xUnit / JavaScript) Manual / Exploratory Web Service UI / e2e Performance Security Accessibility Analytics
- 18. @BagmarAnand
- 19. @BagmarAnand
- 20. @BagmarAnand
- 21. @BagmarAnand
- 22. It happens in Software too! @BagmarAnand https://cdn.pixabay.com/photo/2013/07/12/15/58/smiley-150663_1280.png Surprise
- 23. It happens to Twitter @BagmarAnand
- 24. It happens to UPS @BagmarAnand
- 25. It happens to Financial Times @BagmarAnand
- 26. It Happens to Amazon @BagmarAnand
- 27. It happens to HDFC Bank @BagmarAnand
- 28. Bugs escape because our approach to testing is incorrect @BagmarAnand
- 30. UX / Visual Testing The Missing Piece @BagmarAnand
- 31. • Business / Revenue loss • Brand / Credibility loss • You loose your users! @BagmarAnand If Visual Testing is NOT done …..
- 32. @BagmarAnand What is Visual Testing?
- 34. • Mostly done manually done @BagmarAnand Visual Testing
- 35. • Mostly done manually done @BagmarAnand Challenges of Visual Testing • tedious • very error prone • impossible to scale and repeat • blocker for CI-CD
- 36. • Mostly done manually done • Functional Automation can help @BagmarAnand Visual Testing
- 37. • Mostly done manually done • tedious • very error prone • impossible to scale and repeat – especially in days of CD! • Functional Automation may help – a little @BagmarAnand Challenges of Visual Testing
- 39. • Create baselines by taking screenshots of expected UI • Compare screenshots • Whole page • Snippets • Update baselines as product evolves / changes @BagmarAnand How does it work?
- 40. Challenges of Automating Visual Testing @BagmarAnand
- 41. • False positives / negatives • Baseline creation and maintenance • Browsers • Devices • Resolutions / Viewports • Result analysis & identifying next steps @BagmarAnand Challenges of Automated Visual Validation
- 42. AI in Visual Test Automation @BagmarAnand
- 44. Test Automation Pyramid Unit (xUnit / JavaScript) Component Integration View Web Service UI Manual / Exploratory @BagmarAnand
- 45. @BagmarAnand Test Pyramid – Includes UX & NFRs Unit (xUnit / JavaScript) Manual / Exploratory Web Service UI / e2e Performance Security Accessibility Analytics UX
- 47. • Have a holistic Quality Strategy for your produce • Shift-Left to get quick feedback • Include Visual Testing in your Automation Strategy @BagmarAnand Summary
- 48. • The Practical Test Pyramid - https://martinfowler.com/articles/practical-test-pyramid.html • Testing Pyramids & Ice-Cream Cones - https://watirmelon.blog/testing-pyramids/ • Applitools – www.applitools.com @BagmarAnand References