We are sinking: Hitting the testing iceberg (CukenFest London, 2018)
•
7 likes•897 views
At the session I am going to show you the concept of the testing iceberg through a concrete example. We will see how the "undersea" tests can support the ones on the tip, focusing on business requirements. We will see how you can move tests between the different levels so that finally we get more insight how the testing pyramid can be used in your own projects.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to We are sinking: Hitting the testing iceberg (CukenFest London, 2018)
Similar to We are sinking: Hitting the testing iceberg (CukenFest London, 2018) (20)
More from Gáspár Nagy
More from Gáspár Nagy (12)
Recently uploaded
Recently uploaded (20)
We are sinking: Hitting the testing iceberg (CukenFest London, 2018)
- 1. We are sinking: Hitting the testing iceberg CukenFest London 2018 19/04/2018 Gáspár Nagy coach • trainer • bdd addict • creator of specflow “The BDD Books: Discovery” • http://bddbooks.com @gasparnagy • gaspar@specsolutions.eu
- 3. Copyright © Gaspar NagyCopyright © Gaspar Nagy bdd addict given.when.then CAUTION! on the stage Gáspár Nagy coach, trainer and bdd addict creator of SpecFlow gaspar@specsolutions.eu https://specsolutions.eu @gasparnagy
- 4. BigStockPhoto #88880780 The Test Automation Pyramid
- 5. Copyright © Gaspar NagyCopyright © Gaspar Nagy ThePyramidby MikeCohn,2009 Test Automation Pyramid: Mike Cohn – Succeeding with Agile Pic: http://gasparnagy.com/2017/02/balancing-scenarios-and-unit-tests-case-study-with-specflow/ “Although automated unit testing is wonderful, it can cover only so much of an application's testing needs.” “Without service-level testing […], all other testing ends up being performed through the user interface, resulting in tests that are expensive to run, expensive to write, and brittle.” “service-level testing [fills in] the gap between unit and user interface testing”
- 6. Copyright © Gaspar NagyCopyright © Gaspar Nagy ThePyramidby MikeCohn,2009 Test Automation Pyramid: Mike Cohn – Succeeding with Agile Pic: http://gasparnagy.com/2017/02/balancing-scenarios-and-unit-tests-case-study-with-specflow/
- 7. Copyright © Gaspar NagyCopyright © Gaspar Nagy But what if my UI tests would not be expensive to run, expensive to write, and brittle… But what if my unit tests would not be only used by the developers? Is there anything outside of the testing pyramid?
- 8. Copyright © Gaspar NagyCopyright © Gaspar Nagy There is a carnival of pyramids!
- 9. Copyright © Gaspar NagyCopyright © Gaspar Nagy The Testing Ice- cream Cone The Testing Hourglass The Testing Diamond
- 10. Copyright © Gaspar NagyCopyright © Gaspar Nagy Happy path Automatedtestsfora specificscenario Test Automation Pyramid: Mike Cohn – Succeeding with Agile Pic: http://gasparnagy.com/2017/02/balancing-scenarios-and-unit-tests-case-study-with-specflow/ Icecream Photo by Unknown Author is licensed under CC BY-SA Specific ScenarioTesting gapSpecific Scenario
- 11. Copyright © Gaspar NagyCopyright © Gaspar Nagy We want good enough quality through fast feedback and reasonable costs!
- 12. Copyright © Gaspar NagyCopyright © Gaspar Nagy OK, but… What is good enough quality?
- 13. Quality
- 14. Copyright © Gaspar NagyCopyright © Gaspar Nagy A classification of quality aspects Functional • Works as expected • Expectations are good • Expectations are documented Operational • Secure • Fast • Convenient • Pretty • Consistent • Predictable Strategic • Maintainable • Architecture • Code quality • Easy to integrate • Flexible Source: Kevlin Henney
- 15. Copyright © Gaspar NagyCopyright © Gaspar Nagy Happy path Differentkindoftestson thetestingpyramid Test Automation Pyramid: Mike Cohn – Succeeding with Agile Pic: http://gasparnagy.com/2017/02/balancing-scenarios-and-unit-tests-case-study-with-specflow/ Service-UI connection Functional Operational Strategic Smoke test Timeout handling Edge case Method Argument check DB durab. Data variation Specific Scenario Test Plugin Specific Scenario
- 16. Copyright © Gaspar NagyCopyright © Gaspar Nagy Unit test is a tool, not the goal
- 17. Copyright © Gaspar NagyCopyright © Gaspar Nagy OK, but… What should I automate as “BDDs”?
- 18. Photo by Eric Welch on Unsplash The Testing Iceberg
- 19. Copyright © Gaspar NagyCopyright © Gaspar Nagy Functional Operational Strategic Functionaltestsinthe pyramid • Source: http://gasparnagy.com/2017/02/balancing-scenarios-and-unit-tests-case-study-with-specflow/ Happy path Srv-UI Edge case Argument check Ext call timeout Func1 Func2
- 20. Copyright © Gaspar NagyCopyright © Gaspar Nagy Srv-UI Functional Operational Strategic Edge case Argument check Ext call timeout Source: http://gasparnagy.com/2017/02/balancing-scenarios-and-unit-tests-case-study-with-specflow/ Happy Path Func1 Func2 TestingIceberg!
- 21. Copyright © Gaspar NagyCopyright © Gaspar Nagy Srv-UI Functional Operational Strategic Edge case Argument check Ext call timeout Source: http://gasparnagy.com/2017/02/balancing-scenarios-and-unit-tests-case-study-with-specflow/ Happy Path Func1 Func2 Therearemore water-lines!
- 22. Copyright © Gaspar NagyCopyright © Gaspar Nagy testing the UI != UI testing testing integration != integration test testing a unit != unit test
- 23. Copyright © Gaspar NagyCopyright © Gaspar Nagy TheTestAutomation PrismTM Exploratory Code Analysis (security) Mob Functional Operational Strategic
- 24. Copyright © Gaspar NagyCopyright © Gaspar Nagy “Maybe pyramid is not a goal, but a use…” /Mark Winteringham, @2bittester/
- 25. Copyright © Gaspar NagyCopyright © Gaspar Nagy
- 26. Find your own strategy… …your own pyramid!
- 27. Thank you! Gáspár Nagy coach • trainer • bdd addict • creator of specflow “The BDD Books: Discovery” • http://bddbooks.com @gasparnagy • gaspar@specsolutions.eu
- 28. Copyright © Gaspar NagyCopyright © Gaspar Nagy