SlideShare une entreprise Scribd logo
1  sur  24
Perils of Testing and
Perils of not testing
      A few anecdotes
David Dorward
   twitter @dorward
   CPAN DORWARD
   WWW http://dorward.me.uk
Testing
Why test?
Why test?

To make sure code does what it should do
Why test?

To make sure code does what it should do
To make sure code continues to do what it should do
Why test?

To make sure code does what it should do
To make sure code continues to do what it should do
To communicate what code should do
Knowing your subject
Perils of Tests
15:22 < t0m> Dorward: well volunteered, what was your CPAN id again?
15:23 < Dorward> Eeek
15:23 < Dorward> What have I done?!
15:23 < Penfold> made it better
15:23 < Penfold> be porud
15:23 <+mdk> t0m: nice one ++
15:23 < t0m> Made DORWARD primary maintainer of
Catalyst::View::ContentNegotiation::XHTML.
15:23 < t0m> Made DORWARD primary maintainer of
Catalyst::View::TT::XHTML.
So who needs tests?
So who needs tests?

Me: Can you merge this patch? It might need tweaking, I’m
not an expert in that framework.
So who needs tests?

Me: Can you merge this patch? It might need tweaking, I’m
not an expert in that framework.
Alice: Sure, we’ll tweak it.
So who needs tests?

Me: Can you merge this patch? It might need tweaking, I’m
not an expert in that framework.
Alice: Sure, we’ll tweak it.
Me: Hang on, it only works for the top level directory!
So who needs tests?

Me: Can you merge this patch? It might need tweaking, I’m
not an expert in that framework.
Alice: Sure, we’ll tweak it.
Me: Hang on, it only works for the top level directory!
Bob: It passes the tests that Alice wrote though…
Tests help developers
    communicate
…with each other
BDD
Behaviour Driven
  Development
Scenarios

Given
When
Then
For example

Given a program that started at 1800 yesterday on BBC One
When the iPlayer homepage is loaded
Then that program is show at the top of the schedule
Business
     Reqs
                           Designs

                                            UXD




                 BA

                                 Feedback

               Scenario
                Design
               Meetings
     Testing              Dev




Who creates scenarios?
Benefits

Everyone knows what everyone else means
Challenge requirements
Spot edge cases
When you do start coding, you can just get on with it
BA




                   Scenario
                    Design
                   Meetings
         Testing               Dev




Manual                               Automated
                   Scenarios
 Tests                                 Tests




         Artefacts
TDD

Contenu connexe

En vedette

Βάσεις δεδομένων Κεφ.1
Βάσεις δεδομένων Κεφ.1Βάσεις δεδομένων Κεφ.1
Βάσεις δεδομένων Κεφ.1marygeorg
 
Adjectives main class
Adjectives main classAdjectives main class
Adjectives main classlsaezmansilla
 
Βάσεις Δεδομένων Κεφ3
Βάσεις Δεδομένων Κεφ3Βάσεις Δεδομένων Κεφ3
Βάσεις Δεδομένων Κεφ3marygeorg
 
βάσεις δεδομένων κεφ2
βάσεις δεδομένων κεφ2βάσεις δεδομένων κεφ2
βάσεις δεδομένων κεφ2marygeorg
 
De private holding anno 2012 - patrimoniale en fiscale optimalisatie na het r...
De private holding anno 2012 - patrimoniale en fiscale optimalisatie na het r...De private holding anno 2012 - patrimoniale en fiscale optimalisatie na het r...
De private holding anno 2012 - patrimoniale en fiscale optimalisatie na het r...Lexalert
 
Investigacion etnografica
Investigacion etnograficaInvestigacion etnografica
Investigacion etnograficalilianatarapues
 
Jonathan Edwards powerpoint 2010
Jonathan Edwards powerpoint 2010Jonathan Edwards powerpoint 2010
Jonathan Edwards powerpoint 2010Amber Phelps
 
La 2 república
La 2 repúblicaLa 2 república
La 2 repúblicajaccbatxart
 

En vedette (11)

Βάσεις δεδομένων Κεφ.1
Βάσεις δεδομένων Κεφ.1Βάσεις δεδομένων Κεφ.1
Βάσεις δεδομένων Κεφ.1
 
Adjectives main class
Adjectives main classAdjectives main class
Adjectives main class
 
Βάσεις Δεδομένων Κεφ3
Βάσεις Δεδομένων Κεφ3Βάσεις Δεδομένων Κεφ3
Βάσεις Δεδομένων Κεφ3
 
βάσεις δεδομένων κεφ2
βάσεις δεδομένων κεφ2βάσεις δεδομένων κεφ2
βάσεις δεδομένων κεφ2
 
De private holding anno 2012 - patrimoniale en fiscale optimalisatie na het r...
De private holding anno 2012 - patrimoniale en fiscale optimalisatie na het r...De private holding anno 2012 - patrimoniale en fiscale optimalisatie na het r...
De private holding anno 2012 - patrimoniale en fiscale optimalisatie na het r...
 
I have to...
I have to...I have to...
I have to...
 
Fafsaws01bw
Fafsaws01bwFafsaws01bw
Fafsaws01bw
 
Investigacion etnografica
Investigacion etnograficaInvestigacion etnografica
Investigacion etnografica
 
G6 Pd Presentation
G6 Pd PresentationG6 Pd Presentation
G6 Pd Presentation
 
Jonathan Edwards powerpoint 2010
Jonathan Edwards powerpoint 2010Jonathan Edwards powerpoint 2010
Jonathan Edwards powerpoint 2010
 
La 2 república
La 2 repúblicaLa 2 república
La 2 república
 

Dernier

unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????blackmambaettijean
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 

Dernier (20)

unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
What is Artificial Intelligence?????????
What is Artificial Intelligence?????????What is Artificial Intelligence?????????
What is Artificial Intelligence?????????
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 

Perils of testing

  • 1. Perils of Testing and Perils of not testing A few anecdotes
  • 2. David Dorward twitter @dorward CPAN DORWARD WWW http://dorward.me.uk
  • 5. Why test? To make sure code does what it should do
  • 6. Why test? To make sure code does what it should do To make sure code continues to do what it should do
  • 7. Why test? To make sure code does what it should do To make sure code continues to do what it should do To communicate what code should do
  • 9. Perils of Tests 15:22 < t0m> Dorward: well volunteered, what was your CPAN id again? 15:23 < Dorward> Eeek 15:23 < Dorward> What have I done?! 15:23 < Penfold> made it better 15:23 < Penfold> be porud 15:23 <+mdk> t0m: nice one ++ 15:23 < t0m> Made DORWARD primary maintainer of Catalyst::View::ContentNegotiation::XHTML. 15:23 < t0m> Made DORWARD primary maintainer of Catalyst::View::TT::XHTML.
  • 10. So who needs tests?
  • 11. So who needs tests? Me: Can you merge this patch? It might need tweaking, I’m not an expert in that framework.
  • 12. So who needs tests? Me: Can you merge this patch? It might need tweaking, I’m not an expert in that framework. Alice: Sure, we’ll tweak it.
  • 13. So who needs tests? Me: Can you merge this patch? It might need tweaking, I’m not an expert in that framework. Alice: Sure, we’ll tweak it. Me: Hang on, it only works for the top level directory!
  • 14. So who needs tests? Me: Can you merge this patch? It might need tweaking, I’m not an expert in that framework. Alice: Sure, we’ll tweak it. Me: Hang on, it only works for the top level directory! Bob: It passes the tests that Alice wrote though…
  • 15. Tests help developers communicate
  • 17. BDD
  • 18. Behaviour Driven Development
  • 20. For example Given a program that started at 1800 yesterday on BBC One When the iPlayer homepage is loaded Then that program is show at the top of the schedule
  • 21. Business Reqs Designs UXD BA Feedback Scenario Design Meetings Testing Dev Who creates scenarios?
  • 22. Benefits Everyone knows what everyone else means Challenge requirements Spot edge cases When you do start coding, you can just get on with it
  • 23. BA Scenario Design Meetings Testing Dev Manual Automated Scenarios Tests Tests Artefacts
  • 24. TDD

Notes de l'éditeur

  1. \n\n
  2. \n\n
  3. I&amp;#x2019;ve been spending the last year writing lots and lots of JavaScript and almost no Perl. Which gave me some trouble coming up with a talk for LPW! So let&amp;#x2019;s go for generic programmer material and talk about\n
  4. I&amp;#x2019;m going to talk about that oh so thrilling subject of testing.\n
  5. So, why do we test?\nTo make sure code does what it should do? That&amp;#x2019;s a bit obvious.\nHow about Regression testing? Ditto.\nLet&amp;#x2019;s talk communication. Tests are a way for developers to communicate.\nI promised anecdotes, didn&amp;#x2019;t I? Let&amp;#x2019;s start with one about&amp;#x2026;\n
  6. &amp;#x2026;Knowing your subject. I&amp;#x2019;ve spent quite a lot of time learning about exciting things like HTML, XHTML and content negotiation. Which led me to spotting a couple of limitations with the way a module that dealt with that sort of thing worked. IRC not being the best place to try to explain all the intricacies, I wrote some tests instead and the next thing I knew&amp;#x2026;\n
  7. &amp;#x2026; someone has decided that I knew too much about the domain and made me the module&amp;#x2019;s maintainer. Whoops.\n
  8. I wrote some code. It wasn&amp;#x2019;t very good, but it got the point across. \nOr so I thought. A week later the directory handling portion of the code didn&amp;#x2019;t work.\nIt did pass all the tests though, but since I was the only one involved who knew all the use cases, they didn&amp;#x2019;t cover all the requirements.\n
  9. \n\n
  10. &amp;#x2026;with each other. But what about non-developers?\n
  11. We&amp;#x2019;ve been experimenting with BDD. I love TLAs!\n
  12. This one stands for Business Driven Development, and we&amp;#x2019;re probably doing it wrong, but we are finding it helpful.\n
  13. The basic idea is to break down the requirements into small scenarios that describe preconditions, actions and outcomes &amp;#x2014; in plain English that everyone can understand. Developers, designers, managers, everyone.\n
  14. So a practical example, which I made up based on the main BBC iPlayer website (not a project I work on but one that many of you will recognise)\n
  15. There are issues with that example, but first there is the question of who writes them? Well, it doesn&amp;#x2019;t really matter who writes them down, the important thing is that they are a collaborative process. One of the benefits of scenarios is that they provide a focus for discussion. In our team, a couple of developers sit down with a tester and a business analyst and hammer out the scenarios together.\n
  16. Everyone knows what everyone else means. Discussions about requirements reduce problems such as a word having a different meaning to developers then it does to designers. Measure twice, cut once. There is little as boring as redoing a piece of work because the requirements were miscommunicated. \nA forum to challenge requirements; some of us have no problem shouting when we see a requirement or a design that doesn&amp;#x2019;t make sense, but this gives everyone a safe environment to raise those concerns. And it helps spot the edge cases as it gets every mind on the job. The program that starts at 1800 should be at the top? What if a program runs 1730 to 1830? What if the channel doesn&amp;#x2019;t broadcast at 6pm?\n
  17. And you get scenarios, which are basically tests written in plain English. But not just plain English, it is structured and therefore rather easier to translate into code for automated tests. The rest is just&amp;#x2026;\n
  18. \n\n