Software Testing is a process of discovery, discover how using big trak

1. Its not Manual or Automated
Its Sapient....
@charrett
This work is licensed under the Creative Commons Attribution-
NoDerivs 3.0 Unported License. To view a copy of this license,
visit http://creativecommons.org/licenses/by-nd/3.0/.

2. Manual Testing
• Boring
• Repetitive
• Unskilled
• Anyone can do it
This work is licensed under the Creative Commons Attribution-
NoDerivs 3.0 Unported License. To view a copy of this license,
visit http://creativecommons.org/licenses/by-nd/3.0/.

3. Automated Testing
• Automated Testing
• Unit Tests
• Integrated Tests
• BDD or ATDD
• System GUI Testing
This work is licensed under the Creative Commons Attribution-
NoDerivs 3.0 Unported License. To view a copy of this license,
visit http://creativecommons.org/licenses/by-nd/3.0/.

4. Sapient Testing
• Modelling
• Observation
• Asking Useful Questions
• Logical Reasoning
• Process of Discovery
This work is licensed under the Creative Commons Attribution-
NoDerivs 3.0 Unported License. To view a copy of this license,
http://www.satisfice.com/blog/archives/99
visit http://creativecommons.org/licenses/by-nd/3.0/.

5. Sapient Testing
• A/B Testing
• Lean Startup Business
Model
• Software Testing
• Big Data
This work is licensed under the Creative Commons Attribution-
NoDerivs 3.0 Unported License. To view a copy of this license,
visit http://creativecommons.org/licenses/by-nd/3.0/.

6. Big Trak
is back........
This work is licensed under the Creative Commons Attribution-
NoDerivs 3.0 Unported License. To view a copy of this license,
visit http://creativecommons.org/licenses/by-nd/3.0/.

7. Commands
• CM : Clear Memory
• Forward: 1 or 2 digit number e.g 10
• Back : 1 or 2 digit number
• Rotate Left: 1 or 2 digit number e.g 15
• Rotate Right 1 or 2 digit number e.g 15
• Fire: 1 or 2 digit number
• Go: Executes the program
This work is licensed under the Creative Commons Attribution-
NoDerivs 3.0 Unported License. To view a copy of this license,
visit http://creativecommons.org/licenses/by-nd/3.0/.

8. Challenge
• Formulate hypothesis, design, run and interpret
experiments that bear on their hypothesis
• Write a series of programs and observe the devices
behaviour, relate the outcome of their experiments to
their hypothesis
• Terminate the process when the new rule or principle has
been discovered
• Verbalise your ideas within your team
This work is licensed under the Creative Commons Attribution-
NoDerivs 3.0 Unported License. To view a copy of this license,
visit http://creativecommons.org/licenses/by-nd/3.0/.

9. Reporters & Observers
Reporters
• Remind teams at the start to use the CM at the start of
each experiment
• Note hypothesis, program, prediction and behaviour of each
experiment
Observers
• Note Process of Discovery
• How do they approach the exercise
This work is licensed under the Creative Commons Attribution-
• NoDerivs 3.0 Unported License. To view a copy of this license,
Team work, how breakthroughs happen, Insights
visit http://creativecommons.org/licenses/by-nd/3.0/.

10. What does x2 do?
• x2 is also known as the repeat key
• x2 requires a numeric parameter (n).
• x2 can only be used once in a program
• x2 has no effect on instructions following its location in
the program
This work is licensed under the Creative Commons Attribution-
NoDerivs 3.0 Unported License. To view a copy of this license,
visit http://creativecommons.org/licenses/by-nd/3.0/.

11. What does X2 do?
One repeat of the last n steps
This work is licensed under the Creative Commons Attribution-
NoDerivs 3.0 Unported License. To view a copy of this license,
visit http://creativecommons.org/licenses/by-nd/3.0/.

12. Possible Hypothesis
• N repeats of the entire program
• N repeats of the last step
• One repeat of the first n steps
• One repeat of the nth step
• One repeat of the entire program
• One repeat of the last step
This work is licensed under the Creative Commons Attribution-
NoDerivs 3.0 Unported License. To view a copy of this license,
visit http://creativecommons.org/licenses/by-nd/3.0/.

13. Observations
This work is licensed under the Creative Commons Attribution-
NoDerivs 3.0 Unported License. To view a copy of this license,
visit http://creativecommons.org/licenses/by-nd/3.0/.

14. Exploring Science
• Tests can be easy to construct and easily observable, but
don’t offer much information.
• Knowing where to look & Understand what is seen
• Experimental design: design of experimental and
observational procedures
• Hypothesis formation: formation and evaluation of theory
• Confirmation Bias: “Tendency for people to seek evidence
to verify their hypothesis rather than refute them”
This work is licensed under the Creative Commons Attribution-
NoDerivs 3.0 Unported License. To view a copy of this license,
visit http://creativecommons.org/licenses/by-nd/3.0/.

15. Science & Testing
• Testing is more about acquiring information than pass/fail
• Testing like experiments requires good test design
• Watch out for Confirmation Bias
• Testing requires we ask useful questions, challenge
assumptions
• Testing is about thinking critically
This work is licensed under the Creative Commons Attribution-
NoDerivs 3.0 Unported License. To view a copy of this license,
visit http://creativecommons.org/licenses/by-nd/3.0/.

16. Sapient Testing
• Offers thoughtful test design in ANY testing
• Automated Checking good for confirmation
• Exploratory Testing allows us to investigate the product
• Focus on Testability rather than large automated
regression suites
• Testability in creating test data
• Helping to recognise problems
This work is licensed under the Creative Commons Attribution-
NoDerivs 3.0 Unported License. To view a copy of this license,
visit http://creativecommons.org/licenses/by-nd/3.0/.

17. Thanks!
• Exploring Science - David Klahr
• Science == Testing - James Bach
• Feedback
• mavericktester.com
• exploratory testing class on 4th feb next year
• @charrett
This work is licensed under the Creative Commons Attribution-
NoDerivs 3.0 Unported License. To view a copy of this license,
visit http://creativecommons.org/licenses/by-nd/3.0/.