View webinar: http://www.eurostarconferences.com/community/member/webinar-archive/webinar-77-the-search-for-surprises In this talk, James Lyndsay will identify and illustrate approaches that help you to root out the ways that working software misbehaves. We'll put these approaches in context by describing emergent behaviours, strategies and diversity, wicked problems and the temptations of confirmation. Participants with laptops can download and work through some of the exercises.

1. Welcome to the 2013
This%webinar%is%due%to%start%at%9AM.%Make%sure%you%s4ck%around%at%the%end%for%the%Q&A%
session%and%con4nue%the%conversa4on%with%the%speaker%on%Twi'er*a<er%the%show!%
%
www.eurostarconferences.com%
@esconfs%%%#esconfs%@workroomprds%
This%webinar%is%presented%by%James%Lyndsay%and%he%will%discuss:%
‘The*Search*for*Surprises’*
%
Join%the%conversa4on%on%TwiBer!%%
%
The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
The Search for Surprises
James Lyndsay
Workroom Productions
2

2. The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
3
Want to play?
workroom-productions.com/esconfs
The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
4
Horace Judson (quoting Lewis Thomas)
The Search for Solutions

3. The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
ExpectedDelivered
5
The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
6
Expected Delivered

4. The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
Best practices”, white-box techniques, waterfall,
requirements-based testing
Agile methods, emergent behaviours, context-driven
school, software attacks, risk-based testing
Safety-critical, software engineering, CMM, standards
and methodologies, automated testing
Scant documentation, poor requirements, little time,
skilled manual testing
Systematic Ad-hoc
Formal Informal
7
The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
8
Slow feedback Fast feedback
Scripted Exploratory
Value Risk

5. The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
Some people...
The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
10

6. The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
Modelling testing
Fixed set of things to find
Some easy to find, some harder
Some “costly”, most not
We have a budget...
The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
Tool-free exploration is...
weak and slow

7. The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
13
The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
14

8. The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
15
The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
16

9. The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
Slicing the system
Diverse things to look at -
Code, Config, Data,Transactions, Environments, Logs,
Reading - and running - the existing tests
The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
Seeking meaning...

10. The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
Wicked problems
Not understood until solved
No stopping rule
Symptoms and problems are hard to distinguish
No exhaustively describable set of solutions or permissible
operators
20

11. The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
Surprises in the
Modern World
The Search for Surprises
© Workroom Productions 2013
www.workroom-productions.com
James Lyndsay, @workroomprds
EuroSTARonline Software Testing Summit, September 2013
www.eurostarconferences.com
@esconfs #esconfs
22
James Lyndsay
@workroomprds
jdl@workroom-productions.com
www.workroom-productions.com
Want more?