SlideShare une entreprise Scribd logo
1  sur  27
Télécharger pour lire hors ligne
K3
Keynote
10/2/2013 4:30:00 PM

"Lightning Strikes the Keynotes"
Presented by:
Lee Copeland
Software Quality Engineering

Brought to you by:

340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
Lee Copeland
Software Quality Engineering
With more than thirty years of experience as an information systems professional at commercial
and nonprofit organizations, Lee Copeland has held technical and managerial positions in
applications development, software testing, and software process improvement. Lee has
developed and taught numerous training courses on software development and testing issues
and is a well-known speaker with Software Quality Engineering. Lee presents at software
conferences in the United States and abroad.
9/23/2013

Lightning Strikes
The Keynotes

Moderated by

Lee Copeland
lee@sqe.com

Featuring

James Bach

Jon Bach

Rob Sabourin

Dawn Haynes

Melissa Tondi

Bill Curtis

Julie Gardiner and
Pablo Garcia Munos

Geoff Horne

Jennifer Bonine

Hans Buwalda

Griffin Jones

Clinton Sprauve

Pradeep Soundararajan

Matt Heusser

1
9/23/2013

James Bach

2
9/23/2013

Jon Bach

3
9/23/2013

Julie Gardiner
and
Pablo Garcia
Munos

4
9/23/2013

Jennifer Bonine

5
9/23/2013

Hans Buwalda

Misconceptions of
Test Automation
(and keyword testing)

Hans Buwalda

6
9/23/2013

" automation is easy, no need to think
about it much "

Comments:


I'm still waiting to see my first "easy" automation project



Development is hard, testing is harder, automated testing is the
hardest



If you can't do automation well, be ready to lose time and money



However, if you can do automated testing well... good for time-tomarket, good for quality-to-market, good for business bottom line



Timely automated functional testing is particularly also a holy grail
for agile projects ("same sprint")

" test automation means automating
manual tests "

Comments:

+

=



A car is not the same as a carriage with an engine



Good automated testing is not the same as good automation of good
manual testing



Automating manual test designs tends to be cumbersome, uninspiring,
maintenance sensitive, and hard to scale



How you organize and design your tests is the main driver for automation
success

7
9/23/2013

" keywords is a method "

Comments:


Keywords are not much more than a format to write tests in, in itself
not much different from (good) coding of test cases



Some of the worst tests I have seen were keyword tests



I do believe however that keywords are just about the only way to go
for big and complex projects (in addition to exploratory testing). They
just need a method



In my approach organization of tests into "test modules" plays a
central role

Example of a method with keywords:
"Action Based Testing"
Test Module Plan

Test Module 1

Test Module 2

Objectives

Objectives

Tests

Test Module N

Tests

...

Objectives

Tests

Actions

AUTOMATION

interaction test

check prop

control

log in
log in

user name jdoe
password StarEast

window

enter
enter

business test
user

window

value

control

property

expected

log in

ok button

enabled

true

log in

password

jdoe

StarEast

first

last

brand

John
John

Renter
Renter

Ford
Escape
Chevrolet Volt

last

rent car
rent car

model

total

check bill Renter 140.42

8
9/23/2013

" to do automated testing you need to
be a good programmer "

Comments:


A C++ programmer who is working on an airplane control system is not
therefore automatically a good airline pilot



A good programmer is not automatically a good tester, or vice versa


I therefore don't believe we should replace all testers with "developers in test"



Successful automation depends much more on test design and test
organization than on technical skills



Even automation itself is a craft that is different from regular programming

" you need an ROI analysis to
determine which tests to automate "

Comments:

$
$ $$ $ $ $
$ $ $ $$
$ $ $ $
$ $



One of the most commonly found statements on test automation



In my view, in a good automated testing effort, the automation itself is
a secondary practical matter



I therefore prefer to see an ROI on the tests themselves, rather than
on their automation

(ROI stands for "Return On Investment")

9
9/23/2013

" automated tests are dumb "

Comments:


It is the responsibility of the testers to ensure tests are not dumb



lame tests are not likely to find interesting bugs
automation is not an excuse



True is that automated tests are often mechanical and boring, but they
don't have to be



Try to be focused, smart, and mean to the system under test . . .



To help: distinguish between an analytical activity ("what to test") and
creative activity ("how to test")

" homework "

Are these misconceptions ???


" if there are automation problems, debug your automated tests"



"test automation is the same as programming"



"the most important activity in an automation effort is selecting a tool"



"automation is most suitable for regression testing"



"test automation is a technical challenge"



"if you use keywords your test automation will be successful"



"to have more automation, you just need more people"

10
9/23/2013

Rob Sabourin

11
9/23/2013

Dawn Haynes

12
9/23/2013

Geoff Horne

13
9/23/2013

Griffin Jones

WREST
Workshop on Regulated Software Testing

Software subject to review by
an internal or external regulatory body

14
9/23/2013

More Information
 Next WREST: October 4th 2013
 Contact:
John McConda, Griffin Jones
 Website: wrestworkshop.com

A Simple Tool …

15
9/23/2013

Blank Poster Paper
What is Meaningful To You
Quotes or Memory Triggers

Information Radiator
Easily Accessible (Digitize it)
Listen for the Music it is Singing to You

16
9/23/2013

17
9/23/2013

18
9/23/2013

19
9/23/2013

Clinton Sprauve

20
9/23/2013

Melissa Tondi

21
9/23/2013

Bill Curtis

22
9/23/2013

Pradeep Soundararajan

23
9/23/2013

Matt Heusser

24
9/23/2013

Our Thanks To

James Bach

Jon Bach

Rob Sabourin

Dawn Haynes

Melissa Tondi

Bill Curtis

Julie Gardiner and
Pablo Garcia Munos

Geoff Horne

Jennifer Bonine

Hans Buwalda

Griffin Jones

Clinton Sprauve

Pradeep Soundararajan

Matt Heusser

25

Contenu connexe

En vedette

Bad Testing Metrics—and What To Do About Them
Bad Testing Metrics—and What To Do About ThemBad Testing Metrics—and What To Do About Them
Bad Testing Metrics—and What To Do About Them
TechWell
 

En vedette (18)

Requirements Engineering: A Practicum
Requirements Engineering: A PracticumRequirements Engineering: A Practicum
Requirements Engineering: A Practicum
 
Sprint Reviews that Attract, Engage, and Enlighten Stakeholders
Sprint Reviews that Attract, Engage, and Enlighten StakeholdersSprint Reviews that Attract, Engage, and Enlighten Stakeholders
Sprint Reviews that Attract, Engage, and Enlighten Stakeholders
 
The Business Analyst’s Critical Role in Agile Projects
The Business Analyst’s Critical Role in Agile ProjectsThe Business Analyst’s Critical Role in Agile Projects
The Business Analyst’s Critical Role in Agile Projects
 
Agile Project Failures: Root Causes and Corrective Actions
Agile Project Failures: Root Causes and Corrective ActionsAgile Project Failures: Root Causes and Corrective Actions
Agile Project Failures: Root Causes and Corrective Actions
 
Building an Enterprise Performance and Load Testing Infrastructure
Building an Enterprise Performance and Load Testing InfrastructureBuilding an Enterprise Performance and Load Testing Infrastructure
Building an Enterprise Performance and Load Testing Infrastructure
 
Building Customer Feedback Loops: Learn Quicker, Design Smarter
Building Customer Feedback Loops: Learn Quicker, Design SmarterBuilding Customer Feedback Loops: Learn Quicker, Design Smarter
Building Customer Feedback Loops: Learn Quicker, Design Smarter
 
Presenting Test Results with Clarity and Confidence
Presenting Test Results with Clarity and ConfidencePresenting Test Results with Clarity and Confidence
Presenting Test Results with Clarity and Confidence
 
Agile Release Planning, Metrics, and Retrospectives
Agile Release Planning, Metrics, and RetrospectivesAgile Release Planning, Metrics, and Retrospectives
Agile Release Planning, Metrics, and Retrospectives
 
Automated Performance Profiling with Continuous Integration
Automated Performance Profiling with Continuous IntegrationAutomated Performance Profiling with Continuous Integration
Automated Performance Profiling with Continuous Integration
 
Leading Change―Even If You’re Not in Charge
Leading Change―Even If You’re Not in ChargeLeading Change―Even If You’re Not in Charge
Leading Change―Even If You’re Not in Charge
 
Emotional Intelligence in Software Testing
Emotional Intelligence in Software TestingEmotional Intelligence in Software Testing
Emotional Intelligence in Software Testing
 
Usability Testing: Personas, Scenarios, Use Cases, and Test Cases
Usability Testing: Personas, Scenarios, Use Cases, and Test CasesUsability Testing: Personas, Scenarios, Use Cases, and Test Cases
Usability Testing: Personas, Scenarios, Use Cases, and Test Cases
 
Continuous Delivery at Ancestry.com
Continuous Delivery at Ancestry.comContinuous Delivery at Ancestry.com
Continuous Delivery at Ancestry.com
 
Agile Estimation and Planning: Scrum, Kanban, and Beyond
Agile Estimation and Planning: Scrum, Kanban, and BeyondAgile Estimation and Planning: Scrum, Kanban, and Beyond
Agile Estimation and Planning: Scrum, Kanban, and Beyond
 
Bad Testing Metrics—and What To Do About Them
Bad Testing Metrics—and What To Do About ThemBad Testing Metrics—and What To Do About Them
Bad Testing Metrics—and What To Do About Them
 
Acceptance Test-driven Development: Mastering Agile Testing
Acceptance Test-driven Development: Mastering Agile TestingAcceptance Test-driven Development: Mastering Agile Testing
Acceptance Test-driven Development: Mastering Agile Testing
 
Usability Testing in a Nutshell
Usability Testing in a NutshellUsability Testing in a Nutshell
Usability Testing in a Nutshell
 
Find Requirements Defects to Build Better Software
Find Requirements Defects to Build Better SoftwareFind Requirements Defects to Build Better Software
Find Requirements Defects to Build Better Software
 

Similaire à Keynote: Lightning Strikes the Keynotes

Software testing 2012 - A Year in Review
Software testing 2012 - A Year in ReviewSoftware testing 2012 - A Year in Review
Software testing 2012 - A Year in Review
Johan Hoberg
 
Marlabs test digest Sep 2014
Marlabs test digest Sep 2014Marlabs test digest Sep 2014
Marlabs test digest Sep 2014
Marlabs
 
CHAPTER 1 BASIC CONCEPTS AND PRELIMINARIES
CHAPTER 1 BASIC CONCEPTS AND PRELIMINARIESCHAPTER 1 BASIC CONCEPTS AND PRELIMINARIES
CHAPTER 1 BASIC CONCEPTS AND PRELIMINARIES
Samruddhi Sheth
 
5-Ways-to-Revolutionize-Your-Software-Testing
5-Ways-to-Revolutionize-Your-Software-Testing5-Ways-to-Revolutionize-Your-Software-Testing
5-Ways-to-Revolutionize-Your-Software-Testing
Mary Clemons
 
SbE - Requirements in an agile process
SbE - Requirements in an agile processSbE - Requirements in an agile process
SbE - Requirements in an agile process
Chris Schotanus
 

Similaire à Keynote: Lightning Strikes the Keynotes (20)

Software testing 2012 - A Year in Review
Software testing 2012 - A Year in ReviewSoftware testing 2012 - A Year in Review
Software testing 2012 - A Year in Review
 
Agile testing coach Agile Lean Ireland 2017
Agile testing coach   Agile Lean Ireland 2017Agile testing coach   Agile Lean Ireland 2017
Agile testing coach Agile Lean Ireland 2017
 
software testing
software testingsoftware testing
software testing
 
Marlabs test digest Sep 2014
Marlabs test digest Sep 2014Marlabs test digest Sep 2014
Marlabs test digest Sep 2014
 
CHAPTER 1 BASIC CONCEPTS AND PRELIMINARIES
CHAPTER 1 BASIC CONCEPTS AND PRELIMINARIESCHAPTER 1 BASIC CONCEPTS AND PRELIMINARIES
CHAPTER 1 BASIC CONCEPTS AND PRELIMINARIES
 
Test Automation
Test AutomationTest Automation
Test Automation
 
Psychology and Engineering of Testing
Psychology and Engineering of TestingPsychology and Engineering of Testing
Psychology and Engineering of Testing
 
The productivity of testing in software development life cycle
The productivity of testing in software development life cycleThe productivity of testing in software development life cycle
The productivity of testing in software development life cycle
 
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
Ben Walters - Creating Customer Value With Agile Testing - EuroSTAR 2011
 
Software Tester Job Roles and Responsibilities
Software Tester Job Roles and ResponsibilitiesSoftware Tester Job Roles and Responsibilities
Software Tester Job Roles and Responsibilities
 
Agile testing
Agile testingAgile testing
Agile testing
 
Sprinkle on Just Enough Process
Sprinkle on Just Enough ProcessSprinkle on Just Enough Process
Sprinkle on Just Enough Process
 
5-Ways-to-Revolutionize-Your-Software-Testing
5-Ways-to-Revolutionize-Your-Software-Testing5-Ways-to-Revolutionize-Your-Software-Testing
5-Ways-to-Revolutionize-Your-Software-Testing
 
Automation testing: how tools are important?
Automation testing: how tools are important?Automation testing: how tools are important?
Automation testing: how tools are important?
 
Test automation Anecdotes
Test automation AnecdotesTest automation Anecdotes
Test automation Anecdotes
 
The Developer’s Guide to Test Automation
The Developer’s Guide to Test AutomationThe Developer’s Guide to Test Automation
The Developer’s Guide to Test Automation
 
Intelligent Mistakes in Test Automation
Intelligent Mistakes in Test AutomationIntelligent Mistakes in Test Automation
Intelligent Mistakes in Test Automation
 
A Complete Guide to Codeless Testing.pdf
A Complete Guide to Codeless Testing.pdfA Complete Guide to Codeless Testing.pdf
A Complete Guide to Codeless Testing.pdf
 
SbE - Requirements in an agile process
SbE - Requirements in an agile processSbE - Requirements in an agile process
SbE - Requirements in an agile process
 
Graham Thomas - Software Testing Secrets We Dare Not Tell - EuroSTAR 2013
Graham Thomas - Software Testing Secrets We Dare Not Tell - EuroSTAR 2013Graham Thomas - Software Testing Secrets We Dare Not Tell - EuroSTAR 2013
Graham Thomas - Software Testing Secrets We Dare Not Tell - EuroSTAR 2013
 

Plus de TechWell

Plus de TechWell (20)

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
 
Ma 15
Ma 15Ma 15
Ma 15
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
 

Dernier

CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 

Dernier (20)

Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 

Keynote: Lightning Strikes the Keynotes

  • 1. K3 Keynote 10/2/2013 4:30:00 PM "Lightning Strikes the Keynotes" Presented by: Lee Copeland Software Quality Engineering Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
  • 2. Lee Copeland Software Quality Engineering With more than thirty years of experience as an information systems professional at commercial and nonprofit organizations, Lee Copeland has held technical and managerial positions in applications development, software testing, and software process improvement. Lee has developed and taught numerous training courses on software development and testing issues and is a well-known speaker with Software Quality Engineering. Lee presents at software conferences in the United States and abroad.
  • 3. 9/23/2013 Lightning Strikes The Keynotes Moderated by Lee Copeland lee@sqe.com Featuring James Bach Jon Bach Rob Sabourin Dawn Haynes Melissa Tondi Bill Curtis Julie Gardiner and Pablo Garcia Munos Geoff Horne Jennifer Bonine Hans Buwalda Griffin Jones Clinton Sprauve Pradeep Soundararajan Matt Heusser 1
  • 8. 9/23/2013 Hans Buwalda Misconceptions of Test Automation (and keyword testing) Hans Buwalda 6
  • 9. 9/23/2013 " automation is easy, no need to think about it much " Comments:  I'm still waiting to see my first "easy" automation project  Development is hard, testing is harder, automated testing is the hardest  If you can't do automation well, be ready to lose time and money  However, if you can do automated testing well... good for time-tomarket, good for quality-to-market, good for business bottom line  Timely automated functional testing is particularly also a holy grail for agile projects ("same sprint") " test automation means automating manual tests " Comments: + =  A car is not the same as a carriage with an engine  Good automated testing is not the same as good automation of good manual testing  Automating manual test designs tends to be cumbersome, uninspiring, maintenance sensitive, and hard to scale  How you organize and design your tests is the main driver for automation success 7
  • 10. 9/23/2013 " keywords is a method " Comments:  Keywords are not much more than a format to write tests in, in itself not much different from (good) coding of test cases  Some of the worst tests I have seen were keyword tests  I do believe however that keywords are just about the only way to go for big and complex projects (in addition to exploratory testing). They just need a method  In my approach organization of tests into "test modules" plays a central role Example of a method with keywords: "Action Based Testing" Test Module Plan Test Module 1 Test Module 2 Objectives Objectives Tests Test Module N Tests ... Objectives Tests Actions AUTOMATION interaction test check prop control log in log in user name jdoe password StarEast window enter enter business test user window value control property expected log in ok button enabled true log in password jdoe StarEast first last brand John John Renter Renter Ford Escape Chevrolet Volt last rent car rent car model total check bill Renter 140.42 8
  • 11. 9/23/2013 " to do automated testing you need to be a good programmer " Comments:  A C++ programmer who is working on an airplane control system is not therefore automatically a good airline pilot  A good programmer is not automatically a good tester, or vice versa  I therefore don't believe we should replace all testers with "developers in test"  Successful automation depends much more on test design and test organization than on technical skills  Even automation itself is a craft that is different from regular programming " you need an ROI analysis to determine which tests to automate " Comments: $ $ $$ $ $ $ $ $ $ $$ $ $ $ $ $ $  One of the most commonly found statements on test automation  In my view, in a good automated testing effort, the automation itself is a secondary practical matter  I therefore prefer to see an ROI on the tests themselves, rather than on their automation (ROI stands for "Return On Investment") 9
  • 12. 9/23/2013 " automated tests are dumb " Comments:  It is the responsibility of the testers to ensure tests are not dumb   lame tests are not likely to find interesting bugs automation is not an excuse  True is that automated tests are often mechanical and boring, but they don't have to be  Try to be focused, smart, and mean to the system under test . . .  To help: distinguish between an analytical activity ("what to test") and creative activity ("how to test") " homework " Are these misconceptions ???  " if there are automation problems, debug your automated tests"  "test automation is the same as programming"  "the most important activity in an automation effort is selecting a tool"  "automation is most suitable for regression testing"  "test automation is a technical challenge"  "if you use keywords your test automation will be successful"  "to have more automation, you just need more people" 10
  • 16. 9/23/2013 Griffin Jones WREST Workshop on Regulated Software Testing Software subject to review by an internal or external regulatory body 14
  • 17. 9/23/2013 More Information  Next WREST: October 4th 2013  Contact: John McConda, Griffin Jones  Website: wrestworkshop.com A Simple Tool … 15
  • 18. 9/23/2013 Blank Poster Paper What is Meaningful To You Quotes or Memory Triggers Information Radiator Easily Accessible (Digitize it) Listen for the Music it is Singing to You 16
  • 27. 9/23/2013 Our Thanks To James Bach Jon Bach Rob Sabourin Dawn Haynes Melissa Tondi Bill Curtis Julie Gardiner and Pablo Garcia Munos Geoff Horne Jennifer Bonine Hans Buwalda Griffin Jones Clinton Sprauve Pradeep Soundararajan Matt Heusser 25