Although most software companies have adopted agile development, many still treat quality assurance as something that gets handled when coding is finished and ready for test. However, practicing this reactive approach to quality costs teams in rework, context switching, slower code release cycles, growing bug queues, and the release of defects into production. Join Oscar Gracia and Todd Albers as they share techniques you can use to help change this “ready for test” mindset. Learn how to focus on testing and quality from the start by using a pre-grooming approach to ensure stories are detailed enough for developers to code. Discover how conducting developer demos can help developers themselves find bugs. Start thinking about engaging the teams QA mind early and throughout the software development lifecycle in order to ask insightful questions, uncover potential issues, and address them while the cost is low. Oscar and Todd share the tools you need to make iterative changes—both individually and within your organization—so you can shift the mindset from finding defects to preventing them.

1.
W13
Test
Management
10/4/17
15:00
A
Shift
in
Mindset:
From
Finding
Defects
to
Preventing
Them
Presented
by:
Oscar
Gracia
and
Geordie
Speake
AppFolio
Brought
to
you
by:
350
Corporate
Way,
Suite
400,
Orange
Park,
FL
32073
888-­‐-­‐-­‐268-­‐-­‐-­‐8770
·∙·∙
904-­‐-­‐-­‐278-­‐-­‐-­‐0524
-­‐
info@techwell.com
-­‐
http://www.starwest.techwell.com/

2.
Oscar
Gracia
AppFolio
In
software
quality
assurance
for
fifteen
years,
Oscar
Gracia
has
worked
in
diverse
situations—start-­‐ups
to
mature
organizations,
small
and
large
teams,
waterfall
to
agile
methodologies—to
build
a
wide
array
of
software
from
real-­‐
time
ad-­‐exchange
to
payment
system
software.
For
the
past
five
years,
Oscar
has
been
working
with
AppFolio,
focusing
on
bug
prevention
and
driving
value
for
the
customer
while
maintaining
the
team’s
agility,
as
AppFolio
matures
from
a
start-­‐
up
to
a
growing
public
company.
Geordie
Speake
AppFolio
An
engineer
with
a
background
in
test
and
quality
across
multiple
industries
and
various
company
sizes,
Geordie
Speake
has
been
a
member
of
technical
teams
focused
on
bringing
quality
products
and
solutions
to
customers
both
internal
and
external.
From
the
test
labs
of
a
large
aerospace
company
where
software
was
starting
to
be
used
to
automate
traditionally
manual
processes,
to
his
current
work
with
AppFolio’s
software
Quality
Assurance
team,
Geordie
has
seen
many
ways
teams
attempt
to
insure
bug
free
products
and
is
excited
to
share
some
of
the
things
that
he
feels
are
currently
helping
AppFolio
deliver
exceptional
customer
value.

3. 1
2016 © AppFolio, Inc. Confidential.
A Shift in Mindset from
Finding to Preventing Bugs
Presented by Oscar Gracia & Geordie Speake
2016 © AppFolio, Inc. Confidential.
“mindset” (noun)
A set of beliefs or a way of thinking that
determines one’s behaviour, outlook and
mental attitude.

4. 2
2016 © AppFolio, Inc. Confidential.
What You Should Walk Away With
2016 © AppFolio, Inc. Confidential.

5. 3
2016 © AppFolio, Inc. Confidential.
2016 © AppFolio, Inc. Confidential.
What is a Bug?
“A software bug is an error, flaw,
failure or fault in a computer
program or system that causes it
to produce an incorrect or
unexpected result, or to behave
in unintended ways.”

6. 4
2016 © AppFolio, Inc. Confidential.
What is a Bug?
Unexpected behavior that matters to someone
& there is value to someone for it to be fixed.
2016 © AppFolio, Inc. Confidential.
Where it all begins...the
Backlog

7. 5
2016 © AppFolio, Inc. Confidential.
2016 © AppFolio, Inc. Confidential.
Downside of Grooming

8. 6
2016 © AppFolio, Inc. Confidential.
Pre-Grooming
A few people work
out some basics
before an entire
team gets
together.
2016 © AppFolio, Inc. Confidential.
Technical Grooming

9. 7
2016 © AppFolio, Inc. Confidential.
Geez, you love
meetings!
● We hate long soul
sucking meetings.
● We love efficient,
focused meetings.
● When they are needed.
● On demand.
2016 © AppFolio, Inc. Confidential.
Exploratory Testing Guidelines
● Great for re-use.
● Share and discuss
● Commonly forgotten items
● Captures ideas and strategy.

10. 8
2016 © AppFolio, Inc. Confidential.
Development
2016 © AppFolio, Inc. Confidential.
Developers write all the
automated test code?
● Test code exists to insure the
production code continues
working
● Test code is production quality code
● Delivering a story includes test code

11. 9
2016 © AppFolio, Inc. Confidential.
Everyone wants quality.
Whole Team Owns Quality
2016 © AppFolio, Inc. Confidential.

12. 10
2016 © AppFolio, Inc. Confidential.
Developer Demos
★ Demo early.
★ Guided with Exploratory Testing.
★ Opportunity to find issues
before Dev moves on.
2016 © AppFolio, Inc. Confidential.

13. 11
2016 © AppFolio, Inc. Confidential.
What to Learn When a Bug Gets Out
• How could we have prevented this?
• Is it worth fixing?
• Share what you learn with the entire
team/organization
Triage
1) What’s the bug?
2) What’s the impact?
3) What’s the state of the fix?
4) What’s the risk of patching?
5) What’s the risk of not patching?
6) Should we patch?
7) What systems should we patch or
delay?
8) When should we patch?
Don’t:
- Blame
- How could we
prevent?
- Why wasn’t it
caught in XX?

14. 12
2016 © AppFolio, Inc. Confidential.
Today We Learned
Today We Learned
Very brief summary of what happened
What happened?
Give the details on what happened.
● Avoid specific names (every effort is a team effort, use position instead of name)
● Avoid judgement
● Keep the tone neutral/factual
What was the fix?
2016 © AppFolio, Inc. Confidential.
Today We Learned - Cont.
How did this issue not get caught…
…in automated tests?
…in manual testing?
…in reviewing?
…in QA/FIT?
…at runtime/lead to an exception?
What can we learn from this?

15. 13
2016 © AppFolio, Inc. Confidential.
2016 © AppFolio, Inc. Confidential.
Bugs Queue
Customer reported bugs
assigned and fixed quickly.
Make eliminating bugs queue a
priority.
Not all bugs need/should be
fixed.

16. 14
2016 © AppFolio, Inc. Confidential.
Initiating Change
2016 © AppFolio, Inc. Confidential.
How?
Small incremental changes
Low hanging fruit
Experiment is a great word
Talk to the team individually
Contrasting statements - Not Saying / I Am Saying

17. 15
2016 © AppFolio, Inc. Confidential.
What You Should Walk Away With
2016 © AppFolio, Inc. Confidential.