metrics - performance monitoring or business value optimization?
Performance Testing [not] somebody I used to know
1. Performance Testing
“ Somebody that I used to know
- Gotye
Tuesday, 19 February 13
2. 10,000 hour rule
“The key to success in any field
is, to a large extent, a matter
of practicing a specific task for
a total of around 10,000 hours.
Tuesday, 19 February 13
3. My ‘time on the mainframe’
about 34 projects
multiplied by 3 months
each by 20 days per
month by 8 hours per
day at 20% efficiency
equals ...
Tuesday, 19 February 13
4. Knowledge vs. Time
K
How much you think you know
How much you actually know
t
Tuesday, 19 February 13
3,264 hours
6. Mostly Effective
Most performance test efforts
are effective ...
“Testing was completed”
“NFRs were met”
“We survived go-live”
Tuesday, 19 February 13
7. Rarely Efficient
Performance test efforts are
rarely efficient ...
Tuesday, 19 February 13
8. Lossiness
(lossy) characterized by or
caused by dissipation of
energy.
Tuesday, 19 February 13
9. Tools
“We waste a LOT of energy on
tools and people to execute
the performance test effort.
1,000 VU license = enough to feed a village
Tuesday, 19 February 13
10. Why so Much?
Tools are driving the process!
We are suffering from market
distortion ...
http://1.bp.blogspot.com/_T3Gqqkz9Mm0/TFEoMfpM6-I/AAAAAAAAB0o/8RslwtCum-4/s1600/tail.jpg
Tuesday, 19 February 13
11. Perfect Competition
“Describes markets such that
no participants are large
enough to have the market
power to set the price of a
homogeneous product.
http://1.bp.blogspot.com/_T3Gqqkz9Mm0/TFEoMfpM6-I/AAAAAAAAB0o/8RslwtCum-4/s1600/tail.jpg
Tuesday, 19 February 13
12. Imperfectly Competitive
At first there were few sellers
and now there are many
sellers with highly
differentiated products ...
Tuesday, 19 February 13
17. Cloud Impact?
Force Multiplier
Tuesday, 19 February 13
18. Biggest Drivers for Tools
Are costs, open and
ext endable languages,
integration with popular
test frameworks and
continuous delivery and or
deployment, access to high
level APIs, cross platform
and ease of use.
Tuesday, 19 February 13
19. How to select the right tool?
Effective & Efficient
Almost as important as the job itself.
Tuesday, 19 February 13
20. Think about the price
and cost effectiveness
Tuesday, 19 February 13
22. Think about the integration
Everything from source
control, monitoring,
communications, alerting,
deployment and beyond.
Tuesday, 19 February 13
23. Think about the protocol
HTTP 1999
XHR 2008
WebSocket 2011
Tuesday, 19 February 13
24. Environments
We spend a LOT of time
waiting for test environments
to be provisioned, patched,
restarted or deployed.
environments {start|stop|restart}
Tuesday, 19 February 13
25. Increased Burn Rate
The rate at which hours
(allocated to a project) are
being used ...
Tuesday, 19 February 13
29. Trending Now
“Let’s be *more* agile and
promote an iterative cycle that
emphasizes working products
over product specifications ...
Tuesday, 19 February 13
