Presentation on performance testing. Presented at www.testing.uy.

1. HOW TO TESTHOW TO TEST
PERFORMANCEPERFORMANCE
AND NOT DIE TRYINGAND NOT DIE TRYING
Diego CardozoDiego Cardozo
Sr. Web Performance EngineerSr. Web Performance Engineer
@NetSuite @diecard@NetSuite @diecard

2. AgendaAgenda
Why it mattersWhy it matters
What to testWhat to test
How to testHow to test

3. Why it mattersWhy it matters
Why is performance important for our business?
: 2% slower = 2% less searches/user
: 400 ms faster = 9% more traffic
: 100ms faster = 1% more revenue
: 5s faster
25% more site visits
7 to 12% more revenue
takes load times into account when
ranking a site
Google
Yahoo
Amazon
Shopzilla
Google

4. Why it mattersWhy it matters
Why is performance important for ourselves?
"The best part about performance"The best part about performance
testing is how much you learn abouttesting is how much you learn about
technology in general"technology in general"

5. What to testWhat to test
What should we measure?
Response times and speedResponse times and speed
How much load we can handleHow much load we can handle
How the system behavesHow the system behaves

6. What to testWhat to test
Have a goal in mind - 3 alternatives
Performance budget
Business-specific goal
Twitter's "time to first tweet"
Google's RAIL model

7. How to testHow to test
First rule
1. Measure1. Measure
2. Optimize2. Optimize

8. How to testHow to test
Second rule

9. How to testHow to test
Alternatives
Emulate a browser, run a test case and record
response times for each request
Passively send performance information directly
from the user's application
Synthetic monitoringSynthetic monitoring
Real user monitoring (RUM)Real user monitoring (RUM)

10. How to testHow to test
Synthetic monitoring
Tools
(free, web)
(free, web)
(free/paid, web)
(paid, web)
(free/paid, mobile)
WebPage Test
Google PageSpeed Insights
StatusCake
Keynote/Dynatrace
Monkop

11. How to testHow to test
Real user monitoring
If RUM tools are used during testing, you can go live
with know how on how to interpret the results
Tools
(free, web/mobile)
(free/paid, web)
, (free/paid, web)
(paid, mobile)
Google Analytics
StatusCake
NewRelic Pingdom
HP AppPulse

12. ResourcesResources
Link to slides
RAIL
Microsoft's performance testing guidelines
diegocard.com/testinguy
http://bit.ly/rail-performance
http://bit.ly/microsoft-performance
dcardozo@netsuite.comdcardozo@netsuite.com
@diecard@diecard