Webinar slides from SOASTA and AppDynamics presentation on production performance testing, monitoring and real time analysis.

1. PERFORMANCE:
Where Real-Time Testing & Production
Monitoring Converge

2. Performance Issues Know No Borders
Trouble spans teams, time and scale
Exhausted Connection Pool
Network Network configuration
Capacity limits
& Ops
Hung JVM
CDN file placement
Conflict with other apps
DNS routing
Stage / Team
Load Balancer configuration
OutOfMemoryException
Auto-scaling failures
Unbalanced web servers
Max sockets exceeded
Release
& Deploy Slow third-party plug-ins s Synchronization Latency
Security bottlenecks
Caching issues and benefits
Search technology limits
Default configuration settings
Garbage collection Inadequate server resources
Reality? Any
Memory leaks
Memory leaks
Database thread counts
issue can occur
Dev
& Test
Slow pages
Inefficient database queries
in production!
Code bugs
Method-level tuning
Test Lab Staging Production (100% +++)
Scale and Time

3. Old Way: Performance Testing Has Been a
Lab Exercise
DEPLOY
Dev & Test Lab Production Environment
Status Quo: Performance Testing Challenges:
Small test window prior
to release • Linear, multi-step approaches
• Non-correlated, offline analysis
• Disconnected teams
Analyze • Costly test hardware
• Tune Code
• Build Test
• Adjust • Non-scalable performance tools
• Setup • Collect
Environment Metrics
Settings
• Time-intensive setup
• Find Issues
Run Fix • Inability to hit realistic scale
Time-consuming testing limits
deployment options

4. Old Way: Problem Isolation Has Been a
Lab Exercise
DEPLOY
Dev & Test Lab Production Environment
Status Quo: Problem Isolation Challenges:
Applications still crash
and run slow in prod •Agile methodology increases change
• SOA increases complexity
• Data volumes differ from prod
Analyze •Hardware specs differ from prod
• Fix Code
• Build Test
• Optimize • Profilers slow application down
• Setup • Response
Environment Times
Configuration
•Reliability over Scalability
• Exceptions
Run Fix
Make the application stable

5. What’s Changed?
Agile development cycles compress test cycles
• Days vs. weeks
• Incomplete knowledge transfer from Dev to Test to Ops
• Difficult to simulate every user session variation
Production environments are difficult to replicate
• Horizontal scaling requires many commodity servers
• Transaction volumes have Increased with Web & mobile commerce
• Large data sets are difficult to replicate
Costly to simulate peak loads in test environments
• Performance testing & optimization need to change, too…

6. New Way: Test & Monitor your Applications
from Lab into Production
Dev & Test Lab Production Environment
Start Isolate & fix Hit expected Detect
Recheck Solve issues
small, early to performance scale in problems in
regularly for as they occur
root out code- issues in the staging and both real and
regression in the
level issues lab maintenance synthetic
and capacity lifecycle
windows sessions

7. Everyone Wants to be Agile
Old Way New Way
(dev/test) (production)
Load Testing Weeks
Hours
Isolate Problems Hours
Minutes
Traditional Approaches
TEST BUILDING HW Setup TEST ANALYZE FIX RETEST REPEAT?
TIME
BUILD H
W
TEST H
W
TEST H
W
TEST H
W
TEST H
W
TEST
Extra
ANALYZE ANALYZE ANALYZE ANALYZE ANALYZE
S FIX S S S S
time!
FIX FIX FIX FIX
e e e e e
t t t t t
u
p
u
p
Agile Performance Approach
u
p
u
p
u
p

8. “But, Testing in Production Is SCARY!”
(Isn’t it?)
It is when Key Criteria eliminate never intended for
These using tools & approaches RISK & make
Production Testing a critical requirement!
the complexity & magnitude of modern environments
CONTROL–
Stop, Start, Modify, Pause user
traffic as tests run
REAL TIME ANALYSIS – access
to all performance info as issues
occur
SCALE– simulate any number of
geographically disperse users
SPEED – able to deploy and gain
insight within minutes

9. Q&A
Try us for FREE:
http://www.appdynamics.com/free
http://www.soasta.com/cloudtest/lite
Questions & Answers will post on CloudLink:
http://cloudlink.soasta.com
Previous & Upcoming Webinars:
http://www.soasta.com/info-center/webinars/
Contact SOASTA: Contact AppDynamics
www.soasta.com/cloudtest/ www.appdynamics.com
info@soasta.com info@appdynamics.com
866.344.8766 415-442-8400
Follow us: Follow us:
twitter.com/cloudtest twitter.com/appdynamics
facebook.com/cloudtest facebook.com/appdynamics