An overview of SOASTA\'s CloudTest

1. Company & Solution Overview

2. Attendees
Matt McDonald, Director of Sales
Ed Salazar, Performance Engineering

3. Agenda
Introduction to Cloud Testing
Demonstration of Analytic Dashboards

4. SOASTA
The Leader in Cloud Based Performance Testing
Enterprise-class Customers
First Cloud Testing Company (2007)
First 1M User Web Test Ever Performed
Provisioned Over 250,000 Cloud Servers
Tested Over 10,000 Hours in the Cloud
AWARD Winning Technology:
Top Ten New Cloud Services (IW)
Best Cloud Application (IT Mgmt)
Visionary Leader MQ (Gartner)

5. What is CloudTest?
Game Changer For Testing Web/Cloud Services
The FIRST Cloud Service for Performance Testing
Public Cloud (On-Demand Test Service)
Why SOASTA
Speed (Procure to test in days or hours)
Affordability
Technology (Load Generators & Analytics)

6. Cloud Testing
Load Generation – Public Cloud

7. How On Demand CloudTesting Works
Test Setup
SOASTA team creates user scenarios (specified by customer)
SOASTA team builds test
• Test type (load, stress, performance), ramp speed, duration
The Cloud Test
SOASTA provisions the required load servers/locations
CloudTest (SSH or agent) monitors all aspects of network, system, and applications
CloudTest is pointed at targeted application and testing begins
Results and Analytics
CloudTest real-time dashboards begin presenting “live” test results and analysis
SOASTA performance engineers review with customer “live” data as test is running
SOASTA team delivers a full written report, including screenshots following full test cycle

8. Real Time Analytics enabled by CloudTest Monitoring
net
MOST POPULAR METRICS
Response Time (avg-min-max)
Send/Receive Rate
Error Rate
Completion Time by Scenario
Bytes Sent and receive by scenario
Response Time by Transaction Type
Top Ten Messages, response time
Top Ten Messages by error count
Count of Virtual users by time
CPU Utilization
Per Process CPU
Memory Usage
Disk I/O read write
Network Data Received/sent
App Server Connections
App Server JVM Heap Size
App Server JVM Heap Usage
App Server JVM Thread Count
App Server j2EE Servlet Request
Data Base Connections
Data Base Commits
Data Base Rollbacks

9. Cloud Testing
Changing How We Test Web Sites Forever