2. What does LoadRunner offer ?
TruClient etc. easier scripting. Simple record / replay
Multi-protocol support, unlike competition.
Single tool for Mobile, Ajax, Flex, HTML (5) .Net, Java, Silverlight, SOAP, Citrix, ERP and legacy applications
Browser and mobile device emulation built in.
Options to extend testing with network and service virtualisation.
Various cloud options:
Integration with Amazon & HP Cloud or other third parties. SaaS options with StormRunnerand Performance Centre.
Integration with multiple IDEs as well as CI and automated build systems.
Real time analytics built in, options to extend with SiteScope.
Diagnostic tool support, HP Diagnostics & third party tools.
Excellent reporting.
3. LoadRunner and related products
LoadRunner6.0
PerformanceCenter
9.0
1990s
On-Premise
In-cloud
2006
PerformanceCenter
LoadRunner in the CloudV1
2008
2010
2014
StormRunner
LoadRunner in the CloudV2
LoadRunner8.0
LoadRunner9.0
2012
LoadRunner11.0
LoadRunner12.0
PerformanceCenter
11.0
PerformanceCenter
12.0
4. StormRunner
LoadRunner in the CloudV2
LoadRunner12.0
PerformanceCenter
12.0
LoadRunner and related products
Best of breed performance test tool
Integrates with other ALM products
Multi-protocol support, excellent reporting capabilities
Alternative to LoadRunner (on-premise)
On-demand licensing and hardwareDetailed reportingMulti-protocol support
Cloud onlyOn demand usage
Uses standard LoadRunner scripts (web only) Less detailed reporting but great for “burst testing”
Enterprise testingBetter integration with HP ALM suite
Dashboards, shared assets, ideal for global “follow the sun” operations
5. Which tool should I choose?
•Application Under Test
•Commsprotocols
•vUser numbers
•vUser locations
•Tester locations
•Tester skillset
•Existing test assets
•Script complexity
•Test data requirements
•Security
•Budget
•Timescales
•Cloud?
Decision factors
6. Choosing a cloud-based test tool
StormRunner
LoadRunner in the Cloud
LoadRunner12.0
PerformanceCenter
SaaS
PerformanceCenter
On-premise
Load Generators
Load Generators
12. Remote testers
StormRunner
LoadRunner
12.0
Performance
Center
SaaS
Performance
Center
On-premise
Remote tester
Remote tester
LoadRunner
in the Cloud
13. So which product should I choose?
StormRunner
LoadRunner in the Cloud
LoadRunner
PerformanceCenter
Quick, high volume tests
Web only
Remote load generation
Short-term engagement (s)
Any protocol
Remote and local load generationAdvanced use e.g. NV, diagnostics etc.
More frequent testing
C of E approach
Remote and local load generationDetailed reporting and analysisOn-site testers
Very frequent testing
Larger C of E / “follow the sun”
Dashboard for stakeholders
Integration with ALM etc.
14. LoadRunner in the Cloud
Web-based VM admin console
•Pre-built servers
•Controllers and Load Generators
•CPU / RAM / HDD user configurable
•With or without firewall support
•LGs can be anywhere
•NV support built in
•UFT and other software available
•Different license options
•100, 200 & 500 vUsers
•All protocols supported
•On-demand availability and pricing
•PayPal or Account
•Pay for what you use
•Efficient license use
15. Is “The Cloud” any good for testing?
“Cloud computing is a model for enabling convenient, on-demandnetwork access to a shared pool of configurable computing resources that can be rapidly provisionedand released with minimal management effortor service provider interaction.”
Source: The National Institute of Standards and Technology
BUT….
•Unproven technology for testing: reliability/repeatability
•Steep learning curve
•Costs difficult to quantify
•Security concerns
•Performance
19. Is “The Cloud” any good for testing?
Realism
Repeatability
But how will itreally perform?
Did my change make a difference?
Avoid pitfalls
Repeat tests to obtain average results
Re-validate tests with in physicaltest environments
Use diagnostics software to drill down into application performance…..better application understanding is vital
Use benefits of the cloud/virtualisation
Low cost
On-demand
Flex up & down
Over provision