The benefits of using an APM solution while performance testing
•Télécharger en tant que PPTX, PDF•
6 j'aime•7,307 vues
The benefits of using an APM solution while performance testing or "why load testing without APM is like Corona without the lime...". The deck covers a brief overview of APM, the market & major players, and 4 key benefits from using APM tools during your performance testing cycle.
Recommandé
Recommandé
Contenu connexe
Tendances
Tendances (20)
En vedette
En vedette (8)
Similaire à The benefits of using an APM solution while performance testing
Similaire à The benefits of using an APM solution while performance testing (20)
Plus de DevOpsGroup
Plus de DevOpsGroup (20)
Dernier
Dernier (20)
The benefits of using an APM solution while performance testing
- 1. DevOpsGuys The benefits of using an APM solution while performance testing Why Perf testing without APM is like Corona without the Lime… @DevOpsGuys DevOpsGuys www.devopsguys.com 1
- 3. Perf Testing & APM in 30mins • • • • • Why Performance Test? What is APM anyway? Benefits of APM when Perf Testing With some case studies along the way! Q&A @DevOpsGuys DevOpsGuys www.devopsguys.com 3
- 4. Why Performance Test? 1. Ensure that we meet our customer’s expectations of website response time – So that they convert and we make £££ 2. Ensure that we have sufficient computing capacity to meet #1 under load (load testing) 3. Understand how the system reacts when things go wrong (stress testing) @DevOpsGuys DevOpsGuys www.devopsguys.com 4
- 6. APM Defined “In the fields of information technology and systems management, application performance management (APM), is the monitoring and managing of performance and availability of software applications. APM strives to detect and diagnose application performance problems to maintain an expected level of service. APM is the translation of IT metrics into business meaning (i.e. value).” http://en.wikipedia.org/wiki/Application_Performance_Management @DevOpsGuys DevOpsGuys www.devopsguys.com 6
- 7. “5 Dimensions of APM*” 1. End user experience monitoring - (Active and passive) 2. Application runtime architecture discovery and modeling 3. User-defined transaction profiling (also called business transaction management) 4. Application component monitoring 5. Reporting & Application data analytics *According to Gartner @DevOpsGuys DevOpsGuys www.devopsguys.com 7
- 8. Gartner APM Magic Quadrant 2013 2012 2011 IBM Riverbed CA Compuware Oracle Quest Opnet Microsoft BM Dell SL C New Relic HP AppDynamics OpTier Inetco AppNeta NetScout Precise Progress Managed Engine eG Innovations Network Instruments Idera Visual networks ASG Correlsense Nastel Coradient Aternity Knoa Info vista OpTier Arctures Technologies @DevOpsGuys DevOpsGuys www.devopsguys.com
- 9. Never leave home without it… BENEFITS OF LOAD TESTING WITH APM TOOLS @DevOpsGuys DevOpsGuys www.devopsguys.com 9
- 10. #1 See the Big Picture (aka Systems Thinking) @DevOpsGuys DevOpsGuys www.devopsguys.com 10
- 11. Systems Thinking 101 “Systems thinking is a framework for seeing interrelationships rather than things, for seeing patterns rather than static snapshots. It is a set of general principles spanning fields as diverse as physical and social sciences, engineering and management.” Peter Senge @DevOpsGuys DevOpsGuys www.devopsguys.com 11
- 12. Command & Control vs Systems Thinking @DevOpsGuys DevOpsGuys http://www.systemsthinking.co.uk/2-1.asp www.devopsguys.com 12
- 13. “any improvement not made at the constraint is an illusion” CASE STUDY #1 2 WEEKS WASTED… @DevOpsGuys DevOpsGuys www.devopsguys.com 13
- 14. The Scenario E-commerce customer New website High data-start times on page load Poor load testing results Initial conversation with client 2 week delay while hosting provider scaled out the hardware… • Problem still not fixed… • • • • • • @DevOpsGuys DevOpsGuys www.devopsguys.com 14
- 15. Waterfall Diagram of page load times What’s the root cause of the ~1sec Data Start? @DevOpsGuys DevOpsGuys www.devopsguys.com 15
- 17. #2 Drill down to the Detail (Code-level) @DevOpsGuys DevOpsGuys www.devopsguys.com 17
- 18. Find the slow code! @DevOpsGuys DevOpsGuys www.devopsguys.com 18
- 19. #3 Faster Iteration = Better Value @DevOpsGuys DevOpsGuys www.devopsguys.com 19
- 21. 9am to 9pm. 12hrs. 56x faster! CASE STUDY #1 56X FASTER IN A DAY… @DevOpsGuys DevOpsGuys www.devopsguys.com 21
- 22. The Scenario • • • • • New website pre-launch testing Customer Portal (SaaS solution) Start Load testing 9am 4 “Test & Fix” cycles in the day Final testing completed at 9pm @DevOpsGuys DevOpsGuys www.devopsguys.com 22
- 23. The End Results = 56x Throughput (Req/sec) 16/min 59/min 56x faster Initial Testing Final Result Average Response 3024ms 54ms 3.5x throughput Before 3024ms @DevOpsGuys DevOpsGuys After 54ms www.devopsguys.com 23
- 25. #4 Team Work “The Enemy is Performance, not each other…” @DevOpsGuys DevOpsGuys www.devopsguys.com 25
- 29. Summary 1. 2. 3. 4. See the Big Picture (systems thinking) Drill down to the details Faster Iteration = Better Value Stop the “Blame Game” – aka “There’s your Problem!” @DevOpsGuys DevOpsGuys www.devopsguys.com 29
- 30. DevOpsGuys Thank You Workshop Session @ 1345 End-to-end testing & APM demo operations | availability | performance | scalability | migration | strategy @DevOpsGuys DevOpsGuys www.devopsguys.com 30
- 31. What We Do DevOpsGuys provide development & operations support (DevOps) services for your online applications. You run your business. We run your website. It’s as simple as that. @DevOpsGuys DevOpsGuys www.devopsguys.com 31
- 32. Our service portfolio • 24 x 7 Application-Centric web operations • DevOps Transformation & Training • Continuous Delivery implementation • Infrastructure Automation & “Infrastructure as Code” • Application Performance Management • AppDynamics Implementation & Consultancy @DevOpsGuys • Web Performance consulting • Web monitoring • Load Testing • Test Automation and scripting • JetBrains Product Implementation & Consultancy • Octopus Deploy implementation DevOpsGuys www.devopsguys.com 32
- 33. The Leadership Team James Smith (@TheDevMgr) Steve Thair (@TheOpsMgr) • 16 years of software delivery experience. • Proven track record • 25 years of IT Operations experience. • Proven track record – – – – – – – Pizza Hut KFC Dell RAC Aviva Fujitsu Siemens Whitbread @DevOpsGuys – – – – – – – DevOpsGuys Vodafone Credit Suisse Group IBM BNP Paribas Zurich Financial Services Totaljobs Group TSL Education www.devopsguys.com 33
- 34. Contact Us Visit us at www.devopsguys.com Call our team on +44 (0)20 8798 3079 Email our engineers at team@devopsguys.com @DevOpsGuys DevOpsGuys www.devopsguys.com 34
Notes de l'éditeur
- http://www.flickr.com/photos/lendog64/5781379311/ Keeps bugs out of your applicationClear Glass bottle – stops your application “going off” once it’s deployed to productionIt’s “disinfects your performance bottlenecks” (just like lime does to the top of the bottle) It’s a cynical marketing ploy to get you buy more stuff……http://www.snopes.com/food/ingredient/lime.asp Unlike almost every other beer in the U.S. market, Corona is bottled in clear glass rather than brown or green. Those who know beer recognize that light is an enemy of the brew, turning beverages exposed to it "skunky." The lime, therefore, masks the altered taste resultant from Coronas' having been exposed to light by virtue of their packaging.Corona is a mild-tasting beverage, with the inserted lime adding its only discernable note of flavor.The provision of a lime dates to the days when metal caps sometimes left circlets of rust on the rims of beer bottles. The fruit slice was used to wipe away rust stains the brew's drinker would otherwise have been putting his lips to.Lime (or lemon) is said to work to keep flies away. In an expansion of that theory, prior to the lime slice, fly spray used to combat the flying hordes adversely affected the taste of the beer.Some bright spark who works for the brewery came up with the idea of festooning bottles of Corona with wedges of lime, both in an effort to create a more visually enticing image and to provide what might otherwise be regarded as a somewhat uninspired beer with a hint of cachet, and possibly even an intriguing (if unstated) backstory. People like both ritual and mystery, after all, and the lime provides both.On a bet with a colleague about whether a single person could start a nationwide trend, a bartender came up with the notion of shoving limes into Coronas.Read more at http://www.snopes.com/food/ingredient/lime.asp#UqW7kLTEJ2K0EmP3.99
- Senge P (1990) The Fifth Discipline – The art and practice of the learning organisation, Century Business, ISBN 0-7126-56871. Open University Website, introduction to systems thinking