SlideShare une entreprise Scribd logo
1  sur  19
New Approaches to Real-Time Application
Testing and Performance Monitoring



December 15, 2011
Agenda
•   Best practices for holiday performance testing
•   New testing and monitoring techniques
•   Demo
•   Q&A
The Online Market




              You are here!
Cyber Monday 2011




          • $1.3B
          • 33% y/y growth in traffic
          • 10.8% is Mobile (3.9% last year)
iCommerce: Biggest Mobile Influence
The IT Landscape Has Changed
What is “Peak Load”?
•   100%, 200%...500%+?
•   How much mobile traffic should we prepare for…and how?


What Are The Most Important Transactions?
•   What are the most profitable paths users follow?
•   What is the affect of non-buying “browsing” on paying customers?


What System Do You Test In?
•   Is the lab good enough?
•   Production testing is taboo (isn’t it)?


How Will You Find The Issues?
•   Complexity reigns
•   How do we see where issues are at load?
The IT Landscape Has Changed
What is “Peak Load”?
•   You must to test to new limitswith a mix of web and mobile traffic



What Are The Most Important Transactions?
•   Those that you determine as profitable, complex and/or risky



What System Do You Test In?
•   Testing is a continuous process from the lab to live production



How Will You Find The Issues?
•   Monitoring during tests for the the end-to-end view while tests run
BEST PRACTICES
Monitoring best practice 1
“Assume Nothing”




                             Oops. A
                             production server!


   UAT Environment
   topology autodetected
Monitoring best practice 2
  Visibility explains REAL phenomenas

Specific transaction
type is failing




Specific location is
failing
Monitoring best practice 2
Visibility explains REAL phenomenas



                                      It is pretty
                                      easy to
                                      see the
                                      load
                                      balance
                                      mismatch




                  You can see that
                  the % Time spent
                  between User
                  and Data Center
                  is the issue here


                   When compared      Or the %Time
                   to % Time spent    spent rendering
                   within the Data    on the user’s
                   Center             device
Monitoring best practice 3
Baseline and compare

                    Compare application model of
                    100% load vs. 150% of load
Testing best practice 1
• Start early & test progressively.
   – Begin in development
   – Run many iterative tests that address performance from
     code though infrastructure
   – Finish in production (Live prod to really be sure)
Testing best practice 2
• Test realistically.
   – Model users acting like humans
   – Stress & measure at a realistic pace
   – Run at true scale
   – From different locations and devices
Testing best practice 3
• Seek a single source of performance truth.
  – Get Dev & Ops on the same page. (Is 2 seconds okay?)
  – Measure with the same tools in Dev, Test & Ops
  – Correlate monitoring data with test data as tests run
Thankfully, There is a Solution

         SharePath identifies critical transactions
         to test what matters most


              CloudTest enables testing to any
              level with web or mobile traffic – in
              lab or production environments

                        Monitor critical metrics during
                        and after tests to isolate and
                        prevent production outages
Demo
Summary
• The IT Landscape has changed
• Start your testing early, test progressively, and
  test realistically
• When monitoring critical applications, assume
  nothing, look for root cause phenomena, use
  baselines, and compare
• SharePath and CloudTest provide an integrated
  solution
Questions



   Contact SOASTA:                        Contact Correlsense:
   www.soasta.com/cloudtest/              www.correlsense.com/demo
   info@soasta.com                        www.real-user-monitoring.com
   866.344.8766                           info@correlsense.com
   Follow us:                             Follow us:

        twitter.com/cloudtest                  twitter.com/correlsense
        facebook.com/cloudtest                 facebook.com/correlsense

                                                        Get your free copy
         Download
                                 GET STARTED             SharePath RUM!
    CloudTest Lite - FREE!
                                   TODAY!      http://www.real-user-monitoring.com/
www.soasta.com/cloudtest/lite/

Contenu connexe

Plus de SOASTA

Dach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
Dach webinar - Image Absicherung – Lektionen aus dem Facebook CrashDach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
Dach webinar - Image Absicherung – Lektionen aus dem Facebook CrashSOASTA
 
Four best practices for performance testing mobile apps soasta and utopia
Four best practices for performance testing mobile apps   soasta and utopiaFour best practices for performance testing mobile apps   soasta and utopia
Four best practices for performance testing mobile apps soasta and utopiaSOASTA
 
Synthetic and rum webinar
Synthetic and rum webinarSynthetic and rum webinar
Synthetic and rum webinarSOASTA
 
7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testing7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testingSOASTA
 
Secrets to Realistic Load Testing
Secrets to Realistic Load TestingSecrets to Realistic Load Testing
Secrets to Realistic Load TestingSOASTA
 
How to measure the business impact of web performance
How to measure the business impact of web performanceHow to measure the business impact of web performance
How to measure the business impact of web performanceSOASTA
 
Lasttest auf Zuruf CloudTest on Demand webinar presentation
Lasttest auf Zuruf CloudTest on Demand webinar presentationLasttest auf Zuruf CloudTest on Demand webinar presentation
Lasttest auf Zuruf CloudTest on Demand webinar presentationSOASTA
 
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and DeliveryAccelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and DeliverySOASTA
 
The Mobile Testing Checklist
The Mobile Testing ChecklistThe Mobile Testing Checklist
The Mobile Testing ChecklistSOASTA
 
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...SOASTA
 
Reducing 3rd party content risk with Real User Monitoring
Reducing 3rd party content risk with Real User MonitoringReducing 3rd party content risk with Real User Monitoring
Reducing 3rd party content risk with Real User MonitoringSOASTA
 
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal ReadinessTis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal ReadinessSOASTA
 
Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentModern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentSOASTA
 
Getting started w ct lite load_testing 21.05.14
Getting started w ct lite load_testing 21.05.14Getting started w ct lite load_testing 21.05.14
Getting started w ct lite load_testing 21.05.14SOASTA
 
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014SOASTA
 
What Retailers Know About Performance and User Experience
What Retailers Know About Performance and User ExperienceWhat Retailers Know About Performance and User Experience
What Retailers Know About Performance and User ExperienceSOASTA
 
Getting started w ct lite load_testing 03.04.14
Getting started w ct lite load_testing 03.04.14Getting started w ct lite load_testing 03.04.14
Getting started w ct lite load_testing 03.04.14SOASTA
 
Erste schritte mit ct lite load_testing 02.04.14
Erste schritte mit ct lite load_testing 02.04.14Erste schritte mit ct lite load_testing 02.04.14
Erste schritte mit ct lite load_testing 02.04.14SOASTA
 
Agile Load Testing In The Real World
Agile Load Testing In The Real WorldAgile Load Testing In The Real World
Agile Load Testing In The Real WorldSOASTA
 
Real User Measurement: The Secret Weapon for Quality
Real User Measurement: The Secret Weapon for QualityReal User Measurement: The Secret Weapon for Quality
Real User Measurement: The Secret Weapon for QualitySOASTA
 

Plus de SOASTA (20)

Dach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
Dach webinar - Image Absicherung – Lektionen aus dem Facebook CrashDach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
Dach webinar - Image Absicherung – Lektionen aus dem Facebook Crash
 
Four best practices for performance testing mobile apps soasta and utopia
Four best practices for performance testing mobile apps   soasta and utopiaFour best practices for performance testing mobile apps   soasta and utopia
Four best practices for performance testing mobile apps soasta and utopia
 
Synthetic and rum webinar
Synthetic and rum webinarSynthetic and rum webinar
Synthetic and rum webinar
 
7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testing7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testing
 
Secrets to Realistic Load Testing
Secrets to Realistic Load TestingSecrets to Realistic Load Testing
Secrets to Realistic Load Testing
 
How to measure the business impact of web performance
How to measure the business impact of web performanceHow to measure the business impact of web performance
How to measure the business impact of web performance
 
Lasttest auf Zuruf CloudTest on Demand webinar presentation
Lasttest auf Zuruf CloudTest on Demand webinar presentationLasttest auf Zuruf CloudTest on Demand webinar presentation
Lasttest auf Zuruf CloudTest on Demand webinar presentation
 
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and DeliveryAccelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
 
The Mobile Testing Checklist
The Mobile Testing ChecklistThe Mobile Testing Checklist
The Mobile Testing Checklist
 
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
 
Reducing 3rd party content risk with Real User Monitoring
Reducing 3rd party content risk with Real User MonitoringReducing 3rd party content risk with Real User Monitoring
Reducing 3rd party content risk with Real User Monitoring
 
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal ReadinessTis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
 
Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentModern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the Present
 
Getting started w ct lite load_testing 21.05.14
Getting started w ct lite load_testing 21.05.14Getting started w ct lite load_testing 21.05.14
Getting started w ct lite load_testing 21.05.14
 
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
Continuous Testing for Optimal Mobile Peroformance - STPCon Spring 2014
 
What Retailers Know About Performance and User Experience
What Retailers Know About Performance and User ExperienceWhat Retailers Know About Performance and User Experience
What Retailers Know About Performance and User Experience
 
Getting started w ct lite load_testing 03.04.14
Getting started w ct lite load_testing 03.04.14Getting started w ct lite load_testing 03.04.14
Getting started w ct lite load_testing 03.04.14
 
Erste schritte mit ct lite load_testing 02.04.14
Erste schritte mit ct lite load_testing 02.04.14Erste schritte mit ct lite load_testing 02.04.14
Erste schritte mit ct lite load_testing 02.04.14
 
Agile Load Testing In The Real World
Agile Load Testing In The Real WorldAgile Load Testing In The Real World
Agile Load Testing In The Real World
 
Real User Measurement: The Secret Weapon for Quality
Real User Measurement: The Secret Weapon for QualityReal User Measurement: The Secret Weapon for Quality
Real User Measurement: The Secret Weapon for Quality
 

Dernier

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...apidays
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Bhuvaneswari Subramani
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfOrbitshub
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Orbitshub
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontologyjohnbeverley2021
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...apidays
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistandanishmna97
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 

Dernier (20)

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 

Webinar soasta correlsense_retail_ready_slideshare

  • 1. New Approaches to Real-Time Application Testing and Performance Monitoring December 15, 2011
  • 2. Agenda • Best practices for holiday performance testing • New testing and monitoring techniques • Demo • Q&A
  • 3. The Online Market You are here!
  • 4. Cyber Monday 2011 • $1.3B • 33% y/y growth in traffic • 10.8% is Mobile (3.9% last year)
  • 6. The IT Landscape Has Changed What is “Peak Load”? • 100%, 200%...500%+? • How much mobile traffic should we prepare for…and how? What Are The Most Important Transactions? • What are the most profitable paths users follow? • What is the affect of non-buying “browsing” on paying customers? What System Do You Test In? • Is the lab good enough? • Production testing is taboo (isn’t it)? How Will You Find The Issues? • Complexity reigns • How do we see where issues are at load?
  • 7. The IT Landscape Has Changed What is “Peak Load”? • You must to test to new limitswith a mix of web and mobile traffic What Are The Most Important Transactions? • Those that you determine as profitable, complex and/or risky What System Do You Test In? • Testing is a continuous process from the lab to live production How Will You Find The Issues? • Monitoring during tests for the the end-to-end view while tests run
  • 9. Monitoring best practice 1 “Assume Nothing” Oops. A production server! UAT Environment topology autodetected
  • 10. Monitoring best practice 2 Visibility explains REAL phenomenas Specific transaction type is failing Specific location is failing
  • 11. Monitoring best practice 2 Visibility explains REAL phenomenas It is pretty easy to see the load balance mismatch You can see that the % Time spent between User and Data Center is the issue here When compared Or the %Time to % Time spent spent rendering within the Data on the user’s Center device
  • 12. Monitoring best practice 3 Baseline and compare Compare application model of 100% load vs. 150% of load
  • 13. Testing best practice 1 • Start early & test progressively. – Begin in development – Run many iterative tests that address performance from code though infrastructure – Finish in production (Live prod to really be sure)
  • 14. Testing best practice 2 • Test realistically. – Model users acting like humans – Stress & measure at a realistic pace – Run at true scale – From different locations and devices
  • 15. Testing best practice 3 • Seek a single source of performance truth. – Get Dev & Ops on the same page. (Is 2 seconds okay?) – Measure with the same tools in Dev, Test & Ops – Correlate monitoring data with test data as tests run
  • 16. Thankfully, There is a Solution SharePath identifies critical transactions to test what matters most CloudTest enables testing to any level with web or mobile traffic – in lab or production environments Monitor critical metrics during and after tests to isolate and prevent production outages
  • 17. Demo
  • 18. Summary • The IT Landscape has changed • Start your testing early, test progressively, and test realistically • When monitoring critical applications, assume nothing, look for root cause phenomena, use baselines, and compare • SharePath and CloudTest provide an integrated solution
  • 19. Questions Contact SOASTA: Contact Correlsense: www.soasta.com/cloudtest/ www.correlsense.com/demo info@soasta.com www.real-user-monitoring.com 866.344.8766 info@correlsense.com Follow us: Follow us: twitter.com/cloudtest twitter.com/correlsense facebook.com/cloudtest facebook.com/correlsense Get your free copy Download GET STARTED SharePath RUM! CloudTest Lite - FREE! TODAY! http://www.real-user-monitoring.com/ www.soasta.com/cloudtest/lite/

Notes de l'éditeur

  1. Testing with a production server. Every day at the same time, production outage that was not explained. Turned out this was the time they ran the tests. Part of the team had to stop the test because they got called in to a Production war room, not knowing it was directly related.
  2. CPU is spiking. So what? Example about network monitoring complaining about high throughput. What does it affect? Is it burning the cable?Should be the other way around – look for phenomenas affecting users and drill to root cause
  3. CPU is spiking. So what? Example about network monitoring complaining about high throughput. What does it affect? Is it burning the cable?Should be the other way around – look for phenomenas affecting users and drill to root cause
  4. Give example of chatty application – transaction calling a webservice that has changed. For each call, now making 540 calls instead of 20. Response time stayed the same, but model has changed. This would have popped up in production. Must compare models.
  5. Dan