SlideShare une entreprise Scribd logo
1  sur  25
Are you ready for more Website visitors? Best Practices to realistically load test your applications beyond the firewall  Hari Ramachandran, Project Manager, Cognizant Colin Mason  -  Product Manager, Gome z
Cognizant   Testing   Services
Need for Positive User Experience ,[object Object],[object Object]
User Expectations Not Met at Peak Times Impact the Business ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Total Sample (N=1538)
Many of the industry’s largest merchants suffered site slowdowns or other problems in 2009 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Why Performance Testing is Critical? ,[object Object],[object Object],[object Object]
The Challenge of Delivering Web Applications ,[object Object],[object Object],[object Object],[object Object],[object Object],The  Web Application Delivery Chain Major ISP Local ISP Mobile  Carrier Internet Content Delivery Networks 3rd Party/ Cloud Services Browsers and devices Users Users Storage Web  Servers App  Servers DB  Servers Mainframe Load  Balancers Mobile  Components Network
Performance Testing – Maturity Levels
When to Performance Test in Development Lifecycle  Requirement Analysis ,[object Object],[object Object],Development ,[object Object],[object Object],Design ,[object Object],[object Object],[object Object],Integration & Testing ,[object Object],Implementation ,[object Object],[object Object]
Recommendations For Successful Performance Testing  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Performance   Testing & Problem Diagnosis Design Phase : Architecture Performance Benchmarking ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Excessive Threads Spawned High Virtual Memory Usage After implementing Thread Pooling & Fix Patches From Third-Party Components
Performance   Testing & Problem Diagnosis Development Phase: Early Performance Testing ,[object Object],[object Object],It is seen that the available memory goes down as the number of loaded assemblies increases Number of loaded assemblies keeps increasing throughout the test, although the same transactions are repeatedly executed Heap dump data showing many dynamically loaded assemblies in the heap ,[object Object],[object Object],[object Object]
Performance   Testing & Problem Diagnosis Integration & Testing Phase: Pre-Production Performance Testing  ,[object Object],[object Object],[object Object],Sudden drop in throughput after 70 users indicating a bottleneck. CPU Utilization also peaks indicating the server side bottleneck
[object Object],[object Object],[object Object],Web Application Delivery In A Web 2.0 World
The Challenge of Ensuring Quality Web Experiences Zone of customer expectation Zone of customer expectation Zone of customer expectation Zone of customer expectation Traditional zone  of control The  Web Application Delivery Chain ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Systems management tools: “OK” … user is NOT happy Traditional zone  of control
Gomez Load Testing 2.0 :  On-Demand Realistic Load Testing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Major ISP Local ISP Mobile  Carrier Internet Content Delivery Networks 3rd Party/ Cloud Services Browsers and devices Users Storage Web  Servers App  Servers DB  Servers Mainframe Load  Balancers Mobile  Components Network
Gomez Network:  The World’s Most Comprehensive Performance and Testing Network  Web Performance Management and Load Testing  100+ locations Backbone Cross-Browser Testing  500+ browser/OS combo’s 5,000+ supported devices Virtual Test Bed Web Performance Management and Load Testing  100,000+ locations Gomez Last Mile
[object Object],[object Object],[object Object],Load Testing 2.0 Detects 3 rd- party External Errors 2 Major ISP Local ISP Mobile  Carrier Internet Content Delivery Networks 3rd Party/ Cloud Services Browsers and devices Users Storage Web  Servers App  Servers DB  Servers Mainframe Load  Balancers Mobile  Components Network
Load Testing 2.0 Detects 3 rd- party External Errors cont ,[object Object],[object Object],The load increases throughout the test The transaction rate increases and then falls off as response times climb Errors are seen, all on a 3 rd  party object
[object Object],[object Object],[object Object],Load Testing 2.0 Uncovers Regional Response Time Discrepancies under Load - Case Study 3 Major ISP Local ISP Mobile  Carrier Internet Content Delivery Networks 3rd Party/ Cloud Services Browsers and devices Users Storage Web  Servers App  Servers DB  Servers Mainframe Load  Balancers Mobile  Components Network
By traditional Load Test 1.0 standards the test passed Page response times stayed under 4 seconds, outside of one brief blip There was only 1 page error and 11 errors total out of 60000+ transactions Increase and hold load and not exceed response times of 4 seconds and Success Rate of 99% No Performance Issues Detected From Datacenter
Last Mile data showing substantial number of measurements greater than 4 seconds  Performance Issues Detected When Using Real User Desktops Key geographies for this customer are  New York and Pennsylvania
Load Testing 2.0 Uncovers Poor Response Time for Top Revenue-Generating Regions The response time never met the 4 second average goal. Availability was Less than 99%. Top Revenue-generating geographies were New York and Pennsylvania. By Load Testing 2.0 standards the test failed.
Load Testing 2.0 versus Load Testing 1.0 Capability ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Incomplete Most Accurate ,[object Object],Limited- requires too much hardware Better - SaaS model ,[object Object],No Yes ,[object Object],No Yes ,[object Object],No Yes ,[object Object],Better Good Pre-production Testing Better Used closer to deployment --to test under realistic conditions Client-Server Testing Yes No
Find Out How Gomez + Cognizant Can Help You ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Contenu connexe

Tendances

Bluecoat Packeshaper Presentation
Bluecoat Packeshaper PresentationBluecoat Packeshaper Presentation
Bluecoat Packeshaper PresentationJerry Paul Acosta
 
Streamlining EMC Documentum Web Publisher to Increase Web Author Productivity
Streamlining EMC Documentum Web Publisher to Increase Web Author ProductivityStreamlining EMC Documentum Web Publisher to Increase Web Author Productivity
Streamlining EMC Documentum Web Publisher to Increase Web Author ProductivityBlueFish
 
Testing Web Apps and APIs (1)
Testing Web Apps and APIs (1)Testing Web Apps and APIs (1)
Testing Web Apps and APIs (1)AAron EvaNS
 
Aceleracion de aplicaciones
Aceleracion de aplicacionesAceleracion de aplicaciones
Aceleracion de aplicacionesjfth
 
Como a virtualização de serviços e de rede podem ajudar no desenvolvimento e ...
Como a virtualização de serviços e de rede podem ajudar no desenvolvimento e ...Como a virtualização de serviços e de rede podem ajudar no desenvolvimento e ...
Como a virtualização de serviços e de rede podem ajudar no desenvolvimento e ...Marcelo Galvão
 
Performance testing for web applications – techniques, metrics and profiling
Performance testing for web applications – techniques, metrics and profilingPerformance testing for web applications – techniques, metrics and profiling
Performance testing for web applications – techniques, metrics and profilingTestCampRO
 
Innovate 2013 session 1243 mobile testing.v3
Innovate 2013   session 1243 mobile testing.v3Innovate 2013   session 1243 mobile testing.v3
Innovate 2013 session 1243 mobile testing.v3Leigh Williamson
 
Case Study: Learn How Expeditors Uses APM as Both a Technology and Process T...
Case Study:  Learn How Expeditors Uses APM as Both a Technology and Process T...Case Study:  Learn How Expeditors Uses APM as Both a Technology and Process T...
Case Study: Learn How Expeditors Uses APM as Both a Technology and Process T...CA Technologies
 
Exposing and Fixing Common App Performance Problems
Exposing and Fixing Common App Performance ProblemsExposing and Fixing Common App Performance Problems
Exposing and Fixing Common App Performance ProblemsRiverbed Technology
 
Visualizing Application & Delivery Flows to Make Data-Driven Decisions
Visualizing Application & Delivery Flows to Make Data-Driven DecisionsVisualizing Application & Delivery Flows to Make Data-Driven Decisions
Visualizing Application & Delivery Flows to Make Data-Driven DecisionsCA Technologies
 
5 Best Practices for Application-aware Network Performance Management (AANPM)...
5 Best Practices for Application-aware Network Performance Management (AANPM)...5 Best Practices for Application-aware Network Performance Management (AANPM)...
5 Best Practices for Application-aware Network Performance Management (AANPM)...Enterprise Management Associates
 
Ensuring the compliance, resiliency, and availability of business-critical ne...
Ensuring the compliance, resiliency, and availability of business-critical ne...Ensuring the compliance, resiliency, and availability of business-critical ne...
Ensuring the compliance, resiliency, and availability of business-critical ne...Riverbed Technology
 
Detect and Fix Performance Problems Faster
Detect and Fix Performance Problems FasterDetect and Fix Performance Problems Faster
Detect and Fix Performance Problems FasterRiverbed Technology
 
Cloud Migration - The Earlier You Instrument, The Faster You Go
Cloud Migration - The Earlier You Instrument, The Faster You GoCloud Migration - The Earlier You Instrument, The Faster You Go
Cloud Migration - The Earlier You Instrument, The Faster You GoKevin Downs
 
Automating End-to-End Business Scenario Testing
Automating End-to-End Business Scenario TestingAutomating End-to-End Business Scenario Testing
Automating End-to-End Business Scenario TestingTechWell
 
Test Lead_Anshul_Varshney
Test Lead_Anshul_VarshneyTest Lead_Anshul_Varshney
Test Lead_Anshul_VarshneyAnshul Varshney
 
Riverbed Performance Management: Interop 14 Las Vegas
Riverbed Performance Management: Interop 14 Las VegasRiverbed Performance Management: Interop 14 Las Vegas
Riverbed Performance Management: Interop 14 Las VegasRiverbed Technology
 

Tendances (20)

Bluecoat Packeshaper Presentation
Bluecoat Packeshaper PresentationBluecoat Packeshaper Presentation
Bluecoat Packeshaper Presentation
 
Streamlining EMC Documentum Web Publisher to Increase Web Author Productivity
Streamlining EMC Documentum Web Publisher to Increase Web Author ProductivityStreamlining EMC Documentum Web Publisher to Increase Web Author Productivity
Streamlining EMC Documentum Web Publisher to Increase Web Author Productivity
 
Testing Web Apps and APIs (1)
Testing Web Apps and APIs (1)Testing Web Apps and APIs (1)
Testing Web Apps and APIs (1)
 
Aceleracion de aplicaciones
Aceleracion de aplicacionesAceleracion de aplicaciones
Aceleracion de aplicaciones
 
Como a virtualização de serviços e de rede podem ajudar no desenvolvimento e ...
Como a virtualização de serviços e de rede podem ajudar no desenvolvimento e ...Como a virtualização de serviços e de rede podem ajudar no desenvolvimento e ...
Como a virtualização de serviços e de rede podem ajudar no desenvolvimento e ...
 
Performance testing for web applications – techniques, metrics and profiling
Performance testing for web applications – techniques, metrics and profilingPerformance testing for web applications – techniques, metrics and profiling
Performance testing for web applications – techniques, metrics and profiling
 
Innovate 2013 session 1243 mobile testing.v3
Innovate 2013   session 1243 mobile testing.v3Innovate 2013   session 1243 mobile testing.v3
Innovate 2013 session 1243 mobile testing.v3
 
Case Study: Learn How Expeditors Uses APM as Both a Technology and Process T...
Case Study:  Learn How Expeditors Uses APM as Both a Technology and Process T...Case Study:  Learn How Expeditors Uses APM as Both a Technology and Process T...
Case Study: Learn How Expeditors Uses APM as Both a Technology and Process T...
 
Exposing and Fixing Common App Performance Problems
Exposing and Fixing Common App Performance ProblemsExposing and Fixing Common App Performance Problems
Exposing and Fixing Common App Performance Problems
 
Visualizing Application & Delivery Flows to Make Data-Driven Decisions
Visualizing Application & Delivery Flows to Make Data-Driven DecisionsVisualizing Application & Delivery Flows to Make Data-Driven Decisions
Visualizing Application & Delivery Flows to Make Data-Driven Decisions
 
5 Best Practices for Application-aware Network Performance Management (AANPM)...
5 Best Practices for Application-aware Network Performance Management (AANPM)...5 Best Practices for Application-aware Network Performance Management (AANPM)...
5 Best Practices for Application-aware Network Performance Management (AANPM)...
 
Performance Engineering Basics
Performance Engineering BasicsPerformance Engineering Basics
Performance Engineering Basics
 
Ensuring the compliance, resiliency, and availability of business-critical ne...
Ensuring the compliance, resiliency, and availability of business-critical ne...Ensuring the compliance, resiliency, and availability of business-critical ne...
Ensuring the compliance, resiliency, and availability of business-critical ne...
 
Detect and Fix Performance Problems Faster
Detect and Fix Performance Problems FasterDetect and Fix Performance Problems Faster
Detect and Fix Performance Problems Faster
 
Cloud Migration - The Earlier You Instrument, The Faster You Go
Cloud Migration - The Earlier You Instrument, The Faster You GoCloud Migration - The Earlier You Instrument, The Faster You Go
Cloud Migration - The Earlier You Instrument, The Faster You Go
 
Automating End-to-End Business Scenario Testing
Automating End-to-End Business Scenario TestingAutomating End-to-End Business Scenario Testing
Automating End-to-End Business Scenario Testing
 
Hemachandra_s
Hemachandra_sHemachandra_s
Hemachandra_s
 
Test Lead_Anshul_Varshney
Test Lead_Anshul_VarshneyTest Lead_Anshul_Varshney
Test Lead_Anshul_Varshney
 
Riverbed Performance Management: Interop 14 Las Vegas
Riverbed Performance Management: Interop 14 Las VegasRiverbed Performance Management: Interop 14 Las Vegas
Riverbed Performance Management: Interop 14 Las Vegas
 
Jon shende fbcs citp q&a
Jon shende fbcs citp q&aJon shende fbcs citp q&a
Jon shende fbcs citp q&a
 

En vedette

2006.04.20. Takarítás
2006.04.20.   Takarítás2006.04.20.   Takarítás
2006.04.20. TakarításCsipcsup :-))
 
2006.04.04. Lujza 2.
2006.04.04.   Lujza 2.2006.04.04.   Lujza 2.
2006.04.04. Lujza 2.Csipcsup :-))
 
Nuestros Trabajos De Aula Aut
Nuestros Trabajos De Aula AutNuestros Trabajos De Aula Aut
Nuestros Trabajos De Aula Autjmoi
 
Incurka 2007. április-május
Incurka  2007. április-májusIncurka  2007. április-május
Incurka 2007. április-májusCsipcsup :-))
 
2006.04.20. Lujza Mama
2006.04.20.   Lujza Mama2006.04.20.   Lujza Mama
2006.04.20. Lujza MamaCsipcsup :-))
 
2006.04.23. Jenő Papa
2006.04.23.   Jenő Papa2006.04.23.   Jenő Papa
2006.04.23. Jenő PapaCsipcsup :-))
 
Kalypso Introduction General
Kalypso Introduction GeneralKalypso Introduction General
Kalypso Introduction Generalvgresham
 
2006.04.20. A születés napja
2006.04.20.   A születés napja2006.04.20.   A születés napja
2006.04.20. A születés napjaCsipcsup :-))
 
Projecting Enterprise Security Requirements on the Cloud
Projecting Enterprise Security Requirements on the CloudProjecting Enterprise Security Requirements on the Cloud
Projecting Enterprise Security Requirements on the CloudScientia Groups
 
National Water Company program
National Water Company programNational Water Company program
National Water Company programjasonbackus
 
Placement consultants
Placement consultantsPlacement consultants
Placement consultantsiiswbm
 

En vedette (13)

2006.04.20. Takarítás
2006.04.20.   Takarítás2006.04.20.   Takarítás
2006.04.20. Takarítás
 
2006.04.04. Lujza 2.
2006.04.04.   Lujza 2.2006.04.04.   Lujza 2.
2006.04.04. Lujza 2.
 
Nuestros Trabajos De Aula Aut
Nuestros Trabajos De Aula AutNuestros Trabajos De Aula Aut
Nuestros Trabajos De Aula Aut
 
Incurka 2007. április-május
Incurka  2007. április-májusIncurka  2007. április-május
Incurka 2007. április-május
 
2006.04.20. Lujza Mama
2006.04.20.   Lujza Mama2006.04.20.   Lujza Mama
2006.04.20. Lujza Mama
 
2006.04.23. Jenő Papa
2006.04.23.   Jenő Papa2006.04.23.   Jenő Papa
2006.04.23. Jenő Papa
 
2006.04.02. Lujza
2006.04.02.   Lujza2006.04.02.   Lujza
2006.04.02. Lujza
 
2006.04.22. Napló
2006.04.22.   Napló2006.04.22.   Napló
2006.04.22. Napló
 
Kalypso Introduction General
Kalypso Introduction GeneralKalypso Introduction General
Kalypso Introduction General
 
2006.04.20. A születés napja
2006.04.20.   A születés napja2006.04.20.   A születés napja
2006.04.20. A születés napja
 
Projecting Enterprise Security Requirements on the Cloud
Projecting Enterprise Security Requirements on the CloudProjecting Enterprise Security Requirements on the Cloud
Projecting Enterprise Security Requirements on the Cloud
 
National Water Company program
National Water Company programNational Water Company program
National Water Company program
 
Placement consultants
Placement consultantsPlacement consultants
Placement consultants
 

Similaire à Magical Performance tuning with Gomez

Best Practices In Load And Stress Testing Cmg Seminar[1]
Best Practices In Load And Stress Testing Cmg Seminar[1]Best Practices In Load And Stress Testing Cmg Seminar[1]
Best Practices In Load And Stress Testing Cmg Seminar[1]Munirathnam Naidu
 
[Webinar] Getting Started with Performance Testing
[Webinar] Getting Started with Performance Testing[Webinar] Getting Started with Performance Testing
[Webinar] Getting Started with Performance TestingMaharshi Shah
 
Performance testing : An Overview
Performance testing : An OverviewPerformance testing : An Overview
Performance testing : An Overviewsharadkjain
 
Experitest & Wipro Co-Webinar
Experitest & Wipro Co-Webinar Experitest & Wipro Co-Webinar
Experitest & Wipro Co-Webinar Experitest
 
Performance Testing using LoadRunner
Performance Testing using LoadRunnerPerformance Testing using LoadRunner
Performance Testing using LoadRunnerKumar Gupta
 
Browser Diagnostics using dynatrace Ajax Edition
Browser Diagnostics using dynatrace Ajax EditionBrowser Diagnostics using dynatrace Ajax Edition
Browser Diagnostics using dynatrace Ajax EditionDeepak Kaul
 
From web interface to the database:Monitor all that matters
From web interface to the database:Monitor all that mattersFrom web interface to the database:Monitor all that matters
From web interface to the database:Monitor all that mattersManageEngine, Zoho Corporation
 
Performance Testing
Performance TestingPerformance Testing
Performance TestingSelin Gungor
 
Applying a Methodical Approach to Website Performance
Applying a Methodical Approach to Website PerformanceApplying a Methodical Approach to Website Performance
Applying a Methodical Approach to Website PerformancePostSharp Technologies
 
How to Improve Overall Performance & Security For Any eCommerce Website In 2023
How to Improve Overall Performance & Security For Any eCommerce Website In 2023How to Improve Overall Performance & Security For Any eCommerce Website In 2023
How to Improve Overall Performance & Security For Any eCommerce Website In 2023Galaxy Weblinks
 
Encontrando la Aguja en el Rendimiento de Aplicaciones
Encontrando la Aguja en el Rendimiento de AplicacionesEncontrando la Aguja en el Rendimiento de Aplicaciones
Encontrando la Aguja en el Rendimiento de AplicacionesSoftware Guru
 
Performance Testing from Scratch + JMeter intro
Performance Testing from Scratch + JMeter introPerformance Testing from Scratch + JMeter intro
Performance Testing from Scratch + JMeter introMykola Kovsh
 
Performance testing methodologies and tools
Performance testing methodologies and toolsPerformance testing methodologies and tools
Performance testing methodologies and toolsAlexander Decker
 
11.performance testing methodologies and tools
11.performance testing methodologies and tools11.performance testing methodologies and tools
11.performance testing methodologies and toolsAlexander Decker
 
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...Bitbar
 

Similaire à Magical Performance tuning with Gomez (20)

Gomez
GomezGomez
Gomez
 
Best Practices In Load And Stress Testing Cmg Seminar[1]
Best Practices In Load And Stress Testing Cmg Seminar[1]Best Practices In Load And Stress Testing Cmg Seminar[1]
Best Practices In Load And Stress Testing Cmg Seminar[1]
 
[Webinar] Getting Started with Performance Testing
[Webinar] Getting Started with Performance Testing[Webinar] Getting Started with Performance Testing
[Webinar] Getting Started with Performance Testing
 
Performance testing : An Overview
Performance testing : An OverviewPerformance testing : An Overview
Performance testing : An Overview
 
QSpiders - Introduction to HP Load Runner
QSpiders - Introduction to HP Load RunnerQSpiders - Introduction to HP Load Runner
QSpiders - Introduction to HP Load Runner
 
Experitest & Wipro Co-Webinar
Experitest & Wipro Co-Webinar Experitest & Wipro Co-Webinar
Experitest & Wipro Co-Webinar
 
Performance Testing using LoadRunner
Performance Testing using LoadRunnerPerformance Testing using LoadRunner
Performance Testing using LoadRunner
 
Browser Diagnostics using dynatrace Ajax Edition
Browser Diagnostics using dynatrace Ajax EditionBrowser Diagnostics using dynatrace Ajax Edition
Browser Diagnostics using dynatrace Ajax Edition
 
From web interface to the database:Monitor all that matters
From web interface to the database:Monitor all that mattersFrom web interface to the database:Monitor all that matters
From web interface to the database:Monitor all that matters
 
Performance Testing
Performance TestingPerformance Testing
Performance Testing
 
Applying a Methodical Approach to Website Performance
Applying a Methodical Approach to Website PerformanceApplying a Methodical Approach to Website Performance
Applying a Methodical Approach to Website Performance
 
How to Improve Overall Performance & Security For Any eCommerce Website In 2023
How to Improve Overall Performance & Security For Any eCommerce Website In 2023How to Improve Overall Performance & Security For Any eCommerce Website In 2023
How to Improve Overall Performance & Security For Any eCommerce Website In 2023
 
Encontrando la Aguja en el Rendimiento de Aplicaciones
Encontrando la Aguja en el Rendimiento de AplicacionesEncontrando la Aguja en el Rendimiento de Aplicaciones
Encontrando la Aguja en el Rendimiento de Aplicaciones
 
Performance Testing from Scratch + JMeter intro
Performance Testing from Scratch + JMeter introPerformance Testing from Scratch + JMeter intro
Performance Testing from Scratch + JMeter intro
 
28791456 web-testing
28791456 web-testing28791456 web-testing
28791456 web-testing
 
Performance testing methodologies and tools
Performance testing methodologies and toolsPerformance testing methodologies and tools
Performance testing methodologies and tools
 
11.performance testing methodologies and tools
11.performance testing methodologies and tools11.performance testing methodologies and tools
11.performance testing methodologies and tools
 
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...
 
Performance testing
Performance testingPerformance testing
Performance testing
 
Rajasekar Resume QA
Rajasekar Resume QARajasekar Resume QA
Rajasekar Resume QA
 

Magical Performance tuning with Gomez

  • 1. Are you ready for more Website visitors? Best Practices to realistically load test your applications beyond the firewall Hari Ramachandran, Project Manager, Cognizant Colin Mason - Product Manager, Gome z
  • 2. Cognizant Testing Services
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8. Performance Testing – Maturity Levels
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17. Gomez Network: The World’s Most Comprehensive Performance and Testing Network Web Performance Management and Load Testing 100+ locations Backbone Cross-Browser Testing 500+ browser/OS combo’s 5,000+ supported devices Virtual Test Bed Web Performance Management and Load Testing 100,000+ locations Gomez Last Mile
  • 18.
  • 19.
  • 20.
  • 21. By traditional Load Test 1.0 standards the test passed Page response times stayed under 4 seconds, outside of one brief blip There was only 1 page error and 11 errors total out of 60000+ transactions Increase and hold load and not exceed response times of 4 seconds and Success Rate of 99% No Performance Issues Detected From Datacenter
  • 22. Last Mile data showing substantial number of measurements greater than 4 seconds Performance Issues Detected When Using Real User Desktops Key geographies for this customer are New York and Pennsylvania
  • 23. Load Testing 2.0 Uncovers Poor Response Time for Top Revenue-Generating Regions The response time never met the 4 second average goal. Availability was Less than 99%. Top Revenue-generating geographies were New York and Pennsylvania. By Load Testing 2.0 standards the test failed.
  • 24.
  • 25.

Notes de l'éditeur

  1. Key themes: load testing helps ensure success of critical web based initiatives by reducing risk when launching promotions, rolling out new apps, upgrading infrastructure and anticipating seasonal spikes in traffic Talk track How much risk can your organization accept when launching new web-based initiatives? Whether it’s rolling out a new website or application, launching a major marketing campaign, upgrading or virtualizing infrastructure, or preparing for seasonal spikes in traffic, load testing helps you reduce risk and ensure success. Load testing ensures that your key web pages and transactions perform under load across all the geographic locations you care about. Problems across the entire web application delivery chain can be found and fixed prior to launch – maximizing revenue and protecting your brand. With today’s on-demand “2.0” solutions, load testing is accessible to more organizations and departments than ever before
  2. Last updated or created: Nov ‘09 Changed title Changed script Key themes: State main benefits we deliver to companies Gomez offers a SaaS-based, easy-to-access solution Gomez is a healthy, established, market leader. Talk track Here is a brief overview of Gomez. We help organizations deliver quality experiences to their Web and mobile users. What is a “quality experience?” Optimal performance and availability – You’ll use Gomez to make your web site fast and always available. For example, one customer reduced page load time from 11 seconds to 3 seconds with Gomez. Quality operation across all users, browsers, devices, and geographies -- You’ll use Gomez to ensure you web and mobile applications work for all of your users, across all the browsers and mobile devices, and across all your key geographies. For example, one customer saves 50% in staff fees We also help you resolve any issues that arise with: Rapid issue notification with actionable diagnostics – if something is wrong with your website, Gomez will alert you immediately, along with diagnostics to help you identify and resolve the root cause. Insight into how these issues affect your business (revenue, brand, cost) – a web site’s performance can be the difference between a sale or a lost customer. One Gomez customer has seen a 10% increase in conversions because of Gomez. Some information about the division: SaaS platform – Gomez is on-demand. No installation required. You get quick startup and rapid payback. And it operates on the world’s most comprehensive testing network – over 100K+ global locations and growing organically every day 2,500+ customers worldwide – Any company who relies on their web or mobile application can benefit from Gomez. We work with very large brands, such as Microsoft, MySpace, Google, and Apple – in fact, 12 of the top 20 visited US sites use Gomez. We also work with as many small companies, ones you’ve probably never heard of. We have experience and experience with all of their businesses, and we share them with you. When you become a Gomez customer, you gain the benefit of that insight. Solid business performance -- Gomez is health and established. When it was an independent company, it had five years of consecutive double digit revenue growth, including 44% in 2008. Offices around the globe. We’re recognized as the industry leader – Forrester calls us “THE leader in Web experience management,” and says we’re in the “on fire” category. Gartner calls us a “cool vendor” to watch. And EMA says Gomez is one of the “few companies who gets it.”
  3. In the past, fewer machines served up the same information on one network that now is distributed The applications have gotten more complex and they’re very distributed The average web application now includes SIX separate web applications and they can have an impact on your brand. Third parties can be ads or videos, marketing tracking of visitors. Most of these applications can perform very differently under load., Sometimes the only place that all of these third parties come together is in a browser on the end user’s machine. CDNs can have wildly different performance in different geographies. The effectiveness of your CDN has a huge impact on your user experience and how your customers view the performance of your application.
  4. Last updated or created: Nov ‘09 Moved firewall to the right; more detail in data center Key themes: Many things can and do go wrong in delivering Web/mobile applications Your customer expects you to control them all – not just what’s in your data center You can control these issues, but you must be aware of them first Talk track What kinds of things can go wrong in this Web application delivery chain ? Unfortunately, there are a long list of possible issues. This slide shows examples of the various issues that can occur at any point along the chain. It’s pretty ugly, because there’s a lot that can go wrong. Some of these can occur inside your firewall, but they won’t show up on system monitoring tools. Have you ever heard of or experienced any of these problems? Are you using any third party or cloud services? Are you using a CDN? Do you know if your application runs on every browser and O/S and mobile device? They happen every day. And the harsh reality is: they change everyday, too. You can get them right one day and something goes wrong the next. Your users expect you to control these issues. If they try to visit your site or run your Web application and it doesn’t work, they hold you responsible. The good news is that all of these issues can be controlled – but first you need to be aware of them. That’s the first step to fixing them and ensuring your user has a positive experience.
  5. Last updated or created: Nov ‘09 Moved firewall to the right; more detail in data center Key themes: Delivering Web/mobile apps is complicated and involves many services. Talk track Why is it your data center monitoring tools can be reporting “green” but your users are unhappy? It’s because of something called “the Web applications delivery chain.” To deliver a Web or mobile application in today’s Internet, you must use a complex set of services and layers that are called the “ Web application delivery chain .” These services must all work together to deliver the application to the user. If any one of them has an issue, your user will have a bad experience. First, your application must go through your major corporate ISP. Then, it travels thru the Internet. Increasingly, Web applications today are using third party or cloud services (we’ve seen companies where their home page has over 20 third party providers or services). It’s also very common to use a Content Delivery Network to accelerate the delivery of the Web application. Eventually, your Web or mobile application goes thru a local ISP or a mobile carrier. Ultimately it reaches your end user or customer, where it has to run on their local device – a computer or smart phone – and in their browser. A few years ago it seemed that only Internet Explorer mattered, but now there are a myriad of browsers on the market and, unfortunately for companies delivering Web applications, they all work a differently.
  6. Key themes: Gomez covers the globe with the most comprehensive testing network We are where your customers are Talk track This is a visual depiction of our global testing network. You can see where our Backbone and Last Mile testing locations are. Our Last Mile locations literally span the globe and allow you to test and monitor from any significant location in the world. And it’s growing every day. You can use these for a combination of monitoring and load testing. You can’t see the locations for the virtual test bed because it’s virtual – i.e. location independent.
  7. All aspects of the user experience delivery chain must be tested Business Impact Customers negatively impacted by Higher response times Time-out errors