1. Are you ready for more Website visitors? Best Practices to realistically load test your applications beyond the firewall Hari Ramachandran, Project Manager, Cognizant Colin Mason - Product Manager, Gome z
17. Gomez Network: The World’s Most Comprehensive Performance and Testing Network Web Performance Management and Load Testing 100+ locations Backbone Cross-Browser Testing 500+ browser/OS combo’s 5,000+ supported devices Virtual Test Bed Web Performance Management and Load Testing 100,000+ locations Gomez Last Mile
18.
19.
20.
21. By traditional Load Test 1.0 standards the test passed Page response times stayed under 4 seconds, outside of one brief blip There was only 1 page error and 11 errors total out of 60000+ transactions Increase and hold load and not exceed response times of 4 seconds and Success Rate of 99% No Performance Issues Detected From Datacenter
22. Last Mile data showing substantial number of measurements greater than 4 seconds Performance Issues Detected When Using Real User Desktops Key geographies for this customer are New York and Pennsylvania
23. Load Testing 2.0 Uncovers Poor Response Time for Top Revenue-Generating Regions The response time never met the 4 second average goal. Availability was Less than 99%. Top Revenue-generating geographies were New York and Pennsylvania. By Load Testing 2.0 standards the test failed.
24.
25.
Notes de l'éditeur
Key themes: load testing helps ensure success of critical web based initiatives by reducing risk when launching promotions, rolling out new apps, upgrading infrastructure and anticipating seasonal spikes in traffic Talk track How much risk can your organization accept when launching new web-based initiatives? Whether it’s rolling out a new website or application, launching a major marketing campaign, upgrading or virtualizing infrastructure, or preparing for seasonal spikes in traffic, load testing helps you reduce risk and ensure success. Load testing ensures that your key web pages and transactions perform under load across all the geographic locations you care about. Problems across the entire web application delivery chain can be found and fixed prior to launch – maximizing revenue and protecting your brand. With today’s on-demand “2.0” solutions, load testing is accessible to more organizations and departments than ever before
Last updated or created: Nov ‘09 Changed title Changed script Key themes: State main benefits we deliver to companies Gomez offers a SaaS-based, easy-to-access solution Gomez is a healthy, established, market leader. Talk track Here is a brief overview of Gomez. We help organizations deliver quality experiences to their Web and mobile users. What is a “quality experience?” Optimal performance and availability – You’ll use Gomez to make your web site fast and always available. For example, one customer reduced page load time from 11 seconds to 3 seconds with Gomez. Quality operation across all users, browsers, devices, and geographies -- You’ll use Gomez to ensure you web and mobile applications work for all of your users, across all the browsers and mobile devices, and across all your key geographies. For example, one customer saves 50% in staff fees We also help you resolve any issues that arise with: Rapid issue notification with actionable diagnostics – if something is wrong with your website, Gomez will alert you immediately, along with diagnostics to help you identify and resolve the root cause. Insight into how these issues affect your business (revenue, brand, cost) – a web site’s performance can be the difference between a sale or a lost customer. One Gomez customer has seen a 10% increase in conversions because of Gomez. Some information about the division: SaaS platform – Gomez is on-demand. No installation required. You get quick startup and rapid payback. And it operates on the world’s most comprehensive testing network – over 100K+ global locations and growing organically every day 2,500+ customers worldwide – Any company who relies on their web or mobile application can benefit from Gomez. We work with very large brands, such as Microsoft, MySpace, Google, and Apple – in fact, 12 of the top 20 visited US sites use Gomez. We also work with as many small companies, ones you’ve probably never heard of. We have experience and experience with all of their businesses, and we share them with you. When you become a Gomez customer, you gain the benefit of that insight. Solid business performance -- Gomez is health and established. When it was an independent company, it had five years of consecutive double digit revenue growth, including 44% in 2008. Offices around the globe. We’re recognized as the industry leader – Forrester calls us “THE leader in Web experience management,” and says we’re in the “on fire” category. Gartner calls us a “cool vendor” to watch. And EMA says Gomez is one of the “few companies who gets it.”
In the past, fewer machines served up the same information on one network that now is distributed The applications have gotten more complex and they’re very distributed The average web application now includes SIX separate web applications and they can have an impact on your brand. Third parties can be ads or videos, marketing tracking of visitors. Most of these applications can perform very differently under load., Sometimes the only place that all of these third parties come together is in a browser on the end user’s machine. CDNs can have wildly different performance in different geographies. The effectiveness of your CDN has a huge impact on your user experience and how your customers view the performance of your application.
Last updated or created: Nov ‘09 Moved firewall to the right; more detail in data center Key themes: Many things can and do go wrong in delivering Web/mobile applications Your customer expects you to control them all – not just what’s in your data center You can control these issues, but you must be aware of them first Talk track What kinds of things can go wrong in this Web application delivery chain ? Unfortunately, there are a long list of possible issues. This slide shows examples of the various issues that can occur at any point along the chain. It’s pretty ugly, because there’s a lot that can go wrong. Some of these can occur inside your firewall, but they won’t show up on system monitoring tools. Have you ever heard of or experienced any of these problems? Are you using any third party or cloud services? Are you using a CDN? Do you know if your application runs on every browser and O/S and mobile device? They happen every day. And the harsh reality is: they change everyday, too. You can get them right one day and something goes wrong the next. Your users expect you to control these issues. If they try to visit your site or run your Web application and it doesn’t work, they hold you responsible. The good news is that all of these issues can be controlled – but first you need to be aware of them. That’s the first step to fixing them and ensuring your user has a positive experience.
Last updated or created: Nov ‘09 Moved firewall to the right; more detail in data center Key themes: Delivering Web/mobile apps is complicated and involves many services. Talk track Why is it your data center monitoring tools can be reporting “green” but your users are unhappy? It’s because of something called “the Web applications delivery chain.” To deliver a Web or mobile application in today’s Internet, you must use a complex set of services and layers that are called the “ Web application delivery chain .” These services must all work together to deliver the application to the user. If any one of them has an issue, your user will have a bad experience. First, your application must go through your major corporate ISP. Then, it travels thru the Internet. Increasingly, Web applications today are using third party or cloud services (we’ve seen companies where their home page has over 20 third party providers or services). It’s also very common to use a Content Delivery Network to accelerate the delivery of the Web application. Eventually, your Web or mobile application goes thru a local ISP or a mobile carrier. Ultimately it reaches your end user or customer, where it has to run on their local device – a computer or smart phone – and in their browser. A few years ago it seemed that only Internet Explorer mattered, but now there are a myriad of browsers on the market and, unfortunately for companies delivering Web applications, they all work a differently.
Key themes: Gomez covers the globe with the most comprehensive testing network We are where your customers are Talk track This is a visual depiction of our global testing network. You can see where our Backbone and Last Mile testing locations are. Our Last Mile locations literally span the globe and allow you to test and monitor from any significant location in the world. And it’s growing every day. You can use these for a combination of monitoring and load testing. You can’t see the locations for the virtual test bed because it’s virtual – i.e. location independent.
All aspects of the user experience delivery chain must be tested Business Impact Customers negatively impacted by Higher response times Time-out errors