SlideShare une entreprise Scribd logo
1  sur  30
1© 2012 SOASTA. All rights reserved.Webinar
Presents
Tips and Tricks
from Large-Scale
Retail Performance
Engineers
2© 2012 SOASTA. All rights reserved. May 22, 2012
Preparing for the best case retail scenarios
TODAY’S SOASTA PRESENTERS
Paul Korenevsky: Engagement Manager, Load Testing SME - Akamai
Craig Combs: Principal Performance Engineer – Giant Retailer
Mike Ostenberg: Sr. Solution Architect – SOASTA
Moderator - Brad Johnson: VP Product & Channel Marketing - SOASTA
Agenda:
• Intro & Poll question
• Meet Paul from Akamai
• Meet Craig from a Top 5 retailer
• Panel Questions
• CloudTest demo for Retail
Questions:
Submit in chat box during event
3© 2012 SOASTA. All rights reserved. May 22, 2012
4© 2012 SOASTA. All rights reserved. May 22, 2012
Paul Korenevsky
Engagement Manager, Load Testing SME
©2013 AkamaiAkamai Confidential Faster ForwardTM
The Akamai Intelligent Platform: What is it?
Scale & Breadth
• 120,000+ servers
• 1,100+ networks
• 750+ cities
• 1,700+ locations
• 74 countries
The leading Internet Cloud platform for enabling secure,
high-performing user experiences on any device, anywhere.
Web Traffic
• 500 billion hits per day
• 19+ million hits per second
• 100+ million streams per day
• 1M+ concurrent streams
• 5.5+ Terabits per second peak
• 15 – 30 % of all Web traffic
©2013 AkamaiAkamai Confidential Faster ForwardTM
The Akamai Solution Family
Inspire Innovation
©2013 AkamaiAkamai Confidential Faster ForwardTM
How Akamai Works
Customer
Origin
Users
Akamai Edge Server
closest to Origin
Server
Akamai “SureRoute”
protocol optimizes
routes and reduces
round trips
High Performance
Global Overlay
Network
Edge Region
close to End
User
Web Server
Security embedded
into Akamai Edge
Servers
It All Starts in the Cloud – at the Edge
©2013 AkamaiAkamai Confidential Faster ForwardTM
Preparing for Peak Traffic
1. Inventory potential Availability and Performance risks, such as
failures at the:
• Web(servers/LBs)
• App (servers/db/cache)
• Back end (OMS, inventory, fraud prevention, tokenization…)
• Network (ISP, pipe, DNS, LBs …)
• Security (firewall, WAF, IPS/IDS)
• CDN (unless its Akamai, of course)
• 3rd Party (translation/adaptation, recommendations, reviews, a/b testing, analytics, …)
2. Evaluate each risk
• Stress testing
• Load testing
• Penetration testing
3. Mitigate each risk, prioritizing based on evaluation
• Define and implement proactive mitigations
• Prepare and test reactive mitigations
©2013 AkamaiAkamai Confidential Faster ForwardTM
Typical load provides little insight into issues that
arise under peak load
Origin
Infrastructure
©2013 AkamaiAkamai Confidential Faster ForwardTM
Stress test the origin
Origin
Infrastructure
©2013 AkamaiAkamai Confidential Faster ForwardTM
Why Performance Matters
Consumers are becoming less patient - 40% of shoppers will abandon after
3 seconds
8 Seconds
4 Seconds
3 Seconds
0 2 4 6 8 10
Response Time
Site Abandonment Threshold
Zona Research, 1998
Jupiter Research, 2006
Forrester Research, 2009
10 Seconds
Nielsen, 1996
Webpage
Load Time
Seconds
4
2
6
8
10
2
4
6
8
10
Seconds
Consumer Patience
©2013 AkamaiAkamai Confidential Faster ForwardTM
Load test through Akamai for realistic performance
results
Origin
Infrastructure
13© 2012 SOASTA. All rights reserved. May 22, 2012
Craig Combs
Principal Performance Engineer
RetailerA
14© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance
Testing Retail sites
 Test for spikes
Test what you think doesn’t need to be tested
Test expecting failure
If you can’t test it, virtualize it
Don’t forget about the user experience
Monitor everything
Don’t wait until just before the holidays
Test in production
15© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance
Testing Retail sites
 Test for spikes
 Test what you think doesn’t need to be tested
Test expecting failure
If you can’t test it, virtualize it
Don’t forget about the user experience
Monitor everything
Don’t wait until just before the holidays
Test in production
16© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance
Testing Retail sites
 Test for spikes
 Test what you think doesn’t need to be tested
 Test expecting failure
If you can’t test it, virtualize it
Don’t forget about the user experience
Monitor everything
Don’t wait until just before the holidays
Test in production
17© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance
Testing Retail sites
 Test for spikes
 Test what you think doesn’t need to be tested
 Test expecting failure
 If you can’t test it, virtualize it
Don’t forget about the user experience
Monitor everything
Don’t wait until just before the holidays
Test in production
18© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance
Testing Retail sites
 Test for spikes
 Test what you think doesn’t need to be tested
 Test expecting failure
 If you can’t test it, virtualize it
 Don’t forget about the user experience
Monitor everything
Don’t wait until just before the holidays
Test in production
19© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance
Testing Retail sites
 Test for spikes
 Test what you think doesn’t need to be tested
 Test expecting failure
 If you can’t test it, virtualize it
 Don’t forget about the user experience
 Monitor everything
Don’t wait until just before the holidays
Test in production
20© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance
Testing Retail sites
 Test for spikes
 Test what you think doesn’t need to be tested
 Test expecting failure
 If you can’t test it, virtualize it
 Don’t forget about the user experience
 Monitor everything
 Don’t wait until just before the holidays
Test in production
21© 2012 SOASTA. All rights reserved. May 22, 2012
Critical Things for Load and Performance
Testing Retail sites
 Test for spikes
 Test what you think doesn’t need to be tested
 Test expecting failure
 If you can’t test it, virtualize it
 Don’t forget about the user experience
 Monitor everything
 Don’t wait until just before the holidays
 Test in production
22© 2012 SOASTA. All rights reserved. May 22, 2012
23© 2012 SOASTA. All rights reserved. May 22, 2012
1. What are the two primary goals for seasonal testing?
24© 2012 SOASTA. All rights reserved. May 22, 2012
1. What are the two primary goals for seasonal testing?
2. Which critical user-scenarios should be tested first?
25© 2012 SOASTA. All rights reserved. May 22, 2012
1. What are the two primary goals for seasonal testing?
2. Which critical user-scenarios should be tested first?
3. How do you create realistic conditions
26© 2012 SOASTA. All rights reserved. May 22, 2012
1. What are the two primary goals for seasonal testing?
2. Which critical user-scenarios should be tested first?
3. How do you create realistic conditions
4. When should you stress your CDN?
27© 2012 SOASTA. All rights reserved. May 22, 2012
1. What are the two primary goals for seasonal testing?
2. Which critical user-scenarios should be tested first?
3. How do you create realistic conditions
4. When should you stress your CDN?
5. Should you be hammering on live production systems?
28© 2012 SOASTA. All rights reserved. May 22, 2012
1. What are the two primary goals for seasonal testing?
2. Which critical user-scenarios should be tested first?
3. How do you create realistic conditions
4. When should you stress your CDN?
5. Should you be hammering on live production systems?
29© 2012 SOASTA. All rights reserved. May 22, 2012
CloudTest
Actionable
intelligence
Scale
Speed
30© 2012 SOASTA. All rights reserved. May 22, 2012
Thanks
Contact SOASTA:
www.soasta.com/cloudtest/
info@soasta.com
866.344.8766
Follow us:
twitter.com/cloudtest
facebook.com/cloudtest
Knowledge Center
• White Papers
• Webinar Recordings
• Case Studies
RESOURCES
www.SOASTA.com
CloudLink Community
• Support
• Tutorials
• Video

Contenu connexe

Tendances

Four best practices for performance testing mobile apps soasta and utopia
Four best practices for performance testing mobile apps   soasta and utopiaFour best practices for performance testing mobile apps   soasta and utopia
Four best practices for performance testing mobile apps soasta and utopia
SOASTA
 
SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA
 
O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events
O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major EventsO'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events
O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events
SOASTA
 
What Retailers Know About Performance and User Experience
What Retailers Know About Performance and User ExperienceWhat Retailers Know About Performance and User Experience
What Retailers Know About Performance and User Experience
SOASTA
 

Tendances (20)

Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal ReadinessTis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
Tis The Season: Load Testing Tips and Checklist for Retail Seasonal Readiness
 
Four best practices for performance testing mobile apps soasta and utopia
Four best practices for performance testing mobile apps   soasta and utopiaFour best practices for performance testing mobile apps   soasta and utopia
Four best practices for performance testing mobile apps soasta and utopia
 
SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612SOASTA Webinar: Process Compression For Mobile App Dev 120612
SOASTA Webinar: Process Compression For Mobile App Dev 120612
 
O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events
O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major EventsO'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events
O'Reilly Webcast: How Nordstrom Prepares Its Site for Holidays and Major Events
 
Modern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the PresentModern Load Testing: Move Your Load Testing from the Past to the Present
Modern Load Testing: Move Your Load Testing from the Past to the Present
 
Webinar: Load Testing for Your Peak Season
Webinar: Load Testing for Your Peak SeasonWebinar: Load Testing for Your Peak Season
Webinar: Load Testing for Your Peak Season
 
Soasta New Features in CloudTest & TouchTest Webinar
Soasta New Features in CloudTest & TouchTest WebinarSoasta New Features in CloudTest & TouchTest Webinar
Soasta New Features in CloudTest & TouchTest Webinar
 
SOASTA mPulse update webinar
SOASTA mPulse update webinarSOASTA mPulse update webinar
SOASTA mPulse update webinar
 
Soasta | CloudBees webinar 11/12/2015
Soasta | CloudBees webinar 11/12/2015Soasta | CloudBees webinar 11/12/2015
Soasta | CloudBees webinar 11/12/2015
 
Secrets to Realistic Load Testing
Secrets to Realistic Load TestingSecrets to Realistic Load Testing
Secrets to Realistic Load Testing
 
7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testing7 steps to pragmatic mobile testing
7 steps to pragmatic mobile testing
 
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTestIntegrating Cloud-based performance test in VSTS with SOASTA CloudTest
Integrating Cloud-based performance test in VSTS with SOASTA CloudTest
 
What Retailers Know About Performance and User Experience
What Retailers Know About Performance and User ExperienceWhat Retailers Know About Performance and User Experience
What Retailers Know About Performance and User Experience
 
Testing In Production (TiP) Advances with Big Data & the Cloud
Testing In Production (TiP) Advances with Big Data & the CloudTesting In Production (TiP) Advances with Big Data & the Cloud
Testing In Production (TiP) Advances with Big Data & the Cloud
 
Continuous Testing
Continuous TestingContinuous Testing
Continuous Testing
 
Synthetic and rum webinar
Synthetic and rum webinarSynthetic and rum webinar
Synthetic and rum webinar
 
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTAThriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
Thriving in the Shark Tank: How Vebalizeit Load Tested with SOASTA
 
Building a Performance A-Team
Building a Performance A-TeamBuilding a Performance A-Team
Building a Performance A-Team
 
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and DeliveryAccelerate Web and Mobile Testing for Continuous Integration and Delivery
Accelerate Web and Mobile Testing for Continuous Integration and Delivery
 
Agile Load Testing In The Real World
Agile Load Testing In The Real WorldAgile Load Testing In The Real World
Agile Load Testing In The Real World
 

Similaire à Performance Warrior Tales: Cloud Load Testing the Retail Giants

Introduction to primavera risk analysis ppt
Introduction to primavera risk analysis pptIntroduction to primavera risk analysis ppt
Introduction to primavera risk analysis ppt
p6academy
 
Unleashing the power of Scrum and Kanban together - Best of Both Worlds!!
Unleashing the power of Scrum and Kanban together - Best of Both Worlds!!Unleashing the power of Scrum and Kanban together - Best of Both Worlds!!
Unleashing the power of Scrum and Kanban together - Best of Both Worlds!!
Nitin Ramrakhyani
 
Fusion Applications Bare Metal Provisioning - Lessons Learned
Fusion Applications Bare Metal Provisioning - Lessons LearnedFusion Applications Bare Metal Provisioning - Lessons Learned
Fusion Applications Bare Metal Provisioning - Lessons Learned
Andrejs Karpovs
 

Similaire à Performance Warrior Tales: Cloud Load Testing the Retail Giants (20)

STPCon fall 2012: The Testing Renaissance Has Arrived
STPCon fall 2012: The Testing Renaissance Has ArrivedSTPCon fall 2012: The Testing Renaissance Has Arrived
STPCon fall 2012: The Testing Renaissance Has Arrived
 
Agile Testing Dilemmas
Agile Testing DilemmasAgile Testing Dilemmas
Agile Testing Dilemmas
 
Continuous Performance Testing
Continuous Performance TestingContinuous Performance Testing
Continuous Performance Testing
 
Cross browser testing
Cross browser testingCross browser testing
Cross browser testing
 
QA Role In Agile Teams - by Michael Hall
QA Role In Agile Teams - by Michael HallQA Role In Agile Teams - by Michael Hall
QA Role In Agile Teams - by Michael Hall
 
Continuous Delivery in the Enterprise
Continuous Delivery in the EnterpriseContinuous Delivery in the Enterprise
Continuous Delivery in the Enterprise
 
Introduction to primavera risk analysis ppt
Introduction to primavera risk analysis pptIntroduction to primavera risk analysis ppt
Introduction to primavera risk analysis ppt
 
What's so great about web driver?
What's so great about web driver?What's so great about web driver?
What's so great about web driver?
 
How BiggerPockets runs experiments faster with performance edge
How BiggerPockets runs experiments faster with performance edgeHow BiggerPockets runs experiments faster with performance edge
How BiggerPockets runs experiments faster with performance edge
 
Lean Development Practices for Enterprise Agile
Lean Development Practices for Enterprise AgileLean Development Practices for Enterprise Agile
Lean Development Practices for Enterprise Agile
 
Unleashing the power of Scrum and Kanban together - Best of Both Worlds!!
Unleashing the power of Scrum and Kanban together - Best of Both Worlds!!Unleashing the power of Scrum and Kanban together - Best of Both Worlds!!
Unleashing the power of Scrum and Kanban together - Best of Both Worlds!!
 
Case Study: How we achieved 95% automation with IBM Rational Quality Manageme...
Case Study: How we achieved 95% automation with IBM Rational Quality Manageme...Case Study: How we achieved 95% automation with IBM Rational Quality Manageme...
Case Study: How we achieved 95% automation with IBM Rational Quality Manageme...
 
Making Numbers Count: Metrics That Matter
Making Numbers Count: Metrics That MatterMaking Numbers Count: Metrics That Matter
Making Numbers Count: Metrics That Matter
 
Fusion Applications Bare Metal Provisioning - Lessons Learned
Fusion Applications Bare Metal Provisioning - Lessons LearnedFusion Applications Bare Metal Provisioning - Lessons Learned
Fusion Applications Bare Metal Provisioning - Lessons Learned
 
Getting Demo & POV Ready
Getting Demo & POV ReadyGetting Demo & POV Ready
Getting Demo & POV Ready
 
Universal test solutions customer testimonial 10192013-v2.2
Universal test solutions customer testimonial 10192013-v2.2Universal test solutions customer testimonial 10192013-v2.2
Universal test solutions customer testimonial 10192013-v2.2
 
Dual-Track Agile at Scale
Dual-Track Agile at ScaleDual-Track Agile at Scale
Dual-Track Agile at Scale
 
UAT Validation in Production
UAT Validation in ProductionUAT Validation in Production
UAT Validation in Production
 
Bugday bkk-2014 nitisak-auto_perf
Bugday bkk-2014 nitisak-auto_perfBugday bkk-2014 nitisak-auto_perf
Bugday bkk-2014 nitisak-auto_perf
 
Apm andre santos
Apm andre santosApm andre santos
Apm andre santos
 

Plus de SOASTA

The Four Hats of Load and Performance Testing with special guest Mentora
The Four Hats of Load and Performance Testing with special guest MentoraThe Four Hats of Load and Performance Testing with special guest Mentora
The Four Hats of Load and Performance Testing with special guest Mentora
SOASTA
 

Plus de SOASTA (20)

DPM in Pictures
DPM in PicturesDPM in Pictures
DPM in Pictures
 
Optimizing your marketing promotions to mazimize your revenue
Optimizing your marketing promotions to mazimize your revenueOptimizing your marketing promotions to mazimize your revenue
Optimizing your marketing promotions to mazimize your revenue
 
Using JMeter in CloudTest for Continuous Testing
Using JMeter in CloudTest for Continuous TestingUsing JMeter in CloudTest for Continuous Testing
Using JMeter in CloudTest for Continuous Testing
 
Velocity Booth Session - Better Together: RUM & Synthetic
Velocity Booth Session - Better Together: RUM & SyntheticVelocity Booth Session - Better Together: RUM & Synthetic
Velocity Booth Session - Better Together: RUM & Synthetic
 
Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?
Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?
Velocity Booth Presentation - Which 3rd Party Resources Are Eating Your Profits?
 
Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...
Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...
Velocity 2016 Speaking Session - Using Machine Learning to Determine Drivers ...
 
Velocity 15 Minute Booth Session - Building a Performance Team - Dave Murphy
Velocity 15 Minute Booth Session - Building a Performance Team - Dave MurphyVelocity 15 Minute Booth Session - Building a Performance Team - Dave Murphy
Velocity 15 Minute Booth Session - Building a Performance Team - Dave Murphy
 
Radial | SOASTA IR Webinar
Radial | SOASTA IR WebinarRadial | SOASTA IR Webinar
Radial | SOASTA IR Webinar
 
IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...
IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...
IRCE 2016 Speaking Session – The Small Things That Add Up: How to Find What D...
 
Ann Ruckstuhl eTail West
Ann Ruckstuhl eTail WestAnn Ruckstuhl eTail West
Ann Ruckstuhl eTail West
 
Webinar: New Features in CloudTest & TouchTest
Webinar: New Features in CloudTest & TouchTestWebinar: New Features in CloudTest & TouchTest
Webinar: New Features in CloudTest & TouchTest
 
Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...
Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...
Rewriting The Revenue Rules: From Mobile-First To Mobile-Only Mobile Shopping...
 
Forensic tools for in-depth performance investigations
Forensic tools for in-depth performance investigations Forensic tools for in-depth performance investigations
Forensic tools for in-depth performance investigations
 
Metrics, metrics everywhere (but where the heck do you start?)
Metrics, metrics everywhere (but where the heck do you start?) Metrics, metrics everywhere (but where the heck do you start?)
Metrics, metrics everywhere (but where the heck do you start?)
 
Webinar - Success Factors Behind Successful Flash Sales
Webinar - Success Factors Behind Successful Flash SalesWebinar - Success Factors Behind Successful Flash Sales
Webinar - Success Factors Behind Successful Flash Sales
 
Business Value of Performance - Ann Ruckstuhl CMO DOC
Business Value of Performance - Ann Ruckstuhl CMO DOCBusiness Value of Performance - Ann Ruckstuhl CMO DOC
Business Value of Performance - Ann Ruckstuhl CMO DOC
 
eTail East 2015 - Ann Ruckstuhl Presentation
eTail East 2015 - Ann Ruckstuhl Presentation eTail East 2015 - Ann Ruckstuhl Presentation
eTail East 2015 - Ann Ruckstuhl Presentation
 
State of the Union - Mobile Performance
State of the Union - Mobile PerformanceState of the Union - Mobile Performance
State of the Union - Mobile Performance
 
20,000 Hours in the Cloud - Top 5 Cloud Lessons Learned By Tom Lounibos, CEO ...
20,000 Hours in the Cloud - Top 5 Cloud Lessons Learned By Tom Lounibos, CEO ...20,000 Hours in the Cloud - Top 5 Cloud Lessons Learned By Tom Lounibos, CEO ...
20,000 Hours in the Cloud - Top 5 Cloud Lessons Learned By Tom Lounibos, CEO ...
 
The Four Hats of Load and Performance Testing with special guest Mentora
The Four Hats of Load and Performance Testing with special guest MentoraThe Four Hats of Load and Performance Testing with special guest Mentora
The Four Hats of Load and Performance Testing with special guest Mentora
 

Dernier

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Dernier (20)

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 

Performance Warrior Tales: Cloud Load Testing the Retail Giants

  • 1. 1© 2012 SOASTA. All rights reserved.Webinar Presents Tips and Tricks from Large-Scale Retail Performance Engineers
  • 2. 2© 2012 SOASTA. All rights reserved. May 22, 2012 Preparing for the best case retail scenarios TODAY’S SOASTA PRESENTERS Paul Korenevsky: Engagement Manager, Load Testing SME - Akamai Craig Combs: Principal Performance Engineer – Giant Retailer Mike Ostenberg: Sr. Solution Architect – SOASTA Moderator - Brad Johnson: VP Product & Channel Marketing - SOASTA Agenda: • Intro & Poll question • Meet Paul from Akamai • Meet Craig from a Top 5 retailer • Panel Questions • CloudTest demo for Retail Questions: Submit in chat box during event
  • 3. 3© 2012 SOASTA. All rights reserved. May 22, 2012
  • 4. 4© 2012 SOASTA. All rights reserved. May 22, 2012 Paul Korenevsky Engagement Manager, Load Testing SME
  • 5. ©2013 AkamaiAkamai Confidential Faster ForwardTM The Akamai Intelligent Platform: What is it? Scale & Breadth • 120,000+ servers • 1,100+ networks • 750+ cities • 1,700+ locations • 74 countries The leading Internet Cloud platform for enabling secure, high-performing user experiences on any device, anywhere. Web Traffic • 500 billion hits per day • 19+ million hits per second • 100+ million streams per day • 1M+ concurrent streams • 5.5+ Terabits per second peak • 15 – 30 % of all Web traffic
  • 6. ©2013 AkamaiAkamai Confidential Faster ForwardTM The Akamai Solution Family Inspire Innovation
  • 7. ©2013 AkamaiAkamai Confidential Faster ForwardTM How Akamai Works Customer Origin Users Akamai Edge Server closest to Origin Server Akamai “SureRoute” protocol optimizes routes and reduces round trips High Performance Global Overlay Network Edge Region close to End User Web Server Security embedded into Akamai Edge Servers It All Starts in the Cloud – at the Edge
  • 8. ©2013 AkamaiAkamai Confidential Faster ForwardTM Preparing for Peak Traffic 1. Inventory potential Availability and Performance risks, such as failures at the: • Web(servers/LBs) • App (servers/db/cache) • Back end (OMS, inventory, fraud prevention, tokenization…) • Network (ISP, pipe, DNS, LBs …) • Security (firewall, WAF, IPS/IDS) • CDN (unless its Akamai, of course) • 3rd Party (translation/adaptation, recommendations, reviews, a/b testing, analytics, …) 2. Evaluate each risk • Stress testing • Load testing • Penetration testing 3. Mitigate each risk, prioritizing based on evaluation • Define and implement proactive mitigations • Prepare and test reactive mitigations
  • 9. ©2013 AkamaiAkamai Confidential Faster ForwardTM Typical load provides little insight into issues that arise under peak load Origin Infrastructure
  • 10. ©2013 AkamaiAkamai Confidential Faster ForwardTM Stress test the origin Origin Infrastructure
  • 11. ©2013 AkamaiAkamai Confidential Faster ForwardTM Why Performance Matters Consumers are becoming less patient - 40% of shoppers will abandon after 3 seconds 8 Seconds 4 Seconds 3 Seconds 0 2 4 6 8 10 Response Time Site Abandonment Threshold Zona Research, 1998 Jupiter Research, 2006 Forrester Research, 2009 10 Seconds Nielsen, 1996 Webpage Load Time Seconds 4 2 6 8 10 2 4 6 8 10 Seconds Consumer Patience
  • 12. ©2013 AkamaiAkamai Confidential Faster ForwardTM Load test through Akamai for realistic performance results Origin Infrastructure
  • 13. 13© 2012 SOASTA. All rights reserved. May 22, 2012 Craig Combs Principal Performance Engineer RetailerA
  • 14. 14© 2012 SOASTA. All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites  Test for spikes Test what you think doesn’t need to be tested Test expecting failure If you can’t test it, virtualize it Don’t forget about the user experience Monitor everything Don’t wait until just before the holidays Test in production
  • 15. 15© 2012 SOASTA. All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites  Test for spikes  Test what you think doesn’t need to be tested Test expecting failure If you can’t test it, virtualize it Don’t forget about the user experience Monitor everything Don’t wait until just before the holidays Test in production
  • 16. 16© 2012 SOASTA. All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites  Test for spikes  Test what you think doesn’t need to be tested  Test expecting failure If you can’t test it, virtualize it Don’t forget about the user experience Monitor everything Don’t wait until just before the holidays Test in production
  • 17. 17© 2012 SOASTA. All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites  Test for spikes  Test what you think doesn’t need to be tested  Test expecting failure  If you can’t test it, virtualize it Don’t forget about the user experience Monitor everything Don’t wait until just before the holidays Test in production
  • 18. 18© 2012 SOASTA. All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites  Test for spikes  Test what you think doesn’t need to be tested  Test expecting failure  If you can’t test it, virtualize it  Don’t forget about the user experience Monitor everything Don’t wait until just before the holidays Test in production
  • 19. 19© 2012 SOASTA. All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites  Test for spikes  Test what you think doesn’t need to be tested  Test expecting failure  If you can’t test it, virtualize it  Don’t forget about the user experience  Monitor everything Don’t wait until just before the holidays Test in production
  • 20. 20© 2012 SOASTA. All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites  Test for spikes  Test what you think doesn’t need to be tested  Test expecting failure  If you can’t test it, virtualize it  Don’t forget about the user experience  Monitor everything  Don’t wait until just before the holidays Test in production
  • 21. 21© 2012 SOASTA. All rights reserved. May 22, 2012 Critical Things for Load and Performance Testing Retail sites  Test for spikes  Test what you think doesn’t need to be tested  Test expecting failure  If you can’t test it, virtualize it  Don’t forget about the user experience  Monitor everything  Don’t wait until just before the holidays  Test in production
  • 22. 22© 2012 SOASTA. All rights reserved. May 22, 2012
  • 23. 23© 2012 SOASTA. All rights reserved. May 22, 2012 1. What are the two primary goals for seasonal testing?
  • 24. 24© 2012 SOASTA. All rights reserved. May 22, 2012 1. What are the two primary goals for seasonal testing? 2. Which critical user-scenarios should be tested first?
  • 25. 25© 2012 SOASTA. All rights reserved. May 22, 2012 1. What are the two primary goals for seasonal testing? 2. Which critical user-scenarios should be tested first? 3. How do you create realistic conditions
  • 26. 26© 2012 SOASTA. All rights reserved. May 22, 2012 1. What are the two primary goals for seasonal testing? 2. Which critical user-scenarios should be tested first? 3. How do you create realistic conditions 4. When should you stress your CDN?
  • 27. 27© 2012 SOASTA. All rights reserved. May 22, 2012 1. What are the two primary goals for seasonal testing? 2. Which critical user-scenarios should be tested first? 3. How do you create realistic conditions 4. When should you stress your CDN? 5. Should you be hammering on live production systems?
  • 28. 28© 2012 SOASTA. All rights reserved. May 22, 2012 1. What are the two primary goals for seasonal testing? 2. Which critical user-scenarios should be tested first? 3. How do you create realistic conditions 4. When should you stress your CDN? 5. Should you be hammering on live production systems?
  • 29. 29© 2012 SOASTA. All rights reserved. May 22, 2012 CloudTest Actionable intelligence Scale Speed
  • 30. 30© 2012 SOASTA. All rights reserved. May 22, 2012 Thanks Contact SOASTA: www.soasta.com/cloudtest/ info@soasta.com 866.344.8766 Follow us: twitter.com/cloudtest facebook.com/cloudtest Knowledge Center • White Papers • Webinar Recordings • Case Studies RESOURCES www.SOASTA.com CloudLink Community • Support • Tutorials • Video

Notes de l'éditeur

  1. The Akamai Intelligent Platform is the leading cloud platform for delivering secure, high-performing user experiences to any device, anywhere. It is a network of over 120,000 servers equipped with proprietary software and deployed in over 75 countries. It relies on applied mathematics and algorithms to help solve congestion and vulnerability problems on the Internet. These servers monitor the Internet in real time - gathering information about traffic, congestion, and trouble spots. Akamai uses this intelligence to optimize routes and replicate data dynamically to deliver content and applications more quickly, reliably, and securely. The Akamai Intelligent Platform can: identify, absorb, and block security threats. provide instant device-level detection and optimization. make decisions based on comprehensive knowledge of network conditions. present unprecedented business and technical insights.
  2. The globally-distributed Akamai Intelligent Platform continuously pulls and caches fresh content onto servers that are closer to the end user. Akamai’s intelligent dynamic mapping system directs user requests for dynamic content to an optimal Akamai Edge Server. Through route optimization the fastest and most reliable path back to a customer’s data center is identified to retrieve dynamic/interactive content. Trips to the origin server to refresh and retrieve content are optimized via the use of persistent connections, thereby reducing connection setup and teardown latency. Additional connection optimization techniques tune the parameters that govern server-to-server connections, as well as reduce the number of long-haul round trips required to retrieve content embedded in the site.
  3. Load testing provides insight into site performance, which is closely tied to conversion, engagement, and end user satisfaction Load testing also provides means for accurate evaluation of Dos/DDoS impact
  4. Artificial load is necessary to simulate peak load conditions
  5. Evaluate origin infrastructure by stress testing directly against the origin, bypassing CDN and excluding 3rd Party content/services
  6. The growing requirements of delivering dynamic transactions and interactive content must be matched with an increased ability to scale under high traffic load and perform reliably to meet increased consumer demand. Organizations competing for customers measure their success based not on seconds, but on milliseconds. Research has shown that users will visit a website less often if it is slower than a close competitor by more than 250 milliseconds. The difference between a two second load time and a one second load time can mean the difference between a user conversion, and a lost opportunity. In short, organizations seeking the maximum speed and offload must continue to further refine and optimize website performance.
  7. With Akamai, fewer unique machines connect to your origin server directly and fewer requests are served by your origin.