SlideShare une entreprise Scribd logo
1  sur  20
Excellence in Cloud
Performance




              Performance does
              matter
              5 things to consider
              sven.hammar@apicasystem.com

              Watch the video of this presentation
Situation Today

 Sites Continue to Crash

 Extremely Sluggish Response Times

 Why?




                                      2
How to handle the expected?
          June 19, 2010




                              3
How to prepare for the
   unexpected?...




                         4
Peak Load Problem

                      Load               Server & Cloud
   Rapid Load Ramp-Up          Fixed Capacity
                                Scalability
   Snowball Effect             Application Transparancy




                                                            5
Tips & Suggestions
  #1 For peak and high load
     Small is Fast
     Have backup plan “minimalistic start/landing pages“



  #2 Extensive use of Front End Cache systems
     Optimize the cache solution, consider Varnish
     Less traffic is less problem, no direct DB access


  #3 Implement Scaling & Queuing System
     Redirect excess trafic with LoadBalanser
     Create Informative ”Wait” pages



  Be prepared : Test the solution before launch


                                                            6
Why Run A Performance Load Test ?




                Is the site stable?
               When does it crash?
             How can I make it faster?
            Can my application scale?

                                         7
Capacity
           vs.
                 Load




                  8
Test
Environment



              vs.



                     Production
                    Environment
                           9
Load test 1 to 1
 Load Maximum                       Throughput
                                                     Point of collapse
   – How many users can we handle
     ?
   – What is a good result ?                                             Complete
                                                                         failure

                                                                           Nr of
                                                                           users
 Behaviour in the ”Danger
  Zone”
   –                                 Response time
                                                                  ∞
       Does the application become
       unstable above load maximum
       ?


 Problem Analysis                                                          Nr of
                                                                            users
   – Where are the bottlenecks
   – How to fix them ?

                                                                            10
Do you have
Performance Targets?

              We shall never crash due to load
              We shall be compareble with the best in
                class sites for ...
              Our peak time response time shall be
                better then site www.YYY

               Level : We shall handle100.000 page views
                per hour with :
               Better then 4 sec average response time
               95% of our users shall make a selection for
                purchase of a (ticket, service etc .. ) in less
                then 30 seconds


                                                                  11
LoadTest findings

  #1 Identify the Backend Calls
     Database calls don’t kill your application
     Lack of caching does!


  #2 Check Static Content Delivery
     Optimize the cache solution, consider Varnish
     Consider using a CDN, if needed


  #3 Web Infrastructure
       Load Balancer
       Server model
       Bandwidth
       Scaling & Failover




                                                      12
Know your numbers




                    13
By the numbers

 The need for a baseline
 My startpage, Login, Book a flight


 Response Time – Average 3.2 sec
 Typical Values – Median              2.5 sec
 Standard Deviation        2.8 sec
 SLA % 99.9
 95 % is better then       11,8 sec




                                                 14
WebPerformance Monitoring for the
Cloud
1      UP/Down        2      Browser        3   Application    4   Correlation




     Basic Monitor        Browser          Analytics         Inside
     Alerting             Scenarios        Trend
                                                                   monitoring
                                                                Vital Signs
     Up – down            Analytics        Complex
     Basic SLA            Response time
                                                Application     Drill Down
                                             SLA on            Root cause
                                                applications    Consolidation
                                                                   with other
                                                                   system




                                                                                 15
16
Tips & Suggestions

 #1 Set Goals
    Uptime
    Performance



 #2 Hate the average
    Work with the exceptions
    Remove the 10 Worst transactions
     every month


 #3 Fire drill
    Help identifying problems
    Correlation of data




                                        17
To sum it up

1                   2                 3                 4




     A load test        Know your        Plan for         Fire Drill
     before              numbers...        the                - Be
     release …                             unexpected         prepared
                                           ...




All systems have a weak spot – what is
yours ?
                                                                           18
Excellence in Cloud
Performance




            Thank You!
Further information


 www.apicasystems.com
   – www.apicasystems.com/partners/rightscale.a
     spx


 sven.hammar@apicasystem.com


 craig.irwin@apicasystem.com




                                                  20

Contenu connexe

Similaire à Apica - Performance Does Matter: Five Key Elements to Consider in the Cloud

Implementing Vulnerability Management
Implementing Vulnerability Management Implementing Vulnerability Management
Implementing Vulnerability Management
Argyle Executive Forum
 
Monitoring applications on cloud - Indicthreads cloud computing conference 2011
Monitoring applications on cloud - Indicthreads cloud computing conference 2011Monitoring applications on cloud - Indicthreads cloud computing conference 2011
Monitoring applications on cloud - Indicthreads cloud computing conference 2011
IndicThreads
 
SANscreen Customer Preso 18 Jun09
SANscreen Customer Preso 18 Jun09SANscreen Customer Preso 18 Jun09
SANscreen Customer Preso 18 Jun09
rosaranger
 
Slow Cool 20081009 Final
Slow Cool 20081009 FinalSlow Cool 20081009 Final
Slow Cool 20081009 Final
rajivmordani
 

Similaire à Apica - Performance Does Matter: Five Key Elements to Consider in the Cloud (20)

One millions users vs your web application mega testing cloud applications pr...
One millions users vs your web application mega testing cloud applications pr...One millions users vs your web application mega testing cloud applications pr...
One millions users vs your web application mega testing cloud applications pr...
 
Performance: Key Elements to Consider in the Cloud - RightScale Compute 2013
Performance: Key Elements to Consider in the Cloud - RightScale Compute 2013Performance: Key Elements to Consider in the Cloud - RightScale Compute 2013
Performance: Key Elements to Consider in the Cloud - RightScale Compute 2013
 
Gomez / Universal Mind Webinar - Are You Ready? A New Approach for Ensuring Y...
Gomez / Universal Mind Webinar - Are You Ready? A New Approach for Ensuring Y...Gomez / Universal Mind Webinar - Are You Ready? A New Approach for Ensuring Y...
Gomez / Universal Mind Webinar - Are You Ready? A New Approach for Ensuring Y...
 
Nfr testing(performance)
Nfr testing(performance)Nfr testing(performance)
Nfr testing(performance)
 
Implementing Vulnerability Management
Implementing Vulnerability Management Implementing Vulnerability Management
Implementing Vulnerability Management
 
Monitoring applications on cloud - Indicthreads cloud computing conference 2011
Monitoring applications on cloud - Indicthreads cloud computing conference 2011Monitoring applications on cloud - Indicthreads cloud computing conference 2011
Monitoring applications on cloud - Indicthreads cloud computing conference 2011
 
Starting Your DevOps Journey – Practical Tips for Ops
Starting Your DevOps Journey – Practical Tips for OpsStarting Your DevOps Journey – Practical Tips for Ops
Starting Your DevOps Journey – Practical Tips for Ops
 
10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...
10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...
10 Tricks to Ensure Your Oracle Coherence Cluster is Not a "Black Box" in Pro...
 
Internet World Web2
Internet World Web2Internet World Web2
Internet World Web2
 
Deep Automation and ML-Driven Analytics for Application Services
Deep Automation and ML-Driven Analytics for Application ServicesDeep Automation and ML-Driven Analytics for Application Services
Deep Automation and ML-Driven Analytics for Application Services
 
CPN208 Failures at Scale & How to Ride Through Them - AWS re: Invent 2012
CPN208 Failures at Scale & How to Ride Through Them - AWS re: Invent 2012CPN208 Failures at Scale & How to Ride Through Them - AWS re: Invent 2012
CPN208 Failures at Scale & How to Ride Through Them - AWS re: Invent 2012
 
Accelerating Spark Genome Sequencing in Cloud—A Data Driven Approach, Case St...
Accelerating Spark Genome Sequencing in Cloud—A Data Driven Approach, Case St...Accelerating Spark Genome Sequencing in Cloud—A Data Driven Approach, Case St...
Accelerating Spark Genome Sequencing in Cloud—A Data Driven Approach, Case St...
 
Upgrade Dos and Don'ts for JIRA and Confluence - Atlassian Summit 2010
Upgrade Dos and Don'ts for JIRA and Confluence - Atlassian Summit 2010Upgrade Dos and Don'ts for JIRA and Confluence - Atlassian Summit 2010
Upgrade Dos and Don'ts for JIRA and Confluence - Atlassian Summit 2010
 
Nonfunctional Testing: Examine the Other Side of the Coin
Nonfunctional Testing: Examine the Other Side of the CoinNonfunctional Testing: Examine the Other Side of the Coin
Nonfunctional Testing: Examine the Other Side of the Coin
 
Web Performance Internals explained for Developers and other stake holders.
Web Performance Internals explained for Developers and other stake holders.Web Performance Internals explained for Developers and other stake holders.
Web Performance Internals explained for Developers and other stake holders.
 
What makes the large enterprise network management, large
What makes the large enterprise network management, largeWhat makes the large enterprise network management, large
What makes the large enterprise network management, large
 
Gomez Blazing Fast Cloud Best Practices
Gomez Blazing Fast Cloud Best Practices Gomez Blazing Fast Cloud Best Practices
Gomez Blazing Fast Cloud Best Practices
 
SANscreen Customer Preso 18 Jun09
SANscreen Customer Preso 18 Jun09SANscreen Customer Preso 18 Jun09
SANscreen Customer Preso 18 Jun09
 
Start Up Austin 2017: Production Preview - How to Stop Bad Things From Happening
Start Up Austin 2017: Production Preview - How to Stop Bad Things From HappeningStart Up Austin 2017: Production Preview - How to Stop Bad Things From Happening
Start Up Austin 2017: Production Preview - How to Stop Bad Things From Happening
 
Slow Cool 20081009 Final
Slow Cool 20081009 FinalSlow Cool 20081009 Final
Slow Cool 20081009 Final
 

Plus de RightScale

Plus de RightScale (20)

10 Must-Have Automated Cloud Policies for IT Governance
10 Must-Have Automated Cloud Policies for IT Governance10 Must-Have Automated Cloud Policies for IT Governance
10 Must-Have Automated Cloud Policies for IT Governance
 
Kubernetes and Terraform in the Cloud: How RightScale Does DevOps
Kubernetes and Terraform in the Cloud: How RightScale Does DevOpsKubernetes and Terraform in the Cloud: How RightScale Does DevOps
Kubernetes and Terraform in the Cloud: How RightScale Does DevOps
 
Optimize Software, SaaS, and Cloud with Flexera and RightScale
Optimize Software, SaaS, and Cloud with Flexera and RightScaleOptimize Software, SaaS, and Cloud with Flexera and RightScale
Optimize Software, SaaS, and Cloud with Flexera and RightScale
 
Prepare Your Enterprise Cloud Strategy for 2019: 7 Things to Think About Now
Prepare Your Enterprise Cloud Strategy for 2019: 7 Things to Think About NowPrepare Your Enterprise Cloud Strategy for 2019: 7 Things to Think About Now
Prepare Your Enterprise Cloud Strategy for 2019: 7 Things to Think About Now
 
How to Set Up a Cloud Cost Optimization Process for your Enterprise
How to Set Up a Cloud Cost Optimization Process for your EnterpriseHow to Set Up a Cloud Cost Optimization Process for your Enterprise
How to Set Up a Cloud Cost Optimization Process for your Enterprise
 
Multi-Cloud Management with RightScale CMP (Demo)
Multi-Cloud Management with RightScale CMP (Demo)Multi-Cloud Management with RightScale CMP (Demo)
Multi-Cloud Management with RightScale CMP (Demo)
 
Comparing Cloud VM Types and Prices: AWS vs Azure vs Google vs IBM
Comparing Cloud VM Types and Prices: AWS vs Azure vs Google vs IBMComparing Cloud VM Types and Prices: AWS vs Azure vs Google vs IBM
Comparing Cloud VM Types and Prices: AWS vs Azure vs Google vs IBM
 
How to Allocate and Report Cloud Costs with RightScale Optima
How to Allocate and Report Cloud Costs with RightScale OptimaHow to Allocate and Report Cloud Costs with RightScale Optima
How to Allocate and Report Cloud Costs with RightScale Optima
 
Should You Move Between AWS, Azure, or Google Clouds? Considerations, Pros an...
Should You Move Between AWS, Azure, or Google Clouds? Considerations, Pros an...Should You Move Between AWS, Azure, or Google Clouds? Considerations, Pros an...
Should You Move Between AWS, Azure, or Google Clouds? Considerations, Pros an...
 
Using RightScale CMP with Cloud Provider Tools
Using RightScale CMP with Cloud Provider ToolsUsing RightScale CMP with Cloud Provider Tools
Using RightScale CMP with Cloud Provider Tools
 
Best Practices for Multi-Cloud Security and Compliance
Best Practices for Multi-Cloud Security and ComplianceBest Practices for Multi-Cloud Security and Compliance
Best Practices for Multi-Cloud Security and Compliance
 
Automating Multi-Cloud Policies for AWS, Azure, Google, and More
Automating Multi-Cloud Policies for AWS, Azure, Google, and MoreAutomating Multi-Cloud Policies for AWS, Azure, Google, and More
Automating Multi-Cloud Policies for AWS, Azure, Google, and More
 
The 5 Stages of Cloud Management for Enterprises
The 5 Stages of Cloud Management for EnterprisesThe 5 Stages of Cloud Management for Enterprises
The 5 Stages of Cloud Management for Enterprises
 
9 Ways to Reduce Cloud Storage Costs
9 Ways to Reduce Cloud Storage Costs9 Ways to Reduce Cloud Storage Costs
9 Ways to Reduce Cloud Storage Costs
 
Serverless Comparison: AWS vs Azure vs Google vs IBM
Serverless Comparison: AWS vs Azure vs Google vs IBMServerless Comparison: AWS vs Azure vs Google vs IBM
Serverless Comparison: AWS vs Azure vs Google vs IBM
 
Best Practices for Cloud Managed Services Providers: The Path to CMP Success
Best Practices for Cloud Managed Services Providers: The Path to CMP SuccessBest Practices for Cloud Managed Services Providers: The Path to CMP Success
Best Practices for Cloud Managed Services Providers: The Path to CMP Success
 
Cloud Storage Comparison: AWS vs Azure vs Google vs IBM
Cloud Storage Comparison: AWS vs Azure vs Google vs IBMCloud Storage Comparison: AWS vs Azure vs Google vs IBM
Cloud Storage Comparison: AWS vs Azure vs Google vs IBM
 
2018 Cloud Trends: RightScale State of the Cloud Report
2018 Cloud Trends: RightScale State of the Cloud Report2018 Cloud Trends: RightScale State of the Cloud Report
2018 Cloud Trends: RightScale State of the Cloud Report
 
Got a Multi-Cloud Strategy? How RightScale CMP Helps
Got a Multi-Cloud Strategy? How RightScale CMP HelpsGot a Multi-Cloud Strategy? How RightScale CMP Helps
Got a Multi-Cloud Strategy? How RightScale CMP Helps
 
How to Manage Cloud Costs with RightScale Optima
How to Manage Cloud Costs with RightScale OptimaHow to Manage Cloud Costs with RightScale Optima
How to Manage Cloud Costs with RightScale Optima
 

Dernier

Dernier (20)

08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 

Apica - Performance Does Matter: Five Key Elements to Consider in the Cloud

  • 1. Excellence in Cloud Performance Performance does matter 5 things to consider sven.hammar@apicasystem.com Watch the video of this presentation
  • 2. Situation Today  Sites Continue to Crash  Extremely Sluggish Response Times  Why? 2
  • 3. How to handle the expected? June 19, 2010 3
  • 4. How to prepare for the unexpected?... 4
  • 5. Peak Load Problem Load Server & Cloud  Rapid Load Ramp-Up  Fixed Capacity  Scalability  Snowball Effect  Application Transparancy 5
  • 6. Tips & Suggestions  #1 For peak and high load  Small is Fast  Have backup plan “minimalistic start/landing pages“  #2 Extensive use of Front End Cache systems  Optimize the cache solution, consider Varnish  Less traffic is less problem, no direct DB access  #3 Implement Scaling & Queuing System  Redirect excess trafic with LoadBalanser  Create Informative ”Wait” pages  Be prepared : Test the solution before launch 6
  • 7. Why Run A Performance Load Test ? Is the site stable? When does it crash? How can I make it faster? Can my application scale? 7
  • 8. Capacity vs. Load 8
  • 9. Test Environment vs. Production Environment 9
  • 10. Load test 1 to 1  Load Maximum Throughput Point of collapse – How many users can we handle ? – What is a good result ? Complete failure Nr of users  Behaviour in the ”Danger Zone” – Response time ∞ Does the application become unstable above load maximum ?  Problem Analysis Nr of users – Where are the bottlenecks – How to fix them ? 10
  • 11. Do you have Performance Targets? We shall never crash due to load We shall be compareble with the best in class sites for ... Our peak time response time shall be better then site www.YYY  Level : We shall handle100.000 page views per hour with :  Better then 4 sec average response time  95% of our users shall make a selection for purchase of a (ticket, service etc .. ) in less then 30 seconds 11
  • 12. LoadTest findings  #1 Identify the Backend Calls  Database calls don’t kill your application  Lack of caching does!  #2 Check Static Content Delivery  Optimize the cache solution, consider Varnish  Consider using a CDN, if needed  #3 Web Infrastructure  Load Balancer  Server model  Bandwidth  Scaling & Failover 12
  • 14. By the numbers  The need for a baseline  My startpage, Login, Book a flight  Response Time – Average 3.2 sec  Typical Values – Median 2.5 sec  Standard Deviation 2.8 sec  SLA % 99.9  95 % is better then 11,8 sec 14
  • 15. WebPerformance Monitoring for the Cloud 1 UP/Down 2 Browser 3 Application 4 Correlation  Basic Monitor  Browser  Analytics  Inside  Alerting  Scenarios  Trend monitoring  Vital Signs  Up – down  Analytics  Complex  Basic SLA  Response time Application  Drill Down  SLA on  Root cause applications  Consolidation with other system 15
  • 16. 16
  • 17. Tips & Suggestions  #1 Set Goals  Uptime  Performance  #2 Hate the average  Work with the exceptions  Remove the 10 Worst transactions every month  #3 Fire drill  Help identifying problems  Correlation of data 17
  • 18. To sum it up 1 2 3 4  A load test  Know your  Plan for  Fire Drill before numbers... the - Be release … unexpected prepared ... All systems have a weak spot – what is yours ? 18
  • 20. Further information  www.apicasystems.com – www.apicasystems.com/partners/rightscale.a spx  sven.hammar@apicasystem.com  craig.irwin@apicasystem.com 20

Notes de l'éditeur

  1. Logos