SlideShare une entreprise Scribd logo
1  sur  26
Windows AzureAcid Test!DDD Sydney,  2 July 2011 Matt Done, expanz Pty. Ltd.
Agenda Presentation Overview What is Azure and SQL Azure Goals of the Load Test Testing Setup Test Results Cost Comparisons Live Demo Questions
Presentation Overview Topics Load testing in Windows Azure and the various benefits it brings Horizontally Scalable, Stateful computing. High performance WCF (Windows Communications Foundation) Intended Audience Enterprise Architects, Solution Architects Developers involved in large scale applications People who love Azure!!
What is Windows Azure ,[object Object],[object Object],[object Object]
Have an environment to tweak performance settings and to find potential bottlenecks.
To assess how the Azure platform performs under load.
To assess how SQL azure performs under load.,[object Object]
Load Testing Architecture
Azure Load Test Costs Load Testing Setup Cost Total Cost = $15.71 per hour
Local Debug
Local/Remote Debug Problem ,[object Object]
Azure will not accept remote connectionsSolution Install SSH server (Putty, BitVise) Start azure compute emulator Start local client Start SSH client and port forward to Web service port on remote machine Start testing
(Very) Simple Banking App
Load Test Setup
Database Setup Table Sizing Indexes ,[object Object]
Non Clustered Index on [dbo].[Transactions], Columns [billingaddressbook_id]
Non Clustered Index on [dbo].[Transactions], Columns [account_id]
Non Clustered Index on [dbo].[BillingAddressBooks], Columns [user_id]Considerations ,[object Object],[object Object]
Allocate percentage execution for each process
Determine wait time figure (100ms or 1 sec)?
Each execution waits a random amount of time, based on processExecutionDelay. Thread.Sleep(myRandom.Next(processExecutionDelay));
Each User session is a single thread. 2500 users = 2500 threads.,[object Object]
Do not log to file system
Preserve thread pool threads for load test execution
Preserve bandwidth and CPU as little as possibleSolution ,[object Object]
Capture Request/Responses and send to Site Manager

Contenu connexe

Tendances

Tendances (20)

Arquillian & Citrus
Arquillian & CitrusArquillian & Citrus
Arquillian & Citrus
 
Large Scale Load Testing Amazon.com’s Traffic on AWS (CPN102) | AWS re:Invent...
Large Scale Load Testing Amazon.com’s Traffic on AWS (CPN102) | AWS re:Invent...Large Scale Load Testing Amazon.com’s Traffic on AWS (CPN102) | AWS re:Invent...
Large Scale Load Testing Amazon.com’s Traffic on AWS (CPN102) | AWS re:Invent...
 
Performance Testing Strategy for Cloud-Based System using Open Source Testing...
Performance Testing Strategy for Cloud-Based System using Open Source Testing...Performance Testing Strategy for Cloud-Based System using Open Source Testing...
Performance Testing Strategy for Cloud-Based System using Open Source Testing...
 
Load testing with Blitz
Load testing with BlitzLoad testing with Blitz
Load testing with Blitz
 
Deploy and Destroy Complete Test Environments
Deploy and Destroy Complete Test EnvironmentsDeploy and Destroy Complete Test Environments
Deploy and Destroy Complete Test Environments
 
Testing a Service Fabric solution and live happy!!
Testing a Service Fabric solution and live happy!!Testing a Service Fabric solution and live happy!!
Testing a Service Fabric solution and live happy!!
 
An Introduction to Enterprise Design Patterns
An Introduction to Enterprise Design PatternsAn Introduction to Enterprise Design Patterns
An Introduction to Enterprise Design Patterns
 
Sencha Roadshow 2017: Best Practices for Implementing Continuous Web App Testing
Sencha Roadshow 2017: Best Practices for Implementing Continuous Web App TestingSencha Roadshow 2017: Best Practices for Implementing Continuous Web App Testing
Sencha Roadshow 2017: Best Practices for Implementing Continuous Web App Testing
 
Example of TAF with batch execution of test cases
 Example of TAF with batch execution of test cases  Example of TAF with batch execution of test cases
Example of TAF with batch execution of test cases
 
Performance Metrics for your Build Pipeline - presented at Vienna WebPerf Oct...
Performance Metrics for your Build Pipeline - presented at Vienna WebPerf Oct...Performance Metrics for your Build Pipeline - presented at Vienna WebPerf Oct...
Performance Metrics for your Build Pipeline - presented at Vienna WebPerf Oct...
 
StarWest 2013 Performance is not an afterthought – make it a part of your Agi...
StarWest 2013 Performance is not an afterthought – make it a part of your Agi...StarWest 2013 Performance is not an afterthought – make it a part of your Agi...
StarWest 2013 Performance is not an afterthought – make it a part of your Agi...
 
JavaOne - Performance Focused DevOps to Improve Cont Delivery
JavaOne - Performance Focused DevOps to Improve Cont DeliveryJavaOne - Performance Focused DevOps to Improve Cont Delivery
JavaOne - Performance Focused DevOps to Improve Cont Delivery
 
Cloud-based performance testing
Cloud-based performance testingCloud-based performance testing
Cloud-based performance testing
 
Microsoft Fakes, Unit Testing the (almost) Untestable Code
Microsoft Fakes, Unit Testing the (almost) Untestable CodeMicrosoft Fakes, Unit Testing the (almost) Untestable Code
Microsoft Fakes, Unit Testing the (almost) Untestable Code
 
How to Run a 1,000,000 VU Load Test using Apache JMeter and BlazeMeter
How to Run a 1,000,000 VU Load Test using Apache JMeter and BlazeMeterHow to Run a 1,000,000 VU Load Test using Apache JMeter and BlazeMeter
How to Run a 1,000,000 VU Load Test using Apache JMeter and BlazeMeter
 
Application Performance Tuning Techniques
Application Performance Tuning TechniquesApplication Performance Tuning Techniques
Application Performance Tuning Techniques
 
Testing Java EE apps with Arquillian
Testing Java EE apps with ArquillianTesting Java EE apps with Arquillian
Testing Java EE apps with Arquillian
 
Алексей Ященко и Ярослав Волощук "False simplicity of front-end applications"
Алексей Ященко и Ярослав Волощук "False simplicity of front-end applications"Алексей Ященко и Ярослав Волощук "False simplicity of front-end applications"
Алексей Ященко и Ярослав Волощук "False simplicity of front-end applications"
 
Leandro Melendez - Switching Performance Left & Right
Leandro Melendez - Switching Performance Left & RightLeandro Melendez - Switching Performance Left & Right
Leandro Melendez - Switching Performance Left & Right
 
SenchaCon 2016: How Sencha Test Helps Automate Functional Testing of Ext JS M...
SenchaCon 2016: How Sencha Test Helps Automate Functional Testing of Ext JS M...SenchaCon 2016: How Sencha Test Helps Automate Functional Testing of Ext JS M...
SenchaCon 2016: How Sencha Test Helps Automate Functional Testing of Ext JS M...
 

Similaire à Windows Azure Acid Test

Similaire à Windows Azure Acid Test (20)

Java ee7 with apache spark for the world's largest credit card core systems, ...
Java ee7 with apache spark for the world's largest credit card core systems, ...Java ee7 with apache spark for the world's largest credit card core systems, ...
Java ee7 with apache spark for the world's largest credit card core systems, ...
 
Performance eng prakash.sahu
Performance eng prakash.sahuPerformance eng prakash.sahu
Performance eng prakash.sahu
 
Azure Batch Service Meetup Presentation
Azure Batch Service   Meetup PresentationAzure Batch Service   Meetup Presentation
Azure Batch Service Meetup Presentation
 
Leveraging Functional Tools and AWS for Performance Testing
Leveraging Functional Tools and AWS for Performance TestingLeveraging Functional Tools and AWS for Performance Testing
Leveraging Functional Tools and AWS for Performance Testing
 
NoCOUG Presentation on Oracle RAT
NoCOUG Presentation on Oracle RATNoCOUG Presentation on Oracle RAT
NoCOUG Presentation on Oracle RAT
 
QSpiders - Installation and Brief Dose of Load Runner
QSpiders - Installation and Brief Dose of Load RunnerQSpiders - Installation and Brief Dose of Load Runner
QSpiders - Installation and Brief Dose of Load Runner
 
Performance Test Driven Development with Oracle Coherence
Performance Test Driven Development with Oracle CoherencePerformance Test Driven Development with Oracle Coherence
Performance Test Driven Development with Oracle Coherence
 
11g R2
11g R211g R2
11g R2
 
Performance Tuning Oracle Weblogic Server 12c
Performance Tuning Oracle Weblogic Server 12cPerformance Tuning Oracle Weblogic Server 12c
Performance Tuning Oracle Weblogic Server 12c
 
Copper: A high performance workflow engine
Copper: A high performance workflow engineCopper: A high performance workflow engine
Copper: A high performance workflow engine
 
CMP301_Deep Dive on Amazon EC2 Instances
CMP301_Deep Dive on Amazon EC2 InstancesCMP301_Deep Dive on Amazon EC2 Instances
CMP301_Deep Dive on Amazon EC2 Instances
 
Scaling asp.net websites to millions of users
Scaling asp.net websites to millions of usersScaling asp.net websites to millions of users
Scaling asp.net websites to millions of users
 
Choosing the Right EC2 Instance and Applicable Use Cases - AWS June 2016 Webi...
Choosing the Right EC2 Instance and Applicable Use Cases - AWS June 2016 Webi...Choosing the Right EC2 Instance and Applicable Use Cases - AWS June 2016 Webi...
Choosing the Right EC2 Instance and Applicable Use Cases - AWS June 2016 Webi...
 
Adding Value in the Cloud with Performance Test
Adding Value in the Cloud with Performance TestAdding Value in the Cloud with Performance Test
Adding Value in the Cloud with Performance Test
 
What's New in .Net 4.5
What's New in .Net 4.5What's New in .Net 4.5
What's New in .Net 4.5
 
JITServerTalk JCON World 2023.pdf
JITServerTalk JCON World 2023.pdfJITServerTalk JCON World 2023.pdf
JITServerTalk JCON World 2023.pdf
 
Performance testing in scope of migration to cloud by Serghei Radov
Performance testing in scope of migration to cloud by Serghei RadovPerformance testing in scope of migration to cloud by Serghei Radov
Performance testing in scope of migration to cloud by Serghei Radov
 
SRV402 Deep Dive on Amazon EC2 Instances, Featuring Performance Optimization ...
SRV402 Deep Dive on Amazon EC2 Instances, Featuring Performance Optimization ...SRV402 Deep Dive on Amazon EC2 Instances, Featuring Performance Optimization ...
SRV402 Deep Dive on Amazon EC2 Instances, Featuring Performance Optimization ...
 
Azure SQL Managed Instance - SqlBits 2019
Azure SQL Managed Instance - SqlBits 2019Azure SQL Managed Instance - SqlBits 2019
Azure SQL Managed Instance - SqlBits 2019
 
Deep Dive on Amazon EC2 instances
Deep Dive on Amazon EC2 instancesDeep Dive on Amazon EC2 instances
Deep Dive on Amazon EC2 instances
 

Dernier

CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 

Dernier (20)

CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 

Windows Azure Acid Test

  • 1. Windows AzureAcid Test!DDD Sydney, 2 July 2011 Matt Done, expanz Pty. Ltd.
  • 2. Agenda Presentation Overview What is Azure and SQL Azure Goals of the Load Test Testing Setup Test Results Cost Comparisons Live Demo Questions
  • 3. Presentation Overview Topics Load testing in Windows Azure and the various benefits it brings Horizontally Scalable, Stateful computing. High performance WCF (Windows Communications Foundation) Intended Audience Enterprise Architects, Solution Architects Developers involved in large scale applications People who love Azure!!
  • 4.
  • 5. Have an environment to tweak performance settings and to find potential bottlenecks.
  • 6. To assess how the Azure platform performs under load.
  • 7.
  • 9. Azure Load Test Costs Load Testing Setup Cost Total Cost = $15.71 per hour
  • 11.
  • 12. Azure will not accept remote connectionsSolution Install SSH server (Putty, BitVise) Start azure compute emulator Start local client Start SSH client and port forward to Web service port on remote machine Start testing
  • 15.
  • 16. Non Clustered Index on [dbo].[Transactions], Columns [billingaddressbook_id]
  • 17. Non Clustered Index on [dbo].[Transactions], Columns [account_id]
  • 18.
  • 19. Allocate percentage execution for each process
  • 20. Determine wait time figure (100ms or 1 sec)?
  • 21. Each execution waits a random amount of time, based on processExecutionDelay. Thread.Sleep(myRandom.Next(processExecutionDelay));
  • 22.
  • 23. Do not log to file system
  • 24. Preserve thread pool threads for load test execution
  • 25.
  • 26. Capture Request/Responses and send to Site Manager
  • 27. Site Manager will process and commit records
  • 28.
  • 29. Use Thread.Startinstead of  ThreadPool.QueueUserWorkItem
  • 30.
  • 31. Counter names are normal windows counter. Eg@"rocessor(_Total) Processor Time" , @"emoryvailable MBytes"
  • 32.
  • 34. 5 Large Web Services
  • 35. 1 Large Site Manager
  • 36. 5 Large Session ManagersLarge Instance = 4 x 1.6 GHz cpu’sand 7 GB of ram Test Result Summary Run duration = 32 Minutes Total Transactions = 1.89 Million Average Number of Transactions per Minute = 59767 Average WS Response Time = 70ms Average CPU Utilisation (App Servers) = 30% Min Memory (App Servers) = 4Gb NOT GOOD ENOUGH. NEED MORE!!!
  • 37.
  • 38.
  • 39.
  • 40. For singleton to singleton operations, comms is problematic
  • 41.
  • 42.
  • 43.
  • 45. 10 Large Web Services
  • 46. 1 Extra Large Site Manager
  • 47. 8 Large Session ManagersLarge Instance = 4x 1.6 GHz cpu’sand 7 GB of ram Test Result Summary Run duration = 30 Minutes Total Transactions = 7.8 Million Average Number of Transactions per Minute = 161245 Max Transactions per Minute = 211589 Error Rate = 0.014% Average Web Service response time = 39ms Average CPU Utilisation (App Servers) = 70% Min Memory (App Servers) = 4Gb Total Cost = $12.88 per hour
  • 49. Time line Default WCF Settings. 5 Instances Default WCF Settings. 10 Instances Multithreaded Service. Per Session Context Create Channel Factory Factory Raise tcp Connections limit Adjust Instance Counts
  • 50.
  • 53. Please find full recording of my session atwww.youtube.com/expanzTV
  • 54. Thank you for following my presentation! Please take the time to have a look at the next slide with an exclusive invitation for DDD attendees from expanz as a DDD sponsor.
  • 55. BETA Perpetual License exclusively for DDD Attendees During our Private Beta Program expanz are looking for thought leading developers for trialling an exclusive preview of their next generation Line Of Business (LOB) Application Development Platform, the ‘expanzPLATFORM 2011’ As a DDD Melbourne, Sydney or Adelaide attendee, you qualify for participating in our Private Beta program. To join and receive your free perpetual license after launch, please email us at beta@expanz.com with ‘DDD Attendee’ in your subject line before 22 July 2011.

Notes de l'éditeur

  1. DB Transactions are free for internal apps. Data transfer is 10c per 1gb. MSDN includes 5gb
  2. vvvv
  3. During our Private Beta Program we are looking for thought leading developers for trialling an exclusive preview of our next generation Line Of Business (LOB) Application Development Platform, the ‘expanzPLATFORM 2011’ (eP).Though we’re a small Aussie start-up, we’ve achieved some pretty cool stuff already. Analyst RecognitionOne of six companies global by Gartner as a ‘cool vendor’.Proof Of Conceptwe built and run a multi-tenant, multi device, multi general ledger ERP SaaS app with eP which is live on Azure and used by large Australian distribution companies. Mission Critical ProjectLogica built and deployed the app that counted all votes for the recent NSW 2011 State Election, using eP.Our core values to developers areProductivity extreme code reuse / inheritancemetadata driven framework (rather than code gen)business logic is all on the server side and supports any clientPortability Client – Native Thin UX on any client/device Server - Premise/Hosted/Cloud (Windows)If you believe great design and architecture matters, that writing code (preferably once) is the best way to handle complexity, then you’ll enjoy getting under our hood. To join and qualify for your free perpetual license, please email us at beta@expanz.com with ‘DDD Attendee’ in your subject line before 22 July 2011.