Cloud load testing with Visual Studio Team Services
•
1 j'aime•560 vues
The only way to know if your systems can handle the number of users is to load test, however load testing is hard and the infrastructure expensive. Come and see Martin demontrate the tools and techniqies that are required to test your software under load, even in Production.
Recommandé
Recommandé
Contenu connexe
Tendances
Tendances (20)
En vedette
En vedette (20)
Similaire à Cloud load testing with Visual Studio Team Services
Similaire à Cloud load testing with Visual Studio Team Services (20)
Plus de Martin Hinshelwood
Dernier
Dernier (20)
Cloud load testing with Visual Studio Team Services
- 1. © naked ALM – Martin Hinshelwood 2013 Martin Hinshelwood | @MrHinsh Consultant | MVP | Ranger | Trainer | Coach martin@nkdagility.com | http://nkdagility.com/blog Load Testing with Visual Studio Team Services
- 5. Scrum?
- 6. Join the #DevOps conversation #NDCOlso with @MrHinsh
- 7. Join the #DevOps conversation #NDCOlso with @MrHinsh
- 8. Join the #DevOps conversation #NDCOlso with @MrHinsh
- 9. Join the #DevOps conversation #NDCOlso with @MrHinsh
- 10. Professional Scrum Teams Mechanical / Amateur / Flaccid Scrum Values and Principles Technical Excellence The Scrum Guide: http://www.scrumguides.org/
- 11. FLOW OF CUSTOMER VALUE TEAM AUTONOMY & ENTERPRISE ALIGNMENT BACKLOG refined with LEARNING EVIDENCE gathered in PRODUCTION MANAGED TECHNICAL DEBT PRODUCTION FIRST MINDSET INFRASTRUCTURE is a FLEXIBLE RESOURCE Areas for improvement or Goals to achieve Join the #DevOps conversation #NDCOlso with @MrHinsh
- 12. DevOps?
- 13. Join the #DevOps conversation #NDCOlso with @MrHinsh
- 14. Join the #DevOps conversation #NDCOlso with @MrHinsh
- 15. Join the #DevOps conversation #NDCOlso with @MrHinsh
- 16. Join the #DevOps conversation #NDCOlso with @MrHinsh
- 17. P R A C T I C E S Automated Testing Continuous Integration Continuous Deployment Release Management P R A C T I C E S Usage Monitoring Telemetry Collection Testing in Production Stakeholder Feedback P R A C T I C E S Testing in Production Usage Monitoring User Telemetry Stakeholder feedback Feature flags P R A C T I C E S Code Reviews Automated Testing Continuous Measurement P R A C T I C E S Application Performance Management Infrastructure as Code Continuous Delivery Release Management Configuration Management Automated Recovery P R A C T I C E S Application Performance Management Infrastructure as Code Continuous Deployment Release Management Configuration Management Automated Recovery P R A C T I C E S Enterprise Agile Continuous Integration Continuous Deployment Release Management FLOW OF CUSTOMER VALUE TEAM AUTONOMY & ENTERPRISE ALIGNMENT BACKLOG refined with LEARNING EVIDENCE gathered in PRODUCTION MANAGED TECHNICAL DEBT PRODUCTION FIRST MINDSET INFRASTRUCTURE is a FLEXIBLE RESOURCE DevOps habits and practices Join the #DevOps conversation #NDCOlso with @MrHinsh
- 18. Testing?
- 19. What testing do you do? Functional Tests • User Story Tests • Prototypes • Simulations Exploratory Testing • Usability Testing • User Acceptance Testing • Alpha/Beta Developer Tests • Unit Tests • Component Tests Performance & Load Testing Security Testing -ility Testing SupportingtheTeam Technology Facing CritiqueProduct Business Facing Automated Automated & Manual Automated & Tools Manual Join the #DevOps conversation #NDCOlso with @MrHinsh
- 20. Join the #DevOps conversation #NDCOlso with @MrHinsh
- 21. Don’t leave load testing until last!
- 22. DEMO: URL Cloud Load Test
- 23. That must cost a LOT!
- 24. • 20k: FREE • 2m: $8000 (64k NOK) • 2m-10m: $16000 (130k NOK) So for 2 minutes of 200 simultaneous users per build for 10 deployments per day at 4000 VMU’s, it would be FREE Before it costs any money you can load test 50 deployments at 200 simultaneous users for 2 minutes. Or you could ramp up to 1000 simultaneous users. That must be expensive? Examples Cloud-based Load Testing* * Requires Visual Studio Enterprise - Services purchased via Microsoft Azure based on actual usage - Additional services are accessible to all users on the account and shared among them - Build time is actual computing time required to run the build, and does not include queuing time (if any) - Load test runs specify the number of virtual users and duration in minutes Virtual users x minutes = virtual user minutes (VUM) FREE: 20,000 virtual user minutes per month THEREAFTER: $0.004/virtual user minute for 20,001-2M VUM $0.002/VUM for 2,000,001-10M VUM $0.001/VUM for usage above 10M VUM/month
- 26. Continuous Delivery Continuous Integration Release Management Streamline and automate the workflow between development and IT Ops and deliver higher quality software more frequently with less risk. Continuous Quality
- 27. Enabling continuous value delivery Feedback Approval Feedback Feedback
- 31. https://www.visualstudio.com/docs/integrate/api/load -test/overview DEMO: Cloud Load Test in VSTS Join the #DevOps conversation #NDCOlso with @MrHinsh
- 32. © naked ALM – Martin Hinshelwood 2013 Professional Teams Professional Scrum Professional DevOps Join the #DevOps conversation #NDCOlso with @MrHinsh
- 33. © naked ALM – Martin Hinshelwood 2013 Take-Away for Cloud Load Testing • Cloud-load testing: rich reports in the web • Running Apache JMeter based load tests in the cloud – how to • Creating Load Test Plugins for Cloud-based Load Test • Scheduling Load Test Execution • Performance Testing Join the #DevOps conversation #NDCOlso with @MrHinsh
- 34. © naked ALM – Martin Hinshelwood 201341© 1993-2015 Scrum.org, All Rights Reserved Suggested Reading ProfessionalALM with Visual Studio 2013 The Phoenix Project Software in 30 Days Join the #DevOps conversation #NDCOlso with @MrHinsh
- 35. © naked ALM – Martin Hinshelwood 2013 Suggested Reading Join the #DevOps conversation #NDCOlso with @MrHinsh
- 36. Martin Hinshelwood | @MrHinsh Consultant | MVP | Ranger | Trainer | Coach martin@nkdagility.com | http://nkdagility.com/blog Thanks Load Testing with Visual Studio Team Services
Notes de l'éditeur
- Isolated Scrum Teams Scrum: A lack of engineering standards A distant customer The belief in magic The difficulty to create integrated, releasable Increments Predictive management Are you scaling dysfunctions?
- To help with these demonstrations, consider going through these hands-on exercises from Microsoft http://bit.ly/n3lFY7
- Key feature in Release Management Automate deployment to an environment Orchestrate deployment across environments Track deployments Integrate with other Build, Cloud, and deployment services
- To help with these demonstrations, consider going through these hands-on exercises from Microsoft http://bit.ly/n3lFY7