UNIT-V FMM.HYDRAULIC TURBINE - Construction and working
PAC 2020 Santorin - Vasilis Chatzinasios
1. PERFORMANCE
IS NOT A MYTH
P E R F O R M A N C E A D V I S O R Y C O U N C I L
SANTORINI GREECE
FEBRUARY 26 - 27 2020
How to automate performance in DevOps
Vasilis Chatzinasios
2. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Why performance?
DevOps and Performance - Intro
Speed of delivery
Competitive
performance
Stability for peaks
Migration of
applications
Why DevOps?
Rate of Change
3. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Performance Approach - Monolith
Planning Scripting Running Analysing
4. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Performance Approach – Monolith & Microservices
Planning Scripting Running Analysing
5. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Performance Approach - Microservices
Planning Scripting Running Analysing
6. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
The Challenge of performance in DevOps
Speed of DeliverySpeed of Performance How do you measure performance?
7. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
PERFORMANC
E
What is performance?
8. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Automated Analysis Workflow
Step 1
Step 2
Step 3
Step 4
Step 5
Metrics Framework
Identify Metrics Using a
service metrics framework
Threshold Comparison
Compare against thresholds
Baseline Comparison
Compare against the baseline
Pattern Analysis
Matching with expected
Patterns
Test Result
Rules Engine to give a
Pass/Fail
9. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Service Metrics Framework
Business Metrics Service Metrics Components Metrics
10. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Threshold Analysis
Does it pass the threshold?
How many times does it pass
the threshold?
How many metrics pass the
threshold?
11. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Baseline Comparison
Changes over last run
Change over last release
Trend over time
Response time increase
Garbage Collection Time increase
Processor Utilisation Increase
Running out of Memory
12. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Pattern Analysis
13. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Script Automation
Test Data
Test Scenario
Microservice Call – URL
Service Demand
• Have set Naming conventions
• Agree on Scenario Duration and type
• Input URL automation
• Know the demand from the planning phase
Script
14. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
How to reduce the false positives and ensure results
consistency
Process Tools Environment Data Reporting Roles & Responsibilities
15. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
Integrated Performance Test
Endurance/Soak Test
Load Test
Stress Test
Spike Test
VirtualUsersVirtualUsers
VirtualUsersVirtualUsers
Time Time
TimeTime
16. P E R F O R M A N C E A D V I S O R Y C O U N C I L
byP E R F O R M A N C E A D V I S O R Y C O U N C I L
?
Any Questions?
?????????