This presentation guides through the business and technical preparation meeting as part of a application performance testing project. Goals, Objectives, KPIs, Monitoring and Workload are among the subjects discussed

1. Customer
Performance
Tester
Collaborative
Phase I: Planning
Project Meeting Technical Meeting
Data Flow Diagram
Infrastructure Diagram
Technical Questionnaire
Understand Customer Environment
Understand Customer Application
Verify Expectations
Understand PT Methodology
Establish PTKPI’s
Create Performance Test Plan
Output
Business Process to Infra Mapping
Business Processes
The Performance Testing
Process

2. Output
Phase II: Setup & Script Development
PT Environment
Environment Analysis
& Data Preparation
Development &
Validation
Estimate Injector
Requirements
Setup Controllers &
Injectors
Identify PTE location
(on site)
Assist PTE setup
(on site)
Analyze Environment
Monitoring
Analyze Required Data
Develop Test Scripts
Develop Specialized Scripts
Assist with Information
Obtain Required DataComplete PTE setup
Completed
Test Scripts
Validated
PTE & Test Scripts
Setup Monitoring
Customer
Performance
Tester
Collaborative
The Performance Testing
Process

3. Phase III: Performance Testing Sessions
Initial Baseline Final BaselineSessions
Collaborative Input Collaborative Input
Collaborative Input
Session Goals
Lead Session
Produce Summary Report
Conduct Session De-Brief
De-Brief Session
Final Baseline
Create Final Summary
Report
Initial Baseline
Output
Customer
Performance
Tester
Collaborative
The Performance Testing
Process

4. The Performance Testing
Project
Phase I: Planning
Phase III: Performance Testing Session (PTS)
Phase II: Preparation and Scripting

5. Phase I: Planning
 Define the goals
 Business goals (Business Key Performance Indicators)
○ Define measurable goals for the performance of the application, for example:
 The system needs to create X number of orders per hour with a response time per
page of less than Y seconds in 95% of all cases.
 IT goals (Technical Key Performance Indicators)
○ In addition to the business goals there can be IT specific goals, for example:
 The bandwidth utilization should not exceed 8 mbps

6. Phase I: Planning
 Define the Test Key Performance Indicators
 Test Key Performance Indicators (TKPI’s) are used to measure the goal
achievements, for example:
○ Response Time
○ Throughput
○ Utilization
○ Efficiency
 Define the scope
 Define which part of the application/service to test
 Define which 3rd part service to include/exclude
 Define the timeline

7. Phase II: Preparation
 Application assessment
 Business Processes
 Scenario
○ Think time
○ Iteration
○ User distribution
 Data Flow (in combination with Infrastructure Assessment)
 Infrastructure assessment
 Technical Questionnaire
○ Physical Access to the application
○ Monitoring
○ Data Flow

8. Phase II: Preparation
 Data assessment
 Volume data
 Unique data
 One time data
 Reusable data
 Asses the impact of
 Write
 Update
 Delete

9. Phase II: Setup Monitoring
Infrastructure

10. Phase III: PVS Session

11. Phase III: Analysis and
Reporting
 Summary Report for each performance test
– KPI achievement
– Changes since last test
– Issues and bottlenecks
 Analysis tool
 Session data collected with Performance Center
 De-brief

12. Phase III: Performance Testing
Cycle
Phase I: Planning
Phase II: Preparation
Phase III: Execution

13. Phase II: Preparation
Application Assessment
Infrastructure Assessment

14. Phase II: Application
Assessment
Analyze current or planned application usage
Translate the business processes into scripts
Define the think time and iteration pace
Define the percentage user distribution
Test the scenario against the plan
Define the business processes

15. Phase II: Application
Assessment
 What key business functions are used ?
 E.g. Submit Order, Search Products
 What is the application flow for an end user to perform these business
functions ?
 E.g. “Go to homepage”, “Log-in”, “Enter Search Criteria”, “Click Submit”
 What is the frequency of these business functions ?
 E.g. 100 submitted orders per hour
Step1: Analyze the current or planned usage
“Use those business functions for load testing that generate 80% of
the value.”

16. Phase II: Application
Assessment
Step1: Define the business process

17. Phase II: Application
Assessment
Step2: The business process is translated into a program

18. Phase II: Application
Assessment
 Think time and iteration pace
Step3: Define the Scenario
PacingRT TT TTRT RT TT
Iteration
Response Time
Think Time

19. Phase II: Application
Assessment
 Percentage user distribution
Business Process Name Percentage
bp01_Transfer Funds 24 %
bp02_DisplayTransactionDetails 67 %
bp03_MakePayment 9 %
Step3: Define the Scenario

20. Phase II: Infrastructure
Assessment
System Landscape (Scope)
System Monitoring
Domain specific Monitoring
Resource Monitoring Domains

21. Phase II: Infrastructure
Assessment
Define System and Domain specific monitoring
Work on the response time breakdown
Draw the system landscape

22. Phase III: Performance Validation Session
Performance test run
Analysis and reporting
Script calibration

23. Phase III: Performance test run