This document discusses challenges in measuring cloud performance and provides recommendations. It notes that in the cloud, control and visibility are limited due to shared resources. It recommends measuring performance from an end-user perspective, benchmarking cloud providers, and making performance an integral part of SLAs. New metrics like cost-per-visitor-second are also needed to adequately capture cloud performance.

2. Challenges to measure
Cloud Performance "
May
4th,
Compuware
NL,
Amsterdam

3. What
We
Provide:
 Dedicated
services
to
provide
an
op;mal
web
experience
to
op;mize
the
conversion
poten;al
of
your
online
services:
 A
Faster
Website
 Higher
Availability
 On
Demand
Capacity
 Op:mized
User
Experience
Benefits:
 Increased
conversion
and
revenue
 Opera;onal
control
from
a
business
perspec;ve
 Reduced
IT
and
Service
costs
associated
with
problem
resolu;on
Powered by

4. Our clients"

5. Performance matters!
"

6. 1% more revenue for every 100
milliseconds of improvement
12% increase in revenue, 25%
increase in page views for
every 5 seconds of gain
5% more revenue per user for
every 2 seconds of improvement

7. Speed is crucial

8. Average Impact of 1 second delay in
response time for web users"
Source: Aberdeen Group, 2009
8

9. Web Performance Management"

10. How does the performance of
Infrastructure and Application….
Management
Tool
Client"

11. …relate to the customer experience
Management
Tool

12. Introducing the synthetic user
Management
Tool

13. But synthetic isnʼt enough"
Gomez Asia
Gomez US
Gomez UK

14. Measure all your users
Management
Tool

15. Putting it all together: The Big Picture!
Availability
Speed
Capacity
User Experience
SLA IT suppliers
Shared KPI’s
+/-
Conversion

16. And then…"

17. And then…thereʼs the cloud"

18. But what defines a cloud?"

19. 3 cloud models"

20. IaaS"
Infrastructure-as-a-Service!

21. PaaS"
Platform-as-a-Service!
IaaS"
Infrastructure-as-a-Service!

22. SaaS
Software-as-a-Service
PaaS"
Platform-as-a-Service!
IaaS"
Infrastructure-as-a-Service!

23. SaaS
Software-as-a-Service
PaaS"
Platform-as-a-Service!
IaaS!
Infrastructure-as-a-Service!
Special thanks to @lennysan

25. Challenges for moving into the cloud
Source: IDC Enterprise Panel, 3Q09"

26. Limited control of the environment
"

27. Resources are shared"

28. Limited resolution power
"

29.
Cloud Performance Management:
What
to
measure?

30. Customer
GUI
Applica;on
Middleware
HW/OS
Storage

31. Customer
GUI
Applica;on
Middleware
HW/OS
Storage

32. Customer
GUI
Applica;on
Middleware
HW/OS
Storage

33. Customer
GUI
Applica;on
Middleware
HW/OS
Storage

34. Customer
GUI
Applica;on
Middleware
HW/OS
Storage

35. Measure from End-User perspective"

36. Benchmark your Cloud Providers"

37. Make Performance an integral part of your SLA"
Source: Imad Mouline, CTO Gomez, Cloud Connect Event 2010"

38. New Metrics needed: "
Cost-per-Visitor-Second"
Alistair Croll, Bitcurrent, Cloud Connect Event 2010 !

40. Web Performance in the Cloud"
Impact of the cloud Counter measures
End
User
Control
Monitoring
Benchmark
Visibility
Providers
Resolu;on
Performance
SLA