On September 17 Polteq contributed to the EuroSTAR online event ”Software Testing Summit” with a webinar about testing cloud services with title ”Going Cloudy? How to test SaaS?”
1. Welcome to the 2013
This webinar is presented by Kees Blokland and he will discuss:
‘Going Cloudy? How to test SaaS?’
Join us on Twitter! @esconfs #esconfs
www.eurostarconferences.com
2. Going Cloudy?
How to test SaaS?
Kees Blokland
Polteq Test Services BV
The Netherlands
7. Develop and Test
redundancy, proliferation
limitations
Email
Surf
Transfer
80% unused
storage claim
Operate and Manage
7
environmentally unfriendly
Store
11. Essential characteristics
On-demand service
Broad network access
Resource pooling
Rapid elasticity
Deployment models
– private cloud
– community cloud
– public cloud
– hybrid cloud
Service Models
Measured service
Software as a Service
Platform as a Service
Infrastructure as a Service
US: National Institute of Standards and Technology
http://www.nist.gov
13. Performance risks
Standards
Security risks Cyber crime
Availability and continuity Continuïty
risks
Functionality risks Privacy
Maintainability risks
Multi platform
Legislation and regulations
risks
Suppliers and Impact organisation
outsourcing
risks
Legislation
14. Performance risks
Security risks
YOUR
Operational Profile
Availability and continuity
risks
Functionality risks
Other customers
Maintainability risks
Legislation and regulations
risks
14
Suppliers and outsourcing
risks
YOUR
Operational Profile
PLUS
15. Performance risks
Security risks
The idea:
“it’s safe”
Availability and continuity
risks
Functionality risks
Everything over the web
Maintainability risks
Legislation and regulations
risks
15
Suppliers and outsourcing
risks
Home ground for
hackers
16. Performance risks
Security risks
No free choice of
device.
Availability and continuity
risks
Functionality risks
Bring Your Own Device
Maintainability risks
Legislation and regulations
risks
16
Suppliers and outsourcing
risks
No control.
17. Performance risks
Security risks
Planned and
controlled
Availability and continuity
risks
Functionality risks
Updates, patches, fixes, …
Maintainability risks
Legislation and regulations
risks
17
Suppliers and outsourcing
risks
Do I have a
choice?
18. Performance risks
Security risks
In house.
Availability and continuity
risks
Functionality risks
Where is my data?
And is that OK?
Maintainability risks
Legislation and regulations
risks
18
Suppliers and outsourcing
risks
Somewhere…
22. Testing during selection
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Proef
Proof ofInterview
concept
Testen
Intake
Functional testing
Migration testing
Testing caused by
legislation and regulations
22
Testing in production
23. Performance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
23
Suppliers and outsourcing
risks
Testing during selection
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
24. Performance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
24
Suppliers and outsourcing
risks
Testing during selection
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
25. Performance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
25
Suppliers and outsourcing
risks
Testing during selection
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
26. Performance risks
Security risks
Availability and continuity
risks
Testing during selection
Performance testing
Security testing
Architecture for manageability
Testing
Functionality risks
Availability and continuity
testing
From “individual” riskstesting
Functional
Maintainability risks
to
Migration testing
Legislation and regulations
“individual” test measures by
Testing caused
risks
26
Suppliers and outsourcing
risks
legislation and regulations
Testing in production
27. Testing during selection
Selection
Performance testing
Security testing
Testing for manageability
Implementation
Availability and continuity
testing
Functional testing
Migration testing
Production
27
Testing caused by
legislation and regulations
Testing in production
28. Performance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
28
Suppliers and outsourcing
risks
Testing during selection
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
29. Testing during selection
Performance testing
Selection Criteria
Security testing
Testing for manageability
Availability and continuity
testing
Proof of Concept
Functional testing
Migration testing
Testing caused by
legislation and regulations
29
Testing in production
30. Performance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
30
Suppliers and outsourcing
risks
Testing during selection
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
31. Testing during selection
Performance testing
Known measures
tuned and tweaked
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
New measures developed
Migration testing
Testing caused by
legislation and regulations
31
Testing in production
32. Testing during selection
YOUR
Operational Profile
Performance testing
Security testing
Testing for manageability
Load Testing
Availability and continuity
testing
Functional testing
YOUR
Operational Profile
PLUS
ACTUAL MOMENT
32
Migration testing
Testing caused by
legislation and regulations
Testing in production
33. Testing during selection
Performance testing
Load and stress.
Security testing
Testing for manageability
Elasticity
Availability and continuity
testing
Functional testing
Migration testing
Load and elasticity.
33
Testing caused by
legislation and regulations
Testing in production
35. Testing during selection
Multiplatform
testing.
Performance testing
Security testing
Testing for manageability
Any device – any platform
Availability and continuity
testing
Functional testing
Migration testing
Multiplatform
testing.
35
Testing caused by
legislation and regulations
Testing in production
37. Internet Explorer 7
Windows XP
Internet Explorer 8
Windows Vista
Firefox 3.6
Windows 7
Firefox 4
Browsers
Windows 2003 Server
Safari 4
Safari 5
Windows 8
Chrome11
Windows CE
Opera11
Linux
Operating systems
SUN
Computer
Unix
Mac OS Lion
Mac OS Snow Leopard
PC
Macintosh
iPhone ...
Multi-platform testing
iOS
Samsung …
Mobile phones
NOKIA …
Android
ASUS ...
Windows Mobile
Tablet
Devices
37
Blackberry …
MOTOROLA …
38. Testing during selection
Performance testing
Incidental testing.
Security testing
Legislation + Regulations
=
Test basis
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Compliancy testing.
38
Testing caused by
legislation and regulations
Testing in production
39. Performance risks
Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
39
Suppliers and outsourcing
risks
Testing during selection
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
40. Testing during selection
Continuous
End-to-End Test
Performance testing
Security testing
Testing for manageability
Availability and continuity
testing
Functionals
and
non-functionals
40
Functional testing
Migration testing
Testing caused by
legislation and regulations
Testing in production
42. Performance risks
Security risks
Availability and continuity
risks
Testing during selection
Performance testing
Security testing
Architecture for manageability
Testing starts early: in selection
Testing
Functionality risks
Availability and continuity
testing
From “individual”widened
Scope of testing Functional testing
is risks
Maintainability risks
to Migration testing
Legislation and regulations
“individual” test measuresby
Testing continues in production
Testing caused
risks
42
Suppliers and outsourcing
risks
legislation and regulations
Testing in production