SlideShare une entreprise Scribd logo
1  sur  44
Welcome to the 2013

This webinar is presented by Kees Blokland and he will discuss:

‘Going Cloudy? How to test SaaS?’

Join us on Twitter! @esconfs #esconfs
www.eurostarconferences.com
Going Cloudy?
How to test SaaS?
Kees Blokland
Polteq Test Services BV
The Netherlands
ISBN 978-1-937538-38-5
3
searching, recording, accounting, paying, writing, reviewing,
tracking, calculating, developing, listening, analyzing,
transmitting, learning, controlling, purchasing, testing,
alarming, changing, updating, deleting, accessing, rejecting,
correcting, studying, booking, receiving, tracing, protecting,
deciding, managing, teaching, facilitating, identifying,
copying, removing, demonstrating, checking, showing,
selecting, subscribing, unsubscribing, sharing, mailing,
communicating, reading, playing, working, meeting,
gambling, shopping, storing, cross checking, retrieving,
configuring, sketching, saving, accelerating, enhancing,
creating, growing, checking in, checking out, finding out,
reaching, talking, designing, making, verifying, measuring
Develop and Test

Operate and Manage
6

Email
Surf
Transfer

Store
Develop and Test

redundancy, proliferation

limitations

Email
Surf
Transfer

80% unused

storage claim
Operate and Manage
7

environmentally unfriendly
Store
Develop and Test

Email
Surf
Transfer

SOA

internet technology

virtualization

standard software
Operate and Manage
8

bandwidth
Store
searching, recording, accounting, paying, writing,
reviewing, tracking, calculating, developing, listening,
Develop and Test
Email
Surf
analyzing, transmitting, learning, controlling,
Transfer
purchasing, testing, alarming, changing, updating,
deleting, accessing, rejecting, correcting, studying,
booking, receiving, tracing, protecting, deciding,
managing, teaching, facilitating, identifying, copying,
removing, demonstrating, checking, showing,
selecting, subscribing, unsubscribing, sharing,
Operate communicating, reading, playing, working,
Store
mailing, and Manage
meeting, gambling, shopping, storing, cross
9
Essential characteristics
 On-demand service

 Broad network access
 Resource pooling

 Rapid elasticity

Deployment models
– private cloud
– community cloud
– public cloud
– hybrid cloud
Service Models

 Measured service

Software as a Service
Platform as a Service
Infrastructure as a Service

US: National Institute of Standards and Technology
http://www.nist.gov
Standards
Cyber crime

Continuity

Privacy

Legislation

Multi platform

Impact organisation

143
Performance risks

Standards

Security risks Cyber crime
Availability and continuity Continuïty
risks
Functionality risks Privacy
Maintainability risks
Multi platform

Legislation and regulations
risks
Suppliers and Impact organisation
outsourcing
risks

Legislation
Performance risks

Security risks

YOUR
Operational Profile

Availability and continuity
risks
Functionality risks

Other customers

Maintainability risks
Legislation and regulations
risks
14

Suppliers and outsourcing
risks

YOUR
Operational Profile
PLUS
Performance risks

Security risks

The idea:
“it’s safe”

Availability and continuity
risks
Functionality risks

Everything over the web

Maintainability risks
Legislation and regulations
risks
15

Suppliers and outsourcing
risks

Home ground for
hackers
Performance risks

Security risks

No free choice of
device.

Availability and continuity
risks
Functionality risks

Bring Your Own Device

Maintainability risks
Legislation and regulations
risks
16

Suppliers and outsourcing
risks

No control.
Performance risks

Security risks

Planned and
controlled

Availability and continuity
risks
Functionality risks

Updates, patches, fixes, …

Maintainability risks
Legislation and regulations
risks
17

Suppliers and outsourcing
risks

Do I have a
choice?
Performance risks

Security risks

In house.

Availability and continuity
risks
Functionality risks

Where is my data?
And is that OK?

Maintainability risks
Legislation and regulations
risks
18

Suppliers and outsourcing
risks

Somewhere…
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
19

Suppliers and outsourcing
risks
Testing?
Interview
Check
Trial

Proof of concept

Review

20
Testing!
Interview
Check
Trial

Proof of concept

Proef
Proof ofInterview
concept
Testen
Intake
Review

21
Testing during selection
Performance testing
Security testing

Testing for manageability
Availability and continuity
testing
Proef
Proof ofInterview
concept
Testen
Intake

Functional testing
Migration testing
Testing caused by
legislation and regulations

22

Testing in production
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
23

Suppliers and outsourcing
risks

Testing during selection
Performance testing
Security testing

Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations

Testing in production
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
24

Suppliers and outsourcing
risks

Testing during selection
Performance testing
Security testing

Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations

Testing in production
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
25

Suppliers and outsourcing
risks

Testing during selection
Performance testing
Security testing

Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations

Testing in production
Performance risks

Security risks
Availability and continuity
risks

Testing during selection
Performance testing
Security testing

Architecture for manageability
Testing

Functionality risks

Availability and continuity
testing

From “individual” riskstesting
Functional
Maintainability risks
to
Migration testing
Legislation and regulations
“individual” test measures by
Testing caused
risks
26

Suppliers and outsourcing
risks

legislation and regulations

Testing in production
Testing during selection

Selection

Performance testing
Security testing

Testing for manageability

Implementation

Availability and continuity
testing
Functional testing
Migration testing

Production
27

Testing caused by
legislation and regulations

Testing in production
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
28

Suppliers and outsourcing
risks

Testing during selection
Performance testing
Security testing

Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations

Testing in production
Testing during selection
Performance testing

Selection Criteria

Security testing

Testing for manageability
Availability and continuity
testing

Proof of Concept

Functional testing
Migration testing
Testing caused by
legislation and regulations

29

Testing in production
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
30

Suppliers and outsourcing
risks

Testing during selection
Performance testing
Security testing

Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations

Testing in production
Testing during selection
Performance testing

Known measures
tuned and tweaked

Security testing

Testing for manageability
Availability and continuity
testing
Functional testing

New measures developed

Migration testing
Testing caused by
legislation and regulations

31

Testing in production
Testing during selection
YOUR
Operational Profile

Performance testing
Security testing

Testing for manageability

Load Testing

Availability and continuity
testing
Functional testing

YOUR
Operational Profile
PLUS
ACTUAL MOMENT
32

Migration testing
Testing caused by
legislation and regulations

Testing in production
Testing during selection
Performance testing
Load and stress.
Security testing

Testing for manageability

Elasticity

Availability and continuity
testing
Functional testing
Migration testing

Load and elasticity.
33

Testing caused by
legislation and regulations

Testing in production
load test – ‘up’

load test – ‘down’

101
100

boundary values

99

load

path test
extend?

no

yes
200
charged
34

100
charged

boundary values
‘up’
tc 1: use=99, pay 100
tc 2: use=100, pay 100
tc 3: use=101, pay 200
‘down’
tc1: use=101, pay 200
tc2: use=100, pay 100
tc3: use=99, pay 100
Testing during selection
Multiplatform
testing.

Performance testing
Security testing

Testing for manageability

Any device – any platform

Availability and continuity
testing
Functional testing
Migration testing

Multiplatform
testing.
35

Testing caused by
legislation and regulations

Testing in production
3997 distinct Android devices

http://opensignal.com/reports/fragmentation.php
36
Internet Explorer 7

Windows XP

Internet Explorer 8

Windows Vista

Firefox 3.6
Windows 7

Firefox 4
Browsers

Windows 2003 Server

Safari 4
Safari 5

Windows 8

Chrome11

Windows CE

Opera11
Linux

Operating systems

SUN
Computer

Unix
Mac OS Lion

Mac OS Snow Leopard

PC

Macintosh
iPhone ...

Multi-platform testing

iOS

Samsung …
Mobile phones

NOKIA …

Android
ASUS ...

Windows Mobile
Tablet
Devices
37

Blackberry …
MOTOROLA …
Testing during selection
Performance testing
Incidental testing.
Security testing

Legislation + Regulations
=
Test basis

Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing

Compliancy testing.
38

Testing caused by
legislation and regulations

Testing in production
Performance risks

Security risks
Availability and continuity
risks
Functionality risks
Maintainability risks
Legislation and regulations
risks
39

Suppliers and outsourcing
risks

Testing during selection
Performance testing
Security testing

Testing for manageability
Availability and continuity
testing
Functional testing
Migration testing
Testing caused by
legislation and regulations

Testing in production
Testing during selection

Continuous
End-to-End Test

Performance testing
Security testing

Testing for manageability
Availability and continuity
testing

Functionals
and
non-functionals
40

Functional testing
Migration testing
Testing caused by
legislation and regulations

Testing in production
Standards
Cyber crime

Check

Continuity

Interview
Privacy

Legislation

Proof of concept

Trial
Multi platform

Impact organisation

Intake
Performance risks

Security risks
Availability and continuity
risks

Testing during selection
Performance testing
Security testing

Architecture for manageability
Testing starts early: in selection
Testing

Functionality risks

Availability and continuity
testing

From “individual”widened
Scope of testing Functional testing
is risks
Maintainability risks
to Migration testing
Legislation and regulations
“individual” test measuresby
Testing continues in production
Testing caused
risks
42

Suppliers and outsourcing
risks

legislation and regulations

Testing in production
ISBN 978-1-937538-38-5
43
Thanks for listening!

Go to www.eurostarconferences.com for more information
@esconfs
#esconfs

www.eurostarconferences.com

Contenu connexe

Similaire à EuroStar Webinar Testing Cloud Services Kees Blokland

Test Management for Cloud-based Applications
Test Management for Cloud-based ApplicationsTest Management for Cloud-based Applications
Test Management for Cloud-based ApplicationsTechWell
 
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin PolNon-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin PolKees Blokland
 
Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...
Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...
Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...TEST Huddle
 
Digital transformation testing.
Digital transformation testing. Digital transformation testing.
Digital transformation testing. Deepak Daniel
 
Delight Your Customers with Four Eyes of Quality: Agile Quality Improvement S...
Delight Your Customers with Four Eyes of Quality: Agile Quality Improvement S...Delight Your Customers with Four Eyes of Quality: Agile Quality Improvement S...
Delight Your Customers with Four Eyes of Quality: Agile Quality Improvement S...Kaali Dass PMP, PhD.
 
How Enterprises Are Modernizing Their Security, Risk Management, & Compliance...
How Enterprises Are Modernizing Their Security, Risk Management, & Compliance...How Enterprises Are Modernizing Their Security, Risk Management, & Compliance...
How Enterprises Are Modernizing Their Security, Risk Management, & Compliance...Amazon Web Services
 
Continuous Delivery for people who do not write code - Matthew Skelton - Conflux
Continuous Delivery for people who do not write code - Matthew Skelton - ConfluxContinuous Delivery for people who do not write code - Matthew Skelton - Conflux
Continuous Delivery for people who do not write code - Matthew Skelton - ConfluxMatthew Skelton
 
CRS Company Overview -Feb 6 2017
CRS Company Overview -Feb 6 2017CRS Company Overview -Feb 6 2017
CRS Company Overview -Feb 6 2017Joseph John
 
Webcast Presentation: Accelerate Continuous Delivery with Development Testing...
Webcast Presentation: Accelerate Continuous Delivery with Development Testing...Webcast Presentation: Accelerate Continuous Delivery with Development Testing...
Webcast Presentation: Accelerate Continuous Delivery with Development Testing...GRUC
 
Emerging Trends in Information Privacy and Security
Emerging Trends in Information Privacy and SecurityEmerging Trends in Information Privacy and Security
Emerging Trends in Information Privacy and SecurityJessica Santamaria
 
Emerging Trends in Information Privacy and Security
Emerging Trends in Information Privacy and SecurityEmerging Trends in Information Privacy and Security
Emerging Trends in Information Privacy and SecurityJessica Santamaria
 
Enterprise under attack dealing with security threats and compliance
Enterprise under attack dealing with security threats and complianceEnterprise under attack dealing with security threats and compliance
Enterprise under attack dealing with security threats and complianceSPAN Infotech (India) Pvt Ltd
 
Testing cloud services - EuroSTAR
Testing cloud services - EuroSTARTesting cloud services - EuroSTAR
Testing cloud services - EuroSTARJeroen Mengerink
 
Quality by Design Course Preview
Quality by Design Course PreviewQuality by Design Course Preview
Quality by Design Course PreviewInvensis Learning
 
Third Party Risk Management
Third Party Risk ManagementThird Party Risk Management
Third Party Risk ManagementEC-Council
 
Application Security Review 5 Dec 09 Final
Application Security Review 5 Dec 09 FinalApplication Security Review 5 Dec 09 Final
Application Security Review 5 Dec 09 FinalManoj Agarwal
 

Similaire à EuroStar Webinar Testing Cloud Services Kees Blokland (20)

Test Management for Cloud-based Applications
Test Management for Cloud-based ApplicationsTest Management for Cloud-based Applications
Test Management for Cloud-based Applications
 
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin PolNon-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
 
Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...
Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...
Moving into the Cloud: Make Sure your Test Approach is Cloud Proof by Ruud Te...
 
Delivering Secure Projects
Delivering Secure ProjectsDelivering Secure Projects
Delivering Secure Projects
 
Digital transformation testing.
Digital transformation testing. Digital transformation testing.
Digital transformation testing.
 
Delight Your Customers with Four Eyes of Quality: Agile Quality Improvement S...
Delight Your Customers with Four Eyes of Quality: Agile Quality Improvement S...Delight Your Customers with Four Eyes of Quality: Agile Quality Improvement S...
Delight Your Customers with Four Eyes of Quality: Agile Quality Improvement S...
 
How Enterprises Are Modernizing Their Security, Risk Management, & Compliance...
How Enterprises Are Modernizing Their Security, Risk Management, & Compliance...How Enterprises Are Modernizing Their Security, Risk Management, & Compliance...
How Enterprises Are Modernizing Their Security, Risk Management, & Compliance...
 
Continuous Delivery for people who do not write code - Matthew Skelton - Conflux
Continuous Delivery for people who do not write code - Matthew Skelton - ConfluxContinuous Delivery for people who do not write code - Matthew Skelton - Conflux
Continuous Delivery for people who do not write code - Matthew Skelton - Conflux
 
CRS Company Overview -Feb 6 2017
CRS Company Overview -Feb 6 2017CRS Company Overview -Feb 6 2017
CRS Company Overview -Feb 6 2017
 
Webcast Presentation: Accelerate Continuous Delivery with Development Testing...
Webcast Presentation: Accelerate Continuous Delivery with Development Testing...Webcast Presentation: Accelerate Continuous Delivery with Development Testing...
Webcast Presentation: Accelerate Continuous Delivery with Development Testing...
 
Emerging Trends in Information Privacy and Security
Emerging Trends in Information Privacy and SecurityEmerging Trends in Information Privacy and Security
Emerging Trends in Information Privacy and Security
 
Emerging Trends in Information Privacy and Security
Emerging Trends in Information Privacy and SecurityEmerging Trends in Information Privacy and Security
Emerging Trends in Information Privacy and Security
 
Enterprise under attack dealing with security threats and compliance
Enterprise under attack dealing with security threats and complianceEnterprise under attack dealing with security threats and compliance
Enterprise under attack dealing with security threats and compliance
 
Privacy Engineering
Privacy EngineeringPrivacy Engineering
Privacy Engineering
 
Testing cloud services - EuroSTAR
Testing cloud services - EuroSTARTesting cloud services - EuroSTAR
Testing cloud services - EuroSTAR
 
Quality by Design Course Preview
Quality by Design Course PreviewQuality by Design Course Preview
Quality by Design Course Preview
 
Matrix consultancy services
Matrix consultancy servicesMatrix consultancy services
Matrix consultancy services
 
Third Party Risk Management
Third Party Risk ManagementThird Party Risk Management
Third Party Risk Management
 
[Paul Holland] Trends in Software Testing
[Paul Holland] Trends in Software Testing[Paul Holland] Trends in Software Testing
[Paul Holland] Trends in Software Testing
 
Application Security Review 5 Dec 09 Final
Application Security Review 5 Dec 09 FinalApplication Security Review 5 Dec 09 Final
Application Security Review 5 Dec 09 Final
 

Plus de Kees Blokland

Introductie boek Testing Cloud Services.
Introductie boek Testing Cloud Services.Introductie boek Testing Cloud Services.
Introductie boek Testing Cloud Services.Kees Blokland
 
Introducing testing cloud services - Transformation to SaaS
Introducing testing cloud services - Transformation to SaaSIntroducing testing cloud services - Transformation to SaaS
Introducing testing cloud services - Transformation to SaaSKees Blokland
 
Product risico analyse in de praktijk (2010) - Kees Blokland
Product risico analyse in de praktijk (2010) - Kees BloklandProduct risico analyse in de praktijk (2010) - Kees Blokland
Product risico analyse in de praktijk (2010) - Kees BloklandKees Blokland
 
Monitoring en control op uitbestede testwerkzaamheden door Kees Blokland.
Monitoring en control op uitbestede testwerkzaamheden door Kees Blokland.Monitoring en control op uitbestede testwerkzaamheden door Kees Blokland.
Monitoring en control op uitbestede testwerkzaamheden door Kees Blokland.Kees Blokland
 
Mistakes Outsourcing Customers Make by Kees Blokland
Mistakes Outsourcing Customers Make by Kees BloklandMistakes Outsourcing Customers Make by Kees Blokland
Mistakes Outsourcing Customers Make by Kees BloklandKees Blokland
 
Metrics for (outsourced) test activities by Kees Blokland
Metrics for (outsourced) test activities by Kees BloklandMetrics for (outsourced) test activities by Kees Blokland
Metrics for (outsourced) test activities by Kees BloklandKees Blokland
 
Useful stepping stones in growth towards Agile testing by Kees Blokland
Useful stepping stones in growth towards Agile testing by Kees BloklandUseful stepping stones in growth towards Agile testing by Kees Blokland
Useful stepping stones in growth towards Agile testing by Kees BloklandKees Blokland
 
Risk Based Testing in Agile context - Kees Blokland
Risk Based Testing in Agile context - Kees BloklandRisk Based Testing in Agile context - Kees Blokland
Risk Based Testing in Agile context - Kees BloklandKees Blokland
 
Useful stepping stones in growth towards Agile testing door Kees Blokland.
Useful stepping stones in growth towards Agile testing door Kees Blokland.Useful stepping stones in growth towards Agile testing door Kees Blokland.
Useful stepping stones in growth towards Agile testing door Kees Blokland.Kees Blokland
 

Plus de Kees Blokland (9)

Introductie boek Testing Cloud Services.
Introductie boek Testing Cloud Services.Introductie boek Testing Cloud Services.
Introductie boek Testing Cloud Services.
 
Introducing testing cloud services - Transformation to SaaS
Introducing testing cloud services - Transformation to SaaSIntroducing testing cloud services - Transformation to SaaS
Introducing testing cloud services - Transformation to SaaS
 
Product risico analyse in de praktijk (2010) - Kees Blokland
Product risico analyse in de praktijk (2010) - Kees BloklandProduct risico analyse in de praktijk (2010) - Kees Blokland
Product risico analyse in de praktijk (2010) - Kees Blokland
 
Monitoring en control op uitbestede testwerkzaamheden door Kees Blokland.
Monitoring en control op uitbestede testwerkzaamheden door Kees Blokland.Monitoring en control op uitbestede testwerkzaamheden door Kees Blokland.
Monitoring en control op uitbestede testwerkzaamheden door Kees Blokland.
 
Mistakes Outsourcing Customers Make by Kees Blokland
Mistakes Outsourcing Customers Make by Kees BloklandMistakes Outsourcing Customers Make by Kees Blokland
Mistakes Outsourcing Customers Make by Kees Blokland
 
Metrics for (outsourced) test activities by Kees Blokland
Metrics for (outsourced) test activities by Kees BloklandMetrics for (outsourced) test activities by Kees Blokland
Metrics for (outsourced) test activities by Kees Blokland
 
Useful stepping stones in growth towards Agile testing by Kees Blokland
Useful stepping stones in growth towards Agile testing by Kees BloklandUseful stepping stones in growth towards Agile testing by Kees Blokland
Useful stepping stones in growth towards Agile testing by Kees Blokland
 
Risk Based Testing in Agile context - Kees Blokland
Risk Based Testing in Agile context - Kees BloklandRisk Based Testing in Agile context - Kees Blokland
Risk Based Testing in Agile context - Kees Blokland
 
Useful stepping stones in growth towards Agile testing door Kees Blokland.
Useful stepping stones in growth towards Agile testing door Kees Blokland.Useful stepping stones in growth towards Agile testing door Kees Blokland.
Useful stepping stones in growth towards Agile testing door Kees Blokland.
 

Dernier

Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfPrecisely
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 

Dernier (20)

Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 

EuroStar Webinar Testing Cloud Services Kees Blokland

  • 1. Welcome to the 2013 This webinar is presented by Kees Blokland and he will discuss: ‘Going Cloudy? How to test SaaS?’ Join us on Twitter! @esconfs #esconfs www.eurostarconferences.com
  • 2. Going Cloudy? How to test SaaS? Kees Blokland Polteq Test Services BV The Netherlands
  • 4.
  • 5. searching, recording, accounting, paying, writing, reviewing, tracking, calculating, developing, listening, analyzing, transmitting, learning, controlling, purchasing, testing, alarming, changing, updating, deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, mailing, communicating, reading, playing, working, meeting, gambling, shopping, storing, cross checking, retrieving, configuring, sketching, saving, accelerating, enhancing, creating, growing, checking in, checking out, finding out, reaching, talking, designing, making, verifying, measuring
  • 6. Develop and Test Operate and Manage 6 Email Surf Transfer Store
  • 7. Develop and Test redundancy, proliferation limitations Email Surf Transfer 80% unused storage claim Operate and Manage 7 environmentally unfriendly Store
  • 8. Develop and Test Email Surf Transfer SOA internet technology virtualization standard software Operate and Manage 8 bandwidth Store
  • 9. searching, recording, accounting, paying, writing, reviewing, tracking, calculating, developing, listening, Develop and Test Email Surf analyzing, transmitting, learning, controlling, Transfer purchasing, testing, alarming, changing, updating, deleting, accessing, rejecting, correcting, studying, booking, receiving, tracing, protecting, deciding, managing, teaching, facilitating, identifying, copying, removing, demonstrating, checking, showing, selecting, subscribing, unsubscribing, sharing, Operate communicating, reading, playing, working, Store mailing, and Manage meeting, gambling, shopping, storing, cross 9
  • 10.
  • 11. Essential characteristics  On-demand service  Broad network access  Resource pooling  Rapid elasticity Deployment models – private cloud – community cloud – public cloud – hybrid cloud Service Models  Measured service Software as a Service Platform as a Service Infrastructure as a Service US: National Institute of Standards and Technology http://www.nist.gov
  • 13. Performance risks Standards Security risks Cyber crime Availability and continuity Continuïty risks Functionality risks Privacy Maintainability risks Multi platform Legislation and regulations risks Suppliers and Impact organisation outsourcing risks Legislation
  • 14. Performance risks Security risks YOUR Operational Profile Availability and continuity risks Functionality risks Other customers Maintainability risks Legislation and regulations risks 14 Suppliers and outsourcing risks YOUR Operational Profile PLUS
  • 15. Performance risks Security risks The idea: “it’s safe” Availability and continuity risks Functionality risks Everything over the web Maintainability risks Legislation and regulations risks 15 Suppliers and outsourcing risks Home ground for hackers
  • 16. Performance risks Security risks No free choice of device. Availability and continuity risks Functionality risks Bring Your Own Device Maintainability risks Legislation and regulations risks 16 Suppliers and outsourcing risks No control.
  • 17. Performance risks Security risks Planned and controlled Availability and continuity risks Functionality risks Updates, patches, fixes, … Maintainability risks Legislation and regulations risks 17 Suppliers and outsourcing risks Do I have a choice?
  • 18. Performance risks Security risks In house. Availability and continuity risks Functionality risks Where is my data? And is that OK? Maintainability risks Legislation and regulations risks 18 Suppliers and outsourcing risks Somewhere…
  • 19. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 19 Suppliers and outsourcing risks
  • 21. Testing! Interview Check Trial Proof of concept Proef Proof ofInterview concept Testen Intake Review 21
  • 22. Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Proef Proof ofInterview concept Testen Intake Functional testing Migration testing Testing caused by legislation and regulations 22 Testing in production
  • 23. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 23 Suppliers and outsourcing risks Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  • 24. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 24 Suppliers and outsourcing risks Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  • 25. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 25 Suppliers and outsourcing risks Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  • 26. Performance risks Security risks Availability and continuity risks Testing during selection Performance testing Security testing Architecture for manageability Testing Functionality risks Availability and continuity testing From “individual” riskstesting Functional Maintainability risks to Migration testing Legislation and regulations “individual” test measures by Testing caused risks 26 Suppliers and outsourcing risks legislation and regulations Testing in production
  • 27. Testing during selection Selection Performance testing Security testing Testing for manageability Implementation Availability and continuity testing Functional testing Migration testing Production 27 Testing caused by legislation and regulations Testing in production
  • 28. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 28 Suppliers and outsourcing risks Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  • 29. Testing during selection Performance testing Selection Criteria Security testing Testing for manageability Availability and continuity testing Proof of Concept Functional testing Migration testing Testing caused by legislation and regulations 29 Testing in production
  • 30. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 30 Suppliers and outsourcing risks Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  • 31. Testing during selection Performance testing Known measures tuned and tweaked Security testing Testing for manageability Availability and continuity testing Functional testing New measures developed Migration testing Testing caused by legislation and regulations 31 Testing in production
  • 32. Testing during selection YOUR Operational Profile Performance testing Security testing Testing for manageability Load Testing Availability and continuity testing Functional testing YOUR Operational Profile PLUS ACTUAL MOMENT 32 Migration testing Testing caused by legislation and regulations Testing in production
  • 33. Testing during selection Performance testing Load and stress. Security testing Testing for manageability Elasticity Availability and continuity testing Functional testing Migration testing Load and elasticity. 33 Testing caused by legislation and regulations Testing in production
  • 34. load test – ‘up’ load test – ‘down’ 101 100 boundary values 99 load path test extend? no yes 200 charged 34 100 charged boundary values ‘up’ tc 1: use=99, pay 100 tc 2: use=100, pay 100 tc 3: use=101, pay 200 ‘down’ tc1: use=101, pay 200 tc2: use=100, pay 100 tc3: use=99, pay 100
  • 35. Testing during selection Multiplatform testing. Performance testing Security testing Testing for manageability Any device – any platform Availability and continuity testing Functional testing Migration testing Multiplatform testing. 35 Testing caused by legislation and regulations Testing in production
  • 36. 3997 distinct Android devices http://opensignal.com/reports/fragmentation.php 36
  • 37. Internet Explorer 7 Windows XP Internet Explorer 8 Windows Vista Firefox 3.6 Windows 7 Firefox 4 Browsers Windows 2003 Server Safari 4 Safari 5 Windows 8 Chrome11 Windows CE Opera11 Linux Operating systems SUN Computer Unix Mac OS Lion Mac OS Snow Leopard PC Macintosh iPhone ... Multi-platform testing iOS Samsung … Mobile phones NOKIA … Android ASUS ... Windows Mobile Tablet Devices 37 Blackberry … MOTOROLA …
  • 38. Testing during selection Performance testing Incidental testing. Security testing Legislation + Regulations = Test basis Testing for manageability Availability and continuity testing Functional testing Migration testing Compliancy testing. 38 Testing caused by legislation and regulations Testing in production
  • 39. Performance risks Security risks Availability and continuity risks Functionality risks Maintainability risks Legislation and regulations risks 39 Suppliers and outsourcing risks Testing during selection Performance testing Security testing Testing for manageability Availability and continuity testing Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  • 40. Testing during selection Continuous End-to-End Test Performance testing Security testing Testing for manageability Availability and continuity testing Functionals and non-functionals 40 Functional testing Migration testing Testing caused by legislation and regulations Testing in production
  • 41. Standards Cyber crime Check Continuity Interview Privacy Legislation Proof of concept Trial Multi platform Impact organisation Intake
  • 42. Performance risks Security risks Availability and continuity risks Testing during selection Performance testing Security testing Architecture for manageability Testing starts early: in selection Testing Functionality risks Availability and continuity testing From “individual”widened Scope of testing Functional testing is risks Maintainability risks to Migration testing Legislation and regulations “individual” test measuresby Testing continues in production Testing caused risks 42 Suppliers and outsourcing risks legislation and regulations Testing in production
  • 44. Thanks for listening! Go to www.eurostarconferences.com for more information @esconfs #esconfs www.eurostarconferences.com