SlideShare une entreprise Scribd logo
1  sur  21
Télécharger pour lire hors ligne
T12
Special Topics
5/8/2014 11:15:00 AM
DevOps: Where in the World Is
Test?
Presented by:
Erik Stensland
Pearson Learning Technology
Brought to you by:
340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
Erik Stensland
Pearson Learning Technology
Software quality architect for Pearson Learning Technologies, Erik Stensland is leading the
technical testing efforts with a concentration on functional, performance, and integration testing.
In the software test and quality engineering field for more than twenty years, Erik focuses on
implementing innovative ideas around process and tools to help teams become more effective
and efficient. His previous roles have included senior QA management positions and QA
consultant for Internet startups and DoD industries. A board member for the Software Quality
Association of Denver, Erik has been an international presenter at leading testing conferences
in Europe and the United States. Follow Erik at testarch.blogspot.com/ and on Twitter
@erikstensland60.
4/26/2014
1
DevOps: Where in the
World is Test?
StarEast 2014 Conference
Date: May 8th, 2014
Author: Erik Stensland
A Little about me
Blog: http://testarch.blogspot.com
LinkedIn : http://www.linkedin.com/in/erikstensland/
Twitter : https://twitter.com/erikstensland60
email: estensla@yahoo.com
4/26/2014
2
What “IF” ?
Agenda
• What is DevOps
• DevOps 1, 2, 3
• Challenges for QA
• Take Away’s
• Case Study
4/26/2014
3
First Thought!
The Backyard brawlers
Then Later .
4/26/2014
4
Dev
Ops
4/26/2014
5
TEST/QA
Finally!!!
4/26/2014
6
What is DevOps
Where did it come from?
4/26/2014
7
DevOps Principles
Benefits of
DevOps
Faster time to market (reduced cycle times
and higher deploy rates)
Increased Quality (i.e., increased availability,
increased change success rate, fewer failures)
Increased organizational effectiveness
(increased time spent on value adding activities
vs. waste, increased amount of value being
delivered to the customer).
4/26/2014
8
Questions?
The Challenge for QA
High deployment rates typically associated
with DevOps work streams will often put
enormous pressure on QA.
4/26/2014
9
No longer to find defects,
necessarily.
4/26/2014
10
Prevent defects
Methodology
4/26/2014
11
Automation/Measurement
Culture / People
4/26/2014
12
Keys to Test/QA in
DevOps
Your purpose is to Prevent Defects.
Focus lies on Risks to the product instead
of just the functionality of the software
changes.
QA must be testing early and often using
“Walk Away Automation” to Integrate QA
into the automated deployment flow.
Team members need to have the “Right
Attitude”
The Case Study:
Code Name - Manhattan
4/26/2014
13
What is Manhattan
YESTERDAY
4/26/2014
14
Software Engineering
• Few Builds a week. ~1 Deployment every week or two.
• Limited Unit testing
• Manually Build and Deploy to Pre-Prod
Software Quality Engineering
• Very little architecture review for testability.
• Heavy Manual testing.
• Limited UI automated tests, Little web services automated tests.
• Automated test manually kicked off.
• Some performance testing.
IT Operations
• Manual recompiling of Code for different source code repository
• Manual Deployments and Configurations of Production servers
• Limited monitoring of systems , No monitoring of Applications
• No review of Systems before Code is delivered for Deployment
Yesterday’s Environment
The “Discussion”
4/26/2014
15
Extend Eng
into
Production
• Created a Continuous Integration and Release
process using Jenkins.
• Deeply integrating QA into the release process by
creating “walk away automation”.
• Ensure production readiness of the Code as well as
the Environment by spinning up new
environments before code deployment and testing.
4/26/2014
16
Production
Feedback into
Eng
• Implemented Systems and Application Monitoring
in pre-prod and prod.
• Use one incident reporting system for Dev, QA
and Ops to monitor during production releases and
incidents.
• Created blameless postmortems for all releases
and incidents.
Embed Eng
into IT Ops
• Development and QA resources added to the
rotation for production support.
Embed IT Ops
into Eng
• Created reusable stories for non-functional such as
Monitoring, Environment creations.
4/26/2014
17
TODAY – Software Eng
• 100’s of Builds a day.
• Large amounts of Unit tests
• Multiple Deploys a day to pre-prod
• Push Button Deploys to all pre-prod
environments.
TODAY – Test/QA
• Same Repository for Tests as Code
• Large sets of Automated tests.
• New feature Exploratory testing.
• Low maintenance automation tests.
• Continuously running all Automated
Tests in All Pre-Prod environments.
4/26/2014
18
TODAY – IT Operations
• Same Repository for Code and
Environment scripts.
• Push Button Deployments to
Production.
• Monitoring at system and application
on all new deployments.
Ask Yourself What “IF” ?
4/26/2014
19
Give away questions?
What is the name of the Band I
showed in the Video?
How much did the Krupp Bagger
288 weigh?

Contenu connexe

Tendances

DevOps for a 10-Year-Old (Codebase)
DevOps for a 10-Year-Old (Codebase)DevOps for a 10-Year-Old (Codebase)
DevOps for a 10-Year-Old (Codebase)CA Technologies
 
Learn What’s New With CA 1® - Take Advantage of the Enhancements You Requested
Learn What’s New With CA 1® - Take Advantage of the Enhancements You RequestedLearn What’s New With CA 1® - Take Advantage of the Enhancements You Requested
Learn What’s New With CA 1® - Take Advantage of the Enhancements You RequestedCA Technologies
 
Raising the Speed Limit on Mobile App Development
Raising the Speed Limit on Mobile App DevelopmentRaising the Speed Limit on Mobile App Development
Raising the Speed Limit on Mobile App DevelopmentCA Technologies
 
Case Study: How CA’s IT Automated Salesforce Deployments with CA Release Auto...
Case Study: How CA’s IT Automated Salesforce Deployments with CA Release Auto...Case Study: How CA’s IT Automated Salesforce Deployments with CA Release Auto...
Case Study: How CA’s IT Automated Salesforce Deployments with CA Release Auto...CA Technologies
 
Pitney Bowes Uses Development and Testing Tools to Drive Early API Developmen...
Pitney Bowes Uses Development and Testing Tools to Drive Early API Developmen...Pitney Bowes Uses Development and Testing Tools to Drive Early API Developmen...
Pitney Bowes Uses Development and Testing Tools to Drive Early API Developmen...CA Technologies
 
How National Australia Bank (NAB) used CA APM during performance testing to i...
How National Australia Bank (NAB) used CA APM during performance testing to i...How National Australia Bank (NAB) used CA APM during performance testing to i...
How National Australia Bank (NAB) used CA APM during performance testing to i...CA Technologies
 
Con-way Case Study: Optimizing Application Integration Software Development L...
Con-way Case Study: Optimizing Application Integration Software Development L...Con-way Case Study: Optimizing Application Integration Software Development L...
Con-way Case Study: Optimizing Application Integration Software Development L...CA Technologies
 
Pre-Con Education: Migrating to CA Release Automation 5.5.2 to Exploit New ...
Pre-Con Education: Migrating to CA Release Automation 5.5.2 to Exploit New ...Pre-Con Education: Migrating to CA Release Automation 5.5.2 to Exploit New ...
Pre-Con Education: Migrating to CA Release Automation 5.5.2 to Exploit New ...CA Technologies
 
Accelerate Dev Test with Microsoft® Azure™ and CA Service Virtualization on D...
Accelerate Dev Test with Microsoft® Azure™ and CA Service Virtualization on D...Accelerate Dev Test with Microsoft® Azure™ and CA Service Virtualization on D...
Accelerate Dev Test with Microsoft® Azure™ and CA Service Virtualization on D...CA Technologies
 
CA Service Virtualization vs mocks stubs
CA Service Virtualization vs mocks stubsCA Service Virtualization vs mocks stubs
CA Service Virtualization vs mocks stubsAlan Baptista
 
Hands-On Lab: Take CA Release Automation for a Test Drive
Hands-On Lab: Take CA Release Automation for a Test DriveHands-On Lab: Take CA Release Automation for a Test Drive
Hands-On Lab: Take CA Release Automation for a Test DriveCA Technologies
 
Migrating to CA Workload Automation - Consolidation and Conversion Considerat...
Migrating to CA Workload Automation - Consolidation and Conversion Considerat...Migrating to CA Workload Automation - Consolidation and Conversion Considerat...
Migrating to CA Workload Automation - Consolidation and Conversion Considerat...CA Technologies
 
DevTest Portfolio Overview
DevTest Portfolio OverviewDevTest Portfolio Overview
DevTest Portfolio OverviewCA Technologies
 
TechTalk: Reduce Risk with Canary Deployments
TechTalk: Reduce Risk with Canary DeploymentsTechTalk: Reduce Risk with Canary Deployments
TechTalk: Reduce Risk with Canary DeploymentsCA Technologies
 
Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...
Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...
Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...CA Technologies
 
T-Mobile’s DevOps and Continuous Delivery Journey Building a Foundation for a...
T-Mobile’s DevOps and Continuous Delivery Journey Building a Foundation for a...T-Mobile’s DevOps and Continuous Delivery Journey Building a Foundation for a...
T-Mobile’s DevOps and Continuous Delivery Journey Building a Foundation for a...CA Technologies
 
Nordstrom Case Study: DevOps is High-Fashion: Nordstrom’s Use of Service Vir...
Nordstrom Case Study: DevOps is High-Fashion: Nordstrom’s Use of Service Vir...Nordstrom Case Study: DevOps is High-Fashion: Nordstrom’s Use of Service Vir...
Nordstrom Case Study: DevOps is High-Fashion: Nordstrom’s Use of Service Vir...CA Technologies
 
Technology Primer: Monitor Microservices, Containers, Cloud Foundry and Node ...
Technology Primer: Monitor Microservices, Containers, Cloud Foundry and Node ...Technology Primer: Monitor Microservices, Containers, Cloud Foundry and Node ...
Technology Primer: Monitor Microservices, Containers, Cloud Foundry and Node ...CA Technologies
 
Continuous Delivery—CA Workload Automation ESP Edition 11.4 Enhancements
Continuous Delivery—CA Workload Automation ESP Edition 11.4 EnhancementsContinuous Delivery—CA Workload Automation ESP Edition 11.4 Enhancements
Continuous Delivery—CA Workload Automation ESP Edition 11.4 EnhancementsCA Technologies
 
Upgrade and Unleash the Power of CA Workload Automation AutoSys (AE) and CA W...
Upgrade and Unleash the Power of CA Workload Automation AutoSys (AE) and CA W...Upgrade and Unleash the Power of CA Workload Automation AutoSys (AE) and CA W...
Upgrade and Unleash the Power of CA Workload Automation AutoSys (AE) and CA W...CA Technologies
 

Tendances (20)

DevOps for a 10-Year-Old (Codebase)
DevOps for a 10-Year-Old (Codebase)DevOps for a 10-Year-Old (Codebase)
DevOps for a 10-Year-Old (Codebase)
 
Learn What’s New With CA 1® - Take Advantage of the Enhancements You Requested
Learn What’s New With CA 1® - Take Advantage of the Enhancements You RequestedLearn What’s New With CA 1® - Take Advantage of the Enhancements You Requested
Learn What’s New With CA 1® - Take Advantage of the Enhancements You Requested
 
Raising the Speed Limit on Mobile App Development
Raising the Speed Limit on Mobile App DevelopmentRaising the Speed Limit on Mobile App Development
Raising the Speed Limit on Mobile App Development
 
Case Study: How CA’s IT Automated Salesforce Deployments with CA Release Auto...
Case Study: How CA’s IT Automated Salesforce Deployments with CA Release Auto...Case Study: How CA’s IT Automated Salesforce Deployments with CA Release Auto...
Case Study: How CA’s IT Automated Salesforce Deployments with CA Release Auto...
 
Pitney Bowes Uses Development and Testing Tools to Drive Early API Developmen...
Pitney Bowes Uses Development and Testing Tools to Drive Early API Developmen...Pitney Bowes Uses Development and Testing Tools to Drive Early API Developmen...
Pitney Bowes Uses Development and Testing Tools to Drive Early API Developmen...
 
How National Australia Bank (NAB) used CA APM during performance testing to i...
How National Australia Bank (NAB) used CA APM during performance testing to i...How National Australia Bank (NAB) used CA APM during performance testing to i...
How National Australia Bank (NAB) used CA APM during performance testing to i...
 
Con-way Case Study: Optimizing Application Integration Software Development L...
Con-way Case Study: Optimizing Application Integration Software Development L...Con-way Case Study: Optimizing Application Integration Software Development L...
Con-way Case Study: Optimizing Application Integration Software Development L...
 
Pre-Con Education: Migrating to CA Release Automation 5.5.2 to Exploit New ...
Pre-Con Education: Migrating to CA Release Automation 5.5.2 to Exploit New ...Pre-Con Education: Migrating to CA Release Automation 5.5.2 to Exploit New ...
Pre-Con Education: Migrating to CA Release Automation 5.5.2 to Exploit New ...
 
Accelerate Dev Test with Microsoft® Azure™ and CA Service Virtualization on D...
Accelerate Dev Test with Microsoft® Azure™ and CA Service Virtualization on D...Accelerate Dev Test with Microsoft® Azure™ and CA Service Virtualization on D...
Accelerate Dev Test with Microsoft® Azure™ and CA Service Virtualization on D...
 
CA Service Virtualization vs mocks stubs
CA Service Virtualization vs mocks stubsCA Service Virtualization vs mocks stubs
CA Service Virtualization vs mocks stubs
 
Hands-On Lab: Take CA Release Automation for a Test Drive
Hands-On Lab: Take CA Release Automation for a Test DriveHands-On Lab: Take CA Release Automation for a Test Drive
Hands-On Lab: Take CA Release Automation for a Test Drive
 
Migrating to CA Workload Automation - Consolidation and Conversion Considerat...
Migrating to CA Workload Automation - Consolidation and Conversion Considerat...Migrating to CA Workload Automation - Consolidation and Conversion Considerat...
Migrating to CA Workload Automation - Consolidation and Conversion Considerat...
 
DevTest Portfolio Overview
DevTest Portfolio OverviewDevTest Portfolio Overview
DevTest Portfolio Overview
 
TechTalk: Reduce Risk with Canary Deployments
TechTalk: Reduce Risk with Canary DeploymentsTechTalk: Reduce Risk with Canary Deployments
TechTalk: Reduce Risk with Canary Deployments
 
Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...
Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...
Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...
 
T-Mobile’s DevOps and Continuous Delivery Journey Building a Foundation for a...
T-Mobile’s DevOps and Continuous Delivery Journey Building a Foundation for a...T-Mobile’s DevOps and Continuous Delivery Journey Building a Foundation for a...
T-Mobile’s DevOps and Continuous Delivery Journey Building a Foundation for a...
 
Nordstrom Case Study: DevOps is High-Fashion: Nordstrom’s Use of Service Vir...
Nordstrom Case Study: DevOps is High-Fashion: Nordstrom’s Use of Service Vir...Nordstrom Case Study: DevOps is High-Fashion: Nordstrom’s Use of Service Vir...
Nordstrom Case Study: DevOps is High-Fashion: Nordstrom’s Use of Service Vir...
 
Technology Primer: Monitor Microservices, Containers, Cloud Foundry and Node ...
Technology Primer: Monitor Microservices, Containers, Cloud Foundry and Node ...Technology Primer: Monitor Microservices, Containers, Cloud Foundry and Node ...
Technology Primer: Monitor Microservices, Containers, Cloud Foundry and Node ...
 
Continuous Delivery—CA Workload Automation ESP Edition 11.4 Enhancements
Continuous Delivery—CA Workload Automation ESP Edition 11.4 EnhancementsContinuous Delivery—CA Workload Automation ESP Edition 11.4 Enhancements
Continuous Delivery—CA Workload Automation ESP Edition 11.4 Enhancements
 
Upgrade and Unleash the Power of CA Workload Automation AutoSys (AE) and CA W...
Upgrade and Unleash the Power of CA Workload Automation AutoSys (AE) and CA W...Upgrade and Unleash the Power of CA Workload Automation AutoSys (AE) and CA W...
Upgrade and Unleash the Power of CA Workload Automation AutoSys (AE) and CA W...
 

Similaire à DevOps: Where in the World Is Test?

Helpful Practices in Agile Testing
Helpful Practices in Agile TestingHelpful Practices in Agile Testing
Helpful Practices in Agile TestingJosiah Renaudin
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization TechWell
 
AfterTest Madrid March 2016 - DevOps and Testing Introduction
AfterTest Madrid March 2016 - DevOps and Testing IntroductionAfterTest Madrid March 2016 - DevOps and Testing Introduction
AfterTest Madrid March 2016 - DevOps and Testing IntroductionPeter Marshall
 
How to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps EnvironmentHow to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps EnvironmentNeotys
 
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0minseok kim
 
Resume_Saurabh jain
Resume_Saurabh jainResume_Saurabh jain
Resume_Saurabh jainSaurabh Jain
 
Implementing Azure DevOps with your Testing Project
Implementing Azure DevOps with your Testing ProjectImplementing Azure DevOps with your Testing Project
Implementing Azure DevOps with your Testing ProjectRTTS
 
Continuous Testing of Cloud Applications
Continuous Testing of Cloud ApplicationsContinuous Testing of Cloud Applications
Continuous Testing of Cloud ApplicationsTechWell
 
Meet Big Agile: Testing on Large-Scale Projects
Meet Big Agile: Testing on Large-Scale ProjectsMeet Big Agile: Testing on Large-Scale Projects
Meet Big Agile: Testing on Large-Scale ProjectsTechWell
 
Agile & DevOps - It's all about project success
Agile & DevOps - It's all about project successAgile & DevOps - It's all about project success
Agile & DevOps - It's all about project successAdam Stephensen
 
Puppet + Diaxon: Getting to the next stage of DevOps evolution
Puppet + Diaxon: Getting to the next stage of DevOps evolutionPuppet + Diaxon: Getting to the next stage of DevOps evolution
Puppet + Diaxon: Getting to the next stage of DevOps evolutionPuppet
 
Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle Kari Kakkonen
 
Dev ops != Dev+Ops
Dev ops != Dev+OpsDev ops != Dev+Ops
Dev ops != Dev+OpsShalu Ahuja
 
Patterns and Practices of a Successful DevOps Transformation
Patterns and Practices of a Successful DevOps TransformationPatterns and Practices of a Successful DevOps Transformation
Patterns and Practices of a Successful DevOps TransformationChef
 
DevOps drivein - Mind the Gap
DevOps drivein - Mind the GapDevOps drivein - Mind the Gap
DevOps drivein - Mind the GapSerena Software
 
How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks Ulf Mattsson
 

Similaire à DevOps: Where in the World Is Test? (20)

Helpful Practices in Agile Testing
Helpful Practices in Agile TestingHelpful Practices in Agile Testing
Helpful Practices in Agile Testing
 
Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization Instill a DevOps Testing Culture in Your Team and Organization
Instill a DevOps Testing Culture in Your Team and Organization
 
Reinhard Weiss 2015
Reinhard Weiss 2015Reinhard Weiss 2015
Reinhard Weiss 2015
 
AfterTest Madrid March 2016 - DevOps and Testing Introduction
AfterTest Madrid March 2016 - DevOps and Testing IntroductionAfterTest Madrid March 2016 - DevOps and Testing Introduction
AfterTest Madrid March 2016 - DevOps and Testing Introduction
 
How to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps EnvironmentHow to Fit Performance Testing into a DevOps Environment
How to Fit Performance Testing into a DevOps Environment
 
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0
 
Resume_Saurabh jain
Resume_Saurabh jainResume_Saurabh jain
Resume_Saurabh jain
 
Implementing Azure DevOps with your Testing Project
Implementing Azure DevOps with your Testing ProjectImplementing Azure DevOps with your Testing Project
Implementing Azure DevOps with your Testing Project
 
Continuous Testing of Cloud Applications
Continuous Testing of Cloud ApplicationsContinuous Testing of Cloud Applications
Continuous Testing of Cloud Applications
 
Journey to the center of DevOps - v6
Journey to the center of DevOps - v6Journey to the center of DevOps - v6
Journey to the center of DevOps - v6
 
Meet Big Agile: Testing on Large-Scale Projects
Meet Big Agile: Testing on Large-Scale ProjectsMeet Big Agile: Testing on Large-Scale Projects
Meet Big Agile: Testing on Large-Scale Projects
 
Agile & DevOps - It's all about project success
Agile & DevOps - It's all about project successAgile & DevOps - It's all about project success
Agile & DevOps - It's all about project success
 
Puppet + Diaxon: Getting to the next stage of DevOps evolution
Puppet + Diaxon: Getting to the next stage of DevOps evolutionPuppet + Diaxon: Getting to the next stage of DevOps evolution
Puppet + Diaxon: Getting to the next stage of DevOps evolution
 
Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle
 
kishore
kishorekishore
kishore
 
Dev ops != Dev+Ops
Dev ops != Dev+OpsDev ops != Dev+Ops
Dev ops != Dev+Ops
 
AvenDATA and Devops
AvenDATA and DevopsAvenDATA and Devops
AvenDATA and Devops
 
Patterns and Practices of a Successful DevOps Transformation
Patterns and Practices of a Successful DevOps TransformationPatterns and Practices of a Successful DevOps Transformation
Patterns and Practices of a Successful DevOps Transformation
 
DevOps drivein - Mind the Gap
DevOps drivein - Mind the GapDevOps drivein - Mind the Gap
DevOps drivein - Mind the Gap
 
How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks How to go from waterfall app dev to secure agile development in 2 weeks
How to go from waterfall app dev to secure agile development in 2 weeks
 

Plus de TechWell

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and RecoveringTechWell
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTechWell
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartTechWell
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyTechWell
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTechWell
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowTechWell
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityTechWell
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyTechWell
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTechWell
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipTechWell
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsTechWell
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GameTechWell
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsTechWell
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationTechWell
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessTechWell
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateTechWell
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessTechWell
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTechWell
 
Scale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development TodayScale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development TodayTechWell
 

Plus de TechWell (20)

Failing and Recovering
Failing and RecoveringFailing and Recovering
Failing and Recovering
 
Test Design for Fully Automated Build Architecture
Test Design for Fully Automated Build ArchitectureTest Design for Fully Automated Build Architecture
Test Design for Fully Automated Build Architecture
 
System-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good StartSystem-Level Test Automation: Ensuring a Good Start
System-Level Test Automation: Ensuring a Good Start
 
Build Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test StrategyBuild Your Mobile App Quality and Test Strategy
Build Your Mobile App Quality and Test Strategy
 
Testing Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for SuccessTesting Transformation: The Art and Science for Success
Testing Transformation: The Art and Science for Success
 
Implement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlowImplement BDD with Cucumber and SpecFlow
Implement BDD with Cucumber and SpecFlow
 
Develop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your SanityDevelop WebDriver Automated Tests—and Keep Your Sanity
Develop WebDriver Automated Tests—and Keep Your Sanity
 
Ma 15
Ma 15Ma 15
Ma 15
 
Eliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps StrategyEliminate Cloud Waste with a Holistic DevOps Strategy
Eliminate Cloud Waste with a Holistic DevOps Strategy
 
Transform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOpsTransform Test Organizations for the New World of DevOps
Transform Test Organizations for the New World of DevOps
 
The Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—LeadershipThe Fourth Constraint in Project Delivery—Leadership
The Fourth Constraint in Project Delivery—Leadership
 
Resolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile TeamsResolve the Contradiction of Specialists within Agile Teams
Resolve the Contradiction of Specialists within Agile Teams
 
Pin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile GamePin the Tail on the Metric: A Field-Tested Agile Game
Pin the Tail on the Metric: A Field-Tested Agile Game
 
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile TeamsAgile Performance Holarchy (APH)—A Model for Scaling Agile Teams
Agile Performance Holarchy (APH)—A Model for Scaling Agile Teams
 
A Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps ImplementationA Business-First Approach to DevOps Implementation
A Business-First Approach to DevOps Implementation
 
Databases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery ProcessDatabases in a Continuous Integration/Delivery Process
Databases in a Continuous Integration/Delivery Process
 
Mobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to AutomateMobile Testing: What—and What Not—to Automate
Mobile Testing: What—and What Not—to Automate
 
Cultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for SuccessCultural Intelligence: A Key Skill for Success
Cultural Intelligence: A Key Skill for Success
 
Turn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile TransformationTurn the Lights On: A Power Utility Company's Agile Transformation
Turn the Lights On: A Power Utility Company's Agile Transformation
 
Scale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development TodayScale: The Most Hyped Term in Agile Development Today
Scale: The Most Hyped Term in Agile Development Today
 

Dernier

PicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer ServicePicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer ServiceRenan Moreira de Oliveira
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...DianaGray10
 
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdfJamie (Taka) Wang
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.YounusS2
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfDianaGray10
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 
GenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncGenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncObject Automation
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?SANGHEE SHIN
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding TeamAdam Moalla
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 

Dernier (20)

PicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer ServicePicPay - GenAI Finance Assistant - ChatGPT for Customer Service
PicPay - GenAI Finance Assistant - ChatGPT for Customer Service
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
 
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
20200723_insight_release_plan_v6.pdf20200723_insight_release_plan_v6.pdf
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 
GenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation IncGenAI and AI GCC State of AI_Object Automation Inc
GenAI and AI GCC State of AI_Object Automation Inc
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?Do we need a new standard for visualizing the invisible?
Do we need a new standard for visualizing the invisible?
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team9 Steps For Building Winning Founding Team
9 Steps For Building Winning Founding Team
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 

DevOps: Where in the World Is Test?

  • 1. T12 Special Topics 5/8/2014 11:15:00 AM DevOps: Where in the World Is Test? Presented by: Erik Stensland Pearson Learning Technology Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
  • 2. Erik Stensland Pearson Learning Technology Software quality architect for Pearson Learning Technologies, Erik Stensland is leading the technical testing efforts with a concentration on functional, performance, and integration testing. In the software test and quality engineering field for more than twenty years, Erik focuses on implementing innovative ideas around process and tools to help teams become more effective and efficient. His previous roles have included senior QA management positions and QA consultant for Internet startups and DoD industries. A board member for the Software Quality Association of Denver, Erik has been an international presenter at leading testing conferences in Europe and the United States. Follow Erik at testarch.blogspot.com/ and on Twitter @erikstensland60.
  • 3. 4/26/2014 1 DevOps: Where in the World is Test? StarEast 2014 Conference Date: May 8th, 2014 Author: Erik Stensland A Little about me Blog: http://testarch.blogspot.com LinkedIn : http://www.linkedin.com/in/erikstensland/ Twitter : https://twitter.com/erikstensland60 email: estensla@yahoo.com
  • 4. 4/26/2014 2 What “IF” ? Agenda • What is DevOps • DevOps 1, 2, 3 • Challenges for QA • Take Away’s • Case Study
  • 9. 4/26/2014 7 DevOps Principles Benefits of DevOps Faster time to market (reduced cycle times and higher deploy rates) Increased Quality (i.e., increased availability, increased change success rate, fewer failures) Increased organizational effectiveness (increased time spent on value adding activities vs. waste, increased amount of value being delivered to the customer).
  • 10. 4/26/2014 8 Questions? The Challenge for QA High deployment rates typically associated with DevOps work streams will often put enormous pressure on QA.
  • 11. 4/26/2014 9 No longer to find defects, necessarily.
  • 14. 4/26/2014 12 Keys to Test/QA in DevOps Your purpose is to Prevent Defects. Focus lies on Risks to the product instead of just the functionality of the software changes. QA must be testing early and often using “Walk Away Automation” to Integrate QA into the automated deployment flow. Team members need to have the “Right Attitude” The Case Study: Code Name - Manhattan
  • 16. 4/26/2014 14 Software Engineering • Few Builds a week. ~1 Deployment every week or two. • Limited Unit testing • Manually Build and Deploy to Pre-Prod Software Quality Engineering • Very little architecture review for testability. • Heavy Manual testing. • Limited UI automated tests, Little web services automated tests. • Automated test manually kicked off. • Some performance testing. IT Operations • Manual recompiling of Code for different source code repository • Manual Deployments and Configurations of Production servers • Limited monitoring of systems , No monitoring of Applications • No review of Systems before Code is delivered for Deployment Yesterday’s Environment The “Discussion”
  • 17. 4/26/2014 15 Extend Eng into Production • Created a Continuous Integration and Release process using Jenkins. • Deeply integrating QA into the release process by creating “walk away automation”. • Ensure production readiness of the Code as well as the Environment by spinning up new environments before code deployment and testing.
  • 18. 4/26/2014 16 Production Feedback into Eng • Implemented Systems and Application Monitoring in pre-prod and prod. • Use one incident reporting system for Dev, QA and Ops to monitor during production releases and incidents. • Created blameless postmortems for all releases and incidents. Embed Eng into IT Ops • Development and QA resources added to the rotation for production support. Embed IT Ops into Eng • Created reusable stories for non-functional such as Monitoring, Environment creations.
  • 19. 4/26/2014 17 TODAY – Software Eng • 100’s of Builds a day. • Large amounts of Unit tests • Multiple Deploys a day to pre-prod • Push Button Deploys to all pre-prod environments. TODAY – Test/QA • Same Repository for Tests as Code • Large sets of Automated tests. • New feature Exploratory testing. • Low maintenance automation tests. • Continuously running all Automated Tests in All Pre-Prod environments.
  • 20. 4/26/2014 18 TODAY – IT Operations • Same Repository for Code and Environment scripts. • Push Button Deployments to Production. • Monitoring at system and application on all new deployments. Ask Yourself What “IF” ?
  • 21. 4/26/2014 19 Give away questions? What is the name of the Band I showed in the Video? How much did the Krupp Bagger 288 weigh?