Delivery Patterns for Rapid and Reliable Releases @ JAX DevOps London (May 2019)

•

2 j'aime•267 vues

Today, we pay close attention to scaling our systems by testing for chaos and reducing MTTR in production. However, our delivery pipelines don’t get nearly as much love. This talk presents tried and tested patterns for increasing an accelerated delivery of changes in a safe manner. We’ll also try to solve the mystery of sustainable Continuous Delivery. Everyone wants to go faster but also safer. As a result, we’re cramming more and more activities in the pipeline, from security controls and database changes to compliance approvals and even networking. How can we do this AND still move fast AND avoid burning out teams with all this cognitive load? Key takeaways: - learn patterns to ensure the reliability of your pipelines and make application changes safer - learn smart patterns to accelerate delivery, such as continuous pruning and short path to prod - understand how to sustain your CI/CD adoption growth with key practices like immutable delivery system

Technologie

Delivery Patterns
for Rapid and Reliable
Software Releases 1
Manuel Pais

About me
Manuel Pais
MS Software Eng
@manupaisable
me@manuelpais.net
http://manuelpais.net
DevOps Consultant & Trainer
Co-author of “Team Topologies”
Focused on teams and flow
2@manupaisable | manuelpais.net

@manupaisable | manuelpais.net 3
Today
1. Intro to boring releases
2. Patterns for safer releases
3. Patterns for faster releases
4. Patterns for sustainable delivery

@manupaisable | manuelpais.net 4
Today
1. Intro to boring releases
2. Patterns for safer releases
3. Patterns for faster releases
4. Patterns for sustainable delivery

8
Outcomes
@manupaisable | manuelpais.net

@manupaisable | manuelpais.net 9
Today
1. Intro to boring releases
2. Patterns for safer releases
3. Patterns for faster releases
4. Patterns for sustainable delivery

“ability to get changes of all types,
into production, or into the hands of
users, safely and quickly in a
sustainable way”
–Dave Farley & Jez Humble
continuousdelivery.com
@manupaisable | manuelpais.net 10

Patterns for safer releases
12@manupaisable | manuelpais.net

Patterns for safer releases
1. Map value stream in the pipeline
14@manupaisable | manuelpais.net

@manupaisable | manuelpais.net 17
https://www.youtube.com/watch?v=MAFpuwB7-to

Patterns for safer releases
19@manupaisable | manuelpais.net

Patterns for safer releases
1. Map your value stream to the pipeline
2. Measure key metrics
21@manupaisable | manuelpais.net

Speed lead time
Quality failure rate
Operability MTTR
22@manupaisable | manuelpais.net

Flow efficiency =
“generally flow efficiencies are
around the 15% mark”
http://leankanban.com/flow-efficiency-a-great-metric-you-probably-arent-using
@manupaisable | manuelpais.net 23

issue is not how long it takes to do
something, it's how long we're
waiting for it to get done
@manupaisable | manuelpais.net 24

Patterns for safer releases
25@manupaisable | manuelpais.net

Patterns for safer releases
1. Map your value stream to the pipeline
2. Measure key metrics on speed,
quality & operability
3. Put in the groundwork !!!
27@manupaisable | manuelpais.net

Automated build in clean environment
Ephemeral prod-like test environment
Health checks and fast smoke tests
Automated acceptance tests (BDD)
Everything as code (one truth)
Single path to production
28@manupaisable | manuelpais.net

Patterns for safer releases
1. Map value stream in the pipeline
2. Measure key metrics
3. Put in the groundwork !!!
30@manupaisable | manuelpais.net

@manupaisable | manuelpais.net 31
Today
1. Intro to boring releases
2. Patterns for safer releases
3. Patterns for faster releases
4. Patterns for sustainable delivery

@manupaisable | manuelpais.net 33
Build Test Deploy

@manupaisable | manuelpais.net 34
FixMonitorRun
CI
Peer
review
Infra Security Comply
Database Accept UX Deploy

@manupaisable | manuelpais.net 35
can’t auto-
scale people
How to cope with
ever increasing
cognitive load on
teams to build and
run applications?

Patterns for faster releases
1. Design intelligent pipelines
2. Evolve teams and interactions
3. Set up a self-service platform
36@manupaisable | manuelpais.net

Patterns for faster releases
1. Identify & remove bottlenecks
2. Shorten path to production
3. Continuous pruning
38@manupaisable | manuelpais.net

Waiting for pipeline
@manupaisable | manuelpais.net 39

Waiting for pipeline
@manupaisable | manuelpais.net 40

Waiting for dependencies
@manupaisable | manuelpais.net 41

Waiting for dependencies
@manupaisable | manuelpais.net 42

Patterns for faster releases
1. Design intelligent pipelines
2. Evolve teams and interactions
3. Set up a self-service platform
43@manupaisable | manuelpais.net

Patterns for faster releases
1. Identify & remove bottlenecks
2. Shorten path to production
3. Continuous pruning
44@manupaisable | manuelpais.net

Risk-based activities (short & wide pipeline)
@manupaisable | manuelpais.net 45

Patterns for faster releases
pipelines
1. Set up a self-service platform
46@manupaisable | manuelpais.net

Patterns for faster releases
1. Identify & remove bottlenecks
2. Shorten path to production
3. Continuous pruning & fast feedback
48@manupaisable | manuelpais.net

49
“There are just two moments when
an automated test provides useful
information: the first time it passes
and when it subsequently fails.”
@manupaisable | manuelpais.net
Continuous pruning

Patterns for faster releases
1. Identify & remove bottlenecks
2. Shorten path to production
3. Continuous pruning & fast feedback
55@manupaisable | manuelpais.net

@manupaisable | manuelpais.net 56
Today
1. Intro to boring releases
2. Patterns for safer releases
3. Patterns for faster releases
4. Patterns for sustainable delivery

•CI tool
•CD tool (orchestration)
•Plugins / 3rd party tools
•Pipeline definitions
•Source repos
•Artifact repos
•CI + CD infrastructure
@manupaisable | manuelpais.net 60
Delivery (CI/CD) system

Delivery (CI/CD) system
CI/CD Toolchain
Pipelines
Infra
App 1
App 2
@manupaisable | manuelpais.net 61
Artifacts

System Operability
Available (no downtime)
Scalable (no pipelines waiting to run)
Monitored (alerts on resources and errors)
Recoverable (focus on diagnosis & MTTR)
@manupaisable | manuelpais.net 62

Patterns for sustainability
1. Treat your pipeline as a product
2. Treat your pipeline as a product
3. Treat your pipeline as a product
63@manupaisable | manuelpais.net

Immutable infrastructure
Blue-green deployments
Monitoring & alerting
Aggregated logging
Pipelines-as-code
Auto-scaling
64@manupaisable | manuelpais.net

About me
Manuel Pais
MS Software Eng
@manupaisable
me@manuelpais.net
http://manuelpais.net
DevOps Consultant
Co-author of “Team Topologies”
Focused on teams and flow
65@manupaisable | manuelpais.net

Contenu connexe

Similaire à Delivery Patterns for Rapid and Reliable Releases @ JAX DevOps London (May 2019)

Introduction to Scrum

Vladimir Tsvetkov

Ncerc rlmca202 adm m1 ssm

ssmarar

DevOps ci/cd with Microsoft vsts and azure

Murughan Palaniachari

User Experience Talk

Robin De Croon

Power Platform ALM with DevOps

Christopher R. Barber

What are the differences between popular innovation project management methodologies? Why does project management often fail? Learn how risk assessment should define your methodology in order to become a real innovation factory. The waterfall methodology has been promoted for years as the best practice for IR&D management. These days agile and scrum are increasingly popular as alternative. Hater or believer? Good or bad? Get guided through our body of knowledge as published in the Inspire Toolbox.

Behind the waterfall methodology (by Jan Buytaert)

Verhaert Masters in Innovation

1 rapid prototyping model

delaco

Continuous delivery best practices and essential tools

DBmaestro - Database DevOps

Agile Project Management with Scrum PDF

iFour Technolab Pvt. Ltd.

Automated testing 101

Tabitha Chapman

Software life cycle

kingseif

When agility meets software quality

Babak Khorrami

Scrum@accenture

Pierre E. NEIS

The goal of Lean Warehouse 101 is to equip distributers to be more competitive in their respective markets. Through understanding how to implement Lean Principles, participants can make changes in their facility that will eliminate waste, maximize productivity and increase profits. The class will yield immediate results as students return to their workplace with an understanding of waste and how to begin eliminating it from the process. A great class for distributers, warehouses, logistics companies or any company that has warehousing operations.

Lean Warehouse 101

Colin Reed

Mastering Complex Application Deployments

IBM UrbanCode Products

Promise and Challenge of Runtime Presentation(summary)

Joon ho Park

HOW BS8878 - THE UK WEB ACCESSIBILITY STANDARDS - BRING TOGETHER ACCESSIBILIT...

Nexer Digital

Scrum

Ali Dany

Lean UX

Chester Yiu-Lam Ip

Agile Unified Process (AUP).pptx

Karim Monir

Similaire à Delivery Patterns for Rapid and Reliable Releases @ JAX DevOps London (May 2019) (20)

Introduction to Scrum

Ncerc rlmca202 adm m1 ssm

DevOps ci/cd with Microsoft vsts and azure

User Experience Talk

Power Platform ALM with DevOps

Behind the waterfall methodology (by Jan Buytaert)

1 rapid prototyping model

Continuous delivery best practices and essential tools

Agile Project Management with Scrum PDF

Automated testing 101

Software life cycle

When agility meets software quality

Scrum@accenture

Lean Warehouse 101

Mastering Complex Application Deployments

Promise and Challenge of Runtime Presentation(summary)

HOW BS8878 - THE UK WEB ACCESSIBILITY STANDARDS - BRING TOGETHER ACCESSIBILIT...

Scrum

Lean UX

Agile Unified Process (AUP).pptx

Plus de Manuel Pais

Organizations that do not adapt rapidly to the modern, highly-changeable business environment are failing, and failing in large numbers. Increased regulation, pressures from climate change, shifting of energy sources, digitalization, and (recently) the COVID-19 pandemic are all driving a need for business agility in organizations of all sizes. In this talk, we’ll explore how the patterns and principles from Team Topologies promote true business agility through a rapid flow of software change, fast feedback from running systems, a strong drive for loose coupling, and an awareness of sociotechnical mirroring. Combined with a product mindset and techniques from Domain-driven Design, the Team Topologies approach is helping organizations around the world to adapt to the “new normal” and achieve true business agility.

Accelerating Flow with Team Topologies & Friends @ Wroclaw Kanban, Lean & Cof...

Manuel Pais

While we have made great strides in the last decade to break down silos in Engineering, in most organizations when you look outside there is still an abyss of understanding between teams sitting in different divisions in the organization. This can significantly slow down the flow of value to our customers, directly and indirectly. You’ve likely experienced at least one of these in your professional career… Not being allowed to use the right tool for the job because of a strict procurement process. Spending half a day to get a 20€ expense approved and reimbursed. Or a much anticipated employee onboarding portal that ends up being just a UI on top of the 73 steps and 14 approvals required to set up an employee workstation. None of this happens in bad faith, it just turns out traditionally teams and groups are incentivized for outputs, the more cycles you can run and the faster you can close requests the better. So we end up optimizing internal processes at the cost of company outcomes. I posit that, ultimately, this happens because teams don’t see each other as customers. You might be thinking “But they’re not our customers, they’re our colleagues!”. Also true. The key here is that every team, every division in an organization can adopt a platform mindset in which they treat what they offer to other teams as an internal product. That means other teams become your customers. Certainly there are particular dynamics at play when your customers are your peers as well but fundamentally the core principles of the “platform as a product” approach translate well across the organization. We have seen this work well inside engineering, and we start to see it in other domains of the business as well: data science & business intelligence, but also leadership, marketing, legal, HR, etc. We will cover some early examples during this talk and think ahead to what the future holds for platforms beyond engineering.

Beyond Engineering: The Future of Platforms @ CraftConf, May 2023

Manuel Pais

Product Teams Need A Family Too! @ Iberia SWE Fest, Mar 2023

Manuel Pais

Las organizaciones que no se adaptan rápidamente al entorno empresarial moderno y altamente cambiante están fracasando en gran número. El aumento de la regulación, las presiones del cambio climático, la digitalización y (recientemente) la pandemia de COVID-19 están impulsando la necesidad de agilidad empresarial en organizaciones de todos los tamaños. En esta charla, explicaremos cómo los patrones y principios de Team Topologies promueven una verdadera agilidad del negocio a través de un flujo rápido de cambio de software (soportado por prácticas modernas de ingeniería), feedback rápido desde los sistemas en vivo, bajo acoplamiento sistémico y una visión de la arquitectura sociotécnica. Team Topologies está ayudando a las organizaciones de todo el mundo a adaptarse a la "nueva normalidad" y lograr una verdadera agilidad empresarial. Miraremos ejemplos concretos de cómo han evolucionado algunas empresas bajo estos patrones y principios.

Business and Technical Agility with Team Topologies @ CAS 2022

Manuel Pais

Equipos de productos interfuncionales autónomos y empoderados. Suena como un equipo de ensueño, ¿no? Entonces, ¿qué significa esto para los equipos de entrega de software? ¿Esperamos que un equipo así configure sus herramientas y canalizaciones de CI/CD, automatice la infraestructura, pruebe y asegure *todas las cosas* y, por supuesto, ejecute y supervise su producto en vivo? Oh, espera, hay más: necesitan entender realmente quiénes son sus clientes, qué necesitan del producto, qué está causando fricción y cuál es la viabilidad de nuestro producto como un beneficio neto para la organización. ¿Suena familiar? ¡Enhorabuena, ya estás jugando al Tetris con carga cognitiva! Quiere saber más sobre la carga cognitiva del equipo y cómo podemos hacer uso de topologías e interacciones de equipo efectivas para equilibrar y minimizar la carga cognitiva en un ecosistema de equipos. ¡Únase a esta charla y ascienda en el ranking Tetris de carga cognitiva con la ayuda de uno de los coautores del libro Team Topologies: Organizing Business and Technology Teams for Fast Flow! Del expositor: Manuel Pais es coautor de Team Topologies: Organizando equipos de negocios y tecnología para un flujo rápido. Reconocido por TechBeacon como un líder de pensamiento de DevOps, Manuel es un consultor organizacional de TI independiente y trainer, centrado en las interacciones del equipo, las prácticas de entrega y la aceleración del flujo. Manuel también es instructor de LinkedIn en Continuous Delivery. Twitter: @manupaisable LinkedIn: https://www.linkedin.com/in/manuelpais/

Playing Tetris with Cognitive Load @ Chile Ágil meetup, Oct 2022

Manuel Pais

Why are so many organizations stuck in the “middle” of DevOps evolution? What’s preventing them from achieving higher levels of performance despite all the automation, tooling, and good practices in place? Puppet’s State of DevOps Report 2021 provides important research-based clues to answer these questions, supported by the patterns and recommendations in Team Topologies. In this talk we cover the self-imposed limitations of blindly following some “myths” around DevOps. Almost 80% of organizations are stuck in the “frozen middle” of DevOps evolution because of lack of organizational sensemaking abilities. The margin for growth for these organizations is tremendous, but they need to think beyond technical capabilities to unlock the potential of their teams to deliver with more autonomy and a sense of purpose. The data shows that Team Topologies provides the necessary organizational and team interaction patterns that help organizations achieve performance metrics such as delivering a new customer change request to live in under one hour, or diagnosing and recovering from a serious issue in production in under an hour. Fundamentally, we need to supercharge the fundamental principles of DevOps: fast feedback loops, minimal waste, removing bottlenecks, and continuous learning & improvement.

Keynote: Frozen DevOps? The not-so-technical Last Mile @ DevOpsDays Portugal,...

Manuel Pais

We know that team-based software delivery can be very effective but how can we promote and enable team-based approaches for organisations that are fully remote or hybrid? What should teams think about and what patterns can teams adopt to be effective when most people are not in the office? Based on the ideas from Team Topologies book and the new Remote Team Interactions Workbook, co-author Manuel Pais will present some useful approaches to clarify and evolve inter-team interactions and communication in this remote-first world.

Remote-first Team Interactions with Team Topologies @ Team Topologies Confere...

Manuel Pais

Remote-first work is the "new normal" for companies around the world. There is no shortage of advice on how individual teams can bond and work effectively remotely. However, there is not much on how to address remote interactions between different teams that need to collaborate remotely, as part of the same value stream. Moving from the physical to the online world can further expose pre-existing interaction problems, increase wait times and slow down delivery and possibly response to incidents. Based on the ideas from Team Topologies, Manuel Pais and Matthew Skelton will present some useful approaches to clarify and evolve inter-team interactions and communication in this remote-first world. Designing Team APIs and virtual communication channels that promote relevant team interactions while minimizing communication overhead will help modern organizations keep a fast flow of delivery once they're past the initial adaptation to teleworking. Following well-defined interaction patterns and architecting for team-first software boundaries will also help reduce communication overhead, clarify expectations on teams, and increase visibility of on-going work and support.

Remote-first Team Interactions with Team Topologies @ DevOps Perth Meetup, Ju...

Manuel Pais

Remote-first Team Interactions for Business and Technology Teams @ Berlin CTO...

Manuel Pais

Conway's Law is Out to Get You! @ Large Financial Group, Apr 2022

Manuel Pais

Savvy organizations are discovering the value of treating their internal platforms as products. But what does it mean to treat a "platform as a product"? What benefits does this give, and why would an organization adopt this approach? In this talk, Manuel Pais, co-author of the book Team Topologies, explains why the platform-as-product approach can be a game-changer for organizations building and running software-enabled products and services. Using ideas & patterns from Team Topologies - including Thinnest Viable Platform, team cognitive load, and the evolutionary team interaction modes - Manuel explains how organizations like Uswitch and Adidas have successfully used the platform-as-product model to accelerate and simplify the delivery of software at scale.

What is Platform as a Product? Clues from Team Topologies @ DevOps Porto meet...

Manuel Pais

Why are so many organizations stuck in the "middle" of DevOps evolution? What's preventing them from achieving higher levels of organizational performance despite all the automation, tooling, and good practices in place? Puppet's State of DevOps Report 2021 provides important research-based clues to answer these questions, supported by the patterns and recommendations in Team Topologies. In this talk we cover the self-imposed limitations of blindly following some “myths” around DevOps. Almost 80% of organizations are stuck in the "frozen middle" of DevOps evolution because of lack of organizational sensemaking abilities. The margin for growth for these organizations is tremendous, but they need to think beyond technical capabilities to unlock the potential of their teams to deliver with more autonomy and a sense of purpose. The data shows that Team Topologies provides the necessary organizational and team interaction patterns that help organizations achieve performance metrics such as delivering a new customer change request to live in under one hour, or diagnosing and recovering from a serious issue in production in under an hour. Get the State of DevOps Report 2021 here: https://puppet.com/resources/report/2021-state-of-devops-report To learn more about Team Topologies: https://teamtopologies.com/learn https://academy.teamtopologies.com

Frozen DevOps? Team Topologies Comes to the Rescue! @ DevSecOps - London Gath...

Manuel Pais

Product Teams Need a Family Too! @ Product Camp Brazil, Dec 2021

Manuel Pais

Organizations that do not adapt rapidly to the modern, highly-changeable business and technical environment are failing, and failing in large numbers. Increased regulation, pressures from climate change, shifting of energy sources, digitalization, cloud-native, and (recently) the COVID-19 pandemic are all driving a need for business and technical agility in organizations of all sizes. In this talk, we’ll explore how the patterns and principles from Team Topologies promote true business and technical agility through a rapid flow of software change, fast feedback from running systems, a strong drive for loose coupling, and an awareness of sociotechnical mirroring. Combined with a product mindset and techniques from Domain-driven Design, the Team Topologies approach is helping organizations around the world to adapt to the “new normal” and achieve true business and technical agility.

Business and Technical Agility with Team Topologies @ WTF Is Cloud Native, No...

Manuel Pais

Organizations that do not adapt rapidly to the modern, highly changeable business environment are failing, and failing in large numbers. Increased regulation, pressures from climate change, shifting of energy sources, digitalization, and (recently) the COVID-19 pandemic are all driving a need for business agility in organizations of all sizes. In this talk, we’ll explore how the patterns and principles from Team Topologies promote true business agility through a rapid flow of software change, fast feedback from running systems, a strong drive for loose coupling, and an awareness of sociotechnical mirroring. Combined with a product mindset and techniques from Domain-driven Design, the Team Topologies approach is helping organizations around the world to adapt to the “new normal” and achieve true business agility.

Accelerating Flow with Team Topologies & Friends @ Adaptive Organizations Wee...

Manuel Pais

 Organizations that do not adapt rapidly to the modern, highly-changeable business and technical environment are failing, and failing in large numbers. Increased regulation, pressures from climate change, shifting of energy sources, digitalization, cloud-native, and (recently) the COVID-19 pandemic are all driving a need for business and technical agility in organizations of all sizes. In this talk, we’ll explore how the patterns and principles from Team Topologies promote true business and technical agility through a rapid flow of software change, fast feedback from running systems, a strong drive for loose coupling, and an awareness of sociotechnical mirroring. Combined with a product mindset and techniques from Domain-driven Design, the Team Topologies approach is helping organizations around the world to adapt to the “new normal” and achieve true business and technical agility.  Manuel Pais is co-author of Team Topologies: organizing business and technology teams for fast flow. Recognized by TechBeacon as a DevOps thought leader, Manuel is an independent IT organizational consultant and trainer, focused on team interactions, delivery practices and accelerating flow. Manuel is also a LinkedIn instructor on Accelerating Continuous Delivery in the Enterprise. https://www.linkedin.com/in/manuelpais/

Business Agility with Team Topologies @ Digital Transformation London meetup,...

Manuel Pais

Frozen DevOps? Team Topologies Comes to the Rescue! @ DevOpsDays Poznan, Oct ...

Manuel Pais

Savvy organisations are discovering the value of treating their internal platforms as products. But what does it mean to treat a “platform as a product”? What benefits does this give, and why would an organisation adopt this approach? In this talk, Manuel Pais, co-author of the book Team Topologies, explains why the platform-as-product approach can be a game-changer for organisations building and running software-enabled products and services. Using ideas & patterns from Team Topologies - including Thinnest Viable Platform, team cognitive load, and the evolutionary team interaction modes - Manuel explains how organisations like Uswitch have successfully used the platform-as-product model to accelerate and simplify the delivery of software at scale.

What Is Platform as a Product - Clues from Team Topologies @ AXA, Sep 2021

Manuel Pais

Organizational Trends and Patterns with Team Topologies @ LPCx Meetup, July 2021

Manuel Pais

Organizations that do not adapt rapidly to the modern, highly-changeable business and technical environment are failing, and failing in large numbers. Increased regulation, pressures from climate change, shifting of energy sources, digitalization, cloud-native, and (recently) the COVID-19 pandemic are all driving a need for business and technical agility in organizations of all sizes. In this talk, we’ll explore how the patterns and principles from Team Topologies promote true business and technical agility through a rapid flow of software change, fast feedback from running systems, a strong drive for loose coupling, and awareness of sociotechnical mirroring. Combined with a product mindset and techniques from Domain-driven Design, the Team Topologies approach is helping organizations around the world to adapt to the “new normal” and achieve true business and technical agility.

Business and Technical Agility with Team Topologies, Jun 2021

Manuel Pais

Plus de Manuel Pais (20)