SlideShare une entreprise Scribd logo
1  sur  45
Télécharger pour lire hors ligne
Groovy, there is a docker in
my application pipeline
Kris Buytaert
@krisbuytaert
Kris BuytaertKris Buytaert
● I used to be a Dev,I used to be a Dev,
● Then Became an OpThen Became an Op
● Chief Trolling Officer and Open SourceChief Trolling Officer and Open Source
Consultant @Consultant @inuits.euinuits.eu
● Everything is an effing DNS ProblemEverything is an effing DNS Problem
● Building Clouds since before the bookstoreBuilding Clouds since before the bookstore
● Some books, some papers, some blogsSome books, some papers, some blogs
● Evangelizing devopsEvangelizing devops
● Organiser of #devopsdays, #cfgmgmtcamp,Organiser of #devopsdays, #cfgmgmtcamp,
#loadays, ….#loadays, ….
● Part of the travelling geek circusPart of the travelling geek circus
What's this devopsWhat's this devops
thing anyhow ?thing anyhow ?
C(L)AMSC(L)AMS
● CultureCulture
● (Lean)(Lean)
● AutomationAutomation
● MeasurementMeasurement
● SharingSharing
Damon Edwards and John WillisDamon Edwards and John Willis
Gene KimGene Kim
NirvanaNirvana
An “ecosystem” that supports continuous delivery, fromAn “ecosystem” that supports continuous delivery, from
infrastructure, data and configuration management toinfrastructure, data and configuration management to
business.business.
Through automation of the build, deployment, and testingThrough automation of the build, deployment, and testing
process, and improved collaboration between developers,process, and improved collaboration between developers,
testers, and operations, delivery teams can get changestesters, and operations, delivery teams can get changes
released in a matter of hours — sometimes even minutes–noreleased in a matter of hours — sometimes even minutes–no
matter what the size of a project or the complexity of its codematter what the size of a project or the complexity of its code
base.base.
Continuous Delivery , Jez HumbleContinuous Delivery , Jez Humble
This talk:This talk:
Journey / Early steps of a team that is used toJourney / Early steps of a team that is used to
infrastructure as codeinfrastructure as code
Adopting containers step by step.Adopting containers step by step.
Build PipelinesBuild Pipelines
Jenkins PipelineJenkins Pipeline
" Our job as engineers (and ops, dev-ops, QA," Our job as engineers (and ops, dev-ops, QA,
support, everyone in the company actually) is tosupport, everyone in the company actually) is to
enable the business goals. We strongly feel thatenable the business goals. We strongly feel that
in order to do that you must havein order to do that you must have the ability tothe ability to
deploy code quickly and safelydeploy code quickly and safely. Even if the. Even if the
business goals are to deploy strongly QA’d codebusiness goals are to deploy strongly QA’d code
once a month at 3am (it’s not for us, we push allonce a month at 3am (it’s not for us, we push all
the time), having a reliable and easythe time), having a reliable and easy
deployment should bedeployment should be non-negotiablenon-negotiable."."
Etsy Blog upon releasing DeployinatorEtsy Blog upon releasing Deployinator
http://codeascraft.etsy.com/2010/05/20/quantum-of-deployment/http://codeascraft.etsy.com/2010/05/20/quantum-of-deployment/
We need :We need :
AnAn unmodifiedunmodified artifact from build to deploy.artifact from build to deploy.
SameSame artifact on dev, staging, acceptance,artifact on dev, staging, acceptance,
production, shadow, dr …production, shadow, dr …
Why ops like to packageWhy ops like to package
● Packages give you featuresPackages give you features
•Consistency, security, dependenciesConsistency, security, dependencies
● Uniquely identify where files come fromUniquely identify where files come from
•Package or cfg-mgmtPackage or cfg-mgmt
● Source repo not always availableSource repo not always available
•Firewall / Cloud etc ..Firewall / Cloud etc ..
● Weird deployment locations , no easy accessWeird deployment locations , no easy access
● Little overhead when you automateLittle overhead when you automate
● CONFIG does not belong in a packageCONFIG does not belong in a package
Example app for today :Example app for today :
DashingDashing
Dashing is DeadDashing is Dead
● No it has been forkedNo it has been forked
● https://github.com/dashing-io/dashinghttps://github.com/dashing-io/dashing
● s/dashing/smashing/g;s/dashing/smashing/g;
Dashing {su/ro}cksDashing {su/ro}cks
The GoodThe Good
● Lots of existingLots of existing
widgetswidgets
● Easy to startEasy to start
● Simple rubySimple ruby
● Eventstream forEventstream for
debuggingdebugging
The UglyThe Ugly
● Ruby Gem hellRuby Gem hell
● Widget DeploymentWidget Deployment
from a Gist ?from a Gist ?
● No config separationNo config separation
Deploying DashingDeploying Dashing
● gem install dashinggem install dashing
● gem install is the new maven downloading thegem install is the new maven downloading the
internetinternet
● Reproducable ?Reproducable ?
A typical deploymentA typical deployment
● P all software is packagedP all software is packaged
•
CentOS mostlyCentOS mostly
•
RPM generated with fpmRPM generated with fpm
•
Build in Jenkins, uploaded to pulpBuild in Jenkins, uploaded to pulp
● C config is managed by PuppetC config is managed by Puppet
● S service is managed by PuppetS service is managed by Puppet
Building Ruby/python/nodeBuilding Ruby/python/node
● We need a chrootWe need a chroot
● With the right ruby/python versionWith the right ruby/python version
● With the right dependenciesWith the right dependencies
● IsolatedIsolated
● Ruby => rvmRuby => rvm
● Ruby 2.1 (dashing is pretty picky aboutRuby 2.1 (dashing is pretty picky about
versions)versions)
● What about we try this in a container ?What about we try this in a container ?
Pipelines ?Pipelines ?
● One to build basic dashingOne to build basic dashing
● One to build and deploy the dashboards, scriptsOne to build and deploy the dashboards, scripts
and all other dashing related stufand all other dashing related stuf
•
No hacking In production,No hacking In production,
•
Dashboards are production viewsDashboards are production views
•
Dev → prod promotionsDev → prod promotions
JenkinsJenkins
● Starting point :Starting point :
•
Dev jenkinsDev jenkins
•
1 master (no running jobs)1 master (no running jobs)
•
Multiple slavesMultiple slaves
● Production : diferent jenkins stack with similarProduction : diferent jenkins stack with similar
pipelinespipelines
● We need to be able to reproduce a pipelineWe need to be able to reproduce a pipeline
Building a dashingBuilding a dashing
container step 0container step 0
● Empty / standard distro containerEmpty / standard distro container
updatesupdates
add fpmadd fpm
epel and build dependenciesepel and build dependencies
● Triggering docker from the cli, no plugin inTriggering docker from the cli, no plugin in
Jenkins used (coz Bugz)Jenkins used (coz Bugz)
● $customer environment requires http_proxy$customer environment requires http_proxy
Puppet & DockerPuppet & Docker
● https://github.com/garethr/garethr-dockerhttps://github.com/garethr/garethr-docker
Building a dashingBuilding a dashing
container step 1container step 1
● Read rvm installation docsRead rvm installation docs
● frownfrown
● Frown againFrown again
● Containers => YoloContainers => Yolo
● fpm the whole treefpm the whole tree
Building a dashingBuilding a dashing
container step 2container step 2
● Take rvm containerTake rvm container
● rvm install ruby-2.1rvm install ruby-2.1
● fpm -s dir -t rpm -n rvm-ruby -v 2.1.8fpm -s dir -t rpm -n rvm-ruby -v 2.1.8
/usr/local/rvm/rubies/ruby-2.1.8/usr/local/rvm/rubies/ruby-2.1.8
Building a dashingBuilding a dashing
container step 3container step 3
● Take ruby-2.1 containerTake ruby-2.1 container
● rvm use 2.1rvm use 2.1
● gem install bundlegem install bundle
● gem install dashing (fills /usr/local/rvm/gems/ruby-gem install dashing (fills /usr/local/rvm/gems/ruby-
2.1.8 with gems2.1.8 with gems
● mkdir -p /opt/dashing/ && dashing new dashboardmkdir -p /opt/dashing/ && dashing new dashboard
● cd /opt/dashing/dashboardcd /opt/dashing/dashboard
● bundle installbundle install
● Now we have a “reproducable” container whichNow we have a “reproducable” container which
will show an empty default dashboard uponwill show an empty default dashboard upon
launchinglaunching
● We also have an artifact which we can redeployWe also have an artifact which we can redeploy
● We killed most of those layers afterwardsWe killed most of those layers afterwards
Deploying DashboardDeploying Dashboard
widgetswidgets
dashing installdashing install
GIST_IDGIST_ID
A dashboardA dashboard
● git repo withgit repo with
•
Dashboards (html/erb)Dashboards (html/erb)
•
JobsJobs
•
Mostly with datasources hardcoded inMostly with datasources hardcoded in
scriptsscripts
•
Not multitenantNot multitenant
•
WidgetsWidgets
● Pipeline to deploy and test thatPipeline to deploy and test that
Deploying theDeploying the
dashboardsdashboards
● From dashing containerFrom dashing container
● Cleanup default dashboards (twitter example)Cleanup default dashboards (twitter example)
● Bundle installBundle install
•
ruby scripts have dependenciesruby scripts have dependencies
● Package dependenciesPackage dependencies
•
actually whole /usr/local/rvmactually whole /usr/local/rvm
● Package dashboardPackage dashboard
Testing the dashboardsTesting the dashboards
● Not all deploys were workingNot all deploys were working
● New job, required gems are missingNew job, required gems are missing
● TestingTesting
•
Build container with most recent dashboardBuild container with most recent dashboard
•
Based on the rpm'sBased on the rpm's
•
docker run -p 0.0.0.0:3030:3030 -ddocker run -p 0.0.0.0:3030:3030 -d
dashing/dashboardsdashing/dashboards
•
wget http://localhost:3030/wget http://localhost:3030/
Deploying theDeploying the
dashboardsdashboards
● Deploy 2 rpms on vm's via mcollectiveDeploy 2 rpms on vm's via mcollective
•
dashing-gemsdashing-gems
•
dashing-dashboarddashing-dashboard
on nodes with profile_dashingon nodes with profile_dashing
● mco package update dashing-gems -Fmco package update dashing-gems -F
environment=svc1prd -C profile_dashingenvironment=svc1prd -C profile_dashing
We need a local dockerWe need a local docker
images repositoryimages repository
● Distributed Jenkins (master + multiple slaves)Distributed Jenkins (master + multiple slaves)
● An image build on node X is not available onAn image build on node X is not available on
node Ynode Y
● Tests run on other nodeTests run on other node
docker push dashing/dashingdocker push dashing/dashing
docker push dashing/dashboardsdocker push dashing/dashboards
We need a local dockerWe need a local docker
images repositoryimages repository
● Pulp ?Pulp ?
•
Read only (August 2016)Read only (August 2016)
•
Good for mirrorsGood for mirrors
● Nexus / ArtifactoryNexus / Artifactory
● Docker registry (obsolete, used to be only in aDocker registry (obsolete, used to be only in a
container)container)
● Docker-distribution : packages availableDocker-distribution : packages available
Docker IncompatibilitiesDocker Incompatibilities
● Search path for imagesSearch path for images
•
Local firstLocal first
•
Upstream afterwardsUpstream afterwards
Docker Inc says NODocker Inc says NO
Redhat says YesRedhat says Yes
● --build-args -e--build-args -e
•
Redhat vs Docker implementation diferRedhat vs Docker implementation difer
Problems solvedProblems solved
● Chrooted package build, no complex mockChrooted package build, no complex mock
setups or specfilessetups or specfiles
● Internal docker repo allows reuse of buildInternal docker repo allows reuse of build
images on other nodesimages on other nodes
● Jenkins and docker “integration”Jenkins and docker “integration”
Rinse & RepeatRinse & Repeat
● Similar patterns forSimilar patterns for
•
Python , php, etc.Python , php, etc.
● Test can now run in containers with the correctTest can now run in containers with the correct
versionversion
● Tests can be run with multiple versions of php/Tests can be run with multiple versions of php/
phython/ruby etc..phython/ruby etc..
Can you Automate yourCan you Automate your
Pipeline Creation ?Pipeline Creation ?
● Pipeline as CodePipeline as Code
● Jenkins Job DSLJenkins Job DSL
● Pipeline PluginPipeline Plugin
Building the PipelineBuilding the Pipeline
● Dev environment for JenkinsDev environment for Jenkins
•
Fully puppetizedFully puppetized
● JobsJobs
•
Jenkins Job DSL PluginJenkins Job DSL Plugin
•
https://wiki.jenkins-ci.org/display/JENKINS/Johttps://wiki.jenkins-ci.org/display/JENKINS/Jo
b+DSL+Pluginb+DSL+Plugin
•
SeedjobSeedjob
● GroovyGroovy
● GitGit
● Rebuild jobs onRebuild jobs on
commitcommit
● Keep numbersKeep numbers
● Projects in foldersProjects in folders
A dsl projectA dsl project
def foldername = 'project-x'def foldername = 'project-x'
folder(“${foldername}”)folder(“${foldername}”)
job(“${foldername}/XYZ”) {}job(“${foldername}/XYZ”) {}
job(“${foldername}/ABC”) {}job(“${foldername}/ABC”) {}
buildPipelineView(“${foldername}/pipeline”)buildPipelineView(“${foldername}/pipeline”)
{ selectedJob(“${foldername}/XYZ”) }{ selectedJob(“${foldername}/XYZ”) }
dashing dsl projectdashing dsl project
job("${foldername}/dashing-dashboard-build")job("${foldername}/dashing-dashboard-build")
job("${foldername}/dashing-dashboard-test")job("${foldername}/dashing-dashboard-test")
job("${foldername}/dashing-upload2repo")job("${foldername}/dashing-upload2repo")
job("${foldername}/dashing-dashboard-deploy")job("${foldername}/dashing-dashboard-deploy")
job("${foldername}/dashing-dashboard-deploy-prd")job("${foldername}/dashing-dashboard-deploy-prd")
job("${foldername}/dashing-build")job("${foldername}/dashing-build")
Job partsJob parts
● Logrotator : how long to keep buildsLogrotator : how long to keep builds
● Scm : git configScm : git config
● Trigger : when to buildTrigger : when to build
● Label : where to runLabel : where to run
● Steps : shell(readFileFromWorkspace('file.sh'))Steps : shell(readFileFromWorkspace('file.sh'))
● publisherspublishers
Publisher PartsPublisher Parts
● PublishBuildPublishBuild
● CloneWorkspacePublisherCloneWorkspacePublisher
● ArchiveArtifactsArchiveArtifacts
● Downstreamparametrized …Downstreamparametrized …
Pipeline Problems solvedPipeline Problems solved
● No more promoted build pluginNo more promoted build plugin
•
Manual promote in pipelineManual promote in pipeline
•
Easy visabilityEasy visability
● No more clicking around to create / editNo more clicking around to create / edit
pipelinepipeline
● One job per task, no reuse of jobs with diferentOne job per task, no reuse of jobs with diferent
parametersparameters
● Centrally managed jobs (git)Centrally managed jobs (git)
Solved problems bySolved problems by
ContainersContainers
● Multiversion test of application stacksMultiversion test of application stacks
•
Eg diferent puppet/ php versionsEg diferent puppet/ php versions
● Both functional and unit testing in the pipelineBoth functional and unit testing in the pipeline
● Non blocking pipeline branches for futureNon blocking pipeline branches for future
versionsversions
● Provide developers with producton alikeProvide developers with producton alike
containerscontainers
● Growing container experience with ops folksGrowing container experience with ops folks
ContactContact
Kris BuytaertKris Buytaert Kris.Buytaert@inuits.beKris.Buytaert@inuits.be
Further ReadingFurther Reading
@krisbuytaert@krisbuytaert
http://www.krisbuytaert.be/blog/http://www.krisbuytaert.be/blog/
http://www.inuits.be/http://www.inuits.be/
InuitsInuits
Essensteenweg 31Essensteenweg 31
BrasschaatBrasschaat
BelgiumBelgium
891.514.231891.514.231
+32 475 961221+32 475 961221

Contenu connexe

Tendances

On the Importance of Infrastructure as Code
On the Importance of Infrastructure as CodeOn the Importance of Infrastructure as Code
On the Importance of Infrastructure as CodeKris Buytaert
 
Adopting Devops , Stories from the trenches
Adopting Devops , Stories from the trenchesAdopting Devops , Stories from the trenches
Adopting Devops , Stories from the trenchesKris Buytaert
 
Devops is dead, Long Live Devops
Devops is dead, Long Live DevopsDevops is dead, Long Live Devops
Devops is dead, Long Live DevopsKris Buytaert
 
Run stuff, Deploy Stuff, Jax London 2017 Edition
Run stuff, Deploy Stuff, Jax London 2017 EditionRun stuff, Deploy Stuff, Jax London 2017 Edition
Run stuff, Deploy Stuff, Jax London 2017 EditionKris Buytaert
 
Dev secops opsec, devsec, devops ?
Dev secops opsec, devsec, devops ?Dev secops opsec, devsec, devops ?
Dev secops opsec, devsec, devops ?Kris Buytaert
 
Moby is killing your devops efforts
Moby is killing your devops effortsMoby is killing your devops efforts
Moby is killing your devops effortsKris Buytaert
 
Is there a future for devops ?
Is there a future for devops ?Is there a future for devops ?
Is there a future for devops ?Kris Buytaert
 
No, we can't do continuous delivery
No, we can't do continuous deliveryNo, we can't do continuous delivery
No, we can't do continuous deliveryKris Buytaert
 
Devops is a Security Requirement
Devops is a Security RequirementDevops is a Security Requirement
Devops is a Security RequirementKris Buytaert
 
The Return of the Dull Stack Engineer
The Return of the Dull Stack EngineerThe Return of the Dull Stack Engineer
The Return of the Dull Stack EngineerKris Buytaert
 
Devops 101 QA with Kris Buytaert
Devops 101 QA  with Kris BuytaertDevops 101 QA  with Kris Buytaert
Devops 101 QA with Kris BuytaertKris Buytaert
 
Nightmare on Docker street
Nightmare on Docker streetNightmare on Docker street
Nightmare on Docker streetKris Buytaert
 
Monitoring Drupal In an Infrastructure as Code Age
Monitoring Drupal In an Infrastructure as Code AgeMonitoring Drupal In an Infrastructure as Code Age
Monitoring Drupal In an Infrastructure as Code AgeKris Buytaert
 
Docker is killing your #devops Efforts
Docker is killing your #devops EffortsDocker is killing your #devops Efforts
Docker is killing your #devops EffortsKris Buytaert
 
The influence of "Distributed platforms" on #devops
The influence of "Distributed platforms" on #devopsThe influence of "Distributed platforms" on #devops
The influence of "Distributed platforms" on #devopsKris Buytaert
 
Another 7 tools for your #devops stack
Another 7 tools for your #devops stackAnother 7 tools for your #devops stack
Another 7 tools for your #devops stackKris Buytaert
 
Automating MySQL operations with Puppet
Automating MySQL operations with PuppetAutomating MySQL operations with Puppet
Automating MySQL operations with PuppetKris Buytaert
 

Tendances (20)

Dod is not done
Dod is not doneDod is not done
Dod is not done
 
On the Importance of Infrastructure as Code
On the Importance of Infrastructure as CodeOn the Importance of Infrastructure as Code
On the Importance of Infrastructure as Code
 
devops is a reorg
devops is a reorgdevops is a reorg
devops is a reorg
 
Adopting Devops , Stories from the trenches
Adopting Devops , Stories from the trenchesAdopting Devops , Stories from the trenches
Adopting Devops , Stories from the trenches
 
Devops is dead, Long Live Devops
Devops is dead, Long Live DevopsDevops is dead, Long Live Devops
Devops is dead, Long Live Devops
 
Run stuff, Deploy Stuff, Jax London 2017 Edition
Run stuff, Deploy Stuff, Jax London 2017 EditionRun stuff, Deploy Stuff, Jax London 2017 Edition
Run stuff, Deploy Stuff, Jax London 2017 Edition
 
Dev secops opsec, devsec, devops ?
Dev secops opsec, devsec, devops ?Dev secops opsec, devsec, devops ?
Dev secops opsec, devsec, devops ?
 
Moby is killing your devops efforts
Moby is killing your devops effortsMoby is killing your devops efforts
Moby is killing your devops efforts
 
Is there a future for devops ?
Is there a future for devops ?Is there a future for devops ?
Is there a future for devops ?
 
No, we can't do continuous delivery
No, we can't do continuous deliveryNo, we can't do continuous delivery
No, we can't do continuous delivery
 
Devops is a Security Requirement
Devops is a Security RequirementDevops is a Security Requirement
Devops is a Security Requirement
 
The Return of the Dull Stack Engineer
The Return of the Dull Stack EngineerThe Return of the Dull Stack Engineer
The Return of the Dull Stack Engineer
 
Devops 101 QA with Kris Buytaert
Devops 101 QA  with Kris BuytaertDevops 101 QA  with Kris Buytaert
Devops 101 QA with Kris Buytaert
 
Nightmare on Docker street
Nightmare on Docker streetNightmare on Docker street
Nightmare on Docker street
 
Monitoring Drupal In an Infrastructure as Code Age
Monitoring Drupal In an Infrastructure as Code AgeMonitoring Drupal In an Infrastructure as Code Age
Monitoring Drupal In an Infrastructure as Code Age
 
Docker is killing your #devops Efforts
Docker is killing your #devops EffortsDocker is killing your #devops Efforts
Docker is killing your #devops Efforts
 
The influence of "Distributed platforms" on #devops
The influence of "Distributed platforms" on #devopsThe influence of "Distributed platforms" on #devops
The influence of "Distributed platforms" on #devops
 
Another 7 tools for your #devops stack
Another 7 tools for your #devops stackAnother 7 tools for your #devops stack
Another 7 tools for your #devops stack
 
Automating MySQL operations with Puppet
Automating MySQL operations with PuppetAutomating MySQL operations with Puppet
Automating MySQL operations with Puppet
 
Pipeline as Code
Pipeline as CodePipeline as Code
Pipeline as Code
 

En vedette

Support and Initiate a DevOps Transformation
Support and Initiate a DevOps TransformationSupport and Initiate a DevOps Transformation
Support and Initiate a DevOps Transformationdev2ops
 
Looking back at 7 years of #devopsdays
Looking back at 7 years of #devopsdaysLooking back at 7 years of #devopsdays
Looking back at 7 years of #devopsdaysKris Buytaert
 
Looking back at 6.5 years of #devopsdays
Looking back at 6.5 years of #devopsdaysLooking back at 6.5 years of #devopsdays
Looking back at 6.5 years of #devopsdaysKris Buytaert
 
Técnicas de gestión del tiempo para Administradores de Sistemas
Técnicas de gestión del tiempo para Administradores de SistemasTécnicas de gestión del tiempo para Administradores de Sistemas
Técnicas de gestión del tiempo para Administradores de SistemasCAPSiDE
 
DevOps Transformations
DevOps TransformationsDevOps Transformations
DevOps TransformationsErnest Mueller
 
Shirt Ops: How to make awesome t-shirts for your conference
Shirt Ops: How to make awesome t-shirts for your conferenceShirt Ops: How to make awesome t-shirts for your conference
Shirt Ops: How to make awesome t-shirts for your conferenceJames Wickett
 
Pragmatic Security and Rugged DevOps - SXSW 2015
Pragmatic Security and Rugged DevOps - SXSW 2015Pragmatic Security and Rugged DevOps - SXSW 2015
Pragmatic Security and Rugged DevOps - SXSW 2015James Wickett
 
Application Security Epistemology in a Continuous Delivery World
Application Security Epistemology in a Continuous Delivery WorldApplication Security Epistemology in a Continuous Delivery World
Application Security Epistemology in a Continuous Delivery WorldJames Wickett
 
Юлия Викторова; Александр Тарасов. DevOps без булшита.
Юлия Викторова; Александр Тарасов. DevOps без булшита.Юлия Викторова; Александр Тарасов. DevOps без булшита.
Юлия Викторова; Александр Тарасов. DevOps без булшита.ScrumTrek
 
Build Your Agile Testing Skill Set
Build Your Agile Testing Skill SetBuild Your Agile Testing Skill Set
Build Your Agile Testing Skill Setlisacrispin
 
Agile Requirements Exploration: How Testers Add Value
Agile Requirements Exploration: How Testers Add ValueAgile Requirements Exploration: How Testers Add Value
Agile Requirements Exploration: How Testers Add Valuelisacrispin
 
Containers - (Austin Cloud Meetup April 2016)
Containers - (Austin Cloud Meetup April 2016)Containers - (Austin Cloud Meetup April 2016)
Containers - (Austin Cloud Meetup April 2016)Derrick Wippler
 
Fluentd - Flexible, Stable, Scalable
Fluentd - Flexible, Stable, ScalableFluentd - Flexible, Stable, Scalable
Fluentd - Flexible, Stable, ScalableShu Ting Tseng
 
Los nuevos desafíos del testing
Los nuevos desafíos del testingLos nuevos desafíos del testing
Los nuevos desafíos del testingTestingBaires
 
RSA Conference 2016: Who Are You? From Meat to Electrons and Back Again
RSA Conference 2016: Who Are You? From Meat to Electrons and Back AgainRSA Conference 2016: Who Are You? From Meat to Electrons and Back Again
RSA Conference 2016: Who Are You? From Meat to Electrons and Back AgainMike Schwartz
 

En vedette (17)

Support and Initiate a DevOps Transformation
Support and Initiate a DevOps TransformationSupport and Initiate a DevOps Transformation
Support and Initiate a DevOps Transformation
 
Looking back at 7 years of #devopsdays
Looking back at 7 years of #devopsdaysLooking back at 7 years of #devopsdays
Looking back at 7 years of #devopsdays
 
Looking back at 6.5 years of #devopsdays
Looking back at 6.5 years of #devopsdaysLooking back at 6.5 years of #devopsdays
Looking back at 6.5 years of #devopsdays
 
Técnicas de gestión del tiempo para Administradores de Sistemas
Técnicas de gestión del tiempo para Administradores de SistemasTécnicas de gestión del tiempo para Administradores de Sistemas
Técnicas de gestión del tiempo para Administradores de Sistemas
 
DevOps Transformations
DevOps TransformationsDevOps Transformations
DevOps Transformations
 
Why to docker
Why to dockerWhy to docker
Why to docker
 
Shirt Ops: How to make awesome t-shirts for your conference
Shirt Ops: How to make awesome t-shirts for your conferenceShirt Ops: How to make awesome t-shirts for your conference
Shirt Ops: How to make awesome t-shirts for your conference
 
Pragmatic Security and Rugged DevOps - SXSW 2015
Pragmatic Security and Rugged DevOps - SXSW 2015Pragmatic Security and Rugged DevOps - SXSW 2015
Pragmatic Security and Rugged DevOps - SXSW 2015
 
Application Security Epistemology in a Continuous Delivery World
Application Security Epistemology in a Continuous Delivery WorldApplication Security Epistemology in a Continuous Delivery World
Application Security Epistemology in a Continuous Delivery World
 
Юлия Викторова; Александр Тарасов. DevOps без булшита.
Юлия Викторова; Александр Тарасов. DevOps без булшита.Юлия Викторова; Александр Тарасов. DevOps без булшита.
Юлия Викторова; Александр Тарасов. DevOps без булшита.
 
Build Your Agile Testing Skill Set
Build Your Agile Testing Skill SetBuild Your Agile Testing Skill Set
Build Your Agile Testing Skill Set
 
Agile Requirements Exploration: How Testers Add Value
Agile Requirements Exploration: How Testers Add ValueAgile Requirements Exploration: How Testers Add Value
Agile Requirements Exploration: How Testers Add Value
 
Containers - (Austin Cloud Meetup April 2016)
Containers - (Austin Cloud Meetup April 2016)Containers - (Austin Cloud Meetup April 2016)
Containers - (Austin Cloud Meetup April 2016)
 
Fluentd - Flexible, Stable, Scalable
Fluentd - Flexible, Stable, ScalableFluentd - Flexible, Stable, Scalable
Fluentd - Flexible, Stable, Scalable
 
Los nuevos desafíos del testing
Los nuevos desafíos del testingLos nuevos desafíos del testing
Los nuevos desafíos del testing
 
RSA Conference 2016: Who Are You? From Meat to Electrons and Back Again
RSA Conference 2016: Who Are You? From Meat to Electrons and Back AgainRSA Conference 2016: Who Are You? From Meat to Electrons and Back Again
RSA Conference 2016: Who Are You? From Meat to Electrons and Back Again
 
Speeding Up Innovation
Speeding Up InnovationSpeeding Up Innovation
Speeding Up Innovation
 

Similaire à Groovy there's a docker in my application pipeline

Continuous Delivery of (y)our infrastructure.
Continuous Delivery of (y)our infrastructure.Continuous Delivery of (y)our infrastructure.
Continuous Delivery of (y)our infrastructure.Kris Buytaert
 
Pipeline as code for your infrastructure as Code
Pipeline as code for your infrastructure as CodePipeline as code for your infrastructure as Code
Pipeline as code for your infrastructure as CodeKris Buytaert
 
From Config Management Sucks to #cfgmgmtlove
From Config Management Sucks to #cfgmgmtlove From Config Management Sucks to #cfgmgmtlove
From Config Management Sucks to #cfgmgmtlove Kris Buytaert
 
Repositories as Code
Repositories as CodeRepositories as Code
Repositories as CodeKris Buytaert
 
Icinga Camp Amsterdam - Infrastructure as Code
Icinga Camp Amsterdam - Infrastructure as CodeIcinga Camp Amsterdam - Infrastructure as Code
Icinga Camp Amsterdam - Infrastructure as CodeIcinga
 
Deploying your SaaS stack OnPrem
Deploying your SaaS stack OnPremDeploying your SaaS stack OnPrem
Deploying your SaaS stack OnPremKris Buytaert
 
Continuous Infrastructure First
Continuous Infrastructure FirstContinuous Infrastructure First
Continuous Infrastructure FirstKris Buytaert
 
OSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLove
OSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLoveOSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLove
OSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLoveNETWAYS
 
Continuous Infrastructure First Ignite Edition
Continuous Infrastructure First  Ignite EditionContinuous Infrastructure First  Ignite Edition
Continuous Infrastructure First Ignite EditionKris Buytaert
 
DevOps Days Kyiv 2019 -- continuous Infrafirstructure First //Kris buytaert
DevOps Days Kyiv 2019 -- continuous Infrafirstructure First //Kris buytaertDevOps Days Kyiv 2019 -- continuous Infrafirstructure First //Kris buytaert
DevOps Days Kyiv 2019 -- continuous Infrafirstructure First //Kris buytaertMykola Marzhan
 
Can we fix dev-oops ?
Can we fix dev-oops ?Can we fix dev-oops ?
Can we fix dev-oops ?Kris Buytaert
 
Introduction to Docker at SF Peninsula Software Development Meetup @Guidewire
Introduction to Docker at SF Peninsula Software Development Meetup @GuidewireIntroduction to Docker at SF Peninsula Software Development Meetup @Guidewire
Introduction to Docker at SF Peninsula Software Development Meetup @GuidewiredotCloud
 
Deploying software at Scale
Deploying software at ScaleDeploying software at Scale
Deploying software at ScaleKris Buytaert
 
OSDC 2016 - Another 7 Tools for your #devops Stack by Kris Buytaert
OSDC 2016 - Another 7 Tools for your #devops Stack by Kris BuytaertOSDC 2016 - Another 7 Tools for your #devops Stack by Kris Buytaert
OSDC 2016 - Another 7 Tools for your #devops Stack by Kris BuytaertNETWAYS
 
A Gentle Introduction to Docker and Containers
A Gentle Introduction to Docker and ContainersA Gentle Introduction to Docker and Containers
A Gentle Introduction to Docker and ContainersDocker, Inc.
 
OSDC 2012 | Devops and Open Source by Kris Buyaert
OSDC 2012 | Devops and Open Source by Kris BuyaertOSDC 2012 | Devops and Open Source by Kris Buyaert
OSDC 2012 | Devops and Open Source by Kris BuyaertNETWAYS
 
OSDC 2012 | Devops and Open Source by Kris Buytaert
OSDC 2012 | Devops and Open Source by Kris BuytaertOSDC 2012 | Devops and Open Source by Kris Buytaert
OSDC 2012 | Devops and Open Source by Kris BuytaertNETWAYS
 
Django dev-env-my-way
Django dev-env-my-wayDjango dev-env-my-way
Django dev-env-my-wayRobert Lujo
 
When traditional configuration management is to slow for your needs
When traditional configuration management is to slow for your needsWhen traditional configuration management is to slow for your needs
When traditional configuration management is to slow for your needsKris Buytaert
 

Similaire à Groovy there's a docker in my application pipeline (20)

Continuous Delivery of (y)our infrastructure.
Continuous Delivery of (y)our infrastructure.Continuous Delivery of (y)our infrastructure.
Continuous Delivery of (y)our infrastructure.
 
Pipeline as code for your infrastructure as Code
Pipeline as code for your infrastructure as CodePipeline as code for your infrastructure as Code
Pipeline as code for your infrastructure as Code
 
From Config Management Sucks to #cfgmgmtlove
From Config Management Sucks to #cfgmgmtlove From Config Management Sucks to #cfgmgmtlove
From Config Management Sucks to #cfgmgmtlove
 
Repositories as Code
Repositories as CodeRepositories as Code
Repositories as Code
 
Icinga Camp Amsterdam - Infrastructure as Code
Icinga Camp Amsterdam - Infrastructure as CodeIcinga Camp Amsterdam - Infrastructure as Code
Icinga Camp Amsterdam - Infrastructure as Code
 
Deploying your SaaS stack OnPrem
Deploying your SaaS stack OnPremDeploying your SaaS stack OnPrem
Deploying your SaaS stack OnPrem
 
Continuous Infrastructure First
Continuous Infrastructure FirstContinuous Infrastructure First
Continuous Infrastructure First
 
OSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLove
OSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLoveOSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLove
OSDC 2015: Kris Buytaert | From ConfigManagementSucks to ConfigManagementLove
 
Continuous Infrastructure First Ignite Edition
Continuous Infrastructure First  Ignite EditionContinuous Infrastructure First  Ignite Edition
Continuous Infrastructure First Ignite Edition
 
DevOps Days Kyiv 2019 -- continuous Infrafirstructure First //Kris buytaert
DevOps Days Kyiv 2019 -- continuous Infrafirstructure First //Kris buytaertDevOps Days Kyiv 2019 -- continuous Infrafirstructure First //Kris buytaert
DevOps Days Kyiv 2019 -- continuous Infrafirstructure First //Kris buytaert
 
Can we fix dev-oops ?
Can we fix dev-oops ?Can we fix dev-oops ?
Can we fix dev-oops ?
 
Introduction to Docker at SF Peninsula Software Development Meetup @Guidewire
Introduction to Docker at SF Peninsula Software Development Meetup @GuidewireIntroduction to Docker at SF Peninsula Software Development Meetup @Guidewire
Introduction to Docker at SF Peninsula Software Development Meetup @Guidewire
 
Deploying software at Scale
Deploying software at ScaleDeploying software at Scale
Deploying software at Scale
 
OSDC 2016 - Another 7 Tools for your #devops Stack by Kris Buytaert
OSDC 2016 - Another 7 Tools for your #devops Stack by Kris BuytaertOSDC 2016 - Another 7 Tools for your #devops Stack by Kris Buytaert
OSDC 2016 - Another 7 Tools for your #devops Stack by Kris Buytaert
 
A Gentle Introduction to Docker and Containers
A Gentle Introduction to Docker and ContainersA Gentle Introduction to Docker and Containers
A Gentle Introduction to Docker and Containers
 
OSDC 2012 | Devops and Open Source by Kris Buyaert
OSDC 2012 | Devops and Open Source by Kris BuyaertOSDC 2012 | Devops and Open Source by Kris Buyaert
OSDC 2012 | Devops and Open Source by Kris Buyaert
 
OSDC 2012 | Devops and Open Source by Kris Buytaert
OSDC 2012 | Devops and Open Source by Kris BuytaertOSDC 2012 | Devops and Open Source by Kris Buytaert
OSDC 2012 | Devops and Open Source by Kris Buytaert
 
Django dev-env-my-way
Django dev-env-my-wayDjango dev-env-my-way
Django dev-env-my-way
 
When traditional configuration management is to slow for your needs
When traditional configuration management is to slow for your needsWhen traditional configuration management is to slow for your needs
When traditional configuration management is to slow for your needs
 
Sonatype DevSecOps Leadership forum 2020
Sonatype DevSecOps Leadership forum 2020Sonatype DevSecOps Leadership forum 2020
Sonatype DevSecOps Leadership forum 2020
 

Plus de Kris Buytaert

Years of (not) learning , from devops to devoops
Years of (not) learning , from devops to devoopsYears of (not) learning , from devops to devoops
Years of (not) learning , from devops to devoopsKris Buytaert
 
Observability will not fix your Broken Monitoring ,Ignite
Observability will not fix your Broken Monitoring ,IgniteObservability will not fix your Broken Monitoring ,Ignite
Observability will not fix your Broken Monitoring ,IgniteKris Buytaert
 
Infrastructure as Code Patterns
Infrastructure as Code PatternsInfrastructure as Code Patterns
Infrastructure as Code PatternsKris Buytaert
 
From devoops to devops 13 years of (not) learning
From devoops to devops 13 years of (not) learningFrom devoops to devops 13 years of (not) learning
From devoops to devops 13 years of (not) learningKris Buytaert
 
Pipeline all the Dashboards as Code
Pipeline all the Dashboards as CodePipeline all the Dashboards as Code
Pipeline all the Dashboards as CodeKris Buytaert
 
Help , My Datacenter is on fire
Help , My Datacenter is on fireHelp , My Datacenter is on fire
Help , My Datacenter is on fireKris Buytaert
 
Devops is Dead, Long live Devops
Devops is Dead, Long live DevopsDevops is Dead, Long live Devops
Devops is Dead, Long live DevopsKris Buytaert
 
10 years of #devopsdays, but what have we really learned ?
10 years of #devopsdays, but what have we really learned ? 10 years of #devopsdays, but what have we really learned ?
10 years of #devopsdays, but what have we really learned ? Kris Buytaert
 
Continuous Infrastructure First
Continuous Infrastructure FirstContinuous Infrastructure First
Continuous Infrastructure FirstKris Buytaert
 
Is there a Future for devops ?
Is there a Future for devops   ? Is there a Future for devops   ?
Is there a Future for devops ? Kris Buytaert
 
10 Years of #devopsdays weirdness
10 Years of #devopsdays weirdness10 Years of #devopsdays weirdness
10 Years of #devopsdays weirdnessKris Buytaert
 
ADDO 2019: Looking back at over 10 years of Devops
ADDO 2019:    Looking back at over 10 years of DevopsADDO 2019:    Looking back at over 10 years of Devops
ADDO 2019: Looking back at over 10 years of DevopsKris Buytaert
 
Open Source Monitoring in 2019
Open Source Monitoring in 2019 Open Source Monitoring in 2019
Open Source Monitoring in 2019 Kris Buytaert
 
Migrating to Puppet 5
Migrating to Puppet 5Migrating to Puppet 5
Migrating to Puppet 5Kris Buytaert
 
Looking back at 5 years of #cfgmgmtcamp
Looking back at 5 years of #cfgmgmtcampLooking back at 5 years of #cfgmgmtcamp
Looking back at 5 years of #cfgmgmtcampKris Buytaert
 
Looking back at 7.5 years of Devopsdays , DOd PDX
Looking back at 7.5 years of Devopsdays , DOd PDXLooking back at 7.5 years of Devopsdays , DOd PDX
Looking back at 7.5 years of Devopsdays , DOd PDXKris Buytaert
 
Devopsdays Amsterdam 2017 Keynote, looking back at 5 years of AMS
Devopsdays Amsterdam 2017 Keynote, looking back at 5 years of AMSDevopsdays Amsterdam 2017 Keynote, looking back at 5 years of AMS
Devopsdays Amsterdam 2017 Keynote, looking back at 5 years of AMSKris Buytaert
 

Plus de Kris Buytaert (18)

Years of (not) learning , from devops to devoops
Years of (not) learning , from devops to devoopsYears of (not) learning , from devops to devoops
Years of (not) learning , from devops to devoops
 
Observability will not fix your Broken Monitoring ,Ignite
Observability will not fix your Broken Monitoring ,IgniteObservability will not fix your Broken Monitoring ,Ignite
Observability will not fix your Broken Monitoring ,Ignite
 
Infrastructure as Code Patterns
Infrastructure as Code PatternsInfrastructure as Code Patterns
Infrastructure as Code Patterns
 
From devoops to devops 13 years of (not) learning
From devoops to devops 13 years of (not) learningFrom devoops to devops 13 years of (not) learning
From devoops to devops 13 years of (not) learning
 
Pipeline all the Dashboards as Code
Pipeline all the Dashboards as CodePipeline all the Dashboards as Code
Pipeline all the Dashboards as Code
 
Help , My Datacenter is on fire
Help , My Datacenter is on fireHelp , My Datacenter is on fire
Help , My Datacenter is on fire
 
GitOps , done Right
GitOps , done RightGitOps , done Right
GitOps , done Right
 
Devops is Dead, Long live Devops
Devops is Dead, Long live DevopsDevops is Dead, Long live Devops
Devops is Dead, Long live Devops
 
10 years of #devopsdays, but what have we really learned ?
10 years of #devopsdays, but what have we really learned ? 10 years of #devopsdays, but what have we really learned ?
10 years of #devopsdays, but what have we really learned ?
 
Continuous Infrastructure First
Continuous Infrastructure FirstContinuous Infrastructure First
Continuous Infrastructure First
 
Is there a Future for devops ?
Is there a Future for devops   ? Is there a Future for devops   ?
Is there a Future for devops ?
 
10 Years of #devopsdays weirdness
10 Years of #devopsdays weirdness10 Years of #devopsdays weirdness
10 Years of #devopsdays weirdness
 
ADDO 2019: Looking back at over 10 years of Devops
ADDO 2019:    Looking back at over 10 years of DevopsADDO 2019:    Looking back at over 10 years of Devops
ADDO 2019: Looking back at over 10 years of Devops
 
Open Source Monitoring in 2019
Open Source Monitoring in 2019 Open Source Monitoring in 2019
Open Source Monitoring in 2019
 
Migrating to Puppet 5
Migrating to Puppet 5Migrating to Puppet 5
Migrating to Puppet 5
 
Looking back at 5 years of #cfgmgmtcamp
Looking back at 5 years of #cfgmgmtcampLooking back at 5 years of #cfgmgmtcamp
Looking back at 5 years of #cfgmgmtcamp
 
Looking back at 7.5 years of Devopsdays , DOd PDX
Looking back at 7.5 years of Devopsdays , DOd PDXLooking back at 7.5 years of Devopsdays , DOd PDX
Looking back at 7.5 years of Devopsdays , DOd PDX
 
Devopsdays Amsterdam 2017 Keynote, looking back at 5 years of AMS
Devopsdays Amsterdam 2017 Keynote, looking back at 5 years of AMSDevopsdays Amsterdam 2017 Keynote, looking back at 5 years of AMS
Devopsdays Amsterdam 2017 Keynote, looking back at 5 years of AMS
 

Dernier

UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.YounusS2
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxUdaiappa Ramachandran
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopBachir Benyammi
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?IES VE
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 

Dernier (20)

UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptx
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 Workshop
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?
 
201610817 - edge part1
201610817 - edge part1201610817 - edge part1
201610817 - edge part1
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 

Groovy there's a docker in my application pipeline

  • 1. Groovy, there is a docker in my application pipeline Kris Buytaert @krisbuytaert
  • 2. Kris BuytaertKris Buytaert ● I used to be a Dev,I used to be a Dev, ● Then Became an OpThen Became an Op ● Chief Trolling Officer and Open SourceChief Trolling Officer and Open Source Consultant @Consultant @inuits.euinuits.eu ● Everything is an effing DNS ProblemEverything is an effing DNS Problem ● Building Clouds since before the bookstoreBuilding Clouds since before the bookstore ● Some books, some papers, some blogsSome books, some papers, some blogs ● Evangelizing devopsEvangelizing devops ● Organiser of #devopsdays, #cfgmgmtcamp,Organiser of #devopsdays, #cfgmgmtcamp, #loadays, ….#loadays, …. ● Part of the travelling geek circusPart of the travelling geek circus
  • 3. What's this devopsWhat's this devops thing anyhow ?thing anyhow ?
  • 4. C(L)AMSC(L)AMS ● CultureCulture ● (Lean)(Lean) ● AutomationAutomation ● MeasurementMeasurement ● SharingSharing Damon Edwards and John WillisDamon Edwards and John Willis Gene KimGene Kim
  • 5. NirvanaNirvana An “ecosystem” that supports continuous delivery, fromAn “ecosystem” that supports continuous delivery, from infrastructure, data and configuration management toinfrastructure, data and configuration management to business.business. Through automation of the build, deployment, and testingThrough automation of the build, deployment, and testing process, and improved collaboration between developers,process, and improved collaboration between developers, testers, and operations, delivery teams can get changestesters, and operations, delivery teams can get changes released in a matter of hours — sometimes even minutes–noreleased in a matter of hours — sometimes even minutes–no matter what the size of a project or the complexity of its codematter what the size of a project or the complexity of its code base.base. Continuous Delivery , Jez HumbleContinuous Delivery , Jez Humble
  • 6. This talk:This talk: Journey / Early steps of a team that is used toJourney / Early steps of a team that is used to infrastructure as codeinfrastructure as code Adopting containers step by step.Adopting containers step by step.
  • 9. " Our job as engineers (and ops, dev-ops, QA," Our job as engineers (and ops, dev-ops, QA, support, everyone in the company actually) is tosupport, everyone in the company actually) is to enable the business goals. We strongly feel thatenable the business goals. We strongly feel that in order to do that you must havein order to do that you must have the ability tothe ability to deploy code quickly and safelydeploy code quickly and safely. Even if the. Even if the business goals are to deploy strongly QA’d codebusiness goals are to deploy strongly QA’d code once a month at 3am (it’s not for us, we push allonce a month at 3am (it’s not for us, we push all the time), having a reliable and easythe time), having a reliable and easy deployment should bedeployment should be non-negotiablenon-negotiable."." Etsy Blog upon releasing DeployinatorEtsy Blog upon releasing Deployinator http://codeascraft.etsy.com/2010/05/20/quantum-of-deployment/http://codeascraft.etsy.com/2010/05/20/quantum-of-deployment/
  • 10. We need :We need : AnAn unmodifiedunmodified artifact from build to deploy.artifact from build to deploy. SameSame artifact on dev, staging, acceptance,artifact on dev, staging, acceptance, production, shadow, dr …production, shadow, dr …
  • 11. Why ops like to packageWhy ops like to package ● Packages give you featuresPackages give you features •Consistency, security, dependenciesConsistency, security, dependencies ● Uniquely identify where files come fromUniquely identify where files come from •Package or cfg-mgmtPackage or cfg-mgmt ● Source repo not always availableSource repo not always available •Firewall / Cloud etc ..Firewall / Cloud etc .. ● Weird deployment locations , no easy accessWeird deployment locations , no easy access ● Little overhead when you automateLittle overhead when you automate ● CONFIG does not belong in a packageCONFIG does not belong in a package
  • 12. Example app for today :Example app for today : DashingDashing
  • 13. Dashing is DeadDashing is Dead ● No it has been forkedNo it has been forked ● https://github.com/dashing-io/dashinghttps://github.com/dashing-io/dashing ● s/dashing/smashing/g;s/dashing/smashing/g;
  • 14. Dashing {su/ro}cksDashing {su/ro}cks The GoodThe Good ● Lots of existingLots of existing widgetswidgets ● Easy to startEasy to start ● Simple rubySimple ruby ● Eventstream forEventstream for debuggingdebugging The UglyThe Ugly ● Ruby Gem hellRuby Gem hell ● Widget DeploymentWidget Deployment from a Gist ?from a Gist ? ● No config separationNo config separation
  • 15. Deploying DashingDeploying Dashing ● gem install dashinggem install dashing ● gem install is the new maven downloading thegem install is the new maven downloading the internetinternet ● Reproducable ?Reproducable ?
  • 16. A typical deploymentA typical deployment ● P all software is packagedP all software is packaged • CentOS mostlyCentOS mostly • RPM generated with fpmRPM generated with fpm • Build in Jenkins, uploaded to pulpBuild in Jenkins, uploaded to pulp ● C config is managed by PuppetC config is managed by Puppet ● S service is managed by PuppetS service is managed by Puppet
  • 17. Building Ruby/python/nodeBuilding Ruby/python/node ● We need a chrootWe need a chroot ● With the right ruby/python versionWith the right ruby/python version ● With the right dependenciesWith the right dependencies ● IsolatedIsolated ● Ruby => rvmRuby => rvm ● Ruby 2.1 (dashing is pretty picky aboutRuby 2.1 (dashing is pretty picky about versions)versions) ● What about we try this in a container ?What about we try this in a container ?
  • 18. Pipelines ?Pipelines ? ● One to build basic dashingOne to build basic dashing ● One to build and deploy the dashboards, scriptsOne to build and deploy the dashboards, scripts and all other dashing related stufand all other dashing related stuf • No hacking In production,No hacking In production, • Dashboards are production viewsDashboards are production views • Dev → prod promotionsDev → prod promotions
  • 19. JenkinsJenkins ● Starting point :Starting point : • Dev jenkinsDev jenkins • 1 master (no running jobs)1 master (no running jobs) • Multiple slavesMultiple slaves ● Production : diferent jenkins stack with similarProduction : diferent jenkins stack with similar pipelinespipelines ● We need to be able to reproduce a pipelineWe need to be able to reproduce a pipeline
  • 20. Building a dashingBuilding a dashing container step 0container step 0 ● Empty / standard distro containerEmpty / standard distro container updatesupdates add fpmadd fpm epel and build dependenciesepel and build dependencies ● Triggering docker from the cli, no plugin inTriggering docker from the cli, no plugin in Jenkins used (coz Bugz)Jenkins used (coz Bugz) ● $customer environment requires http_proxy$customer environment requires http_proxy
  • 21. Puppet & DockerPuppet & Docker ● https://github.com/garethr/garethr-dockerhttps://github.com/garethr/garethr-docker
  • 22. Building a dashingBuilding a dashing container step 1container step 1 ● Read rvm installation docsRead rvm installation docs ● frownfrown ● Frown againFrown again ● Containers => YoloContainers => Yolo ● fpm the whole treefpm the whole tree
  • 23. Building a dashingBuilding a dashing container step 2container step 2 ● Take rvm containerTake rvm container ● rvm install ruby-2.1rvm install ruby-2.1 ● fpm -s dir -t rpm -n rvm-ruby -v 2.1.8fpm -s dir -t rpm -n rvm-ruby -v 2.1.8 /usr/local/rvm/rubies/ruby-2.1.8/usr/local/rvm/rubies/ruby-2.1.8
  • 24. Building a dashingBuilding a dashing container step 3container step 3 ● Take ruby-2.1 containerTake ruby-2.1 container ● rvm use 2.1rvm use 2.1 ● gem install bundlegem install bundle ● gem install dashing (fills /usr/local/rvm/gems/ruby-gem install dashing (fills /usr/local/rvm/gems/ruby- 2.1.8 with gems2.1.8 with gems ● mkdir -p /opt/dashing/ && dashing new dashboardmkdir -p /opt/dashing/ && dashing new dashboard ● cd /opt/dashing/dashboardcd /opt/dashing/dashboard ● bundle installbundle install
  • 25. ● Now we have a “reproducable” container whichNow we have a “reproducable” container which will show an empty default dashboard uponwill show an empty default dashboard upon launchinglaunching ● We also have an artifact which we can redeployWe also have an artifact which we can redeploy ● We killed most of those layers afterwardsWe killed most of those layers afterwards
  • 26. Deploying DashboardDeploying Dashboard widgetswidgets dashing installdashing install GIST_IDGIST_ID
  • 27. A dashboardA dashboard ● git repo withgit repo with • Dashboards (html/erb)Dashboards (html/erb) • JobsJobs • Mostly with datasources hardcoded inMostly with datasources hardcoded in scriptsscripts • Not multitenantNot multitenant • WidgetsWidgets ● Pipeline to deploy and test thatPipeline to deploy and test that
  • 28. Deploying theDeploying the dashboardsdashboards ● From dashing containerFrom dashing container ● Cleanup default dashboards (twitter example)Cleanup default dashboards (twitter example) ● Bundle installBundle install • ruby scripts have dependenciesruby scripts have dependencies ● Package dependenciesPackage dependencies • actually whole /usr/local/rvmactually whole /usr/local/rvm ● Package dashboardPackage dashboard
  • 29. Testing the dashboardsTesting the dashboards ● Not all deploys were workingNot all deploys were working ● New job, required gems are missingNew job, required gems are missing ● TestingTesting • Build container with most recent dashboardBuild container with most recent dashboard • Based on the rpm'sBased on the rpm's • docker run -p 0.0.0.0:3030:3030 -ddocker run -p 0.0.0.0:3030:3030 -d dashing/dashboardsdashing/dashboards • wget http://localhost:3030/wget http://localhost:3030/
  • 30. Deploying theDeploying the dashboardsdashboards ● Deploy 2 rpms on vm's via mcollectiveDeploy 2 rpms on vm's via mcollective • dashing-gemsdashing-gems • dashing-dashboarddashing-dashboard on nodes with profile_dashingon nodes with profile_dashing ● mco package update dashing-gems -Fmco package update dashing-gems -F environment=svc1prd -C profile_dashingenvironment=svc1prd -C profile_dashing
  • 31. We need a local dockerWe need a local docker images repositoryimages repository ● Distributed Jenkins (master + multiple slaves)Distributed Jenkins (master + multiple slaves) ● An image build on node X is not available onAn image build on node X is not available on node Ynode Y ● Tests run on other nodeTests run on other node docker push dashing/dashingdocker push dashing/dashing docker push dashing/dashboardsdocker push dashing/dashboards
  • 32. We need a local dockerWe need a local docker images repositoryimages repository ● Pulp ?Pulp ? • Read only (August 2016)Read only (August 2016) • Good for mirrorsGood for mirrors ● Nexus / ArtifactoryNexus / Artifactory ● Docker registry (obsolete, used to be only in aDocker registry (obsolete, used to be only in a container)container) ● Docker-distribution : packages availableDocker-distribution : packages available
  • 33. Docker IncompatibilitiesDocker Incompatibilities ● Search path for imagesSearch path for images • Local firstLocal first • Upstream afterwardsUpstream afterwards Docker Inc says NODocker Inc says NO Redhat says YesRedhat says Yes ● --build-args -e--build-args -e • Redhat vs Docker implementation diferRedhat vs Docker implementation difer
  • 34. Problems solvedProblems solved ● Chrooted package build, no complex mockChrooted package build, no complex mock setups or specfilessetups or specfiles ● Internal docker repo allows reuse of buildInternal docker repo allows reuse of build images on other nodesimages on other nodes ● Jenkins and docker “integration”Jenkins and docker “integration”
  • 35. Rinse & RepeatRinse & Repeat ● Similar patterns forSimilar patterns for • Python , php, etc.Python , php, etc. ● Test can now run in containers with the correctTest can now run in containers with the correct versionversion ● Tests can be run with multiple versions of php/Tests can be run with multiple versions of php/ phython/ruby etc..phython/ruby etc..
  • 36. Can you Automate yourCan you Automate your Pipeline Creation ?Pipeline Creation ? ● Pipeline as CodePipeline as Code ● Jenkins Job DSLJenkins Job DSL ● Pipeline PluginPipeline Plugin
  • 37. Building the PipelineBuilding the Pipeline ● Dev environment for JenkinsDev environment for Jenkins • Fully puppetizedFully puppetized ● JobsJobs • Jenkins Job DSL PluginJenkins Job DSL Plugin • https://wiki.jenkins-ci.org/display/JENKINS/Johttps://wiki.jenkins-ci.org/display/JENKINS/Jo b+DSL+Pluginb+DSL+Plugin •
  • 38. SeedjobSeedjob ● GroovyGroovy ● GitGit ● Rebuild jobs onRebuild jobs on commitcommit ● Keep numbersKeep numbers ● Projects in foldersProjects in folders
  • 39. A dsl projectA dsl project def foldername = 'project-x'def foldername = 'project-x' folder(“${foldername}”)folder(“${foldername}”) job(“${foldername}/XYZ”) {}job(“${foldername}/XYZ”) {} job(“${foldername}/ABC”) {}job(“${foldername}/ABC”) {} buildPipelineView(“${foldername}/pipeline”)buildPipelineView(“${foldername}/pipeline”) { selectedJob(“${foldername}/XYZ”) }{ selectedJob(“${foldername}/XYZ”) }
  • 40. dashing dsl projectdashing dsl project job("${foldername}/dashing-dashboard-build")job("${foldername}/dashing-dashboard-build") job("${foldername}/dashing-dashboard-test")job("${foldername}/dashing-dashboard-test") job("${foldername}/dashing-upload2repo")job("${foldername}/dashing-upload2repo") job("${foldername}/dashing-dashboard-deploy")job("${foldername}/dashing-dashboard-deploy") job("${foldername}/dashing-dashboard-deploy-prd")job("${foldername}/dashing-dashboard-deploy-prd") job("${foldername}/dashing-build")job("${foldername}/dashing-build")
  • 41. Job partsJob parts ● Logrotator : how long to keep buildsLogrotator : how long to keep builds ● Scm : git configScm : git config ● Trigger : when to buildTrigger : when to build ● Label : where to runLabel : where to run ● Steps : shell(readFileFromWorkspace('file.sh'))Steps : shell(readFileFromWorkspace('file.sh')) ● publisherspublishers
  • 42. Publisher PartsPublisher Parts ● PublishBuildPublishBuild ● CloneWorkspacePublisherCloneWorkspacePublisher ● ArchiveArtifactsArchiveArtifacts ● Downstreamparametrized …Downstreamparametrized …
  • 43. Pipeline Problems solvedPipeline Problems solved ● No more promoted build pluginNo more promoted build plugin • Manual promote in pipelineManual promote in pipeline • Easy visabilityEasy visability ● No more clicking around to create / editNo more clicking around to create / edit pipelinepipeline ● One job per task, no reuse of jobs with diferentOne job per task, no reuse of jobs with diferent parametersparameters ● Centrally managed jobs (git)Centrally managed jobs (git)
  • 44. Solved problems bySolved problems by ContainersContainers ● Multiversion test of application stacksMultiversion test of application stacks • Eg diferent puppet/ php versionsEg diferent puppet/ php versions ● Both functional and unit testing in the pipelineBoth functional and unit testing in the pipeline ● Non blocking pipeline branches for futureNon blocking pipeline branches for future versionsversions ● Provide developers with producton alikeProvide developers with producton alike containerscontainers ● Growing container experience with ops folksGrowing container experience with ops folks
  • 45. ContactContact Kris BuytaertKris Buytaert Kris.Buytaert@inuits.beKris.Buytaert@inuits.be Further ReadingFurther Reading @krisbuytaert@krisbuytaert http://www.krisbuytaert.be/blog/http://www.krisbuytaert.be/blog/ http://www.inuits.be/http://www.inuits.be/ InuitsInuits Essensteenweg 31Essensteenweg 31 BrasschaatBrasschaat BelgiumBelgium 891.514.231891.514.231 +32 475 961221+32 475 961221