It's code but not as we know: Infrastructure as Code - Patrick Debois

Infrastructure as Code Patrick Debois
http://www.tumblr.com/tagged/star-trek-quotes

Wednesday 17 October 12

Organizer Since 2009 Europe Organizer 2010 First Europe Training 2010 Speaker

Monitoring Chapter Technical Reviewer Co-Author Veewee / Sahara / Mccloud

Libvirt - Fog Freelance consultant Engineer http://github.com/jedi4ever

Blog: http://jedi.be/blog - Twitter: @patrickdebois - #devops

http://cfengine.com/ http://ansible.cc/
http://puppetlabs.com/ http://palletops.com/
http://opscode.com/chef/

CONFIGURATION
MANAGEMENT SYSTEMS

Chef & Puppet focused
based on my experience

http://www.nerdnirvana.org/wp-content/uploads/2010/12/apology-form.jpg


GIVE ME THE CODE:
“LANGUAGE”


EXAMPLE SYNTAX
Puppet Chef

class myapache { package “apache2”

package “apache2” service “apache2 do
action [:enable , :start]
service “apache2”: end
ensure => “running”,
require => Package[“apache2”]

}


TERMINOLOGY

Java Puppet Chef

manifests recipes
*.java
*.pp *.rb

package module cookbook


TERMINOLOGY (2)

Java Puppet Chef

parametrized recipes with
singleton
classes attributes

deﬁnes, deﬁnitions,
class
classes libraries


SYNTAX
Puppet Chef
Limited DSL
DSL + full ruby
(by design)
Extended by Light Weight
Deﬁnitions Resource Providers /
Custom Resource Deﬁnitions
Providers, Light
providers Weight Resource
ERB & Custom Providers
Libraries
Libraries


LOOPING CONSTRUCTS

Puppet Chef

pass array of elements
erb template for loops do while , repeat etc.
create_resource available through
(:type, hash) native ruby


VARIABLES

Puppet Chef

special syntax native ruby
$bla = “aa” bla = “aa”

string interpolation string interpolation
$bla_string = “${bla}” bla_string = #{bla}


SINGLE CLASS
INHERITANCE
Puppet Chef

override via ‘module override via
path’ ‘cookbook’ path

+> operator “cookbook” attribute


PROJECT STRUCTURE
Puppet Module Chef Cookbook

attributes/
definitions/
files/
files/
libraries/
lib/
metadata.rb
README.rdoc
providers/
manifests/
README.rdoc
templates/
recipes/
resources/
templates/


EXECUTION MODEL

Puppet Chef

Compile catalog
(directed graph
Top Down execution
model)
Then Execute


CODE EDITOR


VIM SYNTAX HIGHLIGHTIING

https://github.com/rodjek/vim-puppet
https://github.com/t9md/vim-chef
https://github.com/vim-scripts/Cfengine-version-3-syntax


GEPPETTO - ECLIPSE IDE

https://github.com/cloudsmith/geppetto
http://cloudsmith.github.com/geppetto/

WYSIWYG CODING

REACTOR8

http://beta.r8network.com/

http://redmine.djagios.org/projects/puppet-lexer
https://github.com/rodjek/puppet-pygments-lexer

CODE GENERATION


REVERSE ENGINEERING

Existing Server -> Manifest/Recipes

https://github.com/devstructure/blueprint

DSL ON TOP OF PUPPET
~GRAILS

Note: Not vastly used
https://github.com/jnewland/shadow_puppet

CODING STYLE


Puppet Chef

http://puppet-lint.com/ http://acrmp.github.com/
foodcritic/
• FC001: Use strings in preference to symbols to access node attributes
• Must use two-space soft tabs. • FC002: Avoid string interpolation where not required
• Must not use literal tab characters. • FC003: Check whether you are running with chef server before using server-
specific features
• Must not contain trailing white space.
• FC004: Use a service resource to start and stop services
• Should not exceed an 80 character line width • FC005: Avoid repetition of resource declarations
An exception has been made for source
=>
'puppet://...' lines as • FC006: Mode should be quoted or fully specified when setting file
permissions
splitting these over multiple lines decreases the readability of the
• FC007: Ensure recipe dependencies are reflected in cookbook metadata
manifests. • FC008: Generated cookbook metadata needs updating
• Should align arrows (=>) within blocks of attributes. • FC009: Resource attribute not recognised
• FC010: Invalid search syntax
• ....
• FC011: Missing README in markdown format
• FC012: Use Markdown for README rather than RDoc
• • FC013: Use file_cache_path rather than hard-coding tmp paths
•

https://github.com/ampledata/cookbook-style-guide
http://docs.puppetlabs.com/guides/style_guide.html

http://www.slideshare.net/PuppetLabs/modern-module-
development-ken-barber-2012-edinburgh-puppet-camp

http://projects.puppetlabs.com/projects/hiera
https://github.com/crayﬁshx/hiera-gpg

CODE VS CONFIG
(THINK “PROFILES”)

http://wiki.opscode.com/display/chef/Data+Bags

“STOP THE FORK(ING)”

https://github.com/jedi4ever/stop-the-fork

PRE-COMMIT CHECKS


DEPENDENCY MGMT

Git
Submodules à la Pom File
Subtree


UPSTREAM REPOS

http://community.opscode.com/
http://forge.puppetlabs.com/


Puppet Chef

https://github.com/rodjek/ https://github.com/
librarian-puppet applicationsonline/librarian

http://berkshelf.com/

site
"http://community.opscode.com/api/v1"

cookbook
"ntp"
cookbook
"timezone",
"0.0.1"

cookbook
"rvm",

:git
=>
"https://github.com/fnichol/chef-‐rvm",

:ref
=>
"v0.7.1"

cookbook
"cloudera",

:path
=>
"vendor/cookbooks/cloudera-‐cookbook"


CHEF METADATA


Puppet Dependency Graphs

http://bitﬁeldconsulting.com/puppet-dependency-graphs

http://wham.cloudsmith.com

DEBUGGING


LOGGING WITH
DIFFERENT LEVELS
Info only, no exception
Chef::Log.info('Some
useful
info')

Fatal, raising exception
Chef::Log.fatal('Something
bad')

REPL - STYLE
(READ EVAL PRINT)

https://github.com/pry/pry
http://wiki.opscode.com/display/chef/Shef

https://github.com/vimeo/simple-black-box

DEV ENVIRONMENT


Virtualbox + (Fusion Soon)
http://vagrantup.com/

Virtualbox, Fusion,
KVM,Parallels, https://github.com/jedi4ever/veewee/

https://github.com/jedi4ever/mccloud/
EC2, KVM, FUSION, HOSTS, Vagrant

Vagrant alike

EC2
https://github.com/rtyler/blimpy

UNIT TESTING


https://github.com/nistude/cucumber-puppet

https://github.com/rodjek/rspec-puppet
https://github.com/acrmp/chefspec
https://github.com/calavera/rspec-chef

MOCKING


https://github.com/customink/fauxhai

AUTO-TRIGGER TESTS RUN

https://github.com/guard/guard-rspec
https://github.com/johnbintz/guard-puppet
https://github.com/alister/guard-puppet-lint
https://github.com/guard/guard-chef

http://www.cucumber-chef.org/ EC2+LXC

Faster testing via LXC

Vagrant+LXC https://github.com/exceedhl/toft

CI INTEGRATION


https://github.com/nicksieger/ci_reporter

https://github.com/rtyler/vagrant-plugin

https://travis-ci.org/

CROSS OS-TESTING

https://github.com/opscode/bento
https://github.com/opscode/test-kitchen

Windows

https://github.com/tknerr/bills-kitchen

INTEGRATION TESTING
(ON REAL MACHINE)


http://auxesis.github.com/cucumber-nagios/

RE-USABLE CUCUMBER STEPS

http://www.cucumber-chef.org/
https://github.com/hedgehog/cuken
https://github.com/cucumber/aruba

Validate “inside” the provision-run cycle
https://github.com/calavera/minitest-chef-handler
https://github.com/jedi4ever/puppet-assert

PERFORMANCE/METRICS


https://github.com/rodjek/puppet-proﬁler

execution time
number of classes
https://github.com/krux/puppet-module-graphite-report
https://github.com/imeyer/chef-handler-graphite
https://github.com/joemiller/puppet-graphite_event

TARGETED TESTING
IMPACT OF CHANGE

https://github.com/jonlives/knife-preﬂight
https://github.com/jedi4ever/puppet-cic

http://foodﬁghtshow.org/


http://wiki.opscode.com/display/chef/Whyrun+Testing

https://github.com/tbatchelli/vmfest

CACHING - AMI, SNAPSHOTS


https://github.com/lak/puppet-memcached

https://github.com/lak/puppet-static-compiler

http://puppetlabs.com/blog/what-is-user-experience-in-
puppet/

AUDITING

http://www.fusioninventory.org/
http://www.normation.com/en/solutions/rudder

http://comodit.github.com/synapse-agent/

http://saltstack.org/

https://github.com/tobami/littlechef

https://github.com/dwt/vagrant-hosts

https://github.com/opscode/omnibus

https://github.com/puppetlabs/puppet-module-tool

http://wiki.opscode.com/display/chef/Recipes#Recipes-
ExceptionsandLogging

http://projects.puppetlabs.com/projects/puppet/wiki/
Anchor_Pattern

VENDORING


https://github.com/railsmachine/rump

http://www.example42.com/?
q=Puppi_A_Puppet_module_for_Deployment_Automation

PLUGINS


http://wiki.opscode.com/display/chef/Knife+Plugins

FACES

http://puppetlabs.com/blog/puppet-faces-what-the-heck-are-
faces/

TESTING


http://rundeck.org/

http://www.sonian.com/cloud-monitoring-sensu/

http://docs.puppetlabs.com/guides/parameterized_classes.html

INHERITANCE


NAMESPACING


https://github.com/rerun/rerun

AUTHENTICATION


DASHBOARDS


http://puppetlabs.com/puppet/related-projects/dashboard/

http://blog.mornati.net/2012/01/29/kermit-a-webui-for-
mcollective/

http://www.opscode.com/hosted-chef/

http://theforeman.org/

It's code but not as we know: Infrastructure as Code - Patrick Debois

Recommended

Recommended

More Related Content

Similar to It's code but not as we know: Infrastructure as Code - Patrick Debois

Similar to It's code but not as we know: Infrastructure as Code - Patrick Debois (20)

More from JAX London

More from JAX London (20)

It's code but not as we know: Infrastructure as Code - Patrick Debois