This document discusses deployment orchestration using tools like Puppet, Ansible, and Jenkins. It describes setting up configuration management with Puppet, querying configuration data with PuppetDB, and using Ansible to automate and orchestrate deployments by running Puppet agent tests on nodes. The author provides an example workflow of using Jenkins for continuous integration and packaging, along with links to online material and code repositories for further details.

1. Deployment orchestration
Jan Collijs
February 2, 2015

2. Introduction
Background
Configuration management
Orchestration
Questions
Table of contents
1 Introduction
whoami
2 Background
project
versioning
continuous integration
packaging
repository management
3 Configuration management
puppet
puppetdb
4 Orchestration
ansible
automation
online-material
5 Questions
Jan Collijs Deployment orchestration

3. Introduction
Background
Configuration management
Orchestration
Questions
whoami
Profile
Sysadmin
Linux & Open-Source enthusiast
Consultant for inuits.eu
@visibilityspots
Jan Collijs Deployment orchestration

4. Introduction
Background
Configuration management
Orchestration
Questions
project
versioning
continuous integration
packaging
repository management
University library of Ghent
• 5 developers
• devops integration
• New website
• 2 environments: dev/prod
Jan Collijs Deployment orchestration

5. Introduction
Background
Configuration management
Orchestration
Questions
project
versioning
continuous integration
packaging
repository management
Versioning
• Software code is based into a repository
• History of changes is available
• Collaboration
• Hooks
• Many tools available (git, redmine, gitlab, chili project, . . . )
Jan Collijs Deployment orchestration

6. Introduction
Background
Configuration management
Orchestration
Questions
project
versioning
continuous integration
packaging
repository management
Jenkins
• Automation tool
• Triggered by hooks
• Custom scripts
Jan Collijs Deployment orchestration

7. Introduction
Background
Configuration management
Orchestration
Questions
project
versioning
continuous integration
packaging
repository management
Jenkins flow example
Jan Collijs Deployment orchestration

8. Introduction
Background
Configuration management
Orchestration
Questions
project
versioning
continuous integration
packaging
repository management
fpm/rpmbuild
• fpm
• spec file
• rpmbuild
Jan Collijs Deployment orchestration

9. Introduction
Background
Configuration management
Orchestration
Questions
project
versioning
continuous integration
packaging
repository management
Yum-repo-server
• Repository management
• One repository per environment (dev/prod)
• Only used for own software
• Vagrant setup
Jan Collijs Deployment orchestration

10. Introduction
Background
Configuration management
Orchestration
Questions
puppet
puppetdb
Puppet
• Configures ALL servers and services
• Hiera
• Roles & profiles
• Custom module for every piece of software
• Cron based runs
Jan Collijs Deployment orchestration

11. Introduction
Background
Configuration management
Orchestration
Questions
puppet
puppetdb
Puppetdb
• Consists puppet data (postgresql DB)
• Query API (experimental v4)
Jan Collijs Deployment orchestration

12. Introduction
Background
Configuration management
Orchestration
Questions
puppet
puppetdb
Query puppetdb
# Look up the nodes which have the given resource type and name declared
for NODE in $(curl --silent -G https://PUPPETDB_HOST:PUPPETDB_PORT/v4/
environments/ENVIRONMENT/resources/TYPE/RESOURCENAME | grep certname |
awk -F ’:’ ’{print $2 }’ | cut -d ’‘‘’ -f2)
do
nodes=(’’${nodes[@]}" $NODE)
done
Jan Collijs Deployment orchestration

13. Introduction
Background
Configuration management
Orchestration
Questions
ansible
automation
online-material
Ansible
• Based on ssh
• No agent on the servers
• User on the clients with public key and sudo rights
Jan Collijs Deployment orchestration

14. Introduction
Background
Configuration management
Orchestration
Questions
ansible
automation
online-material
Dynamic inventory script
• Static inventory
• Dynamic inventory
(https://github.com/visibilityspots/ansible-puppet-inventory)
• Pypuppetdb lib
(https://github.com/puppet-community/pypuppetdb/pull/34)
• Dynamic inventory ansible core
(https://github.com/ansible/ansible/pull/9593)
Jan Collijs Deployment orchestration

15. Introduction
Background
Configuration management
Orchestration
Questions
ansible
automation
online-material
Deploy puppet run
• Jenkins
• puppet-check script (https://github.com/visibilityspots/ci-
scripts/blob/master/puppet/puppet-check.sh)
Jan Collijs Deployment orchestration

16. Introduction
Background
Configuration management
Orchestration
Questions
ansible
automation
online-material
Code
for NODE in "${nodes[@]}"
do
echo "Process $NODE:"
echo ""
ansible $NODE -a "puppet agent --test" --sudo;
echo "======================================="
done
Jan Collijs Deployment orchestration

17. Introduction
Background
Configuration management
Orchestration
Questions
ansible
automation
online-material
Console output
Jan Collijs Deployment orchestration

18. Introduction
Background
Configuration management
Orchestration
Questions
ansible
automation
online-material
online material
• http://visibilityspots.com/ansible-orchestration.html
• https://github.com/visibilityspots/ansible-puppet-inventory
• https://github.com/visibilityspots/ci-scripts
Jan Collijs Deployment orchestration

19. Introduction
Background
Configuration management
Orchestration
Questions
Questions
Jan Collijs Deployment orchestration