1.
Infrastructure Deployment with

2.
Who I am?
• Robert Reiz
• Software Developer
• I started VersionEye
• Software Dev since 1998

3.
Agenda
❖ Intro to Docker
❖ Demo
❖ Intro to Ansible
❖ Demo

4.
Shipment
without
Containers

5.
1956 Malcom McLean introduced the 40’Container - ISO 668.
> 15 Million inst.
2/3
of global trade run
over 40’Containers!

6.
The Logistic Problem

7.
Same Problem in Software Dev.

8.
Java ? ? ?
Ruby ? ? ?
Node.JS ? ? ?
MySQL ? ? ?
Dev-Env. Test-Env. Prod-Env.

9.
Java JKD 1.8.14 - Win32 JKD 1.8.1 - Lnx-64 JDK 1.7-patch UNX
Ruby 2.2.2 rvm 2.2.1 nat MRI 2.1.0 rubinius
Node.JS 4.0 win 4.0 Linux 4.0 Linux
MySQL 5.5 win 5.0 Linux 5.0 Linux
Dev-Env. Test-Env. Prod-Env.

10.
Java
Ruby
Node.JS
MySQL
Dev-Env. Test-Env. Prod-Env.

11.
What is Docker?

12.
What is Docker?
❖ Open Source Project started in March 2013
❖ From the makers of dotCloud (PaaS).
❖ Received $162 Million Funding.
❖ Community grows rapidly!

13.
What is Docker?
❖ Tiny VM (25 MB)
❖ Linux based - LXC Interface / libcontainer
❖ Own Namespaces and Cgroups!
❖ Shared resources with host system.
❖ Changes changed in Layers. Similar to Git!
❖ Originally not for Windows & Mac ! But …
->https://docs.docker.com/installation/windows/
-> https://blog.docker.com/2016/03/docker-for-mac-windows-beta/

14.
Build - Ship - Run
Docker-Hub
Build RUN
RUN
RUN
docker push
docker pull
Server Farm Production

15.
Build

16.
Dockerfile
FROM ubuntu:14.10
MAINTAINER Robert Reiz <reiz@versioneye.com>
ENV LANG en_US.UTF-8
RUN apt-get update
RUN apt-get install -y --force-yes -q nginx
ADD nginx.conf /etc/nginx/nginx.conf
CMD nginx
EXPOSE 80

17.
Build - Dockerfile
> docker build -t reiz/nginx:1.0.0 .
docker image => reiz/nginx:1.0.0

18.
Ship

19.
Ship Docker Image
> docker push reiz/nginx:1.0.0

20.
Run

21.
Fetch a Docker Image
> docker pull reiz/nginx:1.0.0
Download docker image reiz/nginx:1.0.0 from Docker Hub to local
Docker repository.

22.
Run a Docker Container
> docker run reiz/nginx:1.0.0
Creates a Docker container out of the Docker image reiz/nginx:1.0.0.
It runs the nginx process.

23.
More Commands
> docker stop <container_id>
> docker start <container_id>
> docker top <container_id>
> docker logs <container_id>
> docker rm <container_id>

24.
Important
❖ A Docker Container doesn’t store state!
❖ You can not ssh into a Docker Container!
❖ A container is supposed to run 1 process!

25.
Shell

26.
Get a Shell
> docker run -it reiz/mongodb:3.2.0 /bin/bash
Starts a new Docker container with an active shell.

27.
Volumes

28.
Mount a Volume
> docker run -v/mnt/mongodb:/data -d reiz/mongodb:3.2.0
Mounts “/mnt/mongodb” directory into the Docker container as “/data”.
Keep the data on the host. That’s how you keep data persisted.

29.
Environment Variables

30.
Set environment variables
> docker run --envLANG=en_US.UTF-8 -d reiz/mongodb:3.2.0
You can overwrite ENV variables from the Dockerfile here and also define
completely new ones.

31.
Links

32.
Link Docker Containers
> docker run —name mongodb -d versioneye/mongodb:1.0.2
> docker run —linkmongodb:mongo versioneye/api:1.0.0
MONGO_PORT=tcp://172.1.10.1:27017
MONGO_PORT_27017_TCP=tcp://172.1.10.1:27017
MONGO_PORT_27017_TCP_ADDR=172.1.10.1
MONGO_PORT_27017_TCP_PORT=27017
MONGO_PORT_27017_TCP_PROTO=tcp
Environmentvariablesareinjectedin2ndcontainer:

33.
Link Docker Containers
Linking only works on same hosts!

34.
Docker Compose
api:
image: versioneye/rails_api:2.5.7
ports:
- "9090:9090"
container_name: "api"
links:
- mongodb:db
- elasticsearch:es
mongodb:
image: reiz/mongodb:2.6.6_2
container_name: “mongodb"
elasticsearch:
image: reiz/elasticsearch:0.9.1
container_name: "elasticsearch"
docker-compose.yml
describes a whole
set of Docker
containers

35.
Docker Compose
> docker-compose up -d
> docker-compose ps
> docker-compose stop

36.
Docker Compose
> docker-compose build api
> docker-compose up --no-deps -d api
Updating a single container, not ALL of them.

37.
Docker Compose
> docker-compose scale worker=3
Scaling up containers

38.
DEMO

39.
Service Discovery

40.
Service Discovery
❖ Environment Variables
❖ Mount configuration via volumes
❖ Linking
❖ Use a service like: etcd, zookeeper etc…

41.
Orchestration

42.
Docker Orchestration
❖ CM-Tools (Chef, Puppet, Ansible, Salt)
❖ http://kubernetes.io/
❖ https://coreos.com/
❖ https://docs.docker.com/swarm/
❖ https://www.openshift.com/

43.
2012 VersionEye is running on Heroku.

44.
2013 VersionEye moves to AWS because
of the Amazon Activate Program!

45.
WWW
API
APP x 3
RabbitMQ
Tasks
MongoDB MongoDB MongoDB
Elastic
Search
Memcached
Crawlers
x N
VersionEye Infrastructure

46.
Handcrafted Servers are
❖ hardtomaintain
❖ verytime/costintensive
❖ setupisnoteasilyreproducible
❖ manytimesverybuggy

47.
Reasons for Ansible
❖ No Master
❖ No Agents
❖ Configuration in Yaml
❖ Very easy to learn

48.
Server
Server
Server
Server
You SSH
Ansible works via SSH. No Master Server! No Agent on the Server is required.

49.
Installation

50.
sudo pip install ansible

51.
brew update
brew install ansible

52.
Ansible Concepts
❖ Inventory
❖ Playbooks
❖ Roles
❖ Tasks / Handlers / Vars
❖ Modules

53.
Inventory

54.
Inventory
[mongo_master]
168.197.1.14
[mongo_slaves]
168.197.1.15
168.197.1.16
168.197.1.17
[www]
168.197.1.2
Inventory files are simple text
files which describe your servers.
IP Addresses or DNS Names
grouped by names.

55.
Inventory
[mongo_master]
168.197.1.14
[mongo_slaves]
mongo1.server
mongo2.server
mongo3.server
[www]
168.197.1.2
List of target hosts.
Usually located in
/etc/ansible/hosts

56.
Inventory
[mongo_master]
mongo-[a:c]-server
[mongo_slaves]
mongo[1:3].server
[www]
{{my_little_webserver}}
Inventory files can take advantage of
variables and enumerations

57.
Playbooks

58.
Simple Playbook
---
- hosts: dev_servers
user: ubuntu
sudo: true
roles:
- java
- memcached
- hosts: www_servers
user: ubuntu
sudo: true
roles:
- java
group name from the inventory file
server auth
Role which should be installed on the server

59.
Roles / Modules

60.
simpple role with apt module
---
- name: update debian packages
apt: update_cache=true
- name: install Java JDK
apt: name=openjdk-7-jdk state=present

61.
apt module
---
- name: update debian packages
apt: update_cache=true
- name: install Java JDK
apt: name=openjdk-7-jdk state=present
Documentation of this step!
Module
Parameters of the Module

62.
---
- name: update debian packages
apt: update_cache=true
- name: upgrade packages
apt: upgrade=full
- name: ensure that basic packages are installed
apt: name={{ item }} state=present
with_items:
- tree
- wget
- links2
- gcc
- g++
- make
- autoconf
- automake
- libssl-dev
- libcurl4-openssl-dev

63.
Thousands
of
Modules

64.
shell module
---
- name: do what you want
shell: /opt/I_can_do_what_I_want.sh

65.
A role directory

66.
Variables
---
app_dir: /var/www/versioneye
tomcat/vars/main.yml
---
- name: create versioneye directory
command: mkdir -p {{ app_dir }}
tomcat/tasks/main.yml

67.
Handlers
---
- name: restart mongodb
service: name=mongod state=restarted
mongo/handlers/main.yml
- name: copy MongoDB configuration to the server
copy: src=mongodb.conf dest=/etc/mongodb.conf
notify: restart mongodb
mongo/tasks/main.yml

68.
Files
mongo/files/mongodb.list
- name: add MongoDB debian server to the list of servers
copy: src=mongodb.list dest=/etc/apt/sources.list.d/mongodb.list
mongo/tasks/main.yml

69.
Real World Use case

70.
Loadbalancer
APP
APP
APP
Seamless Web App Deployment @ VersionEye
https://gist.github.com/reiz/238e70683bbfbc10bf4c

71.
Loadbalancer
APP
APP
APP
Docker Hub
1. Build new Docker Image
2. push
3. run
Seamless Web App Deployment @ VersionEye
https://gist.github.com/reiz/238e70683bbfbc10bf4c

72.
Loadbalancer
APP
APP
APP
Docker Hub
1. pull
2. run
Seamless Web App Deployment @ VersionEye
https://gist.github.com/reiz/238e70683bbfbc10bf4c

73.
Loadbalancer
APP
APP
APP
Seamless Web App Deployment @ VersionEye
Docker Hub
1. pull
2. run
https://gist.github.com/reiz/238e70683bbfbc10bf4c

74.
Loadbalancer
APP
APP
APP
Seamless Web App Deployment @ VersionEye
https://gist.github.com/reiz/238e70683bbfbc10bf4c

75.
Demo

76.
? ? ?
@RobertReiz