presented by Alexandre Beslic (@abronan) Swarm v1.0 is now ready for running your apps in production! Swarm is the easiest way to run Docker applications at large scale on a cluster. It turns a pool of Docker Engines into a single, virtual Engine. You don’t have to worry about where to put containers, or how they’re going to talk to each other - it just handles all that for you. We’ve spent the last few months tirelessly hardening and tuning it, and in combination with multi-host networking and the new volume system in Docker Engine 1.9, we can confidently say that it’s ready for running your apps in production. In our tests, we’ve been running Swarm on EC2 with 1,000 nodes and 30,000 containers and it keeps on scheduling containers in less than half a second. Not even breaking a sweat! Keep an eye for a blog post soon with the full details. Read more: http://blog.docker.com/2015/11/swarm-1-0/

1. @abronan
Swarm goes stable and v1.0
with a cute new logo
@abronan

2. Single docker engine
Docker
CLI

3. Multiple Docker Engines == Swarm
Docker
CLI
Managers
Agents
CLI
Docker Hub
Token service
etcd
consul
zookeeper
Simple FileMachine
discovery
libkv

4. Timeline
Oct
Nov
Dec
Jan
Feb
Jun
Proof of Concept
DockerCon EU
Open Repository
First Release Candidate
Swarm Beta Release
Global Hack Day
Open Proposal
0.2.0 Release
0.3.0 Release
Apr
Aug
0.4.0 Release
Oct
1.0.0 Release

5. Swarm in General
• Turns a set of Docker Engines into a single pool of resources
• Supports the Docker REST API (99%)
• Resource management (CPU, Mem, Networking)
• Advanced scheduling with constraints and affinities
• Multiple Discovery Backends (hub, etcd, consul, zookeeper)
• TLS: Encryption & Authentication
• Multi Tenancy / Leader Election

6. New release highlights
• Improved scheduler
• Multi-Host Networking
- network management, overlay networking (vxlan)
• Volume management - using volume plugins
- stateful containers, distributed volumes (Ceph, GlusterFS, ZFS/Flocker)
• Quality of life improvements
- build-time constraints (ARG), unless-stopped restart policy, fixed concurrent pull
• Better integration with Compose
• More tests / code cleanup / bug fixes

7. Production ready
• Stable, can be used in production environment
• Stress tested on 1000 EC2 nodes
• Still lots of improvements to come, on the roadmap for 1.1:
- container rebalancing
- global scheduling
• Rationale: Keep it simple to use/operate. Hear back from users and only
include what is wanted/needed by the community
- example: networking, build time constraints, etc.

8. Multi-Host Networking

9. Multi-Host networking
• Announced as part of the experimental release in DockerCon SF
June
• Now in docker stable!
• Allows you to create overlay networks between containers using the
vxlan driver
• Each container connected to the same overlay network are able to
see and discover each other

10. $ docker network --help
Usage: docker network [OPTIONS] COMMAND [OPTIONS]
Commands:
rm Remove a network
create Create a network
connect Connect container to a network
disconnect Disconnect container from a network
inspect Display detailed network information
ls List all networks
A wild docker network appears

11. Swarm / Networking
Docker
CLI
Managers
Agents
CLI
Docker Hub
Token service
etcd
consul
zookeeper
Simple FileMachine
discovery
libkv
Overlay networking (vxlan)

12. GCE Azure EC2
Digital Ocean
node04 node05 node06
node01node02node03
laptop

13. GCE Azure EC2
Digital Ocean
node04 node05 node06
node01node02node03
laptop

14. GCE Azure EC2
Digital Ocean
node04 node05 node06
node01node02node03
laptop
overlay-1

15. GCE Azure EC2
Digital Ocean
node04 node05 node06
node01node02node03
laptop
app1 app2 db1
app3 db2

16. Demo time!

17. $ docker volume --help
Usage: docker volume [OPTIONS] [COMMAND]
Manage Docker volumes
Commands:
create Create a volume
inspect Return low-level information on a volume
ls List volumes
rm Remove a volume
Volume management

18. $ docker volume create --name=data
data
Volume management - example
$ docker run -ti -v data:/data alpine /bin/sh -c “echo hello > /data/world”
$ docker run -ti -v data:/data alpine cat /data/world
hello
Create a volume
Run a container with the volume
Running another container with that volume

19. Volume Plugins
Docker cluster Ceph cluster
create volume
yes sure!
volume
mount

20. Better integration with Machine
and Compose

21. Swarm + Machine + Compose
Docker
CLICompose
Compose
Machine
.yml Description
up / scale / stop/ kill / rm
create / destroy

22. http://github.com/docker/swarm
@abronan
Thank You. Questions?