In two years, Docker hit the sweet spot for devs and ops, with tools for building, shipping, and running distributed apps architected as a set of collaborating microservices packaged as Linux containers. One area of the Docker ecosystem that saw a lot of innovation in the past year is container orchestration systems. This session compares and contrasts various Docker orchestration systems (Swarm, Machine, and Compose), the batteries included with Docker itself, Mesos, Kubernetes, CoreOS/Fleet, Deis, Cloud Foundry, and Tutum. It includes a demo of how to deploy a Java 8 app with MongoDB on several of these systems. The goal of the session is to give you a framework to help evaluate how these systems can meet your particular requirements. Demo code at https://github.com/chanezon/docker-tips/blob/master/orchestration-networking/README.md

1. Patrick Chanezon
Docker Inc.
@chanezon
chanezon@docker.com
Docker Orchestration
Welcome to the Jungle!

2. French
Polyglot
Platforms
Software Plumber
San Francisco
Developer Relations
@chanezon

3. “Welcome to the jungle we've got fun and games
We got everything you want honey, we know the
names”

4. “We are the people that can find whatever you may
need
If you got the money honey we got your disease”

5. 1995 2015

7. “The future is already here — it's
just not very evenly distributed”
William Gibson, Neuromancer

8. Docker’s mission is to
build tools of mass innovation

9. Internet (hardware layer)
Servers
Desktop
s
Phones Cars Houses Drones
Network
equipment
Public
transit
TVs
Industria
l
facilities
Scientific
instrument
s
Financial
system
Programmers
Internet (software layer)
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App

10. Internet (hardware layer)
Servers
Desktop
s
Phones Cars Houses Drones
Network
equipment
Public
transit
TVs
Industria
l
facilities
Scientific
instrument
s
Financial
system
Programmers
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
App
a software layer to program the internet

11. Cloud Market
PublicHybridPrivate
IT Pros Devops DevelopersArchitects

12. Linux Container Ecosystem

13. Business opportunity

16. as Boromir would say …
http://blogs.gartner.com/richard-watson/ok-get-dockers-great/

18. Low MTBIAMSH
MTBIAMSH (Mean Time Between Idea And Making Stuff Happen)

19. Agility == $$

20. Devops

21. 25
Mainframe

22. Client-Server
26

23. 27
Web

24. 28
Cloud - Devops

25. Docker

26. Isolation using Linux kernel features
namespaces
 pid
 mnt
 net
 uts
 ipc
 user
cgroups
 memory
 cpu
 blkio
 devices

27. Image layers

28. Docker Mission

29. Docker for developers
https://registry.hub.docker.com/_/java/

30. docker-compose: running multiple containers
 Run your stack with one command: docker-compose up
 Describe your stack with one file: docker-compose.yml
web:
build: .
command: python app.py
ports:
- "5000:5000"
volumes:
- .:/code
links:
- redis:redis
redis:
image: redis

31. docker-machine
docker-machine create -d azure
—azure-subscription-id="c4f51be3-784c-xxx-7c50ad9e1b7c"
--azure-subscription-cert="/Users/pat/.ssh/docker-azure-
cert.pem"
--azure-location="East US"
--azure-size=Small
--azure-username="pat"
pat-docker-machine-n

33. Kitematic

34. Docker Mission

35. Docker Hub

36. Docker Hub
Dev & QA
ColleaguesDevelopers
QA
Build & Ship

37. Docker Trusted Registry

39. Docker Mission

40. Swarm
Scheduler plugins
Engine
Volumes plugins
Network plugins
Service discovery
plugins
Engine
Volumes plugins
Network plugins
Service discovery
plugins
mesos
flockerglusterfs
weavecalico
consuletcdzookeeper
midokuraciscoazurenuagenetworks
Docker Plugins
Batteries included but removable

41. Docker
CLI
Docker
CLI
Docker
CLI
Docker Engine

42. us-west us-east
Docker
CLI
Docker
CLI
Docker Swarm
Swarm

43. Swarm load balancing: interlock
https://github.com/ehazlett/interlock/tree/master/plugins/haproxy

44. Project Orca
Control Interface (GUI, API)
Swarm
3rd Party
scheduler
Docker Engine
Dev Self-service
Service
Catalog
Auto-Scale
Pluggable Control Plane
Compose Machine
…
Logging
Monitoring
HA
Network
Mgmt
Volume Mgmt
DeveloperOperations Auditing
Common Micro
Services
(Examples)
Service
Discovery
Load
Balancer
Secrets
Mgmt

45. +

46. Leading Enterprises Worldwide Depend on Docker
E-Commerce Media Life Sciences Finance
Vertical Search IT SaaS IaaS PaaS

47. Open Standards

49. Plumbing

50. Notary
“Let’s stop using curl|sh”
Trusted collections for any content
Transport-agnostic
Reliable updates, proof of origin, resistant to untrusted
transport, survivable key compromise
Build on industry-leading standards and research

51. RunC
The universal container runtime
https://runc.io

53. Engine 1.9 Release
• Network management
•Top-level docker network command
•Out of the box support for multi host overlay networking
•Extensibility through plugins
• Volume management
•Top-level docker volume command
•Extensibility through plugins
• Built-in nodes discovery
•Daemon --cluster-store and --cluster-advertise

54. Engine 1.9 Release
• Builder
•Refactoring toward client-side build support
•ARG: build-time arguments (provides support for HTTP_PROXY)
•STOPSIGNAL: choose the stop signal for the contained process
• Miscellaneous
•Quality, stability, performance improvements
•awslog logging driver
• Experimental
•User namespaces phase 1 (daemon-wide root remap)

55. Roadmap Engine 1.10
• Runtime
•Progress toward runC integration
• Distribution
•Ongoing effort to rewrite push/pull layer
•New manifest design, with content addressability from the grounds-up
• Networking
•Stabilize all the new features shipped in 1.9.0
•Better support for IPv6
• Security
•Stable user namespaces (phase 1)

56. Orchestration

58. Docker Swarm

59. Docker
CLI
Docker
CLI
Docker
CLI
Docker Engine

60. us-west us-east
Docker
CLI
Docker
CLI
Docker Swarm
Swarm

63. Swarm integrations
 Fully integrated with Machine and Compose
 Mesos integration

65. Swarm load balancing: interlock
https://github.com/ehazlett/interlock/tree/master/plugins/haproxy

66. Roadmap: Engine & Swarm coming closer
• Clustering is a top level concern for users
•Multi-host networking
•Ability to run containers across several nodes
• The Engine is a degenerated case of a Swarm (single node cluster)
• Proposal: progress toward much more code sharing between the two products
•Engine API <-> Swarm API
•Engine “local node orchestration” <-> Swarm multi-node scheduler
•Distributed systems features: multi-host networking & node discovery
•...

67. Mesos

74. Kubernetes

75. Kubernetes (http://kubernetes.io)

76. Kubernetes
Master / Scheduler
host-1 host-2 host-3 host-n
…..
Container Agent Container Agent Container Agent Container Agent
Linux Linux Linux Linux

77. Kubernetes
Scheduler
host-1 host-2 host-3 host-n
…..
Container Agent Container Agent Container Agent Container Agent
Linux Linux Linux Linux
Container
Container

78. Kubernetes
host-1
Container
host-2 host-3 host-4 host-n
…
Container
Container
Container
Container
ContainerContainer
Container
Container

79. Kubernetes
host-1 host-2 host-3 host-4 host-n
…
Frontend
Worker
my_app pod
MyAppMyApp MyApp
Replication
Controller
3

80. Kubernetes
host-1 host-2 host-3 host-4 host-n
…
Frontend
Worker
my_app pod
MyAppMyApp MyApp
Replication
Controller
3

81. Kubernetes
host-1 host-2 host-3 host-4 host-n
…
MyAppMyApp MyApp
Replication
Controller
Pod Pod
Pod
Pod
PodPod
Pod
Pod
Replication Controller

82. Kubernetes
host-1 host-2 host-3 host-4 host-n
…
MyApp
staging
MyApp
staging
MyApp
staging
MyApp
prod
MyApp
prod
MyApp
prod
MyApp
prod
MyApp
prod
MyApp Production Service
{ environment: prod }
MyApp Staging Service
{ environment: staging }
Labels and Services

83. Cloud Foundry & IBM BlueMix

84. Cloud Foundry Diego & Lattice
cf docker-push my-app cloudfoundry/lattice-app

85. IBM Bluemix
The Digital Innovation Platform

86. 86
Customer Managed
Service Provider Managed
IBM SoftLayer
Bluemix started as a public PaaS
Bluemix started with a major focus on developer productivity in the public cloud.
Infrastructure as
a Service
Code
Data
Runtime
Middleware
OS
Virtualization
Servers
Storage
Networking
Code
Data
Runtime
Middleware
OS
Virtualization
Servers
Storage
Networking
Platform as
a Service

87. 87
Customer Managed
Service Provider Managed
IBM SoftLayer
We listened. Now we’re evolving to become even more flexible.
Capabilities in Bluemix now span PaaS and IaaS and can be delivered as a public,
dedicated, or on-premises* implementation.
Infrastructure as
a Service
Code
Data
Runtime
Middleware
OS
Virtualization
Servers
Storage
Networking
Code
Data
Runtime
Middleware
OS
Virtualization
Servers
Storage
Networking
Platform as
a Service
*Bluemix Local coming Summer 2015
Built on open
technologies:

88. How does Bluemix work?
Bluemix is underlined by three key open compute technologies: Cloud Foundry, Docker, and
OpenStack. It extends each of these with a growing number of services, robust DevOps
tooling, integration capabilities, and a seamless developer experience.
88
Flexible Compute Options to Run Apps / Services
Instant Runtimes Containers Virtual Machines
Platform Deployment Options that Meet Your Workload Requirements
Bluemix
Public
Bluemix
Dedicated
Bluemix
Local*
DevOps
Tooling Your Own Hosted Apps / Services
Integration and
API Mgmt
Powered by IBM SoftLayer In Your Data Center
+ + +
+ +
+ Always focused on what’s next
Catalog of Services that Extend Apps’ Functionality
Web Data Mobile AnalyticsCognitive IoT Security Yours
+
*Bluemix Local coming Summer 2015

89. Containers in Bluemix
Bluemix now comes with a fully integrated, high performance Docker experience, meaning
monitoring, logging, elasticity, enterprise images, and VM abstraction are all standard.
89
Docker Value IBM Value-add Customer Value
Docker Hub Registry holds a
repository of 75000+ Docker
images
• IBM hosted public registry containing IBM images - linked to
Docker Hub
• Client unique registry available on and off premises
• Enterprise-ready images
Access to the images you require to deploy
containers that meet your business needs and
strategy
Open-source, standardized,
lightweight, self sufficient LXC
container technology
• Enhanced performance with bare metal deployment
• Run images to local datacenter or cloud
• Deployment choice with pSeries & zSeries
Flexibility to choose the right hybrid cloud mix
for your business
Build, ship, and run standardized
containers
• Integrated monitoring & logging
• Elasticity to grow storage & container needs
• Life-cycle management of containers and data volumes
• No VMs to manage
Docker ease of use combined with enterprise-
level integrity and confidence
Container connections using
links and service discovery
• Private network communication
• External IP address
• Subnet Range
Extends and connects Docker containers to
production-ready enterprise environments

90. SaaS Orchestration systems

91. Big 3
Amazon ECS
Google Container Engine
Microsoft Azure Container Service

92. Tutum

93. The Container Platform
@tutumcloud tutum.co info@tutum.co

94. Tutum: The Container Platform
TUTUM CONTAINER PLATFORM
Any
application
Any
infrastructur
eManagedSimple Flexible
Hybrid/Agnostic
Any
Operating
System
Containers
+
Other
Design Principles:

95. Tutum: The Container Platform
Dev Deploy ManageBuild
CI CD
Code
repo
Image
repo
Monitoring
Logging
Scaling
Networking
Storage
Service Discovery
Composability
Security
Hosts Public Cloud Private CloudAcross: Environments
TUTUM CONTAINER PLATFORM
Public Cloud
Test
Orchestration

96. Triton

97. Joyent Triton
The network is the computer… v2:-)

98. Orchestration summary
• Docker Swarm: Docker-style, provision with docker-machine,
1.0, ready for production, 1k nodes
• Mesos: Twitter-style, aligned with Swarm
• Fleet: CoreOS-style, simple
• Kubernetes: Google-style, heavy-duty, many concepts
• Deis: Heroku-style workflow
• Cloud Foundry Diego, IBM BlueMix: PaaS -> orchestration
• Also: Joyent, Tutum, Flynn

99. Demos

100. • Docker Swarm, Compose and networking
• docker 1.9
• swarm 1.0.0
• compose 1.5.0 --x-networking
Spring Boot App using MongoDB
https://github.com/joshlong/spring-doge
https://github.com/chanezon/docker-tips/orchestration-networking

101. • Compose for build and deploy, Wildfly, Apache, Angular, Mysql,
Redis, batch and API apps - Compose for build
Java EE 7 / Angular App with Docker Compose
https://github.com/mgreau/docker4dev-tennistour-app

102. • Service Discovery
• https://github.com/gliderlabs/registrator
• https://github.com/hashicorp/consul-template
• https://github.com/ehazlett/interlock
• Persistent volumes with Swarm and Rex Ray on AWS
• http://blog.emccode.com/2015/11/03/use-docker-swarm-with-a-data-
persistence-layer/
• https://github.com/emccode/rexray
• Kubernetes on Swarm
• https://github.com/docker/swarm-frontends
Orchestration projects

103. • Spring Boot, MongoDB, compose, swarm, networking
• https://github.com/joshlong/spring-doge
• https://github.com/chanezon/docker-tips/orchestration-
networking
• Java EE 7 / Angular App with Docker Swarm by @mgreau
Compose for build and deploy, Wildfly, Apache, Angular, Mysql,
Redis, batch and API apps
• https://github.com/mgreau/docker4dev-tennistour-app
• Java EE Docker & Kubernetes by @arun-gupta
• https://github.com/javaee-samples/docker-java
Java Examples

104. • Docs
https://docs.docker.com/engine/userguide/networking/dock
ernetworks/
• Create a Swarm cluster with networking
https://github.com/chanezon/docker-tips/orchestration-
networking
• Networking in compose
https://github.com/docker/compose/blob/master/docs/netw
orking.md
Docker networking

105. Fire up your first container today!
Ride the Whale!

106. Learning
• http://docs.docker.com/
• http://training.docker.com
• http://slideshare.net/chanezon
• http://opencontainers.org
• https://github.com/chanezon/docker-tips
• https://github.com/dave-tucker/docker-network-demos

107. We’re hiring!
https://www.docker.com/company/careers/

108. Q&A