Docker Amsterdam Summer meetup, August 2014: using Docker at Cloud9 IDE This talk showcases how we use Docker at c9.io, and highlights some of the challenged we faced in adopting docker for our use case.

1. Docker at Cloud9
Lennart Kats
@lennartcl

2. You?
George Hendrik Breitner: Lauriergracht, Amsterdam, 1895

3. 3.0: July 2014

7. •

10. ~300,000
lines
of
JavaScript
(source)

11. Workspace Types

12. How to maintain
these configurations and
create efficient,
configurable containers?

13. Answer:

14. • Fast
• Inexpensive
• Reproducible environment
• Copy-on-write storage
• sudo apt-get install anything

15. Demo

16. Basic software stack
d9.sh
node.js: docker.js
Docker
dockerode.js
micro_inetd + dropbear
tmux

17. d9.sh
d9 ps == docker ps
d9 run ⪞ docker run
d9 dry
d9 attached
d9 check
d9 ok

18. VFS
Backup worker
Docker host
IDE server
You?
Load
balancing,
regions
Docker container
Servers
Security

19. How to manage Docker
containers for a cloud
service with 350K users?

20. Load Balancing
!
!
!
!
How can we make optimal use of our servers
with users going online and offline all day?

21. Load Balancing
pick a host based on:
• active containers
• total containers
• cpu load
• …

22. Regions
europe
us
asia

23. Server upgrades
New kernel
New docker version

24. How can we
move running containers
with minimal impact
to users?

25. Answer:
We can’t, really :(

26. Alternate answer:
We can cheat, kind of.

27. Load balancing and
container moving
• persist all on-disk state (backup)
• filesystem diff
• original image name & revision
• restore on other host
• move around free user containers

28. Docker Hub
hub.docker.com Security Backup worker
Docker host
Docker container
Google Cloud
Storage

29. BUGS!!1

30. BUGS!!1
Container
not creating
Container
not starting
Image not
uploading
Port not
opening
Container
not stopping
Docker
daemon dying

31. BUGS!!1
for N in {1..10}; do try; done
workarounds
logging, monitoring
conservative w.r.t. docker updates
(stress)testing

32. Monitoring

33. Docker getting better

34. <TODO>
• Open source our Dockerfiles
• Allow users to roll their own
• Use Docker for Cloud9 services

35. Summary
power!
could be better:
load balancing
cpu/disk quotas
bugs :(
more coming for Cloud9 & docker!
rules!

36. @lennartcl
info@c9.io
We’re hiring!