Session on CloudStack, Docker, Kubernetes, and Big Data

1. Sebastien Goasguen,
@sebgoa
On CloudStack
Docker, Kubernetes
and Big Data…Oh my !

2. Who am I ?
• Joined Citrix OSS team in July 2012
• Associate professor at Clemson
University prior
• High Performance Computing, Grid
computing
• At CERN summer 2009/2010, built their
first cloud on opennebula
• http://sebgoa.blogspot.com
@sebgoa

3. • Apache CloudStack and licloud committer + PMC
member
• Looking at techs and how they work together
• Half dev, half community manager, + half event planner
What do I do ?

4. Today’s talk

5. CloudStack

6. IaaS Landscape

7. Users…Check CCC videos
#cloudstackworks

8. CloudStack
clouds

9. Load Balancers FWs & VPNs
Dashboard Identity Mgmt.Image Mgmt.
ComputeStorage Network
MeteringAPI (EC2 & CS) Self-service Portal
Data Center Orchestrator

10. Interfaces and standards

11. The Apache Software Foundation

12. Apache Software Foundation

13. 35 projects in incubation:
• 12 Hadoop related
• ~30% Big Data related
• Spark
117 top level projects:
• ~16 cloud or bigdata +10%
• Deltacloud, Libcloud, Whirr, jclouds
• Hadoop, couchdb, cassandra, mesos, aurora
• Spark
• Bigtop, accumulo, lucene, UIMA
• CloudStack

14. IaaS History

15. VMWare
1998
Xen 2003
HW assisted Virt
2005
EC2
2006
Opennebula
Eucalyptus
2008
CloudStack
2010
Openstack
2010
GCE
2012

16. Goals
• Utility computing
• Elasticity of the infrastructure
• On-demand
• Pay as you go
• Multi-tenant
• Programmable access

17. So what…
Let’s assume this is solved.
What is not solved:
- Application deployment
- Application scalability
- Application portability
- Application composability

18. Docker

19. • Linux container (LXC
+)
• Application
deployment
• PaaS
• Portability
• Image sharing via
DockerHub
• Ease of packaging
applications

20. Building docker images
Fair use from http://blog.octo.com/en/docker-registry-first-steps/

21. + config
mgmt

22. “Bake vs. Fry and what do we do
with configuration management
tools ?”

23. CoreOS

24. Good job 

25. Similar projects

26. coreOS and CloudStack

27. CoreOS
• Linux distribution
• Rolling upgrades
• Minimal OS
• Docker support
• etcd and fleet tools
to manage distributed
applications based on
containers.
• Cloud-init support
• Systemd units

28. Building CoreOS
See Brian Harrington Video..

29. coreOS “OEM”
http://github.com/coreos/coreos-overlay

30. coreOS
“OEM”
http://github.com/coreos/coreos-overlay

31. The cloudinit magic

32. CoreOS on exoscale

33. Starting
containers#cloud-config
coreos:
units:
- name: docker.service
command: start
- name: es.service
command: start
content: |
[Unit]
After=docker.service
Requires=docker.service
Description=starts ElasticSearch container
[Service]
TimeoutStartSec=0
ExecStartPre=/usr/bin/docker pull dockerfile/elasticsearch
ExecStart=/usr/bin/docker run -d -p 9200:9200 -p 9300:9300
dockerfile/elasticsearch

34. Openvm.eu
http://dl.openvm.eu/cloudstack/coreos/x86_64/

35. DEMO ?

36. CoreOS clustering
etcd HA key value store
• Raft election algorithm
• Writes when majority in cluster has committed
update
• e.g 5 nodes, tolerates 2 nodes failure
fleet distributed init system (schedules
systemd units in a cluster)
• Submits systemd units cluster wide
• Affinity, anti-affinity, global “scheduling”

37. CoreOS Cluster

38. “coreOS is the first cloud OS dedicated
to docker based application workloads”

39. “Where are you going to run coreOS ?”
“Where are you going to run Docker ?“

40. - Bare metal cluster
- Public Clouds
- Private Clouds

41. “How are you going to manage
containers running on multiple Docker
Hosts ?”

42. Docker schedulers
• Docker Swarm
• Citadel
• CoreOS Fleet
• Lattice from CF
incubator
• Clocker (via
blueprints)
• …
• Kubernetes

43. Kubernetes on CloudStack

44. Kubernetes
• Docker application
orchestration
• Google GCE,
rackspace, Azure
providers
• Deployable on
CoreOS
• Container replication
• HA services

46. Kubernetes API

47. {
"id": "redis-master-2",
"kind": "Pod",
"apiVersion": "v1beta1",
"desiredState": {
"manifest": {
"version": "v1beta1",
"id": "redis-master-2",
"containers": [{
"name": "master",
"image": "dockerfile/redis",
"ports": [{
"containerPort": 6379,
"hostPort": 6379
…
"labels": {
"name": "redis-master"
}
}
Kubernetes Pod

48. Standardizing on pod
Look at the differences between:
- k8s pod
- AWS ECS task
- Ansible Docker playbook
- Fig file

49. ?
- hosts: wordpress
tasks:
- name: Run mysql container
docker:
name=mysql
image=mysql
detach=true
env="MYSQL_ROOT_PASSWORD=wordpressdocker,MYSQL_DATABASE=wordpress,
MYSQL_USER=wordpress,MYSQL_PASSWORD=wordpresspwd"
- name: Run wordpress container
docker:
image=wordpress
env="WORDPRESS_DB_NAME=wordpress,WORDPRESS_DB_USER=wordpress,
WORDPRESS_DB_PASSWORD=wordpresspwd"
ports="80:80"
detach=true
links="mysql:mysql"

50. ?
wordpress:
image: wordpress
links:
- mysql
ports:
- "80:80"
environment:
- WORDPRESS_DB_NAME=wordpress
- WORDPRESS_DB_USER=wordpress
- WORDPRESS_DB_PASSWORD=wordpresspwd
mysql:
image: mysql
volumes:
- /home/docker/mysql:/var/lib/mysql
environment:
- MYSQL_ROOT_PASSWORD=wordpressdocker
- MYSQL_DATABASE=wordpress
- MYSQL_USER=wordpress
- MYSQL_PASSWORD=wordpresspwd

51. ?
apiVersion: v1beta1
id: wordpress
desiredState:
manifest:
version: v1beta1
id: wordpress
containers:
- name: wordpress
image: wordpress
ports:
- containerPort: 80
volumeMounts:
# name must match the volume name below
- name: wordpress-persistent-storage
# mount path within the container
mountPath: /var/www/html
env:
- name: WORDPRESS_DB_PASSWORD
# change this - must match mysql.yaml password
value: yourpassword
volumes:
- name: wordpress-persistent-storage
source:
# emptyDir: {}
persistentDisk:
# This GCE PD must already exist.
pdName: wordpress-disk
fsType: ext4
labels:
name: wpfrontend
kind: Pod

52. ?
[
{
"image": "wordpress",
"name": "wordpress",
"cpu": 10,
"memory": 200,
"essential": true,
"links": [
"mysql"
],
"portMappings": [
{
"containerPort": 80,
"hostPort": 80
}
],
"environment": [
{
"name": "WORDPRESS_DB_NAME",
"value": "wordpress"
},
…

53. Kubernetes on CloudStack
Find a CloudStack cloud that supports
CoreOS
Then use:
https://github.com/runseb/ansible-kubernetes
Based on the Ansible cloudstack module

54. Cloud API
Libcloud startup
scripts
Etcd cluster
5 nodes
Discovery service to
bootstrap
Kubernetes cluster
5 nodes
Start Kube* services via fleet
Run guestbook example
PR welcome:
https://github.com/runseb/
kubernetes-exoscale
OLD WAY

55. Cloud (e.g CloudStack based = exoscale)
coreOS coreOS coreOS
K* K* K*
Docker
container
Docker
container
Docker
container
API calls to
Kubernetes API

56. Demo ?

57. A view on Big Data

58. Demo …
https://github.com/runseb/ansible-mesos-
cloudstack

59. SKA

60. http://www.economist.com/node/15557443?story_id=15557443

64. How did we get there ?

65. A natural evolution

66. New Distributed systems for:
Large scale datasets
• From scientific instruments
• From Web apps logs
Complex datasets
• Not necessarily large.
Object stores
• S3 clones

67. BigData and map-reduce
• While BigData is often associated with HDFS,
Map-Reduce is the algorithm used to
parallelize data processing.
• BigData ≠ Map-Reduce ≠ HDFS
• Map-reduce is a way to express
embarrassingly parallel work easily.
• You can do Map-Reduce without HDFS.
• e.g Basho map-reduce on riackCS

68. A really quick view on Clouds

71. Today

72. BigData at
peak

73. History
2003 –Google File System
2005 – Hadoop
2006 – Hadoop enters ASF incubator (Feb)
2006 – S3 launched
2007 – Paper on Amazon Dynamo
2009 – EMR launched
2013 – CloudStack as a ASF TLP (March)
2013 – Spark/Mesos enters ASF incubator

74. The Apache Software Foundation

75. Apache Software Foundation

76. 35 projects in incubation:
• 12 Hadoop related
• ~30% Big Data related
• Spark
117 top level projects:
• ~16 cloud or bigdata +10%
• Deltacloud, Libcloud, Whirr, jclouds
• Hadoop, couchdb, cassandra, mesos
• Bigtop, accumulo, lucene, UIMA
• CloudStack

77. Hadoop Ecosystem
+ Up-coming next generation BD
systems

78. Stay on top…
Big Data and Cloud

79. Big Data and Cloud (Stack)s

80. Clouds and BigData
• Object store + compute IaaS to build EC2+S3
clone
• BigData solutions as storage backends for
image catalogue and large scale instance
storage.
• BigData solutions as workloads to CloudStack
based clouds.

81. EC2, S3 clone
• An open source IaaS with an EC2
wrapper e.g Opennebula, CloudStack
• Deploy a S3 compatible object store –
separately- e.g riakCS
• Two independent distributed systems
deployed
Cloud = EC2 + S3

82. Big Data
as IaaS backend
“Big Data” solutions can be used as secondary
storage in CloudStack
.

83. Example
• Open source IaaS + EC2 wrapper, e.g
CloudStack
• Deploy S3 compatible object store, e.g
riakCS or Ceph or glusterFS
• Use S3 as image store
• Your EC2 service is a customer to your S3
service
+ Logstash + elasticsearch for logs/
monitoring

84. Even use Bare Metal

85. A note on Scheduling
• Core problem of computer science
• knapsack is NP complete
• Central scheduling has been used for a long
time in HPC
• Optimizing the cluster utilization requires
multi-level scheduling (e.g backfill,
preemption etc..)
• Google Omega paper 2013
• Mesos 2009/2011, ASF Dec 2011

86. Past: BOINC/Condor Backfill

87. Food for thought
Mesos Framework for managing VM ?
Workload sharing in your data-center:
• Big Data
• VM
• Services
Cloud and BigData

88. Conclusions
• Big Data is “catching up”
• Tackle the “big three” head on:
• BigData, Cloud and DevOps
• Add a big data backend to your cloud
from the start
• Provide Big Data services on your cloud

89. Still
behind !

90. Get Involved with Apache
CloudStack
Web: http://cloudstack.apache.org/
Mailing Lists: cloudstack.apache.org/mailing-lists.html
IRC: irc.freenode.net: 6667 #cloudstack #cloudstack-dev
Twitter: @cloudstack
LinkedIn: www.linkedin.com/groups/CloudStack-Users-Group-3144859
If it didn’t happen on the mailing list, it didn’t happen.

91. The Velocity Conference
Santa Clara, May 27-29
• 2 days of keynotes & sessions
• 1 day of tutorials
• New full-day trainings
• Amazing presenters – Jez Humble,
Patrick Meenan, Mesosphere, Fastly &
more
Use discount code
CLOUDSTACK20 during
registration for 20% off
http://velocityconf.com/velocity2015

92. Free O’Reilly Resources
Get 50% off ebooks & 40% off print
books at oreilly.com with coupon
code DSUG