These are my slides from today's Cloud Foundry Anniversary event. This is just the technical portion of the deck.

1. Cloud Foundry Update
The Industry’s Open Platform as a Service
Twitter: @cloudfoundry
© 2012 VMware, Inc. All rights reserved

2. Mark Lucovsky
VP Engineering, Cloud Foundry, VMware
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 2

3. CloudFoundry.org
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 3

4. The New CloudFoundry.org
cloudfoundry.com
production updated ~2x/week
github
github.com/cloudfoundry
on +2 and ✓ change pushed to github
Reviewers +1/-1 Gerrit Code Review +2/-2 Committers
reviews.cloudfoundry.org
test verification score ✓ ✗ git push triggers test execution
Jenkins CI
ci.cloudfoundry.org
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 4

5. More
Clouds
More More
Partners Community
More
Code
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 5

6. What have we been up to: Visible Features
§ Services
• Caldecott – tunnel into your services, explore with standard client tools
• PostgreSQL, RabbitMQ
§ Frameworks, Runtimes, and Tools
• Java and Ruby Auto-Reconfiguration
• Scala, node.JS 0.6.*, Erlang, JRuby, PHP, Python, .NET, Spring 3.1, Grails 2.0
• Multi-Node Chef based deployment tools
• Maven Plugin, Eclipse Integration
• VMC manifests, Java Debugging, Rails Console
§ Micro Cloud Foundry x 3
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 6

7. 80% of our work has been below the water line
§ Developer Visible Features
§ Contributor Visible Features
• re-visiting architectural issues
• extensive hardening
• algorithm tuning
• scalability enhancements
• operational enhancements
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 7

8. App lifecycle management: at launch
start/stop instances
§ awesome conceptual
architecture, logical flows
§ simplistic design provided a cloud
controller health
solid conceptual foundation
manager
§ scalability, robustness,
operational efficiency, and cc - db actual
get expected
extensibility was inadequate state
state
NFS
§ deconstruction/refactoring dea
• enable multiple independently resources,
droplets, packages
scalable components
• eliminate “boot storms” at scale fetch droplets
• tune the hot data paths
§ apply learning from the beta
• across the board and to all major
system components
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 8

9. App lifecycle management: +1yr
v2
cloud
stager health
v2
controller New!
manager
cc - db staging
jobs New!
package
uaa - db cache New! v2*
New! dea
redis
New!
uaa - AuthN blobstore
staging logs New!
New!
more new code than old code CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 9

10. App execution (DEA): at launch and +1yr
§ Major internal rewrite
§ Validating isolation model in Jenkins
§ Live in CF.com ~30d dea.rb
container api
nat and firewall
dea.rb
private network
apps
app
private fs
warden container*
CONFIDENTIAL * also running in our Jenkins workers
© 2012 VMware, Inc. All rights reserved 10

11. Router: at launch and +1yr
http request http request
nginx nginx
(+lua extension)
proxied lookup
request node:port
upstream
router.rb
locator svc
proxied proxied
nats request nats request
<app>.cf.com <app>.cf.com
ê ê
node:port node:port
dea dea
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 11

12. Production Grade Cloud Foundry Clusters
§ 500 – 5,000 VMs cloudfoundry.com
§ 40+ unique node types
§ 75+ unique software packages
§ 75+ unique environments
§ 2x/week cf.com updates
§ 24x7x365 non-stop operation
§ No-downtime deployments
§ Reliable, robust, repeatable
deployments, updates,
capacity adjustments
§ Small teams manage many
instances production, staging, stress, qa, dev
Google style problem  Google style solution
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 12

13. Cloud Foundry BOSH
§ Cloud Foundry BOSH is an open source tool-chain for
release engineering, deployment, and lifecycle management of
large scale distributed services
• Prescriptive way of creating releases and managing systems and services
• It is not a collection of shell scripts, not a pile of Perl
§ Built to deploy and manage production-class, large scale clusters
• Production grade Cloud Foundry clusters: 500+ VMs, 40+ jobs, 75+ packages
• Multi-node, multi-tier, complex clusters: e.g., our Gerrit/Jenkins Cluster
§ Built for devops usage and scale by a crack team of veterans
• A project, not a product: command line interface, YAML, etc.
• Continuous improvement, iterative development, rough edges
github.com/cloudfoundry/bosh
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 13

14. BOSH: under the hood
BOSH User
“BOSH is deployed by BOSH”
bosh cli director healthmon
cloudfoundry.com
db redis nats
workers blobs
active jobs
agent
IaaS CPI stemcell disk
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 14

15. IaaS neutral by design
vSphere: battle tested implementation,
thousands of deployments CPI: code complete
vCloud Director: “work in progress”, 2H 2012 functional status: “work in progress”
Cloud Foundry BOSH
Cloud Provider Interface (CPI)
contribute: github.com/cloudfoundry/bosh
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 15

16. Where do I go for what
§ Learn
• developers: http://docs.cloudfoundry.com
• contributors: http://cloudfoundry.org
§ Ask Questions
• using BOSH: http://groups.google.com/a/cloudfoundry.org/group/bosh-users
• code BOSH: http://groups.google.com/a/cloudfoundry.org/group/bosh-dev
• code VCAP: http://groups.google.com/a/cloudfoundry.org/group/dev
• use cloudfoundry.com: http://support.cloudfoundry.com
§ File a Bug
• http://cloudfoundry.atlassian.net
§ Browse, Fork, Contribute
• browse on github: https://github.com/cloudfoundry/bosh
• contribute: gerrit-clone ssh://reviews.cloudfoundry.org:29418/bosh.git
CONFIDENTIAL
© 2012 VMware, Inc. All rights reserved 16