BOSH / CF Deployment in modern ways #cf_tokyo

1
BOSH / CF Deployment
in modern ways
2017-09-12
Toshiaki Maki (@making)

Who am I ?
2
Toshiaki Maki (@making) https://blog.ik.am
Sr. Solutions Architect @Pivotal Japan
Spring Framework 💖
Cloud Foundry 💖
BOSH 💖

Topics
3
• BOSH CLI v2
• BOSH Boot Loader
• cf deployment

BOSH Deployment General Workflow
4

4
Infrastructure
LoaderBalancer

4
Infrastructure
LoaderBalancer
BOSH CLI

4
Infrastructure
Director
LoaderBalancer
BOSH CLI

4
Infrastructure
Director
LoaderBalancer
Cloud ConfigBOSH CLI

4
Infrastructure
Director
LoaderBalancer
Stemcell

4
Infrastructure
Director
LoaderBalancer
Stemcell
BOSH Release

4
Infrastructure
Director
LoaderBalancer
Stemcell
BOSH Release
Manifest

4
Infrastructure
Director
BOSH VMs
LoaderBalancer
BOSH VMs
BOSH VMs
Stemcell
BOSH Release
Manifest

BOSH CLI v2
5
• Executable binary 🙌 by Golang (Ruby for v1 ...😒)
• bosh create-env to initialize an environment
• operation-files
https://bosh.io/docs/cli-v2.html
$ brew install cloudfoundry/tap/bosh-cli

Differences v1 and v2
6
$ bosh target <Director IP>
$ bosh login <client> <secret>
$ bosh status
https://bosh.io/docs/cli-v2-diff.html
Before
$ export BOSH_CLIENT=<client>
$ export BOSH_CLIENT_SECRET=<secret>
$ export BOSH_CA_CERT=...
$ export BOSH_ENVIRONMENT=<Director IP>
$ bosh env
After

7
$ bosh update cloud-config cloud.yml
$ bosh upload stemcell stemcell.tgz
$ bosh upload release foo.tgz
$ bosh deployment foo.yml
$ bosh deploy
$ bosh update-cloud-config cloud.yml
$ bosh upload-stemcell stemcell.tgz
$ bosh upload-release foo.tgz
$ bosh deploy -d foo foo.yml
Before
After

8
$ bosh vms
$ bosh instances --ps
$ bosh vms
$ bosh instances --ps
Before
After

9
$ bosh logs job
$ bosh logs -d foo job
$ bosh logs -d foo job -f # tailing 🙌
Before
After

Maintaining YAML file (Before)
10
instance_groups:
- name: worker
instances: 1
vm_type: default
azs: [z1]
networks: [{name:default}]
Official YAML (from Github)
instance_groups:
- name: worker
instances: 1
vm_type: default
azs: [z1]
networks: [{name:private}]
instance_groups:
- name: worker
instances: 3
vm_type: m4.xlarge
azs: [z1, z2]
Copy for my env1
Copy for my env2

Maintaining YAML file (After)
11
instance_groups:
- name: worker
instances: 1
vm_type: default
azs: [z1]
Official YAML (from Github)
- type: replace
path: /instance_groups/name=worker/vm_type
value: m4.xlarge
- type: replace
path: /instance_groups/name=worker/instances
value: 3
- type: replace
path: /instance_groups/name=worker/azs/-
value: z2
Operation file (ops.yml) for my env
$ bosh deploy -d foo original.yml
-o ops.yml

Operation files (YAML Composition)
12
-o high-availalitiy.yml
-o multi-az.yml
-o enable-feature-X.yml
-o change-vm-type-for-me.yml
-o change-properties-for-me.yml

12
-o multi-az.yml
BOSH release maintainer can provide some
types of configuration without copy-and-paste.

12
-o multi-az.yml
You can maintain and compose
only your customizations ☺
BOSH release maintainer can provide some
types of configuration without copy-and-paste.

Download BOSH releases (Before)
13
releases:
- name: concourse
version: 3.4.1
- name: garden-runc
version: 1.6.0
bosh upload-release
https://bosh.io/d/github.com/concourse/concourse?v=3.4.1
bosh upload-release
https://bosh.io/d/github.com/cloudfoundry/garden-runc-release?v=1.6.0
bosh deploy -d concourse concourse.yml

Download BOSH releases (After)
14
releases:
- name: concourse
version: 3.4.1
url: https://bosh.io/d/github.com/concourse/concourse?v=3.4.1
sha1: b9c3cd85caccf0dae7406f8d7dfc237b4c698ce6
- name: garden-runc
version: 1.6.0
url: https://bosh.io/d/github.com/cloudfoundry/garden-runc-release?v=1.6.0
sha1: 58fbc64aff303e6d76899441241dd5dacef50cb7

Variables Interpolation
15
instance_groups:
- name: web
jobs:
- name: atc
release: concourse
properties:
basic_auth_username: admin
basic_auth_password: opensesami
🤔

16
instance_groups:
- name: web
jobs:
- name: atc
release: concourse
properties:
basic_auth_password: ((ui_password))
bosh deploy -d concourse concourse.yml -v ui_password=opensesami

17
instance_groups:
- name: web
jobs:
- name: atc
release: concourse
properties:
basic_auth_password: ((ui_password))
variables:
- name: ui_password
type: password

18
--vars-store ./creds.yml
ui_password: u98vzinh4y8gfcr1h6g0
creds.yml

Variables Interpolation + CredHub
19
https://github.com/cloudfoundry-incubator/credhub
Director CredHub
Director VM
/my-director/concourse/ui_password u98vzinh4y8gfcr1h6g0

How to provision Director?
20
Infrastructure
Director
BOSH VMs
LoaderBalancer
BOSH VMs
BOSH VMs
Stemcell
BOSH Release
Manifest

21
$ bosh-init your-env.yml
Bootstrapping BOSH Director (Before)

21
$ bosh-init your-env.yml
Bootstrapping BOSH Director (Before)
Copy from bosh.io
and
change environment
configuration

22
$ git clone https://github.com/cloudfoundry/bosh-deployment.git
$ bosh create-env bosh-deployment/bosh.yml
--state=state.json
--vars-store=creds.yml
-o bosh-deployment/aws/cpi.yml
-v director_name=bosh-1
-v internal_cidr=10.0.0.0/24
-v internal_gw=10.0.0.1
-v internal_ip=10.0.0.6
-v subnet_id=subnet-ait8g34t
-v access_key_id=AKI...
-v ...
Bootstrapping BOSH Director (After)
Base template
Environment
configuration

23
-v subnet_id=subnet-ait8g34t
-v access_key_id=AKI...
-v ...
BOSH Director for AWS

24
-o bosh-deployment/gcp/cpi.yml
-v project_id=moonlight-2389ry3
--var-file gcp_credentials_json=~/Downloads/gcp.json
-v ...
BOSH Director for GCP

25
-o bosh-deployment/uaa.yml
-v ...
BOSH Director with UAA

26
-o bosh-deployment/credhub.yml
-v ...
BOSH Director with UAA + CredHub

27
-o bosh-deployment/virtualbox/cpi.yml
-o bosh-deployment/virtualbox/outbound-network.yml
-o bosh-deployment/bosh-lite.yml
-o bosh-deployment/bosh-lite-runc.yml
-v ...
BOSH Director for VirtualBox (a.k.a BOSH Lite)

28
-v ...
BOSH Lite with UAA

29
-v ...
BOSH Lite with UAA + CredHub

30
-v ...
BOSH Lite with UAA + CredHub for GCP

Concourse (Single VM) without BOSH Director
31
$ git clone https://github.com/concourse/concourse-deployment
$ bosh create-env concourse-deployment/concourse.yml
-o concourse-deployment/infrastructures/virtualbox.yml
--vars-store vbox-creds.yml
--state vbox-state.json
-v public_ip=192.168.50.4

Concourse (Single VM) without BOSH Director
32
$ git clone https://github.com/concourse/concourse-deployment
$ bosh create-env concourse-deployment/concourse.yml
-o concourse-deployment//infrastructures/gcp.yml
--vars-store gcp-creds.yml
--state gcp-state.json
-v gcp_credentials_json="'$gcp_credentials_json'"
-v internal_cidr=... -v internal_gw=...
-v internal_ip=... -v public_ip=...
-v network=... -v project_id=...
-v subnetwork=... -v tags=...
-v zone=...

How to provision Infrastructure?
33
Infrastructure
Director
BOSH VMs
LoaderBalancer
BOSH VMs
BOSH VMs
Stemcell
BOSH Release
Manifest

BOSH Boot Loader (a.k.a. bbl)
34
• bbl bootstraps a CloudFoundry or Concourse
installation on AWS and GCP (and Azure).
• terraform is used internally
https://github.com/cloudfoundry/bosh-bootloader
$ brew install cloudfoundry/tap/bbl

Bootstrapping AWS
35
$ export BBL_IAAS=aws
$ export BBL_AWS_ACCESS_KEY_ID=...
$ export BBL_AWS_SECRET_ACCESS_KEY=...
$ export BBL_AWS_REGION=ap-northeast-1
$ bbl up

Bootstrapping GCP
36
$ export BBL_IAAS=gcp
$ export BBL_GCP_SERVICE_ACCOUNT_KEY=...
$ export BBL_GCP_PROJECT_ID=...
$ export BBL_GCP_REGION=asia-northeast1
$ export BBL_GCP_ZONE=asia-northeast1-a
$ bbl up

Accessing to Director
38
$ eval $(bbl print-env)
$ bosh env

Bootstrapping without BOSH Director
39
$ bbl up --no-director
-l <(bbl bosh-deployment-vars)
$ bosh update-cloud-config <(bbl cloud-config)
https://github.com/cloudfoundry/bosh-bootloader/blob/master/docs/advanced.md

Bootstrapping with Operation Files
40
$ bbl up --ops-file=bosh-deployment/uaa.yml
$ cat uaa.yml credhub.yml > your-ops.yml
$ bbl up --ops-file=your-ops.yml
Multi-ops file is not supported at this moment...

41
Infrastructure
Director
BOSH VMs
LoaderBalancer
BOSH VMs
BOSH VMs
Stemcell
BOSH Release
Manifest

41
Infrastructure
Director
BOSH VMs
LoaderBalancer
BOSH VMs
BOSH VMs
Stemcell
BOSH Release
Manifest
$ bbl create-lbs --type cf
--cert cert.pem
--key key.pem
# or
$ bbl create-lbs --type concourse

Load Balancer (--type cf)
42
GCP
AWS

(Tips) bosh ssh/logs after bbl
43
$ bbl ssh-key > bosh.pem
$ chmod 400 bosh.pem
$ bosh logs -f foo -d bar
--gw-private-key bosh.pem
https://github.com/cloudfoundry/bosh-cli/issues/128

cf-deployment
44
$ bosh upload-stemcell https://bosh.io/d/stemcells/...
$ git clone https://github.com/cloudfoundry/cf-deployment.git
$ bosh deploy -d cf cf-deployment/cf-deployment.yml
--vars-store cf-deployment-vars.yml
-v system_domain=system.your-domain.example.com
assumes GCP as the default deployment environment.

cf-deployment
44
$ bosh upload-stemcell https://bosh.io/d/stemcells/...
$ git clone https://github.com/cloudfoundry/cf-deployment.git
assumes GCP as the default deployment environment.
$ bosh update-cloud-config
cf-deployment/bosh-lite/cloud-config.yml
-v system_domain=bosh-lite.com
BOSH Lite ver.

cf-deployment
45
-o cf-deployment/operations/aws.yml
-o cf-deployment/operations/scale-to-one-az.yml
-o cf-deployment/operations/use-s3-blobstore.yml
-o cf-deployment/operations/use-latest-stemcell.yml

cf-deployment
46
-o cf-deployment/operations/aws.yml
-o cf-deployment/operations/scale-to-one-az.yml
-o cf-deployment/use-s3-blobstore.yml
-o cf-deployment/operations/use-latest-stemcell.yml
-o cf-deployment/operations/experimental/disable-etcd.yml

cf login
49
$ PASWORD=`bosh int cf-deployment-vars.yml --
path /cf_admin_password`
$ cf login
-a api.system.your-domain.example.com
-u admin
-p ${PASWORD}
--skip-ssl-validation

cf-release will be deprecated
50
https://github.com/cloudfoundry/cf-deployment#purpose

Is production ready??
51
https://github.com/cloudfoundry/cf-deployment#readiness

Transition path from cf-release
52
https://github.com/cloudfoundry/cf-deployment-transition

Bonus topics ... (not today)
53
• CredHub
• BOSH Backup and Restore (a.k.a. bbr)

Summary
54
• bbl up to bootstrap IaaS
• bosh create-env to provision BOSH Director
• bosh deploy -d cf cf.yml to deploy a cluster (Cloud
Foundry)
• bosh deploy -d cf cf.yml -o ops.yml to compose
configuration
Thank you!

BOSH / CF Deployment in modern ways #cf_tokyo

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (6)

Similar to BOSH / CF Deployment in modern ways #cf_tokyo

Similar to BOSH / CF Deployment in modern ways #cf_tokyo (20)

More from Toshiaki Maki

More from Toshiaki Maki (20)

Recently uploaded

Recently uploaded (20)

BOSH / CF Deployment in modern ways #cf_tokyo