Managing Your Application Lifecycle on AWS: Continuous Integration and Deployment

Managing Your Application Lifecycle on AWS
Continuous Integration and Deployment
Adrian White, Solutions Architect
Amazon Web Services

Business
101 Technical
201 Technical
301 Technical
401 Technical
Session Grading

What are we covering today?
• Consistency through the development, test and
release lifecycle
• Improve quality over time
• Increase velocity of application change
• AWS deployment and management approaches
• What does deployment look like in the future?

Task tracker
Continuous integration /
Automated testing /
Release management
Artifact repository
Source code
management
Deployment service
AWS OpsWorks
AWS Elastic
Beanstalk
AWS
CloudFormation
AWS
CodeDeploy
Local
development
Application lifecycle management workflow

AWS Code and Deployment Tools
MonitorProvisionDeployTestBuildCode
Elastic Beanstalk
OpsWorks
Cloud
Watch
Cloud
Formation
Code
Deploy
Code
Commit
Code
Pipeline

Local development challenges
• Source code management design
• “But it works on my machine”
• Portable development environments
• Distributed teams work on tasks in parallel

Source code management features
• Fast and easy branching
• Pull requests for distributed development workflows
• Code review
• Audit, logging, security

Feature branching, Gitflow and Pull requests
Inspired by https://www.atlassian.com/git/tutorials/comparing-workflows/feature-branch-workflow/
Master Develop Release Feature Hotfix

Container image factories 
(for consistency)
…

CodeCommit
• Private Git on AWS
• Massive scaled version controlled projects
• High service availability and resiliency
• Encrypted at rest
• Pay as you go pricing
• Import from SVN, Git, Microsoft TFS
• Use IAM to control access to repositories

CodeCommit workflow
git clone
create repository Create repository
Receive clone request
Sync local / remote repos
modify local files
git add / commit / push
Receive push request
Update remote repo
git pull
Receive push request
Update remote repo
List repos, list branches
Display response
Receive requests
Send responses

Why use a release automation service?
Automate
workflow
Release
quickly
Ensure
quality

CodePipeline
• Customizable workflow engine
• Integrate with partner and custom systems
• Visual editor and status
Continuous delivery and release automation, just like Amazon
Build
1) Build
2) Unit test
1) Deploy
2) UI test
Source Beta Production
1) Deploy
2) Load test
Gamma
1) Deploy region1
2) Deploy region2
3) Deploy region3

How do you ship application changes?
• Deployment approaches
– In place vs discrete stacks
• Where is state in the system?
– Stateless vs stateful application components
• Frequency and speed of change

Why use a deployment service?
Automate
deployments
Manage
complexity
Avoid
downtime

Shipping artifacts to existing environments

AWS CodeDeploy helps with this!
Now available in Sydney
(ap-southeast-2)

CodeDeploy
• Scale from 1 instance to thousands
• Deploy without downtime
• Centralize deployment control and monitoring
Staging
CodeDeployv1, v2, v3
Production
Dev
Coordinate automated deployments, just like Amazon
Application
revisions
Deployment groups

Step 1: Package your application (with an AppSpec
file)
version: 0.0
os: linux
files:
- source: chef/
destination: /etc/chef/codedeploy
- source: target/hello.war
destination: /var/lib/tomcat6/webapps
hooks:
ApplicationStop:
- location: deploy_hooks/stop-tomcat.sh
BeforeInstall:
- location: deploy_hooks/install-chef.sh
AfterInstall:
- location: deploy_hooks/librarian-install.sh
ApplicationStart:
- location: deploy_hooks/chef-solo.sh
ValidateService:
- location: deploy_hooks/verify_service.sh

Step 2: Set up your target environments
Agent Agent Agent
Staging
Agent Agent
Agent Agent
Agent
Agent
Production
Deployment groupDeployment group
Group instances by:
• Auto Scaling group
• Amazon EC2 tag
• On-premises tag

Step 3: Deploy!
aws deploy create-deployment
--application-name MyApp
--deployment-group-name TargetGroup
--s3-location bucket=MyBucket,key=MyApp.zip
AWS CLI & SDKs
AWS Console
CI / CD Partners
GitHub

Deployment config – Choose speed
v2 v1 v1 v1 v1 v1 v1 v1
v2 v2 v2 v2 v1 v1 v1 v1
v2 v2 v2 v2 v2 v2 v2 v2
One-at-a-time
Half-at-a-time
All-at-once

Rolling update – Deploy without downtime
v1v1 v1
Load Balancer

v1v2 v1
Load Balancer

v2v2 v1
Load Balancer

v2v2v2
Load Balancer

v2v2 v2
Load Balancer

Health Tracking – Catch deployment problems
v2v2 v2
Load Balancer

Health tracking – Catch deployment problems
v3 v2 v2Stop
Load Balancer

Health tracking – Catch deployment problems
v2v2 v2
Load Balancer
Rollback

Demo: CodeDeploy & Atlassian Bamboo

Shipping artifacts to new environments
• What if we can quickly and easily build new environments
every time?
• CloudFormation
– Deploying AMIs
– Deploying containers
– ECS
• CodeDeploy to manage discrete application versions

Shipping artifacts – Discrete environments
AWS CloudFormation
Discrete stacks
Amazon
Route53
CI / Release
management

Shipping artifacts – Immutability via containers
ECS cluster
Amazon EC2
Container Service
Immutable infrastructure with Docker and
Amazon EC2 Container Service (ECS)

Shipping artifacts – Immutability via containers
ECS now supports ELB, health checks,
scale-up and scale-down and update
management
ECS Task
Definition
ECS cluster with tasks

ECS Task Definitions
{
"containerDefinitions": [
{
"name": "wordpress",
"links": [
"mysql"
],
"image": "wordpress",
"essential": true,
"portMappings": [
{
"containerPort": 80,
"hostPort": 80
}
],
"memory": 500,
"cpu": 10
},
{
"environment": [
{
"name": "MYSQL_ROOT_PASSWORD",
"value": "password"
}
],
"name": "mysql",
"image": "mysql",
"cpu": 10,
"memory": 500,
"essential": true
}
],
"family": "hello_world"
}

Demo: Docker with AWS ECS & 
Atlassian Bamboo

Futures: what are you really deploying?
• Application bundles?
• AMIs?
• Docker containers?
• Lambda functions?
• Microservices architectures

Featherweight compute abstractions
• Lambda and compute-less architectures
– Short lived microservices
– Event driven compute / architectures
• ECS tasks
– Short lived + Long lived microservices
• Elastic Beanstalk containers
– Long lived microservices

• Service-Oriented
Architecture (SOA) 
• Everything gets a
service interface 
• Primitives 
• “Microservices”

Thousands of teams + 
 
Microservices architecture +
Multiple environments +
Continuous delivery

= 50 million deployments a year
Thousands of teams + 
 
Microservices architecture +
Multiple environments +
Continuous delivery

Continuous Delivery @ Outsmart Games
Taking it to the next level with Blood Gate
Nathan Smith, Technical Director

How do we enable rapid
delivery of updates to
Blood Gate?

Delivering Mobile App
QA ☑
1 week+
1 hour
AppStore

Content Manager Publishing
S3 & CloudFront < 1 min
Designers
/Artists
/Publishers
QA

Content Manager CI/CD
Elastic Beanstalk
Dev (Build System)

Backend Services
• Multiplayer
• Anti-cheat
• Multiple Devices
• Social

Microservices Architecture
Deployment

Service A
Edge
Middle Tier
Service B Worker
Admin
Deployment

Dynamic Configuration
Archaius
DynamoDB
?

Service Discovery
Route 53 ELB

Failure Isolation & Monitoring

Alerting on Failure
Cloud Watch

Delivering Microservices
Dev Docker Hub
(Build System)

Delivering Microservices
Elastic Beanstalk
Dev Docker Hub
Ops
Success? /
Rollback?Cloud Watch
(Build System)

Future
• Further automation
• Lambda
• Instances with multiple containers

Summary
1. Cloud Build
2. Content Manager
3. Microservices Backend

Outcomes
• Milestone every 2 weeks
• Tooling for Designers/Artists/Publishers
• Game goes live soon!

Thank you!
Nathan Smith, Technical Director
nathan.smith@outsmartgames.com

Where to go next…
• AWS Training & Certification
– http://aws.amazon.com/training/
• Deployment and Management at AWS
– http://aws.amazon.com/application-management/
• Code Management and Deployment
– https://aws.amazon.com/blogs/aws/code-management-and-
deployment/
• Amazon EC2 Container Service
– http://aws.amazon.com/ecs/

Managing Your Application Lifecycle on AWS: Continuous Integration and Deployment

Managing Your Application Lifecycle on AWS: Continuous Integration and Deployment

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

En vedette

En vedette (20)

Similaire à Managing Your Application Lifecycle on AWS: Continuous Integration and Deployment

Similaire à Managing Your Application Lifecycle on AWS: Continuous Integration and Deployment (20)

Plus de Amazon Web Services

Plus de Amazon Web Services (20)

Dernier

Dernier (20)

Managing Your Application Lifecycle on AWS: Continuous Integration and Deployment