Join this webinar for a deep dive on the speed and agility of the AWS cloud which allows you to access resources faster.

1. Building Agile Applications using
Continuous Integration & Deployment
on AWS
Leo Zhadanovsky
Senior Solutions Architect

2. CONTINUOUS
INTEGRATION

3. What is Continuous Integration?
Changes to code automatically deployed to mainline branch
• After passing unit and mock tests
Makes changes to code, and deployments iterative, not
monolithic
Bugs are detected quickly
Allows rapid development
Helps automate deployments

4. DEVELOPER

5. SOURCE CODE
REPOSITORY

6. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER

7. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER

8. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER
PICK
TASKS

9. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER
SUBMIT
CODE

10. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER
SCHEDULE
BUILD

11. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER
RECURRENT
BUILDS

12. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER
CODE
FETCH

13. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER
CODE QUALITY
TESTS
TEST
RESULTS

14. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER
BUILD OUTPUT

15. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER
DOCS
BINARIES
& PACKAGES
DEV FACING
NOTIFICATIONS

17. SOURCE CODE
REPOSITORY
DNS
CONTINUOUS
INTEGRATION SERVER
PROJECT
MANAGEMENT SERVER
BUILDS

18. New AWS Managed Options
CodeDeploy
• Deploy your code to hundreds or thousands of instances
CodeCommit
• AWS Managed Git Hosting
CodePipelines
• AWS Managed Continuous Integration System

19. Cloud Software Development Lifecycle
10/13/14 19
MonitorProvisionDeployTestBuildCode
Elastic Beanstalk
OpsWorks
Cloud
Watch
Cloud
Formation
?

20. Why?
Customers are asking
Share Amazon tools and processes with customers
Showcase and integrate AWS partner tools
9/25/14 20

21. Source Control
Private Git repositories hosted on Amazon S3
Full Git compatibility (use with existing tools)
All the benefits of the cloud
(scalable, durable, reliable, low pay as you go pricing)
No size limits on repositories (store binary files)
Online code tools with browse, edit, diff
10/13/14 21

23. Continuous Delivery
Customizable release automation, with integrated build and test
Model and visualize custom release workflow
(source  build  beta  gamma  prod)
Automate builds, tests, and deployments
Enforce custom rules, approvals, and gates
Integrate with third-party and custom tools
10/13/14 23

25. Deployment
Coordinate software updates to fleets of EC2 instances
Rolling updates for no downtime
Deployment health checks and easy rollback
Auto Scaling integration
Works with any application
Reuse existing setup tools
(Bash, Powershell, Chef, Puppet…)
10/13/14 25

26. 9/25/14 Slides not intended for 26

27. Cloud Software Development Lifecycle
10/13/14 27
MonitorProvisionDeployTestBuildCode
Elastic Beanstalk
OpsWorks
Cloud
Watch
Cloud
Formation
Code
Deploy
Code
Commit
Code
Pipeline

28. PAIN POINTS
• UNIT TESTS INCOMPLETE
• MOCK TESTS MAINTENANCE
• EXPENSIVE TEST ENVIRONMENT
• TEST ENVIRONMENT ≠ PRODUCTION
• DEPLOYMENT CYCLES

29. ON-DEMAND
PAY AS YOU GO
ELASTIC

30. =
PROGRAMMABLE
PLATFORM

33. IF YOU CAN PROGRAM IT
YOU CAN AUTOMATE IT

34. A lot of options…
Configuration Management Systems
• Puppet
• Chef
• Saltstack
Deployment Frameworks
• Elastic Beanstalk
• OpsWorks
• Ansible
• Fabric
• Capistrano
Infrastructure Management
• CloudFormation

35. Bake an AMI Configure dynamically
Time consuming
configuration (startup time)
Static configurations (less
change management)
Bootstrapping

36. Bake an AMI Configure dynamically
Continuous deployment
(latest code)
Environment specific (dev-
test-prod)
Bootstrapping

37. Obama for America
awsofa.info

38. Web-Scale Applications

39. 500k+ IOPS DB Systems

40. Services API

42. Typical Charts

44. How?

45. Ingredients
Ubuntu nginx boundary Unity jQuery SQLServer hbase NewRelic
EC2 node.js Cybersource hive ElasticSearch Ruby Twilio EE S3
ELB boto Magento PHP EMR SES Route53 SimpleDB Campfire
nagios Paypal CentOS CloudSearch levelDB mongoDB python
securitygroups Usahidhi PostgresSQL Github apache bootstrap
SNS OpsView Jekyll RoR EBS FPS VPC Mashery Vertica RDS
Optimizely MySQL puppet tsunamiUDP R asgard cloudwatch
ElastiCache cloudopt SQS cloudinit DirectConnect BSD rsync STS
Objective-C DynamoDB

46. Infrastructure, Configuration
Management & Monitoring
Ubuntu nginx boundary Unity jQuery SQLServer hbase NewRelic
EC2 node.js Cybersource hive ElasticSearch Ruby Twilio EE S3
ELB boto Magento PHP EMR SES Route53 SimpleDB Campfire
nagios Paypal CentOS CloudSearch levelDB mongoDB python
securitygroups Usahidhi PostgresSQL Github apache bootstrap
SNS OpsView Jekyll RoR EBS FPS VPC Mashery Vertica RDS
Optimizely MySQL puppet tsunamiUDP R asgard cloudwatch
ElastiCache cloudopt SQS cloudinit DirectConnect BSD rsync STS
Objective-C DynamoDB

47. One thing that is difficult to prepare for…

48. They had this built for the previous 3 months, a
on the East Coast.

49. They had this built for the previous 3 months, a
on the East Coast.
We built this part in
9 hours to be safe.
AWS +
Puppet +
Netflix Asgard +
WAN Optimization Software +
DevOps =
Cross-Continent Fault-
Tolerance On-Demand

50. Mozilla Foundation

51. Webmaker.org circa 2012
• Included Apps, non-SOA: Thimble, Popcorn, Goggles
• ~20 pushes of new software in 2012
• Operations and Development interacted mostly through bugzilla
tickets for deploys.
• Hosting in physical datacenter at Mozilla
Webmaker.org circa early 2013
• Deciding to go 12-factor, SOA in app layer
• Weekly pushes of Popcorn on train model
• Operations and Development interacted mostly through bugzilla
tickets for deploys.

52. April 2013
Webmaker begins rebuilding entire platform
SOA, 12-factor in node.js exclusively
Moving apps into AWS and DevOps / CI

53. Since April 2013….
Openbadges, Webmaker combine for: 1339 Pushes
Pushes Per Day to Staging / Prod
Pushes Per Day (Staging and Prod)

54. Who?
• ~30 Paid Developers
• Hundreds of Students
• Thousands of Contributors
• One DevOps / Internet Jedi
• Multiple Teams
How?
• Puppet, Jenkins, Fabric
• Tight feedback loops:
Newrelic, Opsview
• Culture Shift
• Staging Envs
• Brave devs iterate,
keeping work in-context
• Visible Ops
• Cross-train developers in
operations

55. What changed?

56. 1) Know How You Were Doing Before
2) Know What Changed When
3) Know How You Are Now Doing
=
The confidence to try more things
and try them faster, with minimum
viable planning.

57. Deployment
Pipeline

58. AWS
CLOUDFORMATION
STACK-BASED DEPLOYMENT
SERVICE

59. CLOUDFORMATION
TEMPLATE

61. {
"Description" : "Create RDS with username and password",
"Resources" : {
"MyDB" : {
"Type" : "AWS::RDS::DBInstance",
"Properties" : {
"AllocatedStorage" : "500",
"DBInstanceClass" : "db.m1.small",
"Engine" : "MySQL",
"EngineVersion" : "5.5",
"MasterUsername" : "MyName",
"MasterUserPassword" : "MyPassword"
}
}
}
}

62. "AWS::CloudFormation::Init" : { "config" : {
"packages" : {
"yum" : {
"mysql" : [],
"mysql-server" : [],
"httpd" : [],
"php" : [],
"php-mysql" : []
}
},
"sources" : {
"/var/www/html" :
"https://s3.amazonaws.com/my-builds/build-v4.zip"
}
}

63. {
"Parameters" : {
"KeyName" : {
"Description" : "Name of an existing EC2
KeyPair to enable SSH
access to the instance",
"Type" : "String"
}
},
}

64. CLOUDFORMATION
TEMPLATE
PROCEDURAL
DEFINITION
Create it programmatically
KNOWN
CONFIGURATION
Store stack configuration in
source control
PARAMETER
DRIVEN
Dynamic and user-driven
templates
COLLABORATION
Share templates with ease
as just files

66. APPLICATION
VERSIONS
+
INFRASTRUCTURE
VERSIONS

67. CLOUDFORMATION
TEMPLATE

68. LOAD TESTING

71. Benchmarking

72. US-East Cache Node Performance 25.3 Gbps

73. Only ~42Mbps
Impact on US-East FMS Origin Servers

75. CONTINUOUS
DEPLOYMENT
SMALL, FREQUENT CHANGES
CONSTANTLY INTEGRATING INTO
PRODUCTION.

76. KEY = ITERATION

77. ITERATION
=
MODIFY THE SYSTEM TO BETTER
MEET THE EXPECTATIONS OF
YOUR USERS

78. 11.6s
Mean time
between
deployments
(weekday)
1,079
Max number of
deployments in a
single hour
10,000
Mean number of
hosts
simultaneously
receiving a
deployment
30,000
Max number of
hosts
simultaneously
receiving a
deployment
DEPLOYMENTS AT
AMAZON.COM

79. SOFTWARE DEPLOY
≠
PRODUCT LAUNCH

81. 1.5 BILLION PAGE VIEWS
OCTOBER 2012
$83 MILLION IN TRANSACTIONS
4.2 MILLION ITEMS SOLD

82. 30 DEPLOYS PER DAY
1 DEPLOY EVERY 20 MINUTES

83. "Production is truly the only place you
can validate your code."

88. DATA-DRIVEN
ARCHITECTURES

89. METRICS @ETSY

90. METRICS @OBAMA FOR AMERICA

91. COST-ORIENTED
ARCHITECTURES

92. PHP+APACHE+VARNISH
NGINX+NODEJS

94. CONTINUOUS
INTEGRATION
CONTINUOUS
DEPLOYMENT

95. CONTINUOUS
DEPLOYMENT
=
CONTINUOUS
EXPERIMENTATION

96. CONTINUOUS
DEPLOYMENT
=
CONTINUOUS
IMPROVEMENT

97. INNOVATE

98. « Want to increase innovation?
Lower the cost of failure »
Joi Ito

99. SPEED AND AGILITY
Experiment
Often
Fail quickly at
a low cost
More
Innovation
Experiment
Infrequently
Failure is
expensive
Less
Innovation
“ON-PREMISE”