Join this webinar for a deep dive on the speed and agility of the AWS cloud which allows you to access resources faster.

1. Building Agile Applications using
Continuous Integration & Deployment
on AWS
Leo Zhadanovsky
Senior Solutions Architect

2. What is Continuous Integration?
Changes to code automatically deployed to mainline branch
• After passing unit and mock tests
Makes changes to code, and deployments iterative, not
monolithic
Bugs are detected quickly
Allows rapid development
Helps automate deployments

3. DEVELOPER

4. SOURCE CODE
REPOSITORY

5. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER

6. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER

7. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER
PICK
TASKS

8. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER
SUBMIT
CODE

9. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER
SCHEDULE
BUILD

10. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER
RECURRENT
BUILDS

11. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER
CODE
FETCH

12. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER
CODE QUALITY
TESTS
TEST
RESULTS

13. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER
BUILD OUTPUT

14. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER
CONTINUOUS
INTEGRATION SERVER
DOCS
BINARIES
& PACKAGES
DEV FACING
NOTIFICATIONS

15. SOURCE CODE
REPOSITORY
DNS
CONTINUOUS
INTEGRATION SERVER
PROJECT
MANAGEMENT SERVER
BUILDS

16. New AWS Managed Options
CodeDeploy
• Deploy your code to hundreds or thousands of instances
CodeCommit
• AWS Managed Git Hosting
CodePipelines
• AWS Managed Continuous Integration System

17. Cloud Software Development Lifecycle
10/13/14 17
MonitorProvisionDeployTestBuildCode
Elastic Beanstalk
OpsWorks
Cloud
Watch
Cloud
Formation
?

18. Why?
Customers are asking
Share Amazon tools and processes with customers
Showcase and integrate AWS partner tools
9/25/14 18

19. Source Control
Private Git repositories hosted on Amazon S3
Full Git compatibility (use with existing tools)
All the benefits of the cloud
(scalable, durable, reliable, low pay as you go pricing)
No size limits on repositories (store binary files)
Online code tools with browse, edit, diff
10/13/14 19

21. Continuous Delivery
Customizable release automation, with integrated build and test
Model and visualize custom release workflow
(source  build  beta  gamma  prod)
Automate builds, tests, and deployments
Enforce custom rules, approvals, and gates
Integrate with third-party and custom tools
10/13/14 21

23. Deployment
Coordinate software updates to fleets of EC2 instances
Rolling updates for no downtime
Deployment health checks and easy rollback
Auto Scaling integration
Works with any application
Reuse existing setup tools
(Bash, Powershell, Chef, Puppet…)
10/13/14 23

24. 9/25/14 Slides not intended for 24

25. Cloud Software Development Lifecycle
10/13/14 25
MonitorProvisionDeployTestBuildCode
Elastic Beanstalk
OpsWorks
Cloud
Watch
Cloud
Formation
Code
Deploy
Code
Commit
Code
Pipeline

26. PAIN POINTS
• UNIT TESTS INCOMPLETE
• MOCK TESTS MAINTENANCE
• EXPENSIVE TEST ENVIRONMENT
• TEST ENVIRONMENT ≠ PRODUCTION
• DEPLOYMENT CYCLES

27. ON-DEMAND
PAY AS YOU GO
ELASTIC

28. =
PROGRAMMABLE
PLATFORM

31. A lot of options…
Configuration Management Systems
• Puppet
• Chef
• Saltstack
Deployment Frameworks
• Elastic Beanstalk
• OpsWorks
• Ansible
• Fabric
• Capistrano
Infrastructure Management
• CloudFormation

32. Bake an AMI Configure dynamically
Time consuming
configuration (startup time)
Static configurations (less
change management)
Bootstrapping

33. Bake an AMI Configure dynamically
Continuous deployment
(latest code)
Environment specific (dev-
test-prod)
Bootstrapping

34. Obama for America
awsofa.info

35. Web-Scale Applications

36. 500k+ IOPS DB Systems

37. Services API

39. Typical Charts

41. Ingredients
Ubuntu nginx boundary Unity jQuery SQLServer hbase NewRelic
EC2 node.js Cybersource hive ElasticSearch Ruby Twilio EE S3
ELB boto Magento PHP EMR SES Route53 SimpleDB Campfire
nagios Paypal CentOS CloudSearch levelDB mongoDB python
securitygroups Usahidhi PostgresSQL Github apache bootstrap
SNS OpsView Jekyll RoR EBS FPS VPC Mashery Vertica RDS
Optimizely MySQL puppet tsunamiUDP R asgard cloudwatch
ElastiCache cloudopt SQS cloudinit DirectConnect BSD rsync STS
Objective-C DynamoDB

42. Infrastructure, Configuration
Management & Monitoring
Ubuntu nginx boundary Unity jQuery SQLServer hbase NewRelic
EC2 node.js Cybersource hive ElasticSearch Ruby Twilio EE S3
ELB boto Magento PHP EMR SES Route53 SimpleDB Campfire
nagios Paypal CentOS CloudSearch levelDB mongoDB python
securitygroups Usahidhi PostgresSQL Github apache bootstrap
SNS OpsView Jekyll RoR EBS FPS VPC Mashery Vertica RDS
Optimizely MySQL puppet tsunamiUDP R asgard cloudwatch
ElastiCache cloudopt SQS cloudinit DirectConnect BSD rsync STS
Objective-C DynamoDB

43. One thing that is difficult to prepare for…

44. They had this built for the previous 3 months, a
on the East Coast.
We built this part in
9 hours to be safe.
AWS +
Puppet +
Netflix Asgard +
WAN Optimization Software +
DevOps =
Cross-Continent Fault-
Tolerance On-Demand

45. Mozilla Foundation

46. Webmaker.org circa 2012
• Included Apps, non-SOA: Thimble, Popcorn, Goggles
• ~20 pushes of new software in 2012
• Operations and Development interacted mostly through bugzilla
tickets for deploys.
• Hosting in physical datacenter at Mozilla
Webmaker.org circa early 2013
• Deciding to go 12-factor, SOA in app layer
• Weekly pushes of Popcorn on train model
• Operations and Development interacted mostly through bugzilla
tickets for deploys.

47. April 2013
Webmaker begins rebuilding entire platform
SOA, 12-factor in node.js exclusively
Moving apps into AWS and DevOps / CI

48. Since April 2013….
Openbadges, Webmaker combine for: 1339 Pushes
Pushes Per Day to Staging / Prod
Pushes Per Day (Staging and Prod)

49. Who?
• ~30 Paid Developers
• Hundreds of Students
• Thousands of Contributors
• One DevOps / Internet Jedi
• Multiple Teams
How?
• Puppet, Jenkins, Fabric
• Tight feedback loops:
Newrelic, Opsview
• Culture Shift
• Staging Envs
• Brave devs iterate,
keeping work in-context
• Visible Ops
• Cross-train developers in
operations

50. What changed?

51. 1) Know How You Were Doing Before
2) Know What Changed When
3) Know How You Are Now Doing
=
The confidence to try more things
and try them faster, with minimum
viable planning.

52. Deployment
Pipeline

53. CLOUDFORMATION
TEMPLATE

55. {
"Description" : "Create RDS with username and password",
"Resources" : {
"MyDB" : {
"Type" : "AWS::RDS::DBInstance",
"Properties" : {
"AllocatedStorage" : "500",
"DBInstanceClass" : "db.m1.small",
"Engine" : "MySQL",
"EngineVersion" : "5.5",
"MasterUsername" : "MyName",
"MasterUserPassword" : "MyPassword"
}
}
}
}

56. "AWS::CloudFormation::Init" : { "config" : {
"packages" : {
"yum" : {
"mysql" : [],
"mysql-server" : [],
"httpd" : [],
"php" : [],
"php-mysql" : []
}
},
"sources" : {
"/var/www/html" :
"https://s3.amazonaws.com/my-builds/build-v4.zip"
}
}

57. {
"Parameters" : {
"KeyName" : {
"Description" : "Name of an existing EC2
KeyPair to enable SSH
access to the instance",
"Type" : "String"
}
},
}

58. CLOUDFORMATION
TEMPLATE
PROCEDURAL
DEFINITION
Create it programmatically
KNOWN
CONFIGURATION
Store stack configuration in
source control
PARAMETER
DRIVEN
Dynamic and user-driven
templates
COLLABORATION
Share templates with ease
as just files

60. APPLICATION
VERSIONS
+
INFRASTRUCTURE
VERSIONS

61. CLOUDFORMATION
TEMPLATE

62. LOAD TESTING

64. Benchmarking

65. US-East Cache Node Performance 25.3 Gbps

66. Only ~42Mbps
Impact on US-East FMS Origin Servers

68. CONTINUOUS
DEPLOYMENT
SMALL, FREQUENT CHANGES
CONSTANTLY INTEGRATING INTO
PRODUCTION.

69. KEY = ITERATION

70. ITERATION
=
MODIFY THE SYSTEM TO BETTER
MEET THE EXPECTATIONS OF
YOUR USERS

71. 11.6s
Mean time
between
deployments
(weekday)
1,079
Max number of
deployments in a
single hour
10,000
Mean number of
hosts
simultaneously
receiving a
deployment
30,000
Max number of
hosts
simultaneously
receiving a
deployment
DEPLOYMENTS AT
AMAZON.COM

72. SOFTWARE DEPLOY
≠
PRODUCT LAUNCH

74. 1.5 BILLION PAGE VIEWS
OCTOBER 2012
$83 MILLION IN TRANSACTIONS
4.2 MILLION ITEMS SOLD

75. 30 DEPLOYS PER DAY
1 DEPLOY EVERY 20 MINUTES

76. "Production is truly the only place you
can validate your code."

81. DATA-DRIVEN
ARCHITECTURES

82. METRICS @ETSY

83. METRICS @OBAMA FOR AMERICA

84. COST-ORIENTED
ARCHITECTURES

85. PHP+APACHE+VARNISH
NGINX+NODEJS

87. CONTINUOUS
INTEGRATION
CONTINUOUS
DEPLOYMENT

88. CONTINUOUS
DEPLOYMENT
=
CONTINUOUS
EXPERIMENTATION

89. CONTINUOUS
DEPLOYMENT
=
CONTINUOUS
IMPROVEMENT

90. INNOVATE

91. « Want to increase innovation?
Lower the cost of failure »
Joi Ito

92. SPEED AND AGILITY
Experiment
Often
Fail quickly at
a low cost
More
Innovation
Experiment
Infrequently
Failure is
expensive
Less
Innovation
“ON-PREMISE”