1. Continuous Deployment
Tiago Henriques
Solutions Architect, Amazon Web Services

2. CONTINUOUS
INTEGRATION

3. DEVELOPER

4. SOURCE CODE
REPOSITORY

5. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER

6. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
PROJECT MANAGEMENT
SERVER

7. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
PROJECT MANAGEMENT
SERVER
PICK
TASKS

8. SOURCE CODE
REPOSITORY
SUBMIT
CODE
CONTINUOUS
INTEGRATION SERVER
PROJECT MANAGEMENT
SERVER

9. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
SCHEDULE
BUILD
PROJECT MANAGEMENT
SERVER

10. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
RECURRENT
BUILDS
PROJECT MANAGEMENT
SERVER

11. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
CODE
FETCH
PROJECT MANAGEMENT
SERVER

12. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
CODE QUALITY
TESTS
PROJECT MANAGEMENT
SERVER
TEST
RESULTS

13. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
BUILD OUTPUT
PROJECT MANAGEMENT
SERVER

14. SOURCE CODE
REPOSITORY
DOCS
CONTINUOUS
INTEGRATION SERVER
BINARIES
& PACKAGES
PROJECT MANAGEMENT
SERVER

16. SOURCE CODE
REPOSITORY
BUILDS
CONTINUOUS
INTEGRATION SERVER
DNS
PROJECT
MANAGEMENT SERVER

17. PAIN POINTS
•
•
•
•
•
UNIT TESTS INCOMPLETE
MOCK TESTS MAINTENANCE
EXPENSIVE TEST ENVIRONMENT
TEST ENVIRONMENT ≠ PRODUCTION
DEPLOYMENT CYCLES

18. ON-DEMAND
ELASTIC
PAY AS YOU GO

19. =
PROGRAMMABLE
PLATFORM

23. IF YOU CAN PROGRAM IT
YOU CAN AUTOMATE IT

24. AWS
CLOUDFORMATION
STACK-BASED DEPLOYMENT
SERVICE

25. CLOUDFORMATION
TEMPLATE

27. {
"Description" : "Create RDS with username and password",
"Resources" : {
"MyDB" : {
"Type" : "AWS::RDS::DBInstance",
"Properties" : {
"AllocatedStorage" : "500",
"DBInstanceClass" : "db.m1.small",
"Engine" : "MySQL",
"EngineVersion" : "5.5",
"MasterUsername" : "MyName",
"MasterUserPassword" : "MyPassword"
}
}
}
}

28. "AWS::CloudFormation::Init" : {
"config" : {
"packages" : {
"yum" : {
"mysql"
: [],
"mysql-server" : [],
"httpd"
: [],
"php"
: [],
"php-mysql"
: []
}
},
"sources" : {
"/var/www/html" :
"https://s3.amazonaws.com/my-builds/build-v4.zip"
}
}

29. {
"Parameters" : {
"KeyName" : {
"Description" : "Name of an existing EC2
KeyPair to enable SSH
access to the instance",
"Type" : "String"
}
},
}

30. PROCEDURAL
DEFINITION
KNOWN
CONFIGURATION
Create it programmatically
Store stack configuration in
source control
CLOUDFORMATION
TEMPLATE
PARAMETER
DRIVEN
Dynamic and user-driven
templates
COLLABORATION
Share templates with ease
as just files

32. APPLICATION
VERSIONS
+
INFRASTRUCTURE
VERSIONS

33. CLOUDFORMATION
TEMPLATE

38. HTTP://SORCERY.SMUGMUG.COM/

39. TEST ENVIRONMENTS

40. 30,000 REQUESTS / SECOND
1 TB TRAFFIC / DAY

41. “…AWS seemed to be the best solution available to allow a
small, independent company to rapidly develop and test a
completely new infrastructure, and host it.
We also loved the flexibility that AWS allowed us, when
spinning up smaller test environments, for beta trials, QA,
localization, and during development. The low initial cost
was also crucial.”
Alex Evans, CTO

42. LOAD TESTING

48. USING AMAZON EC2 TO SIMULATE
2.4 MILLION PLAYERS

49. CONTINUOUS
DEPLOYMENT
SMALL, FREQUENT CHANGES
CONSTANTLY INTEGRATING INTO
PRODUCTION

51. KEY = ITERATION

52. ITERATION
=
MODIFY THE SYSTEM TO BETTER
MEET THE EXPECTATIONS OF
YOUR USERS

53. DEPLOYMENTS AT
AMAZON.COM
11.6s
1,079
10,000
30,000
Mean time
between
deployments
(weekday)
Max number of
deployments in a
single hour
Mean number of
hosts
simultaneously
receiving a
deployment
Max number of
hosts
simultaneously
receiving a
deployment

54. SOFTWARE DEPLOY
≠
PRODUCT LAUNCH

56. 1.5 BILLION PAGE VIEWS
$83 MILLION IN TRANSACTIONS
4.2 MILLION ITEMS SOLD
OCTOBER 2012

57. 30 DEPLOYS PER DAY
1 DEPLOY EVERY 20 MINUTES

58. "Production is truly the only place you
can validate your code."

62. AWS OPSWORKS
INTEGRATED APPLICATION
MANAGEMENT

64. 14 BILLION REQUESTS/MONTH
50 000 DATABASE UPDATES / SEC
NO CACHE

65. A / B TESTING

70. DATA-DRIVEN
ARCHITECTURES

71. METRICS @ETSY

72. COST-ORIENTED
ARCHITECTURES

73. PHP+APACHE+VARNISH
NGINX+NODEJS

75. CONTINUOUS
DEPLOYMENT
CONTINUOUS
INTEGRATION

76. Continuous Deployment
Tiago Henriques
Solutions Architect, Amazon Web Services

77. CONTINUOUS
DEPLOYMENT
=
CONTINUOUS
EXPERIMENTATION

78. CONTINUOUS
DEPLOYMENT
=
CONTINUOUS
IMPROVEMENT

79. INNOVATE

80. « Want to increase innovation?
Lower the cost of failure »
Joi Ito

81. SPEED AND AGILITY
“ON-PREMISE”
Experiment
Infrequently
Experiment
Often
Failure is
expensive
Fail quickly at
a low cost
Less
Innovation
More
Innovation

82. TEST ENVIRONMENTS ON DEMAND

83. ODIGEO GROUP
ODIGEO Group, creado en Julio 2011, está formado
por eDreams, GO Voyages, Opodo y Travellink.
ODIGEO Group actualmente opera y ofrece sus
servicios en un total de 38 paises.
En 2011, servimos conjuntamente 14 milliones de
clientes y 3.9 Billion en Reservas.
Somos más de 1400 empleados. Y más de 300
empleados en el equipo de IT.
Más de 80 nuevos miebrss en el equipo de IT en el
último año.

84. CI
•
•
•
•
•
•
CI Server
Plugin jenkins – Amazon EC2
VCS: SVN y Bitbucket.
1 job por rama de desarrollo.
Cada commit lanza una ejecución de los jobs.
La CI está compuesta por:
• Métricas de calidad.
• Test unitarios.
• Test automáticos.
• Publicación de artefactos.

85. Entornos de test
Problema
• Incremento del equipo de IT
• No disponibilidad de entornos de test.
Requerimientos
•
•
•
•
•
Creación de los entornos bajo demanda.
Gestión de los entornos por los usuarios.
Los entornos sin actividad se deben autodestruir.
Sin límite de entornos de test concurrentes.
Start/Stop automáticos.

86. QAM
Solución
•
•
•
•
•
Amazon EC2
Tenemos una ami con la configuración del entorno.
Configuración por puppet del entorno.
La versión de software se descarga de Nexus.
Aplicación de gestión desarrollada en colaboración
con Celingest
• Gestión de usuarios.
• Auditaría del uso y consumo.
• Control de instancias, número y tiempo.