5. 503
Service Temporarily Unavailable
The server is temporarily unable
to service your request due to
maintenance downtime or capacity
problems. Please try again later.
6. 503
Service Temporarily Unavailable
The server is temporarily unable
to service your request due to
maintenance downtime or capacity
problems. Please try again later.
26. 21st Century Architectures
Build systems the way you always wanted to,
but never could
Secure
High performance
Fault Tolerant
Scalable
Cost-effective
32. Massive Mismatches
It is Out of Control Enterprise Internet
Project Cycles Years Hours
Project Life Spans Decades Months
Project Frequencies 101 - 102 106
Investment Decision Cycles Mythical Person-Months Impulse
Implementation Scale Enterprise Global
Decision Process Orderly Centralized Chaotic Individualized
39. Before
Customer Amazon Web Server
Generic S3
HTML Puller
S3
HTML
Store
After
Amazon Web Server
Render Process
Service Call IMDB
Service
IMDB
Database
Customer
49. seconds mean time between
deployments (weekday)
Max number of deployments in a
single hour
Mean number of hosts
simultaneously receiving
a deployment
Max number of hosts
simultaneously
receiving a deployment
11.6 1,079
10,000 30,000
Deployments at Amazon.com
50. Load Balancer
WWW1 WWW2 WWW3 WWWn
Availability Zone 1
WWW1 WWW2 WWW3 WWWn
Availability Zone 2
WWW1 WWW2 WWW3 WWWn
Availability Zone 3
51. Load Balancer
WWW1 WWW2 WWW3 WWWn
Availability Zone 1
WWW1 WWW2 WWW3 WWWn
Availability Zone 2
WWW1 WWW2 WWW3 WWWn
Availability Zone 3
52. Load Balancer
WWW1 WWW2 WWW3 WWWn
Availability Zone 1
WWW1 WWW2 WWW3 WWWn
Availability Zone 2
WWW1 WWW2 WWW3 WWWn
Availability Zone 3
53. Load Balancer
WWW1 WWW2 WWW3 WWWn
Availability Zone 1
WWW1 WWW2 WWW3 WWWn
Availability Zone 2
WWW1 WWW2 WWW3 WWWn
Availability Zone 3
54. Load Balancer
WWW1 WWW2 WWW3 WWWn
Availability Zone 1
WWW1 WWW2 WWW3 WWWn
Availability Zone 2
WWW1 WWW2 WWW3 WWWn
Availability Zone 3
55. Load Balancer
WWW1 WWW2 WWW3 WWWn
Availability Zone 1
WWW1 WWW2 WWW3 WWWn
Availability Zone 2
WWW1 WWW2 WWW3 WWWn
Availability Zone 3
56. Load Balancer
WWW1 WWW2 WWW3 WWWn
Availability Zone 1
Availability Zone 2
Availability Zone 3
WWW2 WWWnWWW3WWW1
WWW2 WWWnWWW3WWW1
WWW1 WWW2 WWW3 WWWn
Availability Zone 1
Availability Zone 2
Availability Zone 3
WWW2 WWWnWWW3WWW1
WWW2 WWWnWWW3WWW1
57. Load Balancer
WWW1 WWW2 WWW3 WWWn
Availability Zone 1
Availability Zone 2
Availability Zone 3
WWW2 WWWnWWW3WWW1
WWW2 WWWnWWW3WWW1
WWW1 WWW2 WWW3 WWWn
Availability Zone 1
Availability Zone 2
Availability Zone 3
WWW2 WWWnWWW3WWW1
WWW2 WWWnWWW3WWW1
58. Load Balancer
WWW1 WWW2 WWW3 WWWn
Availability Zone 1
Availability Zone 2
Availability Zone 3
WWW2 WWWnWWW3WWW1
WWW2 WWWnWWW3WWW1
WWW1 WWW2 WWW3 WWWn
Availability Zone 1
Availability Zone 2
Availability Zone 3
WWW2 WWWnWWW3WWW1
WWW2 WWWnWWW3WWW1
72. Controllable
Architect with
cost in mind
Adaptive
Make no
assumtpions
Resilient
Don’t treat failure
as an exception
Data-driven
Put everything
in logs