SlideShare une entreprise Scribd logo
1  sur  124
Télécharger pour lire hors ligne
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Scaling Up to Your First
10 Million Users
Ben Thurgood
Principal Solutions Architect
Amazon Web Services
A R C 2 0 5
http://i.telegraph.co.uk/multimedia/archive/02674/CLIMBER_2674482b.jp
g
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Now that’s a lot of
things to read!
This is NOT
where we want to
start!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
It’s not the single thing that fixes everything
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What do we need first?
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS global infrastructure
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon global edge network
136+ edge locations
and caches
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Robust, fully featured technology infrastructure
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS building blocks
Amazon CloudFront
Amazon Route 53
Amazon Simple Storage
Service (Amazon S3)
Amazon DynamoDB
Elastic Load Balancing
Amazon Elastic File
System (Amazon EFS)
AWS Lambda
Amazon Simple Queue
Service (Amazon SQS)
Amazon Simple
Notification Service
(Amazon SNS)
Amazon Simple Email
Service (Amazon SES)
AWS Step Functions
. . .
Highly scalable, available with
the right architecture
Amazon Elastic Compute
Cloud (Amazon EC2)
Amazon Elastic Block Store
(Amazon EBS)
Amazon Relational Database
Service (Amazon RDS)
Amazon Virtual Private Cloud
(Amazon VPC)
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Considerations
Rex Boggs
https://creativecom
mons.org/licenses/by
-nd/2.0/
“Many decisions are reversible, two-
way doors.”
Jeff Bezos
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Build Measure
Learn
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Guiding tenets
Identify and avoid
undifferentiated heavy lifting
(Wardley maps)
Serverless versus managed
versus run it yourself
https://commons.wikimedia.org/wiki/Category:Yaks_of_Tibet#/media/File:Yak_at_Nam_Tso_Tibet.jpg
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
So let’s start from day . . .
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
You
User
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
One user
VPC
User
Elastic IP
address
Amazon EC2
instance
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Lightsail: The easiest way to get started on AWS
Choose from five plans that include bundled compute,
storage, and networking
Benefit from a low, predictable price
Spin up a fully configured server in seconds
Manage from the intuitive Lightsail console
Scale with access to AWS services
Automate with Lightsail API & AWS Command Line
Interface (AWS CLI)
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Simplest approach
• Can now leverage PIOPS
• High I/O instances
• High memory instances
• High CPU instances
• High storage instances
• Easy to change instance sizes
• Will hit an endpoint eventually t3.nano
m5.2xlarge
c5.9xlarge
“We’re gonna need a bigger box”
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
“We’re gonna need a bigger box”
• Simplest approach
• Can now leverage PIOPS
• High I/O instances
• High memory instances
• High CPU instances
• High storage instances
• Easy to change instance sizes
• Will hit an endpoint eventually t3.nano
m5.2xlarge
c5.9xlarge
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
One user
• No failover
• No redundancy
• Too many eggs in one basket
VPC
User
Elastic IP
address
Amazon EC2
instance
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Users > 1
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Database
instance
VPC
Users > 1
User
Elastic IP
address
Amazon EC2
instance
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Database options
Fully managedSelf-managed
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora
• MySQL or Postgres compatible
• Automatic storage scaling (up to 64 TB)
• Up to 15 read-replicas
• Continuous (incremental) backups to Amazon S3
• Six-way replication across three zones
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora
• MySQL or Postgres compatible
• Automatic storage scaling (up to 64 TB)
• Up to 15 read-replicas
• Continuous (incremental) backups to Amazon S3
• Six-way replication across three zones
• Serverless option
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora Serverless
On-demand,auto-scalingdatabaseforapplicationswithvariableworkloads
Starts up on demand, shuts down when not in use
Automatically scales with no instances to manage
Pay per second for the database capacity you use
Warm capacity
pool
Application
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
To NoSQL, or not to NoSQL?
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Start with SQL databases
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why start with SQL?
• Established and well-known technology
• Lots of existing code, communities, books, and tools
• You aren’t going to break SQL DBs in your first millions of users. No,
really, you won’t*
• Clear patterns to scalability
*Unless you are doing something SUPER peculiar with the data or you have MASSIVE amounts of it.
. . . but even then SQL will have a place in your stack
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AH HA! You said,
“Massive amounts”
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
> 5 TB in year one?
Incredibly data intensive workload?
OK!
You might need NoSQL
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why else might you need NoSQL?
• Super low-latency applications
• Metadata-driven datasets
• Highly nonrelational data
• Need schema-less data constructs*
• Rapid ingest of data (thousands of records/sec)
• Massive amounts of data (again, in the TB range)
• *Need!= “It’s easier to do dev without schemas”
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Users > 1
Registration, Sign
In, and others
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Cognito overview
Web and mobile
apps
Developers focus on what
is special about their app
Amazon Cognito
handles auth and
identity
Federation
Managed user directory
Hosted UI
AWS credentials
Standard tokens
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Security checklist
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Security checklist
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Security checklist
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Security checklist
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Users > 100
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
VPC
Amazon RDS
instance
Users > 100
User
Elastic IP
address
Amazon EC2
instance
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Users > 1000
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
VPC
User
Users > 1000
Amazon RDS DB
instance active (Multi-
AZ)
Web instance
Availability zone
Web instance
Amazon RDS DB
instance standby
(Multi-AZ)
Availability zone
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Sharing the load
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Application Load Balancer
• Highly available
• 1 - 65535
• Health checks
• Session stickiness
• Monitoring / logging
• Content-based routing
• Container-based apps
• WebSockets
• HTTP/2
Recommended
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
horizontally
vertically
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Users >10,000
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
VPC
Availability zone
User
Users > 10,000
Amazon RDS DB
instance active
(Multi-AZ)
Web instance
Amazon RDS DB
instance standby
(Multi-AZ)
Availability zone
Web instance Web instance Web instance Web instance Web instance Web instance Web instance
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
VPC
Availability zone
User
Users > 10,000
Amazon RDS DB
instance active
(Multi-AZ)
Web instance
Amazon RDS DB
instance standby
(Multi-AZ)
Availability zone
Web instance Web instance Web instance Web instance Web instance Web instance Web instance
DB instance read
replica
DB instance read
replica
DB instance read
replica
DB instance read
replica
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Shift some load around
User
Availability zone
Amazon RDS DB instance
active (Multi-AZ)
Amazon RDS DB
instance standby
(Multi-AZ)
VPC
Web instances Web instances
Availability zone
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Simple Storage Service (Amazon S3)
• Object-based storage
• Highly durable
• Great for static assets
• “Infinitely scalable”
• Objects up to 5 TB in size
• Encryption at rest and in transit
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon CloudFront
• Cache content for faster delivery
• Lower load on origin
• Dynamic and static content
• Streaming video
• Custom SSL certificates
• Low TTLs (as short as 0 seconds)
• Optimized for AWS
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon CloudFront
ResponseTime
ServerLoad
ResponseTime
Server
Load
Response
Time
Server
Load
No CDN CDN for static content CDN for static &
dynamic content
0
10
20
30
40
50
60
70
80
VolumeofData
Delivered(Gbps)
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Shift some more load around
VPC
User
Amazon RDS DB instance
active (Multi-AZ)
Availability zones
Web instances
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon ElastiCache
• Managed Memcached or Redis
• Scale from one to many nodes
• Self-healing (replaces dead instance)
• Single-digit ms speeds (usually)
• Local to a single AZ for Memcached
• Multi-AZ possible with Redis
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Shift even more load around
VPC
User
Amazon RDS DB instance
active (Multi-AZ)
Availability zones
Web instances
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon DynamoDB
• Managed NoSQL database
• Provisioned throughput
• Fast, predictable performance
• Fully distributed, fault tolerant
• JSON support
• Items up to 400 KB
• Time-to-live (TTL)
• Streams and triggers
• AWS Application Auto Scaling
• Global tables
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon DynamoDB
• Managed NoSQL database
• Provisioned throughput
• Fast, predictable performance
• Fully distributed, fault tolerant
• JSON support
• Items up to 400 KB
• Time-to-live (TTL)
• Streams and triggers
• AWS Application Auto Scaling
• Global tables
AWS Database
Migration Service
(AWS DMS)!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Now that our web tier is
much more lightweight,
we can revisit the beginning
of our talk . . .
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Auto Scaling!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Sunday Monday Tuesday Wednesday Thursday Friday Saturday
Typical weekly traffic to Amazon.com
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Sunday Monday Tuesday Wednesday Thursday Friday Saturday
Typical weekly traffic to Amazon.com
Provisioned capacity
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
November
November traffic to Amazon.com
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Provisioned capacity
November
November traffic to Amazon.com
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
November traffic to Amazon.com
76%
24%
November
Provisioned capacity
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
November traffic to Amazon.com
November
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Auto Scaling
lets you do this!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Auto Scaling
• Automatic resizing of compute clusters
• Define min/max pool sizes
• Amazon CloudWatch metrics drive scaling
• On-Demand or Spot Instances
aws autoscaling create-auto-scaling-group
--auto-scaling-group-name MyGroup
--launch-configuration-name MyConfig
--min-size 4
--max-size 200
--availability-zones us-west-2c, us-west-2b
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS DB
instance read
replica
Amazon RDS DB
instance read
replica
Amazon RDS DB
instance active (Multi-
AZ)
Auto Scaling group
Users > 500,000
VPC
User
Web instance
Amazon RDS DB
instance standby
(Multi-AZ)
Availability zone
Web instance Web instance
Amazon
ElastiCache
Auto Scaling group
Web instance
Availability zone
Web instance Web instance
Amazon
ElastiCache
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS DB
instance read
replica
Amazon RDS DB
instance read
replica
Amazon RDS DB
instance active (Multi-
AZ)
Auto Scaling group
Users > 500,000
VPC
User
Web Instance
Amazon RDS DB
instance standby
(Multi-AZ)
Availability zone
Web Instance Web Instance
Amazon
ElastiCache
Web Instance
Availability zone
Web Instance Web Instance
Amazon
ElastiCache
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Use automation
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Systems Manager
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS infrastructure automation
Convenience Control
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS infrastructure automation
Convenience Control
Do it yourself
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS infrastructure automation
Convenience Control
Do it yourselfHigher-level services
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS infrastructure automation
Convenience Control
Do it yourselfHigher-level services
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS infrastructure automation
Convenience Control
Do it yourselfHigher-level services
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS infrastructure automation
Convenience Control
Do it yourselfHigher-level services
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS infrastructure automation
Convenience Control
Do it yourselfHigher-level services
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Develop Source Build Test Deploy
AWS Code Services
Third-party
tooling
Software release steps:
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS CodeStar
• Start developing on AWS in
minutes
• Work across your team, securely
• Manage software delivery easily
• Choose from a variety of project
templates
Quickly develop, build, and deploy applications on AWS
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Users >500,000
• Monitoring, metrics, and logging
• If you can’t build it internally,
outsource it! (third-party SaaS)
• What are customers saying?
• Try to squeeze as much performance
out of each service/component
Aggregate
level
metrics
Log
analysis
External
site performance
Host
level
metrics
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon CloudWatch
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
There are further
improvements to be made
in breaking apart our
web/app layer
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The monolithic architecture
User interface
Business logic
Data access
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SOA
What does this mean?
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Now that’s a lot
of things to read!
This is NOT
where we want
to start!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
This is NOT
where we want
to start!
This IS where we
want to start!
Now that’s a lot
of things to read!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The service-oriented architecture
Presentation tier Logic tier
Data tier
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SOAing
Move services into their own tiers
• Treat them separately
• Scale them independently
It offers flexibility and greater
understanding of each component
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Serverless = winning
Don’t reinvent the wheel
• API
• Queuing
• Transcoding
• Search
• Databases
• Monitoring
• Logging
• Compute
• Machine learning
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Loose coupling – Amazon SQS and Amazon SNS
• Reliable (multi-AZ)
• Scalable (unlimited messages)
• Secure (queue authentication)
• Simple (simple APIs)
• FIFO now supported
Topic
Queue
subscribed to
topic
Message
Get
message
Put
message
Publish
notification
Instance Instance
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Functions triggered by events
• Node.js (JavaScript), Java, Python, and C#
• Serverless
• Implicit scaling
Push: event
notification
Pull:
DynamoDB
stream
Pull:
Amazon Kinesis
stream
Event-driven compute – AWS Lambda
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Loose coupling sets you free!
The looser they're coupled, the bigger they scale
• Independent components
• Design everything as a black box
• Decouple interactions
• Favor services with built-in redundancy and scalability
• Don’t build your own!
Push: event
notification
Pull:
DynamoDB
stream
Pull:
Amazon Kinesis
stream
Topic
Queue
subscribed to
topic
Message
Get
message
Put
message
Publish
notification
Instance Instance
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Serverless Web application
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The microservices architecture
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The microservices architecture
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS X-Ray
• Identify performance bottlenecks and errors
• Pinpoint issues to specific service(s) in your
application
• Identify impact of issues on users of the
application
• Visualize the service call graph of your
application
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Visualize service call graph
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Users >1,000,000
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Users >1 million
Reaching a million and above is going to require some bit of all the
previous things
• Multi-AZ
• Elastic Load Balancing between tiers
• Auto Scaling
• Service oriented architecture (SOA)
• Serving content smartly (Amazon S3/CloudFront)
• Caching off DB
• Moving state off tiers that auto scale
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Users >1 million
VPC
User
Web Auto Scaling group
Web Instance Web Instance Web Instance Web Instance
Amazon RDS DB
Instance Read
Replica
Amazon RDS DB
Instance Active (Multi-
AZ)
Amazon RDS DB
Instance Read
Replica
Amazon
ElastiCache
Worker Auto Scaling group
Worker
Instance
Worker
Instance
App Scaling group
App
Instance
App
Instance
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Users >1 million
VPC
User
Web Auto Scaling group
Web Instance Web Instance Web Instance Web Instance
Amazon RDS DB
Instance Read
Replica
Amazon RDS DB
Instance Active (Multi-
AZ)
Amazon RDS DB
Instance Read
Replica
Amazon
ElastiCache
Worker Auto Scaling group
Worker
Instance
Worker
Instance
App Scaling group
App
Instance
App
Instance
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The next big steps
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Users >5 million–10 million
Database issues?
Solutions
• Federation—Splitting into multiple DBs based on function
• Sharding—Splitting one dataset up across multiple hosts
• Moving some functionality to other types of DBs (NoSQL, Graph)
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Database federation
• Split up databases by function/purpose
• Harder to do cross-function queries
• Essentially delays sharding/NoSQL
• Won’t help with single huge functions/tables
Forums DB
Users DB
Products DB
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Sharded horizontal scaling
User ShardID
002345 A
002346 B
002347 C
002348 B
002349 A
CBA
• More complex at the application layer
• No practical limit on scalability
• Operation complexity/sophistication
• Shard by function or key space
• RDBMS or NoSQL
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Shifting functionality to NoSQL
• Similar in a sense to federation
• NoSQL versus SQL
• Leverage managed services like DynamoDB
Some use cases
• Leaderboards/scoring
• Rapid ingest of clickstream/log data
• Temporary data needs (cart data)
• “Hot” tables
• Metadata/lookup tables
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
A quick review
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
A quick review
• Multi-AZ your infrastructure
• Make use of self-scaling services—Application Load Balancer, Amazon S3, AWS
Lambda, Amazon SNS, Amazon SQS, AWS Step Functions, and others
• Build in redundancy at every level
• Start with SQL. Seriously
• Cache data both inside and outside your infrastructure
• Use automation tools in your infrastructure
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
A quick review continued
• Make sure you have good metrics/monitoring/logging
• Split tiers into individual services (SOA)
• Use Auto Scaling once you’re ready for it
• Don’t reinvent the wheel
• Move to NoSQL if and when it makes sense
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
10+ million users!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
To infinity . . .
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
User >10 million
• More fine-tuning of your application
• More SOA of features/functionality
• Going from multi-AZ to multi-region
• Possibly start to build custom solutions
• Deep analysis of your entire stack
• Build serverless whenever possible
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Related builder sessions
Wednesday, November 28
Scale up a Web Application
5:30 – 6:30 p.m. | Aria West, Level 3, Starvine 3, Table 4
Thursday, November 29
Scale up a Web Application
4:00 – 5:00 p.m. | Mirage, Grand Ballroom D, Table 6
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Next steps?
Read!
aws.amazon.com/documentation
aws.amazon.com/architecture
aws.amazon.com/well-architected
aws.amazon.com/solutions
aws.amazon.com/quickstart
Start using AWS
aws.amazon.com/free
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Next steps?
forums.aws.amazon.com
aws.amazon.com/answers
aws.amazon.com/premiumsupport
A solutions architect
Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Ben Thurgood
btgood@amazon.com
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Contenu connexe

Tendances

Deep Dive on Amazon RDS (Relational Database Service)
Deep Dive on Amazon RDS (Relational Database Service)Deep Dive on Amazon RDS (Relational Database Service)
Deep Dive on Amazon RDS (Relational Database Service)Amazon Web Services
 
AWS Black Belt Techシリーズ Elastic Load Balancing (ELB)
AWS Black Belt Techシリーズ  Elastic Load Balancing (ELB)AWS Black Belt Techシリーズ  Elastic Load Balancing (ELB)
AWS Black Belt Techシリーズ Elastic Load Balancing (ELB)Amazon Web Services Japan
 
20200623 AWS Black Belt Online Seminar Amazon Elasticsearch Service
20200623 AWS Black Belt Online Seminar Amazon Elasticsearch Service20200623 AWS Black Belt Online Seminar Amazon Elasticsearch Service
20200623 AWS Black Belt Online Seminar Amazon Elasticsearch ServiceAmazon Web Services Japan
 
Amazon OpenSearch Deep dive - 내부구조, 성능최적화 그리고 스케일링
Amazon OpenSearch Deep dive - 내부구조, 성능최적화 그리고 스케일링Amazon OpenSearch Deep dive - 내부구조, 성능최적화 그리고 스케일링
Amazon OpenSearch Deep dive - 내부구조, 성능최적화 그리고 스케일링Amazon Web Services Korea
 
AWS Black Belt Online Seminar 2017 Amazon Aurora with PostgreSQL Compatibility
AWS Black Belt Online Seminar 2017 Amazon Aurora with PostgreSQL CompatibilityAWS Black Belt Online Seminar 2017 Amazon Aurora with PostgreSQL Compatibility
AWS Black Belt Online Seminar 2017 Amazon Aurora with PostgreSQL CompatibilityAmazon Web Services Japan
 
AWS CLOUD 2018- Amazon DynamoDB기반 글로벌 서비스 개발 방법 (김준형 솔루션즈 아키텍트)
AWS CLOUD 2018- Amazon DynamoDB기반 글로벌 서비스 개발 방법 (김준형 솔루션즈 아키텍트)AWS CLOUD 2018- Amazon DynamoDB기반 글로벌 서비스 개발 방법 (김준형 솔루션즈 아키텍트)
AWS CLOUD 2018- Amazon DynamoDB기반 글로벌 서비스 개발 방법 (김준형 솔루션즈 아키텍트)Amazon Web Services Korea
 
Day 5 - AWS Autoscaling Master Class - The New Capacity Plan
Day 5 - AWS Autoscaling Master Class - The New Capacity PlanDay 5 - AWS Autoscaling Master Class - The New Capacity Plan
Day 5 - AWS Autoscaling Master Class - The New Capacity PlanAmazon Web Services
 
20200526 AWS Black Belt Online Seminar AWS X-Ray
20200526 AWS Black Belt Online Seminar AWS X-Ray20200526 AWS Black Belt Online Seminar AWS X-Ray
20200526 AWS Black Belt Online Seminar AWS X-RayAmazon Web Services Japan
 
Getting Started with AWS Lambda and Serverless
Getting Started with AWS Lambda and ServerlessGetting Started with AWS Lambda and Serverless
Getting Started with AWS Lambda and ServerlessAmazon Web Services
 
Behind the Scenes: Exploring the AWS Global Network (NET305) - AWS re:Invent ...
Behind the Scenes: Exploring the AWS Global Network (NET305) - AWS re:Invent ...Behind the Scenes: Exploring the AWS Global Network (NET305) - AWS re:Invent ...
Behind the Scenes: Exploring the AWS Global Network (NET305) - AWS re:Invent ...Amazon Web Services
 
AWS Single Sign-On (SSO) 서비스 집중 탐구 - 윤석찬 :: AWS Unboxing 온라인 세미나
AWS Single Sign-On (SSO) 서비스 집중 탐구 - 윤석찬 :: AWS Unboxing 온라인 세미나AWS Single Sign-On (SSO) 서비스 집중 탐구 - 윤석찬 :: AWS Unboxing 온라인 세미나
AWS Single Sign-On (SSO) 서비스 집중 탐구 - 윤석찬 :: AWS Unboxing 온라인 세미나Amazon Web Services Korea
 
Reliability of the Cloud: How AWS Achieves High Availability (ARC317-R1) - AW...
Reliability of the Cloud: How AWS Achieves High Availability (ARC317-R1) - AW...Reliability of the Cloud: How AWS Achieves High Availability (ARC317-R1) - AW...
Reliability of the Cloud: How AWS Achieves High Availability (ARC317-R1) - AW...Amazon Web Services
 
Intro to AWS: EC2 & Compute Services
Intro to AWS: EC2 & Compute ServicesIntro to AWS: EC2 & Compute Services
Intro to AWS: EC2 & Compute ServicesAmazon Web Services
 
20200728 AWS Black Belt Online Seminar What's New in Serverless
20200728 AWS Black Belt Online Seminar What's New in Serverless20200728 AWS Black Belt Online Seminar What's New in Serverless
20200728 AWS Black Belt Online Seminar What's New in ServerlessAmazon Web Services Japan
 
Amazon Kinesis Familyを活用したストリームデータ処理
Amazon Kinesis Familyを活用したストリームデータ処理Amazon Kinesis Familyを活用したストリームデータ処理
Amazon Kinesis Familyを活用したストリームデータ処理Amazon Web Services Japan
 
20191120 AWS Black Belt Online Seminar Amazon Managed Streaming for Apache Ka...
20191120 AWS Black Belt Online Seminar Amazon Managed Streaming for Apache Ka...20191120 AWS Black Belt Online Seminar Amazon Managed Streaming for Apache Ka...
20191120 AWS Black Belt Online Seminar Amazon Managed Streaming for Apache Ka...Amazon Web Services Japan
 
AWS 고객이 주로 겪는 운영 이슈에 대한 해법-AWS Summit Seoul 2017
AWS 고객이 주로 겪는 운영 이슈에 대한 해법-AWS Summit Seoul 2017AWS 고객이 주로 겪는 운영 이슈에 대한 해법-AWS Summit Seoul 2017
AWS 고객이 주로 겪는 운영 이슈에 대한 해법-AWS Summit Seoul 2017Amazon Web Services Korea
 
Elastic Load Balancing Deep Dive - AWS Online Tech Talk
Elastic  Load Balancing Deep Dive - AWS Online Tech TalkElastic  Load Balancing Deep Dive - AWS Online Tech Talk
Elastic Load Balancing Deep Dive - AWS Online Tech TalkAmazon Web Services
 

Tendances (20)

Deep Dive on Amazon RDS (Relational Database Service)
Deep Dive on Amazon RDS (Relational Database Service)Deep Dive on Amazon RDS (Relational Database Service)
Deep Dive on Amazon RDS (Relational Database Service)
 
AWS Black Belt Techシリーズ Elastic Load Balancing (ELB)
AWS Black Belt Techシリーズ  Elastic Load Balancing (ELB)AWS Black Belt Techシリーズ  Elastic Load Balancing (ELB)
AWS Black Belt Techシリーズ Elastic Load Balancing (ELB)
 
20200623 AWS Black Belt Online Seminar Amazon Elasticsearch Service
20200623 AWS Black Belt Online Seminar Amazon Elasticsearch Service20200623 AWS Black Belt Online Seminar Amazon Elasticsearch Service
20200623 AWS Black Belt Online Seminar Amazon Elasticsearch Service
 
Amazon OpenSearch Deep dive - 내부구조, 성능최적화 그리고 스케일링
Amazon OpenSearch Deep dive - 내부구조, 성능최적화 그리고 스케일링Amazon OpenSearch Deep dive - 내부구조, 성능최적화 그리고 스케일링
Amazon OpenSearch Deep dive - 내부구조, 성능최적화 그리고 스케일링
 
AWS Black Belt Online Seminar 2017 Amazon Aurora with PostgreSQL Compatibility
AWS Black Belt Online Seminar 2017 Amazon Aurora with PostgreSQL CompatibilityAWS Black Belt Online Seminar 2017 Amazon Aurora with PostgreSQL Compatibility
AWS Black Belt Online Seminar 2017 Amazon Aurora with PostgreSQL Compatibility
 
AWS CLOUD 2018- Amazon DynamoDB기반 글로벌 서비스 개발 방법 (김준형 솔루션즈 아키텍트)
AWS CLOUD 2018- Amazon DynamoDB기반 글로벌 서비스 개발 방법 (김준형 솔루션즈 아키텍트)AWS CLOUD 2018- Amazon DynamoDB기반 글로벌 서비스 개발 방법 (김준형 솔루션즈 아키텍트)
AWS CLOUD 2018- Amazon DynamoDB기반 글로벌 서비스 개발 방법 (김준형 솔루션즈 아키텍트)
 
Day 5 - AWS Autoscaling Master Class - The New Capacity Plan
Day 5 - AWS Autoscaling Master Class - The New Capacity PlanDay 5 - AWS Autoscaling Master Class - The New Capacity Plan
Day 5 - AWS Autoscaling Master Class - The New Capacity Plan
 
20200526 AWS Black Belt Online Seminar AWS X-Ray
20200526 AWS Black Belt Online Seminar AWS X-Ray20200526 AWS Black Belt Online Seminar AWS X-Ray
20200526 AWS Black Belt Online Seminar AWS X-Ray
 
Getting Started with AWS Lambda and Serverless
Getting Started with AWS Lambda and ServerlessGetting Started with AWS Lambda and Serverless
Getting Started with AWS Lambda and Serverless
 
AWS Black Belt Online Seminar Amazon Aurora
AWS Black Belt Online Seminar Amazon AuroraAWS Black Belt Online Seminar Amazon Aurora
AWS Black Belt Online Seminar Amazon Aurora
 
Behind the Scenes: Exploring the AWS Global Network (NET305) - AWS re:Invent ...
Behind the Scenes: Exploring the AWS Global Network (NET305) - AWS re:Invent ...Behind the Scenes: Exploring the AWS Global Network (NET305) - AWS re:Invent ...
Behind the Scenes: Exploring the AWS Global Network (NET305) - AWS re:Invent ...
 
AWS Single Sign-On (SSO) 서비스 집중 탐구 - 윤석찬 :: AWS Unboxing 온라인 세미나
AWS Single Sign-On (SSO) 서비스 집중 탐구 - 윤석찬 :: AWS Unboxing 온라인 세미나AWS Single Sign-On (SSO) 서비스 집중 탐구 - 윤석찬 :: AWS Unboxing 온라인 세미나
AWS Single Sign-On (SSO) 서비스 집중 탐구 - 윤석찬 :: AWS Unboxing 온라인 세미나
 
Architecting for AWS
Architecting for AWSArchitecting for AWS
Architecting for AWS
 
Reliability of the Cloud: How AWS Achieves High Availability (ARC317-R1) - AW...
Reliability of the Cloud: How AWS Achieves High Availability (ARC317-R1) - AW...Reliability of the Cloud: How AWS Achieves High Availability (ARC317-R1) - AW...
Reliability of the Cloud: How AWS Achieves High Availability (ARC317-R1) - AW...
 
Intro to AWS: EC2 & Compute Services
Intro to AWS: EC2 & Compute ServicesIntro to AWS: EC2 & Compute Services
Intro to AWS: EC2 & Compute Services
 
20200728 AWS Black Belt Online Seminar What's New in Serverless
20200728 AWS Black Belt Online Seminar What's New in Serverless20200728 AWS Black Belt Online Seminar What's New in Serverless
20200728 AWS Black Belt Online Seminar What's New in Serverless
 
Amazon Kinesis Familyを活用したストリームデータ処理
Amazon Kinesis Familyを活用したストリームデータ処理Amazon Kinesis Familyを活用したストリームデータ処理
Amazon Kinesis Familyを活用したストリームデータ処理
 
20191120 AWS Black Belt Online Seminar Amazon Managed Streaming for Apache Ka...
20191120 AWS Black Belt Online Seminar Amazon Managed Streaming for Apache Ka...20191120 AWS Black Belt Online Seminar Amazon Managed Streaming for Apache Ka...
20191120 AWS Black Belt Online Seminar Amazon Managed Streaming for Apache Ka...
 
AWS 고객이 주로 겪는 운영 이슈에 대한 해법-AWS Summit Seoul 2017
AWS 고객이 주로 겪는 운영 이슈에 대한 해법-AWS Summit Seoul 2017AWS 고객이 주로 겪는 운영 이슈에 대한 해법-AWS Summit Seoul 2017
AWS 고객이 주로 겪는 운영 이슈에 대한 해법-AWS Summit Seoul 2017
 
Elastic Load Balancing Deep Dive - AWS Online Tech Talk
Elastic  Load Balancing Deep Dive - AWS Online Tech TalkElastic  Load Balancing Deep Dive - AWS Online Tech Talk
Elastic Load Balancing Deep Dive - AWS Online Tech Talk
 

Similaire à Scaling Up to Your First 10 Million Users (ARC205-R1) - AWS re:Invent 2018

Come scalare da zero ai tuoi primi 10 milioni di utenti.pdf
Come scalare da zero ai tuoi primi 10 milioni di utenti.pdfCome scalare da zero ai tuoi primi 10 milioni di utenti.pdf
Come scalare da zero ai tuoi primi 10 milioni di utenti.pdfAmazon Web Services
 
Scaling from zero to millions of users
Scaling from zero to millions of usersScaling from zero to millions of users
Scaling from zero to millions of usersAmazon Web Services
 
Scaling Up To and Beyond 10M Users
Scaling Up To and Beyond 10M UsersScaling Up To and Beyond 10M Users
Scaling Up To and Beyond 10M UsersAmazon Web Services
 
Scaling up to and beyond 10M users
Scaling up to and beyond 10M usersScaling up to and beyond 10M users
Scaling up to and beyond 10M usersAmazon Web Services
 
Lessons Learned from a Large-Scale Legacy Migration with Sysco (STG311) - AWS...
Lessons Learned from a Large-Scale Legacy Migration with Sysco (STG311) - AWS...Lessons Learned from a Large-Scale Legacy Migration with Sysco (STG311) - AWS...
Lessons Learned from a Large-Scale Legacy Migration with Sysco (STG311) - AWS...Amazon Web Services
 
Build Your Own Log Analytics Solutions on AWS (ANT323-R) - AWS re:Invent 2018
Build Your Own Log Analytics Solutions on AWS (ANT323-R) - AWS re:Invent 2018Build Your Own Log Analytics Solutions on AWS (ANT323-R) - AWS re:Invent 2018
Build Your Own Log Analytics Solutions on AWS (ANT323-R) - AWS re:Invent 2018Amazon Web Services
 
Introduction to Serverless computing and AWS Lambda - Floor28
Introduction to Serverless computing and AWS Lambda - Floor28Introduction to Serverless computing and AWS Lambda - Floor28
Introduction to Serverless computing and AWS Lambda - Floor28Boaz Ziniman
 
Introduction to Serverless computing and AWS Lambda | AWS Floor28
Introduction to Serverless computing and AWS Lambda | AWS Floor28Introduction to Serverless computing and AWS Lambda | AWS Floor28
Introduction to Serverless computing and AWS Lambda | AWS Floor28Amazon Web Services
 
Introduction to Serverless on AWS - Builders Day Jerusalem
Introduction to Serverless on AWS - Builders Day JerusalemIntroduction to Serverless on AWS - Builders Day Jerusalem
Introduction to Serverless on AWS - Builders Day JerusalemAmazon Web Services
 
Using Amazon VPC Flow Logs for Predictive Security Analytics (NET319) - AWS r...
Using Amazon VPC Flow Logs for Predictive Security Analytics (NET319) - AWS r...Using Amazon VPC Flow Logs for Predictive Security Analytics (NET319) - AWS r...
Using Amazon VPC Flow Logs for Predictive Security Analytics (NET319) - AWS r...Amazon Web Services
 
AWS SUMMIT TEL AVIV - 2018
AWS SUMMIT TEL AVIV - 2018AWS SUMMIT TEL AVIV - 2018
AWS SUMMIT TEL AVIV - 2018Ayaz Hussain
 
Wildrydes Serverless Workshop Tel Aviv
Wildrydes Serverless Workshop Tel AvivWildrydes Serverless Workshop Tel Aviv
Wildrydes Serverless Workshop Tel AvivBoaz Ziniman
 
Operational Excellence with Containerized Workloads Using AWS Fargate (CON320...
Operational Excellence with Containerized Workloads Using AWS Fargate (CON320...Operational Excellence with Containerized Workloads Using AWS Fargate (CON320...
Operational Excellence with Containerized Workloads Using AWS Fargate (CON320...Amazon Web Services
 
Adding Search to DynamoDB: Database Week San Francisco
Adding Search to DynamoDB: Database Week San FranciscoAdding Search to DynamoDB: Database Week San Francisco
Adding Search to DynamoDB: Database Week San FranciscoAmazon Web Services
 
Using Search with a Database: Database Week SF
Using Search with a Database: Database Week SFUsing Search with a Database: Database Week SF
Using Search with a Database: Database Week SFAmazon Web Services
 
AWS Black Belt Online Seminar 2018 re:Invent Recap: Compute, Container and Ne...
AWS Black Belt Online Seminar 2018 re:Invent Recap: Compute, Container and Ne...AWS Black Belt Online Seminar 2018 re:Invent Recap: Compute, Container and Ne...
AWS Black Belt Online Seminar 2018 re:Invent Recap: Compute, Container and Ne...Amazon Web Services Japan
 
Using Search with a Database - Peter Dachnowicz
Using Search with a Database - Peter DachnowiczUsing Search with a Database - Peter Dachnowicz
Using Search with a Database - Peter DachnowiczAmazon Web Services
 
AWSome Day - Solutions Architecture Best Practices
AWSome Day - Solutions Architecture Best PracticesAWSome Day - Solutions Architecture Best Practices
AWSome Day - Solutions Architecture Best PracticesAmazon Web Services
 
Serverless Architectural Patterns
Serverless Architectural PatternsServerless Architectural Patterns
Serverless Architectural PatternsAmazon Web Services
 

Similaire à Scaling Up to Your First 10 Million Users (ARC205-R1) - AWS re:Invent 2018 (20)

Come scalare da zero ai tuoi primi 10 milioni di utenti.pdf
Come scalare da zero ai tuoi primi 10 milioni di utenti.pdfCome scalare da zero ai tuoi primi 10 milioni di utenti.pdf
Come scalare da zero ai tuoi primi 10 milioni di utenti.pdf
 
Scaling from zero to millions of users
Scaling from zero to millions of usersScaling from zero to millions of users
Scaling from zero to millions of users
 
Scaling Up To and Beyond 10M Users
Scaling Up To and Beyond 10M UsersScaling Up To and Beyond 10M Users
Scaling Up To and Beyond 10M Users
 
Scaling up to and beyond 10M users
Scaling up to and beyond 10M usersScaling up to and beyond 10M users
Scaling up to and beyond 10M users
 
Lessons Learned from a Large-Scale Legacy Migration with Sysco (STG311) - AWS...
Lessons Learned from a Large-Scale Legacy Migration with Sysco (STG311) - AWS...Lessons Learned from a Large-Scale Legacy Migration with Sysco (STG311) - AWS...
Lessons Learned from a Large-Scale Legacy Migration with Sysco (STG311) - AWS...
 
Build Your Own Log Analytics Solutions on AWS (ANT323-R) - AWS re:Invent 2018
Build Your Own Log Analytics Solutions on AWS (ANT323-R) - AWS re:Invent 2018Build Your Own Log Analytics Solutions on AWS (ANT323-R) - AWS re:Invent 2018
Build Your Own Log Analytics Solutions on AWS (ANT323-R) - AWS re:Invent 2018
 
Introduction to Serverless computing and AWS Lambda - Floor28
Introduction to Serverless computing and AWS Lambda - Floor28Introduction to Serverless computing and AWS Lambda - Floor28
Introduction to Serverless computing and AWS Lambda - Floor28
 
Introduction to Serverless computing and AWS Lambda | AWS Floor28
Introduction to Serverless computing and AWS Lambda | AWS Floor28Introduction to Serverless computing and AWS Lambda | AWS Floor28
Introduction to Serverless computing and AWS Lambda | AWS Floor28
 
Introduction to Serverless on AWS - Builders Day Jerusalem
Introduction to Serverless on AWS - Builders Day JerusalemIntroduction to Serverless on AWS - Builders Day Jerusalem
Introduction to Serverless on AWS - Builders Day Jerusalem
 
Using Amazon VPC Flow Logs for Predictive Security Analytics (NET319) - AWS r...
Using Amazon VPC Flow Logs for Predictive Security Analytics (NET319) - AWS r...Using Amazon VPC Flow Logs for Predictive Security Analytics (NET319) - AWS r...
Using Amazon VPC Flow Logs for Predictive Security Analytics (NET319) - AWS r...
 
AWS 101 - Tel Aviv Summit 2018
AWS 101 - Tel Aviv Summit 2018AWS 101 - Tel Aviv Summit 2018
AWS 101 - Tel Aviv Summit 2018
 
AWS SUMMIT TEL AVIV - 2018
AWS SUMMIT TEL AVIV - 2018AWS SUMMIT TEL AVIV - 2018
AWS SUMMIT TEL AVIV - 2018
 
Wildrydes Serverless Workshop Tel Aviv
Wildrydes Serverless Workshop Tel AvivWildrydes Serverless Workshop Tel Aviv
Wildrydes Serverless Workshop Tel Aviv
 
Operational Excellence with Containerized Workloads Using AWS Fargate (CON320...
Operational Excellence with Containerized Workloads Using AWS Fargate (CON320...Operational Excellence with Containerized Workloads Using AWS Fargate (CON320...
Operational Excellence with Containerized Workloads Using AWS Fargate (CON320...
 
Adding Search to DynamoDB: Database Week San Francisco
Adding Search to DynamoDB: Database Week San FranciscoAdding Search to DynamoDB: Database Week San Francisco
Adding Search to DynamoDB: Database Week San Francisco
 
Using Search with a Database: Database Week SF
Using Search with a Database: Database Week SFUsing Search with a Database: Database Week SF
Using Search with a Database: Database Week SF
 
AWS Black Belt Online Seminar 2018 re:Invent Recap: Compute, Container and Ne...
AWS Black Belt Online Seminar 2018 re:Invent Recap: Compute, Container and Ne...AWS Black Belt Online Seminar 2018 re:Invent Recap: Compute, Container and Ne...
AWS Black Belt Online Seminar 2018 re:Invent Recap: Compute, Container and Ne...
 
Using Search with a Database - Peter Dachnowicz
Using Search with a Database - Peter DachnowiczUsing Search with a Database - Peter Dachnowicz
Using Search with a Database - Peter Dachnowicz
 
AWSome Day - Solutions Architecture Best Practices
AWSome Day - Solutions Architecture Best PracticesAWSome Day - Solutions Architecture Best Practices
AWSome Day - Solutions Architecture Best Practices
 
Serverless Architectural Patterns
Serverless Architectural PatternsServerless Architectural Patterns
Serverless Architectural Patterns
 

Plus de Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSAmazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAmazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWSAmazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckAmazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without serversAmazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceAmazon Web Services
 

Plus de Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Scaling Up to Your First 10 Million Users (ARC205-R1) - AWS re:Invent 2018

  • 1.
  • 2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Scaling Up to Your First 10 Million Users Ben Thurgood Principal Solutions Architect Amazon Web Services A R C 2 0 5
  • 3.
  • 5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Now that’s a lot of things to read! This is NOT where we want to start!
  • 7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. It’s not the single thing that fixes everything
  • 8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. What do we need first?
  • 9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS global infrastructure
  • 10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon global edge network 136+ edge locations and caches
  • 11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Robust, fully featured technology infrastructure
  • 12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS building blocks Amazon CloudFront Amazon Route 53 Amazon Simple Storage Service (Amazon S3) Amazon DynamoDB Elastic Load Balancing Amazon Elastic File System (Amazon EFS) AWS Lambda Amazon Simple Queue Service (Amazon SQS) Amazon Simple Notification Service (Amazon SNS) Amazon Simple Email Service (Amazon SES) AWS Step Functions . . . Highly scalable, available with the right architecture Amazon Elastic Compute Cloud (Amazon EC2) Amazon Elastic Block Store (Amazon EBS) Amazon Relational Database Service (Amazon RDS) Amazon Virtual Private Cloud (Amazon VPC)
  • 13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Considerations Rex Boggs https://creativecom mons.org/licenses/by -nd/2.0/
  • 14. “Many decisions are reversible, two- way doors.” Jeff Bezos
  • 15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Build Measure Learn
  • 16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Guiding tenets Identify and avoid undifferentiated heavy lifting (Wardley maps) Serverless versus managed versus run it yourself https://commons.wikimedia.org/wiki/Category:Yaks_of_Tibet#/media/File:Yak_at_Nam_Tso_Tibet.jpg
  • 17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. So let’s start from day . . .
  • 18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. You User
  • 19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. One user VPC User Elastic IP address Amazon EC2 instance
  • 20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Lightsail: The easiest way to get started on AWS Choose from five plans that include bundled compute, storage, and networking Benefit from a low, predictable price Spin up a fully configured server in seconds Manage from the intuitive Lightsail console Scale with access to AWS services Automate with Lightsail API & AWS Command Line Interface (AWS CLI)
  • 21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. • Simplest approach • Can now leverage PIOPS • High I/O instances • High memory instances • High CPU instances • High storage instances • Easy to change instance sizes • Will hit an endpoint eventually t3.nano m5.2xlarge c5.9xlarge “We’re gonna need a bigger box”
  • 22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. “We’re gonna need a bigger box” • Simplest approach • Can now leverage PIOPS • High I/O instances • High memory instances • High CPU instances • High storage instances • Easy to change instance sizes • Will hit an endpoint eventually t3.nano m5.2xlarge c5.9xlarge
  • 23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. One user • No failover • No redundancy • Too many eggs in one basket VPC User Elastic IP address Amazon EC2 instance
  • 24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Users > 1
  • 25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Database instance VPC Users > 1 User Elastic IP address Amazon EC2 instance
  • 26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Database options Fully managedSelf-managed
  • 27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora • MySQL or Postgres compatible • Automatic storage scaling (up to 64 TB) • Up to 15 read-replicas • Continuous (incremental) backups to Amazon S3 • Six-way replication across three zones
  • 28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora • MySQL or Postgres compatible • Automatic storage scaling (up to 64 TB) • Up to 15 read-replicas • Continuous (incremental) backups to Amazon S3 • Six-way replication across three zones • Serverless option
  • 29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora Serverless On-demand,auto-scalingdatabaseforapplicationswithvariableworkloads Starts up on demand, shuts down when not in use Automatically scales with no instances to manage Pay per second for the database capacity you use Warm capacity pool Application
  • 30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. To NoSQL, or not to NoSQL?
  • 31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Start with SQL databases
  • 32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why start with SQL? • Established and well-known technology • Lots of existing code, communities, books, and tools • You aren’t going to break SQL DBs in your first millions of users. No, really, you won’t* • Clear patterns to scalability *Unless you are doing something SUPER peculiar with the data or you have MASSIVE amounts of it. . . . but even then SQL will have a place in your stack
  • 33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AH HA! You said, “Massive amounts”
  • 34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. > 5 TB in year one? Incredibly data intensive workload? OK! You might need NoSQL
  • 35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why else might you need NoSQL? • Super low-latency applications • Metadata-driven datasets • Highly nonrelational data • Need schema-less data constructs* • Rapid ingest of data (thousands of records/sec) • Massive amounts of data (again, in the TB range) • *Need!= “It’s easier to do dev without schemas”
  • 36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Users > 1 Registration, Sign In, and others
  • 37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Cognito overview Web and mobile apps Developers focus on what is special about their app Amazon Cognito handles auth and identity Federation Managed user directory Hosted UI AWS credentials Standard tokens
  • 38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Security checklist
  • 39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Security checklist
  • 40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Security checklist
  • 41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Security checklist
  • 42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Users > 100
  • 43. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. VPC Amazon RDS instance Users > 100 User Elastic IP address Amazon EC2 instance
  • 44. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Users > 1000
  • 45. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. VPC User Users > 1000 Amazon RDS DB instance active (Multi- AZ) Web instance Availability zone Web instance Amazon RDS DB instance standby (Multi-AZ) Availability zone
  • 46. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Sharing the load
  • 47. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Application Load Balancer • Highly available • 1 - 65535 • Health checks • Session stickiness • Monitoring / logging • Content-based routing • Container-based apps • WebSockets • HTTP/2 Recommended
  • 48. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. horizontally vertically
  • 49. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Users >10,000
  • 50. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. VPC Availability zone User Users > 10,000 Amazon RDS DB instance active (Multi-AZ) Web instance Amazon RDS DB instance standby (Multi-AZ) Availability zone Web instance Web instance Web instance Web instance Web instance Web instance Web instance
  • 51. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. VPC Availability zone User Users > 10,000 Amazon RDS DB instance active (Multi-AZ) Web instance Amazon RDS DB instance standby (Multi-AZ) Availability zone Web instance Web instance Web instance Web instance Web instance Web instance Web instance DB instance read replica DB instance read replica DB instance read replica DB instance read replica
  • 52. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Shift some load around User Availability zone Amazon RDS DB instance active (Multi-AZ) Amazon RDS DB instance standby (Multi-AZ) VPC Web instances Web instances Availability zone
  • 53. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Simple Storage Service (Amazon S3) • Object-based storage • Highly durable • Great for static assets • “Infinitely scalable” • Objects up to 5 TB in size • Encryption at rest and in transit
  • 54. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon CloudFront • Cache content for faster delivery • Lower load on origin • Dynamic and static content • Streaming video • Custom SSL certificates • Low TTLs (as short as 0 seconds) • Optimized for AWS
  • 55. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon CloudFront ResponseTime ServerLoad ResponseTime Server Load Response Time Server Load No CDN CDN for static content CDN for static & dynamic content 0 10 20 30 40 50 60 70 80 VolumeofData Delivered(Gbps)
  • 56. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Shift some more load around VPC User Amazon RDS DB instance active (Multi-AZ) Availability zones Web instances
  • 57. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon ElastiCache • Managed Memcached or Redis • Scale from one to many nodes • Self-healing (replaces dead instance) • Single-digit ms speeds (usually) • Local to a single AZ for Memcached • Multi-AZ possible with Redis
  • 58. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Shift even more load around VPC User Amazon RDS DB instance active (Multi-AZ) Availability zones Web instances
  • 59. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon DynamoDB • Managed NoSQL database • Provisioned throughput • Fast, predictable performance • Fully distributed, fault tolerant • JSON support • Items up to 400 KB • Time-to-live (TTL) • Streams and triggers • AWS Application Auto Scaling • Global tables
  • 60. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon DynamoDB • Managed NoSQL database • Provisioned throughput • Fast, predictable performance • Fully distributed, fault tolerant • JSON support • Items up to 400 KB • Time-to-live (TTL) • Streams and triggers • AWS Application Auto Scaling • Global tables AWS Database Migration Service (AWS DMS)!
  • 61. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Now that our web tier is much more lightweight, we can revisit the beginning of our talk . . .
  • 62. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Auto Scaling!
  • 63. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Sunday Monday Tuesday Wednesday Thursday Friday Saturday Typical weekly traffic to Amazon.com
  • 64. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Sunday Monday Tuesday Wednesday Thursday Friday Saturday Typical weekly traffic to Amazon.com Provisioned capacity
  • 65. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. November November traffic to Amazon.com
  • 66. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Provisioned capacity November November traffic to Amazon.com
  • 67. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. November traffic to Amazon.com 76% 24% November Provisioned capacity
  • 68. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. November traffic to Amazon.com November
  • 69. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Auto Scaling lets you do this!
  • 70. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Auto Scaling • Automatic resizing of compute clusters • Define min/max pool sizes • Amazon CloudWatch metrics drive scaling • On-Demand or Spot Instances aws autoscaling create-auto-scaling-group --auto-scaling-group-name MyGroup --launch-configuration-name MyConfig --min-size 4 --max-size 200 --availability-zones us-west-2c, us-west-2b
  • 71. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon RDS DB instance read replica Amazon RDS DB instance read replica Amazon RDS DB instance active (Multi- AZ) Auto Scaling group Users > 500,000 VPC User Web instance Amazon RDS DB instance standby (Multi-AZ) Availability zone Web instance Web instance Amazon ElastiCache Auto Scaling group Web instance Availability zone Web instance Web instance Amazon ElastiCache
  • 72. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon RDS DB instance read replica Amazon RDS DB instance read replica Amazon RDS DB instance active (Multi- AZ) Auto Scaling group Users > 500,000 VPC User Web Instance Amazon RDS DB instance standby (Multi-AZ) Availability zone Web Instance Web Instance Amazon ElastiCache Web Instance Availability zone Web Instance Web Instance Amazon ElastiCache
  • 73. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Use automation
  • 74. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Systems Manager
  • 75. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS infrastructure automation Convenience Control
  • 76. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS infrastructure automation Convenience Control Do it yourself
  • 77. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS infrastructure automation Convenience Control Do it yourselfHigher-level services
  • 78. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS infrastructure automation Convenience Control Do it yourselfHigher-level services
  • 79. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS infrastructure automation Convenience Control Do it yourselfHigher-level services
  • 80. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS infrastructure automation Convenience Control Do it yourselfHigher-level services
  • 81. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS infrastructure automation Convenience Control Do it yourselfHigher-level services
  • 82. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Develop Source Build Test Deploy AWS Code Services Third-party tooling Software release steps:
  • 83. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS CodeStar • Start developing on AWS in minutes • Work across your team, securely • Manage software delivery easily • Choose from a variety of project templates Quickly develop, build, and deploy applications on AWS
  • 84. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Users >500,000 • Monitoring, metrics, and logging • If you can’t build it internally, outsource it! (third-party SaaS) • What are customers saying? • Try to squeeze as much performance out of each service/component
  • 86. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon CloudWatch
  • 87. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. There are further improvements to be made in breaking apart our web/app layer
  • 88. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The monolithic architecture User interface Business logic Data access
  • 89. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. SOA What does this mean?
  • 90. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 91. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Now that’s a lot of things to read! This is NOT where we want to start!
  • 92. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. This is NOT where we want to start! This IS where we want to start! Now that’s a lot of things to read!
  • 93. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The service-oriented architecture Presentation tier Logic tier Data tier
  • 94. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. SOAing Move services into their own tiers • Treat them separately • Scale them independently It offers flexibility and greater understanding of each component
  • 95. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Serverless = winning Don’t reinvent the wheel • API • Queuing • Transcoding • Search • Databases • Monitoring • Logging • Compute • Machine learning
  • 96. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Loose coupling – Amazon SQS and Amazon SNS • Reliable (multi-AZ) • Scalable (unlimited messages) • Secure (queue authentication) • Simple (simple APIs) • FIFO now supported Topic Queue subscribed to topic Message Get message Put message Publish notification Instance Instance
  • 97. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. • Functions triggered by events • Node.js (JavaScript), Java, Python, and C# • Serverless • Implicit scaling Push: event notification Pull: DynamoDB stream Pull: Amazon Kinesis stream Event-driven compute – AWS Lambda
  • 98. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Loose coupling sets you free! The looser they're coupled, the bigger they scale • Independent components • Design everything as a black box • Decouple interactions • Favor services with built-in redundancy and scalability • Don’t build your own! Push: event notification Pull: DynamoDB stream Pull: Amazon Kinesis stream Topic Queue subscribed to topic Message Get message Put message Publish notification Instance Instance
  • 99. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Serverless Web application
  • 100. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 101. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The microservices architecture
  • 102. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The microservices architecture
  • 103. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS X-Ray • Identify performance bottlenecks and errors • Pinpoint issues to specific service(s) in your application • Identify impact of issues on users of the application • Visualize the service call graph of your application
  • 104. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Visualize service call graph
  • 105. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Users >1,000,000
  • 106. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Users >1 million Reaching a million and above is going to require some bit of all the previous things • Multi-AZ • Elastic Load Balancing between tiers • Auto Scaling • Service oriented architecture (SOA) • Serving content smartly (Amazon S3/CloudFront) • Caching off DB • Moving state off tiers that auto scale
  • 107. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Users >1 million VPC User Web Auto Scaling group Web Instance Web Instance Web Instance Web Instance Amazon RDS DB Instance Read Replica Amazon RDS DB Instance Active (Multi- AZ) Amazon RDS DB Instance Read Replica Amazon ElastiCache Worker Auto Scaling group Worker Instance Worker Instance App Scaling group App Instance App Instance
  • 108. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Users >1 million VPC User Web Auto Scaling group Web Instance Web Instance Web Instance Web Instance Amazon RDS DB Instance Read Replica Amazon RDS DB Instance Active (Multi- AZ) Amazon RDS DB Instance Read Replica Amazon ElastiCache Worker Auto Scaling group Worker Instance Worker Instance App Scaling group App Instance App Instance
  • 109. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The next big steps
  • 110. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Users >5 million–10 million Database issues? Solutions • Federation—Splitting into multiple DBs based on function • Sharding—Splitting one dataset up across multiple hosts • Moving some functionality to other types of DBs (NoSQL, Graph)
  • 111. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Database federation • Split up databases by function/purpose • Harder to do cross-function queries • Essentially delays sharding/NoSQL • Won’t help with single huge functions/tables Forums DB Users DB Products DB
  • 112. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Sharded horizontal scaling User ShardID 002345 A 002346 B 002347 C 002348 B 002349 A CBA • More complex at the application layer • No practical limit on scalability • Operation complexity/sophistication • Shard by function or key space • RDBMS or NoSQL
  • 113. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Shifting functionality to NoSQL • Similar in a sense to federation • NoSQL versus SQL • Leverage managed services like DynamoDB Some use cases • Leaderboards/scoring • Rapid ingest of clickstream/log data • Temporary data needs (cart data) • “Hot” tables • Metadata/lookup tables
  • 114. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. A quick review
  • 115. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. A quick review • Multi-AZ your infrastructure • Make use of self-scaling services—Application Load Balancer, Amazon S3, AWS Lambda, Amazon SNS, Amazon SQS, AWS Step Functions, and others • Build in redundancy at every level • Start with SQL. Seriously • Cache data both inside and outside your infrastructure • Use automation tools in your infrastructure
  • 116. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. A quick review continued • Make sure you have good metrics/monitoring/logging • Split tiers into individual services (SOA) • Use Auto Scaling once you’re ready for it • Don’t reinvent the wheel • Move to NoSQL if and when it makes sense
  • 117. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. 10+ million users!
  • 118. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. To infinity . . .
  • 119. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. User >10 million • More fine-tuning of your application • More SOA of features/functionality • Going from multi-AZ to multi-region • Possibly start to build custom solutions • Deep analysis of your entire stack • Build serverless whenever possible
  • 120. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Related builder sessions Wednesday, November 28 Scale up a Web Application 5:30 – 6:30 p.m. | Aria West, Level 3, Starvine 3, Table 4 Thursday, November 29 Scale up a Web Application 4:00 – 5:00 p.m. | Mirage, Grand Ballroom D, Table 6
  • 121. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Next steps? Read! aws.amazon.com/documentation aws.amazon.com/architecture aws.amazon.com/well-architected aws.amazon.com/solutions aws.amazon.com/quickstart Start using AWS aws.amazon.com/free
  • 122. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Next steps? forums.aws.amazon.com aws.amazon.com/answers aws.amazon.com/premiumsupport A solutions architect
  • 123. Thank you! © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Ben Thurgood btgood@amazon.com
  • 124. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.