This document discusses Amazon Web Services (AWS) and its compute offerings. It provides an overview of AWS' Nitro System architecture, which improved EC2 instance performance and efficiency. It describes new AWS compute instance types including Graviton processors, M6g/C6g/R6g instances, and Inferentia instances for machine learning inference. It also discusses new services like AWS Compute Optimizer and AWS Outposts for on-premises deployments. The document emphasizes AWS' focus on innovation, customer obsession, and providing the broadest selection of compute resources to meet customers' varying needs.

1. Paul Yung
Head of Partner Ecosystem – Hong Kong & Taiwan
pyung@amazon.com

2. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
re:Invent 2019

3. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.

4. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
re:Invent 2019

5. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
re:Invent 2019

6. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
re:Invent 2019

7. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
re:Invent 2019

8. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
State of the Union: Compute & DevOps

9. The broadest and deepest cloud platform for today’s builders
A W S C o n f i d e n t i a l – D O N O T D I S T R I B U T E

10. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Azure GCP
DowntimeHoursByMajorCloudProvider
Normalizedsumofdowntimehours(Jan2018-December2019)aspublishedbythemajorproviders
“There is no compression
algorithm for experience.”
- Andy Jassy, AWS CEO
Operational Excellence

11. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
“Amazon, the clear market leader,
nudged its market share upwards and
remains equivalent in size to its next four
competitors combined.”
Source: https://www.srgresearch.com/articles/fourth-quarter-growth-cloud-services-tops-banner-year-cloud-providers
Synergy provides quarterly market tracking and segmentation data on IT and Cloud related markets, including vendor revenues by segment and by region. Market shares and forecasts are provided via Synergy’s uniquely designed online
database tool, which enables easy access to complex data sets. To speak to an analyst or to find out how to receive a copy of a Synergy report, please contact Heather Gallo at hgallo@srgresearch.com or 775-852-3330 extension 101.
Innovate to Scale - Benefit of Economies of Scale

12. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Where innovation starts
we start with the customer
and work backwards

13. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Great products and services come from
deeply understanding the customer.

14. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Working backwards process
Press Release FAQs Visuals

15. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
1. Who is our customer?
2. What is the customer problem or opportunity?
3. What is the most important customer benefit?
4. How do we know what our customer needs or wants?
5. What does the experience look like?
5 Working Backward Questions

16. 48 82
160
280
516
722
1017
1430
1,957
0
500
1000
1500
2000
2500
2009 2011 2012 2013 2014 2015 2016 2017 2018
#SERVICESANDFEATURESRELEASED
• Customer-driven services and features
• 90% of roadmap originates with customer requests
and designed to meet specific needs

17. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
We push ourselves to invent on
behalf of the customer.

18. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.

19. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.

20. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
I N S T A N C E S

21. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Original EC2 host architecture
SERVER
Management,
Security &
Monitoring
Storage
Customer Instances
Networking
Hypervisor

22. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Original EC2 host architecture
SERVER
Management,
Security &
Monitoring
Storage
Customer Instances
Networking
Hypervisor
Performance
Unabletoachievebare
metal-likeperformance
Patching
Interruptiontocustomer
workloadswhenhypervisor
neededtobepatched
Efficiency
20%+ofavailablecompute
capacitylosttohypervisor

23. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Innovation enabled by AWS Nitro System
Nitro Cards Nitro Security Chip Nitro Hypervisor
VPC Networking
Amazon EBS
Local NVMe Storage
System Controller
Integrated into motherboard
Protects hardware resources
Hardware Root of Trust
Lightweight hypervisor
Memory and CPU allocation
Bare Metal-like performance
Modular building blocks for rapid design and delivery of EC2 instances

24. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The Nitro system architecture
SERVER
Management,
Security &
Monitoring
Storage
Customer Instances
Networking
Hypervisor
NITRO

25. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
0
3
6
9
12
15
18
C5 Instances M5 Instances
EBS-Optimized Instance Bandwidth
Instances Instances with Nitro
1.8X
1.5X
without Nitro
0
20000
40000
60000
80000
100000
C5 Instances M5 Instances
EBS-Optimized Instance IOPS
Instances Instances with Nitrowithout Nitro
1.2X
Nitro instances provide bandwidth, performance, and price
improvements over previous instance generations
1.3X
The Nitro system architecture

26. Nitro-enabled Innovation
- 270+ instances across 42 instance types
270 +
2017

27. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Own and have access to
encrypted confidential data
Instance
Internal system admins,
developers, applications
Customers want to be able to create an
isolated environment to process highly
sensitive data, like:
• Personally identifiable information (PII)
• Healthcare information
• Intellectual property
• Trade secrets
without providing access to their own
authorized system administrators,
developers, and applications

28. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Secure isolation
Flexible resource
allocation
Support for wide
range of workloads
Instance A Enclave A Instance B
Nitro Hypervisor
Additional isolation
within an EC2 instance
2019 NEW!

29. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Intel® Xeon® Scalable
(Skylake, Cascade Lake)
processor
AMD EPYC processorNVIDIA V100 Tensor
Core GPUs
Right compute for the workload
AWS Graviton
Processor (arm)

31. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Graviton Processor Amazon EC2 A1
Run scale-out and Arm-based applications
in the cloud
Up to 45%
cost savings
AWS Graviton Processor
64-bit Arm Neoverse cores
and custom AWS silicon
Flexibility and
choice for your
workloads
Lower cost Maximize resource
efficiency with AWS
Nitro System

32. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
OSVs and ISVs
Plus: Fedora Rawhide, Fedora Atomic, Debian 9.8,
FreeBSD, openSUSE Leap, Ubuntu 18.10 (Cosmic), 19.04
(Disco), and 19.10 (Eoan)
More coming soon.
Amazon Linux 2
Ubuntu 16.04LTS, 18.04LTS
and newer
Red Hat Enterprise
Linux 7.6 and 8.0
SUSE Linux Enterprise
Server 15
Datadog Agent for AWS
Graviton / Arm
Crowdstrike Falcon cloud-
native endpoint protection
Tools and software
AWS MarketplaceAWS Systems
Manager
Amazon
CloudWatch
AWS
CodePipeline
AWS Cloud9
AWS
CodeCommit
Amazon
Inspector
AWS Batch
AWS
CodeBuild
Amazon Corretto OpenJDK
Containers
Amazon Elastic
Container
Service
Amazon Elastic
Kubernetes
Service
Docker Desktop Community
and Docker Enterprise Engine
Micro VMs

33. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.

34. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
7 nm
Up to 64 vCPUs
7x 4x
5x
Graviton Processor Graviton2 Processor
Enabling the best price/performance for your cloud workloads
2019 NEW!

35. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
M6g C6g R6g
Up to 40% better price-performance for general purpose, compute
intensive, and memory intensive workloads.
Built for: General-purpose workloads
such as application servers, mid-size
data stores, and microservices.
Built for: Compute intensive
applications such as HPC, video
encoding, gaming, and simulation
workloads.
Built for: Memory intensive
workloads such as open-source
databases, or in-memory caches.
2019 NEW!

36. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
40
60
80
100
120
140
160
S P E C I N T 2 0 1 7 ( E s t i m a t e ) N G I N X M E M C A C H E D
PERCENTAGE

37. 1.7 GHz
1.75 GB
160 GB
250 Mbps
Your applications run on a “virtual CPU”,
the equivalent of a 1.7 GHz Xeon
processor, 1.75 GB of RAM, 160 GB of local
disk and 250 Mbps of network bandwidth
Evolution of EC2 and
the Nitro Platform

38. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
1.7 GHz
1.75 GB
160 GB
250 Mbps
4.0 GHz
24 TiB
60 TB
100 Gbps
48 TB
d2.8xlarge

39. Categories Capabilities Options
Broadest and deepest platform choice for compute instances
General purpose
Burstable
Compute intensive
Memory intensive
Storage (High I/O)
Dense storage
GPU compute
Graphics intensive
Elastic Block Store
Elastic Inference
Choice of processor
(AWS, Intel, AMD)
Fast processors
(up to 4.0 GHz)
High memory footprint
(up to 12 TiB)
Instance storage
(HDD and NVMe)
Accelerated computing
(GPUs and FPGA)
Networking
(up to 100 Gbps)
Bare Metal
Size
(Nano to 32xlarge)
270 +instance types
for virtually every
workload and
business need

40. Categories Capabilities Options
Broadest and deepest platform choice for compute instances
General purpose
Burstable
Compute intensive
Memory intensive
Storage (High I/O)
Dense storage
GPU compute
Graphics intensive
Elastic Block Store
Elastic Inference
Choice of processor
(AWS, Intel, AMD)
Fast processors
(up to 4.0 GHz)
High memory footprint
(up to 12 TiB)
Instance storage
(HDD and NVMe)
Accelerated computing
(GPUs and FPGA)
Networking
(up to 100 Gbps)
Bare Metal
Size
(Nano to 32xlarge)
270 +instance types
for virtually every
workload and
business need
How do you select the right
instance to launch and optimize?

41. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Compute Optimizer
Recommends optimal instances for EC2 and and EC2 Auto Scaling groups
from 140+ instances from M, C, R, T, and X families
Lower costs
performance
insights from
millions of workloads
Saves time comparing
2019 NEW!

42. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Compute
Optimizer
Identify optimal
AWS Compute resources
for your workloads
Mettle scans your AWS
infrastructure and uses
machine learning to
automatically identify
optimal AWS resources
for your workloads
Identifies workload
characteristics and profile
based on the data
gathered
Matches the resource
requirements of your
workloads to optimal
AWS resources by
recommending:
CloudWatch
Metrics
EC2 Instance
EC2 Auto
Scaling Groups
Helps you visualize
what-if scenarios
based on the
recommended
resources
AWS resources
metadata
Lower
costs
Optimize
performance
Get started
quickly

43. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
New services that recommends optimal AWS Compute resources to reduce costs up to 25%
Recommends optimal EC2 instances
Optimizes performance and reduce costs by making
recommendations to help you right size compute to
your workloads
Analyzes CloudWatch Metrics and considers Auto
Scaling group configuration for intuitive and
actionable recommendations
Up to three recommendations per workload
Available at no additional charge

44. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
% Infrastructure Cost
Machine Learning
Training (<10%)
Machine Learning
Inference (>90%)

45. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ASIC
Chart for illustrative purposes
GPU CPU
Performance/WATT
Applications

46. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
High performance
Low cost
AWS NeuronAWS Custom 2nd Gen Intel
Xeon Scalable Processors
AWS InferentiaAWS Nitro
2019 NEW!

47. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Object detection Natural language processing Personalization
Speech recognition Image processing Fraud detection
The Fastest and lowest cost machine leaning inference in the cloud
Inf1 delivers up to 3X higher throughput and up to 40% lower cost (vs G4 CPU)

48. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Available in 4 sizes
• Single and multi chip
instances
• AWS 2nd Gen Intel Xeon
Scalable Processors
• Up to 100Gbps
networking bandwidth
Instance size vCPUs
Memory
(GIB) Storage
Inferentia
Chips
Neuron Core
Pipeline Mode Network B/W EBS B/W
inf1.xlarge 4 8 EBS only 1 N/A Up to 25 Gbps Up to 3.5 Gbps
inf1.2xlarge 8 16 EBS only 1 N/A Up to 25 Gbps Up to 3.5 Gbps
inf1.6xlarge 24 48 EBS only 4 Yes 25 Gbps 3.5 Gbps
inf1.24xlarge 96 192 EBS only 16 Yes 100 Gbps 14 Gbps
• Will support managed
services such as Amazon
SageMaker, EKS and ECS

49. AWS Outposts - General Available
Industry standard 42U rack
Fully assembled, ready to be rolled
into final position
Installed by AWS, simply plugged into power
and network
Centralized redundant power conversion
unit and DC distribution system for
higher reliability, energy efficiency,
easier serviceability
Redundant active components including
top of rack switches and hot spare hosts
Dimensions
• 24” Wide
• 48” Deep
• 80” Tall
GA !

50. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Applications that are sensitive to
latency and variability in latency
• Need for near real time
responses to end user applications
• Need to control on-site equipment
• Need to communicate with other
on-premises systems
• Need to ensure integrity of ingested signal
(e.g. at live events before broadcasting)
• Need to reliably process messages from
industrial equipment to monitor production
• Need for managing local data stores
Applications that process data locally
Applications that need to remain on-premises

51. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
same
Same
operational
consistency
Same tools for
automation,
deployments, and
security controls
Same services
and APIs
Same pace of
innovation as in
the cloud
Same reliable,
secure, and high
performance
infrastructure

52. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Same AWS-designed
infrastructure as in
AWS data centers
(built on AWS Nitro System)
Fully managed, monitored,
and operated by AWS
as if in AWS Regions
Single pane of management
in the cloud providing the
same APIs and tools as
in AWS Regions
AWS Outposts: bringing AWS on-premises

53. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Available in 2 Variants
VMware APIs and services to
leverage existing skills, automation,
and governance policies
For customers running VMware
SDDC on-premises
AWS APIs, services, and features
as in the AWS cloud
EC2 and EBS with support for
services including RDS, ECS, EKS,
EMR, ALB, others
Native AWS VMware Cloud on AWS

54. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Compute & Storage—Amazon EC2 instances
and EBS volumes
• Networking—Amazon VPC
• Database—Amazon Relational Database
Service (RDS)
• Containers—Amazon Elastic Container Service
(ECS) & Amazon Elastic Kubernetes Service (EKS)
• Data Processing—Amazon Elastic Map Reduce (EMR)
Run AWS services locally
Available at GA or soon after

55. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
EC2 Auto Scaling Groups
AWS CloudFormation
CloudWatch
CloudTrail
Elastic BeanStalk
Cloud9
and more…
With the same AWS APIs & tools as in the AWS Region

56. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Hong Kong Region
Availability Zone
Subnet
VPC
Availability Zone
Subnet

57. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Hong Kong Region
Availability Zone
Subnet
VPC
Availability Zone
Subnet
AWS
Outposts
Subnet
Instances in the Outpost can securely talk to other instances in the VPC via private IP addresses

58. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
C o n t a i n e r s

59. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Broadest Choice for running containers
Management
Deployment, Scheduling,
Scaling & Management of
containerized applications
Hosting
Where the containers run
Amazon Elastic
Container Service
(ECS)
Amazon Elastic
Kubernetes Service
(EKS)
Amazon EC2 AWS Fargate
Image Registry
Container Image Repository
Amazon Elastic
Container Registry

60. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Managed by AWS
No servers or clusters to provision, scale or manage
Elastic
Serverless for optimum elasticity
Scale up & down seamlessly. Pay only for what you use
Integrated
with the AWS ecosystem: VPC Networking, Elastic Load
Balancing, IAM Permissions, CloudWatch and more. Run
Kubernetes pods or ECS tasks.
AWS Fargate
- only compute engine that allow you to run containers without having to manage servers
40% of customers adopting an AWS
container service choose AWS Fargate

61. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Bring existing pods Production ready Right-Sized and Integrated
You don’t need to change your
existing pods. Fargate works with
existing workflows and services
that run on Kubernetes.
Launch ten or tens of thousands
of pods in seconds. Easily run pods
across multiple AZs for high-availability.
Only pay for the resources you
need to run your pods. Includes
native AWS integrations for
networking, and security.
Fargate runs tens of millions of containers for AWS customers every week
2019 NEW!

62. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
C o n t a i n e r sI N S T A N C E S
NEW!
NEW!
NEW!
Amazon ECS
Amazon EKS
Amazon Fargate
NEW!
NEW!
GA!

63. © 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon confidential
AWS Hong Kong Region
Availability Zone
Subnet
VPC
Availability Zone
Subnet
AWS
Outposts
Subnet
Amazon S3
Use Interface Endpoints to access all regional AWS services such as DynamoDB and S3 in your
private VPC environment

64. Thank you!
© 2020, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Paul Yung
pyung@amazon.com