General purpose HPC and AI computing in the cloud all have different requirements that can affect your application’s performance and your infrastructure costs. Compute performance and TCO matter when choosing Amazon EC2 instances. Instance types with varying combinations of CPU, memory, storage, and networking capacity give you the flexibility to choose the appropriate mix of resources for your applications, and scale globally. In this session, learn which Intel-powered EC2 instance has the right price-to-performance for your workload. Learn why the underlying technology matters, and how AWS uses customized Intel Xeon Scalable processors to build a wide selection of instance types optimized to fit different use cases. This presentation is brought to you by AWS partner, Intel.

1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon EC2 instances: Customizable cloud
computing across workloads
Martin Yip
Senior Product Marketing Manager,
Amazon Web Services
D E M 2 0 - S
Ravi Ravishankar
Senior Cloud Infrastructure
Solutions Architect, Intel
AWS Certified Cloud Solutions Architect

2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Agenda
• Background
• EC2 instances: workloads, benefits, customer stories
• Wrap-Up

3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
What does Intel do with Amazon
https://aws.amazon.com/intel/
13+ year engineering partnership
Digital Transformation
Shared customer passion
High performance + low costs
World class supply chain
Common History & Values Amazon EC2
VMware
Cloud on
AWS
AWS IoT
Core
AWS
Greengrass
Amazon SageMaker
AWS Deep
Learning AMIs
AWS
DeepLens
Amazon S3
AWS
Deepracer
Amazon Echo
Look
Amazon Echo
Show
Cloud &
Data Center
Things &
Devices
Alexa Voice
Services

4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Customer Obsession: AWS and Intel
Amazon EC2 instances powered by Intel
provide up to 44% better price performance1
for current and future workloads
Performance optimized instances for the
widest variety of workloads: HPC, AI, General
Purpose, Data Intensive, Memory Intensive
Intel architecture is supported by an extensive
ISV ecosystem providing ease in application
migration and portability to AWS
AWS instances powered by Intel
delivers the ability to scale globally from two
sockets to eight sockets and beyond to meet
business needs
Many ready-to-use solutions optimized for AWS
instances powered by Intel available in AWS
Market Place
AWS instances powered by Intel available
GLOBALLY and have the best SPOT Market
Availability
1 TSO Logic Research - https://tsologic.com/wp-content/uploads/2018/11/TSOLogic_Intel_Research_Final_2018-1.pdf
Price/Performance Scalability Availability

5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Benefits of Intel® Xeon® Scalable Processors
Price / Performance World-Class Ecosystem Workload Optimizations
1.25x
4.1x
1.7M
480k
MS SQL
SAP
20k+
1k+
* AWS SQL Server Performance on AWS https://s3.amazonaws.com/aws-database-blog/artifacts/whitepapers/SQL-Server-Performance-on-AWS.pdf
** SAP: https://www.sap.com/dmc/benchmark/2018/Cert18041.pdf and AWS: https://aws.amazon.com/blogs/awsforsap/new-sap-certifications-for-aws-instances-and-world-record-benchmark-results/

6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Optimize Price & Performance: Modernize AWS Instances
C4 C5
1 Source: https://www.dbbest.com/blog/validating-aws-ec2-sql-server-deployments-using-benchmark-tools/
2 Source: Intel benchmarks
3 Source: : TSO Logic Research - https://tsologic.com/wp-content/uploads/2018/11/TSOLogic_Intel_Research_Final_2018-1.pdf
50%
Up to
EC2 Instance
3.8x
Up to
Images/sec
Improvement
4.6x
Up to
Performance
ImprovementCost savings
223
M4 M5
General Purpose
Computing
Tensorflow
Inference
High Performance
Computing
24% 2.8x
Up to
Images/sec
Improvement
3.5x
Up to
Performance
Improvement
1 2
EC2 Instance
Cost Savings
2
Up to

7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS Marketplace: Accelerate Time to Market
Intel® DAAL k-Nearest Neighbors (kNN)
Intel® DAAL DecisionForest Classification
Intel® DAAL PCA
Intel® DAAL Logistic Regression.
Intel® DAAL Decision Forest Regression.
Intel® DAAL K-Means
BigDL Text Classifier on Analytics Zoo
MXNet ResNet50 Inference
https://itpeernetwork.intel.com/artificial-intelligence-world-bank-image-
recognition/#gs.mgtkqy
Image training accuracy up to 81.5%
Linear scaling with BigDL throughput
increasing from 56.7 to 99.6

8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
ML: APN Collaboration
C3.ai and Intel collaborate to deliver breakthrough performance and TCO for
Machine Learning workloads on AWS
30%
I n v e n t o r y
R e d u c t i o n
”Through working with Intel, C3 have been able to offer better performance and TCO benefits to their end customers”
99%+
S e r v i c e
L e v e l s
80%
A c c u r a c y
Amazon EC2
21%-50%
B e t t e r
P e r f o r m a n c e
41%-49%
L o w e r T C O
C5

9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Workloads
High Performance
Computing (HPC)
Artificial Intelligence (AI)
Machine Learning (ML)
Big Data
SAP on AWS
VMWare Cloud on AWS
Internet of Things (IoT)
Strategic Migration
AWS instance mapping with Intel
P3dn
General Purpose
R5
R5d
Memory-optimized
X1
X1e
Large
Memory
I3
metal
High I/O
C5n
Compute-intensive
H1
Local HDD
Storage
z1d
M5
M5d
HMT3
C5
C5d
High Frequency
General
Purpose GPU
Burstable
Instance Types
Amazon EC2 instances powered by Intel
LATEST INTEL MICROARCHITECTURE
Xeon Scalable Processors
(Skylake & Cascade Lake)
Xeon Processors
(Broadwell & Haswell)

10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon EC2 instance characteristics
M5d.xlarge
Instance family
Instance
generation
Instance size
Instance type
CPU
Memory
Storage
Network performance
*Additional
capabilities

11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon EC2 13+ years ago…
Scale up or down
quickly, as needed
Pay for what
you use
“One size fits all”
M1

12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Continued rapid pace of innovation
Instance growth
210+
instances
2007 2019

13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS is positioned highest in execution and
furthest in vision within the Leaders Quadrant
EC2 is the foundation on which most services are
built
AWS positioned as a leader in the Gartner Magic
Quadrant for Cloud Infrastructure as a Service

14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon EC2 – Key Ingredients
Resources
Instances
Storage
Networking
Availability
Regions and AZs
Placement Groups
Load Balancing
Auto Scaling
Management
Deployment
Monitoring
Administration
Purchase Options
On Demand
Reserved
Spot

15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
General-purpose instance workloads
Web/app servers Enterprise apps Gaming servers
Caching fleets Analytics applications Dev/test environments

16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
M5: general-purpose instances
• Balance of compute, memory, and networking resources
• Powered by 2.5 GHz Intel Xeon Scalable Processors (Skylake)
• Largest instance size, m5.24xlarge has 96 vCPUs and 384 GiB
of memory
• Improved network and EBS performance on smaller sizes
• Support for Intel AVX-512 offering up to twice
the performance for vector and floating point workloads
14% price/performance improvement
with M5
M4 M5
M5d
SSD
M5d: Now available with high performance local
NVMe SSD storage

17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Low utilization
High utilization
Opportunity: most instances aren’t very busy

18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
T3: burstable general-purpose instances
Balance of compute, memory, and network
Baseline level of CPU performance with the ability to burst
CPU usage when needed at any time for as long as required
Lowest cost instance at $0.0052 per hour and up to 30%
better price performance over T2
With T3 Unlimited bursting
over baseline is only $0.05
per vCPU-hour, averaged
over 24 hours
…7 sizes

19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
R5: memory-optimized instances
Memory-optimized instances with 8:1 GiB to vCPU
2.5 GHz Intel Xeon Scalable Processors (Skylake)
Up to 25 Gbps NW bandwidth
R5d instances include up to 3.6 TB of local NVMe SSD
…
6 sizes

20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Compute-intensive workloads
Batch processing Distributed analytics High-perf computing (HPC)
Ad serving Multiplayer gaming Video encoding

21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
C5: Compute-optimized instances
Custom 3.0 GHz Intel Xeon Scalable Processors (Skylake)
Up to 72 vCPUs and 144 GiB of memory (2:1 Memory:vCPU
ratio)
25 Gbps network bandwidth
Support for Intel AVX-512
C5d with local NVMe-based SSD storage
C5.12xLarge, C5.24xLarge with 2nd Generation Xeon Scalable
Processor and Deep Learning Boost (VNNI)
25% price/ performance improvement
over C4
C4 C5
“We are eager to migrate onto the AVX-512 enabled c5.18xlarge instance
size… We expect to decrease the processing time of some of our key
workloads by more than 30%.”
“We saw significant performance improvement on Amazon EC2 C5, with up to
a 140% performance improvement in industry standard CPU benchmarks
over C4.”

22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
z1d
Fastest compute with fastest
processor for design automation
High-memory
Largest SAP-certified in-memory
instances–6 | 9 | 12 TB
18 TB & 24 TB coming in 2019
Maximum performance with optimized instances
Custom Intel Xeon
Scalable processor
Custom Intel Xeon
Scalable processor,
4.0-GHz core frequency
All built on the Nitro platform

23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Enhanced network for HPC and machine learning
Up to 100-Gbps network bandwidth
Elastic Fabric Adapter for HPC
Best for large HPC workloads
C5n
Most elastic and scalable
HPC network
P3dn
Fastest machine learning
training in the cloud
Custom Intel Xeon
Scalable processor
NVIDIA V100
Tensor Core GPUs

24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Scale Up / Scale Down
M5z1d
High Mem
X1/X1e
C5 R5
ComputeOptimized
GeneralCompute
MemoryOptimized
T3
Application CompatibilityProcessor Choice
M5Z1d
High Mem
X1/X1e
C5 R5T3
Consistent Intel computing architecture
providing 100% application compatibility
on-premises and in EC2 – No rework
needed
Enterprise Applications (on-prem)
Offering customers choices of Intel Xeon processors
from Haswell to NEW 2nd Generation Intel Xeon
Scalable processors (Cascade Lake)
Embedded workload acceleration with Intel AVX
512, Intel Inference Boost (Deep Learning Boost),
Intel AES-NI, Intel Turbo Boost
EC2 Intel Instance Type Benefits

25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Learn more:
Amazon EC2 instances featuring Intel: https://aws.amazon.com/ec2/
AWS Marketplace instance optimizations by Intel: https://amzn.to/2FRwxnQ
AWS and Intel relationship: http://aws.amazon.com/intel
Developer Kits for AWS Greengrass: https://intel.ly/2KW4ace

26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Questions and Answers

27. Thank you!
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.