Cloud services built on compute-optimized EC2 instances can serve as your next-generation HPC platform. Learn how to utilize the Rescale platform on AWS to meet the ever-increasing demands on compute resources while avoiding costly capex investments. Custom Intel Xeon processors enable you to meet your HPC needs by taking advantage of the newest technologies in the cloud. This session is brought to you by AWS partner, Intel.
5. HPC-TARGETED SEGMENTS FOR INTEL® XEON®
SCALABLE PROCESSORS
Financial – Risk Weather
Scientific visualization /
Professional Rendering
Simulation,
CAE & CFD
Defense/security
Energy – Seismic
Reservoir
Data Analytics &
Machine Learning
Life sciences –
Genomics/sequencing
6. HPC WORKLOADS IN THE CLOUD
C l u s t e r H P C
Tightly coupled, latency sensitive
applications
Use larger Amazon EC2 compute
instances, placement groups, Enhanced
Networking
G r i d H T C
Loosely coupled, pleasingly parallel
Use a variety of Amazon EC2 instances,
multiple Availability Zones, Amazon Spot
instances, AWS Auto Scaling, Amazon
Simple Queue Service
7. HPC CUSTOMERS ARE LOOKING TO THE CLOUD
R&D
Collaboration
Manage Demand
Surges
Easy
Maintenance
Capital /
Investment
Access to Scale Upgrading Current
Capabilities
Top Reasons
8. INTEL® XEON® PROCESSOR FAMILY POWERS HPC IN
CLOUD
P e r f o r m a n c e
Provides seamless HPC
application performance
for dedicated and cloud
infrastructure
S e c u r i t y
High reliability and
enhanced security features
reduce risk, without
compromising
performance
A g i l i t y
Enables fully virtualized,
software-defined
datacenter that
dynamically self-
provisions resources based
on demand
9. INTEL® XEON® PROCESSOR SCALABLE FAMILY
Potential Customer Benefits:
• Faster time to completion for
improved TCO
• Higher resolution simulations
for greater accuracy
• More sophisticated analysis for
higher confidence in outcomes
hpc
Intel® AVX-512
Up to2X
FLOPs/clock-cycle
peak performance capability
1.74X to
4.66X
Source
Performance
improvements
S o f t w a r e p e r f o r m a n c e p r o o f p o i n t s – H P C ( c o m m e r c i a l )
Performance results are based on testing as of September 2018 and may not reflect all publicly available security updates. See configuration disclosure for details. No product can be absolutely secure.
Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software,
operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product
when combined with other products. For more complete information visit www.intel.com/benchmarks. 1,2,3Configurations: 1.74x performance improvement on HOMME-WACCM app workload and 4.66x performance improvement on LAMMPS-Polyethylene
app workload running on AWS C4.8xlarge to AWS C5 18xlarge on operating system RHEL 7.4 3.10.0-693.el7.x86_64.
10. EC2 C5: COMPUTE OPTIMIZED INSTANCES
• Based on 3.0 GHz Intel Xeon Scalable Processors
(Skylake)
• Up to 72 vCPUs and 144 GiB of memory
(2:1 Memory:vCPU ratio)
• 25 Gbps NW bandwidth
• Support for Intel AVX-512
25% price/performance
improvement over C4
C4 C5
“We saw significant performance improvement on
Amazon EC2 C5, with up to a 140% performance
improvement in industry standard CPU benchmarks
over C4.”
“We are eager to migrate onto the AVX-512 enabled
c5.18xlarge instance size… . We expect to decrease
the processing time of some of our key workloads by
more than 30%.”
Performance results are based on testing as of September 2018 and may not reflect all publicly available security updates. See configuration disclosure for details. No product can be absolutely secure.
Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software,
operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product
when combined with other products. For more complete information visit www.intel.com/benchmarks. 1,2,3
11. AVX 512
72 vCPUs
“Skylake”
144 GiB memory
C5
12 Gbps to EBS
2X vCPUs
3X throughput
2.4X memory
C4
36 vCPUs
“Haswell”
4 Gbps to EBS
60 GiB
memory
C5: Next Generation Compute-
Optimized Instances with Intel®
Xeon® Scalable Processor
AWS Compute optimized instances
support the new Intel® AVX-512
advanced instruction set, enabling
you to more efficiently run vector
processing workloads with single
and double floating point
precision, such as AI/machine
learning or video processing.
C5 WITH INTEL® XEON® SCALABLE PROCESSOR
12. XEON SCALABLE PROCESSER PERFORMANCE
12
W o r k l o a d C 4 t o C 5 p e r f o r m a n c e i m p r o v e m e n t s
App Workloads
C5/C4
Improvements
HOMME-WACCM 1.74
STREAM-Triad 1.77
MILC-su3_rhmd_hisq (CG Only) 1.81
LS-Dyna-3 Cars 1.92
LS-Dyna-Refined Neon 1.96
WRF-CONUS 12km 2.13
LS-Dyna-Car2Car 2.23
LAMMPS-Liquid Crystal 2.80
GROMACS-water_1.5M_rf 2.89
GROMACS-water_1.5M_pme 2.90
App Workloads (continued)
C5/C4
Improvements
LAMMPS-Silicon 2.99
GROMACS-lignocellulose_3M_rf 3.00
LAMMPS-Tersoff 3.06
LAMMPS-Atomic Fluid 3.53
LAMMPS-Protein 3.61
LAMMPS-Geomean 3.64
LAMMPS-Copper 3.76
LAMMPS-DPD 3.90
DGEMM-mt-dgemm N=16384 4.28
LAMMPS-Polyethylene 4.66
Performance results are based on testing as of September 2018 and may not reflect all publicly available security updates. See configuration disclosure for details. No product can be absolutely secure.
Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software,
operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product
when combined with other products. For more complete information visit www.intel.com/benchmarks. 1,2,3Configurations: SEE BACKUP SLIDE 32
13. EC2 Z1D: HIGH FREQUENCY INSTANCES
Relational
databases
GamingEDA
• 8:1 GiB to vCPU ratio
• High Frequency instances with custom Intel® Xeon®
Scalable Processors running at up to 4.0 GHz
• Up to 25 Gbps NW bandwidth and up to 1.8 TB of
local NVMe storage
z1d.large
16 GiB
2 vCPU
384 GiB
48 vCPU
z1d.12xlarge
…6 sizes
Electronic
Design
Automation
14. A CONSISTENT HPC PLATFORM
Applications
Platform
Provisioning, Messaging, Runtimes,
System Management, Resource
Management
Infrastructure
High Performance Components
Server Storage
SSDs
Switch
Fabric
Infrastructure
Applications
Platform
Messaging, Runtimes, System
Management, Resource Management
IAAS
Standard or High Performance
Components
Server Storage
SSDs
Network Infrastructure
HPC Provisioning Layer
H P C C l u s t e r H P C i n t h e C l o u d
16. METABIOTA LEVERAGES AWS TO MODEL COMPLEX
BIOTHREATS
B i o t e c h n o l o g y f i r m r u n s t e n s o f t h o u s a n d s o f p a r a l l e l
s i m u l a t i o n s v i a t h e R e s c a l e S c a l e X p l a t f o r m
● Metabiota distills complex disease models into
quantitative risk for business and government
● Eliminated $M’s in IT and server capital costs
● Rescale proprietary technology layers used to
leverage compute markets and reduce modeling costs
by 50%
“One of the biggest
advantages we have in
our market is our speed
and the agile methods
we use.”
- Kierste Miller, Data
Scientist
17. Many customers have moved from
“why” cloud to “how” cloud.
Tim Crawford
@tcrawford
“
”
22. CHALLENGE: ACCESSING DIVERSE DATA CENTERS
USA
LATAM
Europe
Asia
R e s c a l e - L e v e r a g e C l o u d P r o v i d e r s a n d S u p e r c o m p u t e r
C e n t e r s
23. SCALEX PLATFORM: SEAMLESS AWS HPC DEPLOYMENT
Multiple complex systems services and tools
required for AWS HPC deployment...
…transformed into one seamless,
automated enterprise SaaS deployment
A u t o m a t i o n o f s e r v i c e s & t o o l s r e q u i r e d i n A W S H P C d e p l o y m e n t
24. GLOBAL INTEGRATION
I n t e g r a t i o n w i t h A l l A W S D a t a C e n t e r s . . . a n d H P C i n s t a n c e t y p e s
25. SIMPLIFYING THE AWS HPC DEPLOYMENT
A W S
R e s p o n s i b i l i t y
M y O r g a n i z a t i o n ’ s
R e s p o n s i b i l i t y
Shared Security and
Compliance
Systems Administration
Management and
Monitoring
Productivity and Workflow
Tools
Deployment and User
Experience
26. HYB RID HPC:
E x t e n d Y o u r
D a t a c e n t e r
HIGH -PE RFORMANCE
S T ORAGE:
D a t a D e l i v e r e d w i t h
V e l o c i t y
E N D T O E N D
DE S KT OPS :
I n t e r a c t i v e H P C
WHY A PLATFORM: INNOVATING AT THE SPEED OF HPC
27. ACCELERATING EM SIMULATIONS FOR SMARTPHONES
• Customer: pSemi, a Murata Company
• Reduced time to verify and test frontends
by over 10x
• Instant speed up for EM simulations on Intel
Xeon Scalable Processors (c5, r5)
• pSemi uses HPC on AWS to drastically speed
up the time it takes to test and verify the
frontend modules which are integrated into
the latest smartphones
• Rescale’s solution deployed rapidly and non-
disruptively, allowing engineers to save time
and focus on designing innovation
27
28. AWS HPC ON RESCALE
• I n s t a n t a c c e s s t o u n l i m i t e d r e s o u r c e s
• C h o i c e o f a r c h i t e c t u r e s
• A p p l i c a t i o n s a v a i l a b l e a n d t u n e d
• A p p l i c a t i o n r u n s o n b e s t s u i t e d a r c h i t e c t u r e
• J o b s r u n w i t h n o w a i t
• E n g i n e e r s n o t c o n s t r a i n e d b y t h e s i z e o f a s y s t e m
• F a s t e r i n n o v a t i o n , s h o r t e r c y c l e s , i m p r o v e d t i m e t o m a r k e t
• I m m e d i a t e p r o v i s i o n , v a r i a b l e s i z e , n o c a p i t a l i n v e s t m e n t
• S y s t e m u t i l i z a t i o n , j o b q u e u e s , d o w n t i m e s , a r e a t h i n g o f t h e
p a s t