With Amazon EC2, you have the flexibility to mix-and-match purchasing models to suit your business needs. By combining pay-as-you-go (On-Demand), reserve ahead of time for discounts (Reserved), and high-discount spare capacity (Spot) purchasing models, you can optimize cost, grow your compute capacity and throughput, and enable new types of cloud computing applications. This presentation will guide you on how to achieve high performance and availability at the lowest TCO. We will explore how to best combine EC2's purchasing models across several common applications with immediately actionable takeaways.

1. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Joshua Burgin, General Manager
EC2 Spot
April 2016
Get the Most Out of Amazon EC2
A Deep Dive on Reserved, On-Demand,
and Spot Purchasing Models

2. On-Demand
Pay for compute capacity
by the hour with no long-
term commitments
For spiky workloads,
or to define needs
AWS EC2 Purchasing Options
Reserved
Make a commitment to
receive a significant discount
on the hourly charge and a
capacity commitment
For committed utilization and
capacity reservation
Spot
Bid for unused capacity,
charged at a Spot price
which fluctuates based
on supply and demand
For flexible, fault tolerant
or transient workloads

3. How is Cloud Compute Helping Enterprise?
Faster Time to Results
Access computing
infrastructure in minutes
Lower Total Cost
Pay-as-you-go pricing
Elastic and Powerful
Easily add or remove capacity
Globally Accessible
Easily collaborate with
teams around the world
Secure
A collection of tools to
protect data and privacy
Scalable
Access to effectively
limitless capacity

4. AWS Global Infrastructure
Region
Edge Location
Over 1 million active
customers across 190
countries
800+ government agencies
3,000+ educational
institutions
12 regions (2016: USA,
Canada, India, UK)
33 availability zones
54 edge locations

5. Example AWS Region
AZ
AZ
AZ AZ AZ
Transit
Transit

6. Example AWS Availability Zone
AZ
AZ
AZ AZ AZ
Transit
Transit

7. Example AWS Data Center

8. Amazon EC2 Instance Types
• Micro (T2)
• General Purpose (M3, M4, T2)
• Compute Optimized (C3, C4)
• Storage Optimized (I2, D2)
• GPU Optimized (G2)
• Memory Optimized (R3, X1*)
Instances to suit your application needs
*We expect to have the X1 available in the first half of 2016

9. EC2 can help strengthen your security posture
Get native functionality and tools at
no additional charge
Over 30 global compliance
certifications and accreditations
Leverage security enhancements gleaned
from 1M+ customer experiences
Benefit from AWS industry leading
security teams 24/7, 365 days a year
Security infrastructure built to
satisfy military, global banks, and other
high-sensitivity organizations

10. More accreditations & certifications than anyone
ISO 9001
SOC 3
SOC 2
ISO 27001
ISO 27017
PCI DSS Level 1ISO 27018
SOC 1 / ISAE 3402
GxPHIPAA
ITAR
FERPA
FISMA, RMF, and DIACAP
FedRAMP
Section 508 / VPAT
DoD SRG Levels 2 & 4
FIPS 140-2
CJIS
Cloud Security Alliance
MPAA
NIST
MLPS Level 3
G-Cloud
IT-Grundschutz
MTCS Tier 3
IRAP Cyber Essentials Plus

11. The Forrester Wave™: Public Cloud Platform
Service Providers' Security, Q4 2014
The Forrester Wave™ is copyrighted by Forrester Research, Inc. Forrester and Forrester Wave™ are trademarks of Forrester
Research, Inc. The Forrester Wave™ is a graphical representation of Forrester's call on a market and is plotted using a
detailed spreadsheet with exposed scores, weightings, and comments. Forrester does not endorse any vendor, product, or
service depicted in the Forrester Wave. Information is based on best available resources. Opinions reflect judgment at the time
and are subject to change.
“We work closely with AWS to develop
a security model, which we believe enables us
to operate more securely in the public cloud
than we can in our own data centers.”
Rob Alexander - CIO, Capital One

12. Enterprise Customers

13. Pillars of Performance and Cost Optimization
Right Sizing Purchasing
Options
Increase
Elasticity
Measure,
Monitor, &
Improve

14. Right Sizing
Right Sizing
• Selecting the cheapest instance available while
meeting performance requirements
• Looks at CPU, RAM, storage, and network utilization
to identify potential instances that can be
downsized

15. Increase Elasticity
Turn off non-production instances
• Look for dev/test, non-prod instances that are
running always-on and turn off
Autoscale Production
• Use Autoscaling to scale up and down based on
demand and usage (e.g. spikes)

16. Measure, Monitor, & Improve - Uncover the Cost
Optimization Opportunities
• Auto-tag resources
• Identify ‘always on’ Non Prod
• Identify instances to down-size
• Recommend RIs to purchase
• Dashboard our status
• Report on savings

17. AWS Pricing Principles
Pay as you go
Pay less by using more
Pay less when you reserve
Pay less when AWS grows
No up-front investment
Pay per use

18. We completed the equivalent of
thirty-nine years of computational
chemistry in just under 9 hours for
a cost of around $4200.
Steve Litster
Global Head of Scientific Computing, Novartis
”
“
Novartis: Acceleration of pre-clinical R&D
• Existing infrastructure to screen10 million
compounds in a computational model not
available
• New infrastructure would have cost
approximately $40 million to build
Novartis used AWS for HPC computational
chemistry

19. On-Demand
AWS EC2 Purchasing Options
Reserved Spot

20. EC2 On-Demand Pricing
Short-term, Spiky and
unpredictable
Low cost and
flexible
Develop and test

21. EC2 Reserved Pricing
Upfront payments to
reduce costs
Steady State Reserved Capacity

22. Reserved Instance details
Options
• No upfront
• Partial upfront
• All upfront
Commitment Level
• 1 Year
• 3 Year
• RI Marketplace
* Dependent on specific AWS Service, size/type and Region

23. EC2 Spot Pricing
Users with urgent
computing needs or
large amounts of
additional capacity
Time or instance
flexible
Experiment and/or
build cost sensitive
businesses

24. Options
• Spot fleet to maintain Instance
Availability
• Spot block durations (1-6 hours)
for workloads that must run
continuously
Commitment level
• None
* Compared to On Demand price based on specific EC2 instance type, region and availability zone
Spot Instance details

25. Spot Rules
Markets where the price of compute changes based on supply and demand
You’ll never pay more than your bid.
50% Bid
of OD
75% Bid
of OD
25% Bid
of OD
You pay the
market price
87% discount!

26. Which EC2 Consumption Model is right for me?

27. Have a balanced meal!
Why choose just one business model?

28. Use a Combination of All Three!
1. Use Reserved Instances for
known/steady-state workloads
2. Set-up multiple Scaling groups
3. Scale using Spot, On-Demand or
both
0
2
4
6
8
10
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
/Spot Instances
On Demand
Spot
Reserved Instance

29. Examples

30. Example – 3 tier web app

31. Tagging is essential!
• How do we explain the costs?
• How do we allocate the charges to
the right team?
• How do we save money?

32. Tagging is essential!

33. Stateless
Scale based on demand
Web Tier
0
5
10
15
20
25
30
35
40
0 2 4 6 8 10 12 2 4 6 8 10
Web Servers
Reserved Spot On-Demand
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
0 0 0 0 0 0 0 0 0 0 0 0 0
Web Traffic

34. App Tier
Stateful
Scale based on demand
0
50
100
150
200
250
300
350
400
450
500
0 2 4 6 8 10 12 2 4 6 8 10
App Requests
0
5
10
15
20
25
30
35
40
45
50
0 2 4 6 8 10 12 2 4 6 8 10
App Servers
Reserved On-Demand Spot block

35. Database Tier
Highly Stateful
Static at peak load
0
100
200
300
400
500
600
700
800
900
0 2 4 6 8 10 12 2 4 6 8 10
Database Requests
0
0.5
1
1.5
2
2.5
3
3.5
0 2 4 6 8 10 12 2 4 6 8 10
Database Servers
Reserved On-Demand Spot

36. Summary – 3 tier web app
0
10
20
30
40
50
60
70
80
90
0 2 4 6 8 10 12 2 4 6 8 10
3 Tier Application Servers
Reserved On-Demand Spot
Summary
Have a balanced meal! Across the three tiers our
meal consist of
• Spot 13%
• On-Demand 11%
• Reserved 76%
Remember!
“No server is easier to manage than no server” -
Werner Vogels, CTO, Amazon.com.

37. Ubisoft uses AWS to develop and launch social games quickly
• Ubisoft is a Paris-based gaming company, and creator of
popular gaming titles, including Assassins Creed, Far Cry,
and Just Dance
• Moving games to social and mobile platforms and needed
capacity to scale fast; using a traditional environment
would be an extensive and costly investment
• Using the AWS Cloud to optimize games at the application,
caching, and data layers, improving the user experience
”
“ By using the AWS cloud we
were able to launch 10 social
games within 18 months.
Lenin Gali
Senior Director, Ubisoft

38. Example – Grid processing

39. The Old Way: Low Utilization, High Costs
Time
Typical server utilization rates are low due to need to deploy for peak needs…

40. Time
The Old Way: Managing Utilization with Grids
Higher grid utilization rates result in hidden costs: longer queue wait times,
and delayed results

41. The Old Way: In the Cloud!
0
20
40
60
80
100
120
140
160
3 year Reserved Instances
?

42. The World as Seen by Central IT
Higher utilization can reduce IT spending…
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Grid Utilization

43. The World as Seen by the Business
But higher utilization also creates IT constraints…
Every job in the
queue represents
business impact
But Grid Utilization
looks great!
-600%
-500%
-400%
-300%
-200%
-100%
0%
100%
0
200
400
600
800
1000
1200
1400
Jobs in the Queue
Grid Utilization

44. Reduced Time
The Cloud Way: Scalability When Needed
Project
Acceleration
Scale higher to reduce time-to-results: shorter wait times, greater agility,
faster innovation cycles

45. The New Way: In the Cloud!
? 0
100
200
300
400
500
600
1 2 3 4 5 6 7 8 9 10 11 12
Optimizing for cost and business results
3 year Reserved Instances On-Demand Spot

46. The New Way: In the Cloud!
? 0
100
200
300
400
500
600
1 2 3 4 5 6 7 8 9 10 11 12
Going a step further with Spot blocks!
3 year Reserved Instances On-Demand Spot block Spot

47. “We constantly understate what our capabilities are to solve problems. The
biggest constraint is never the constraint of time or money, it’s generally the
constraint of thought.”
– Jeff Smith, CEO, Suncorp Business Services
Founded: 1996 • Employees: 15,000+ • Headquarters: Brisbane, Australia
Accelerating Transformation

48. EC2 Purchasing Options via Industry

49. Web scale (e.g. Adtech)
Company
Enterprise SaaS Company
Consumption Model by Industry

50. Onboarding Enterprise Gaming Company
Consumption Model by Industry

51. Technology CompanyScientific Research
Consumption Model by Industry

52. Different Purchasing Options in a single company
Data Science
New app development Test and Development
Internal IT

53. Let’s Recap
Remember the pillars of optimization
Right Sizing
Increase elasticity (turn stuff off!)
Measure, Monitor and Improve
Use Tags to understand your services
There are 3 core purchasing options
– have a balanced meal!
Architect Your Workloads with
Performance and Cost in Mind

54. Summary
Freedom to build
unfettered
Freedom to get real
value from data
Freedom to say Yes
AWS is more cost-effective than on-premises environments in both short-term
and long-term. By leveraging the EC2 consumptions models you gain the…

55. Thank you!