In addition to running databases in Amazon EC2, AWS customers can choose among a variety of managed database services. These services save effort, save time, and unlock new capabilities and economies. In this session, we make it easy to understand how they differ, what they have in common, and how to choose one or more. We explain the fundamentals of Amazon DynamoDB, a fully managed NoSQL database service; Amazon RDS, a relational database service in the cloud; Amazon ElastiCache, a fast, in-memory caching service in the cloud; and Amazon Redshift, a fully managed, petabyte-scale data-warehouse solution that can be surprisingly economical. We will cover how each service might help support your application, how much each service costs, and how to get started.

1. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
David Elliott, Manager, Solutions Architecture, AWS
Rob Hart, Head of Solutions & Design Architecture, DVSA
July 7th, 2016
Getting Started with Managed
Database Services on AWS

2. What to expect from the session
• Why managed database services?
• AWS managed database options
• Amazon RDS—A relational managed database
• Amazon DynamoDB—A nonrelational managed database
• Amazon ElastiCache—A managed in-memory cache
• Amazon Redshift—A managed data warehouse
• Choosing AWS managed database services
• Rob Hart, Head of Solutions & Design Architecture, DVSA
• Wrap-up

3. Why managed database services?

4. If you host your databases on-premises
Power, HVAC, net
Rack and stack
Server maintenance
OS patches
DB software patches
Database backups
Scaling
High availability
DB software installs
OS installation
you
App optimization

5. If you host your databases in Amazon EC2
Power, HVAC, net
Rack and stack
Server maintenance
OS patches
DB software patches
Database backups
Scaling
High availability
DB software installs
OS installation
you
App optimization

6. If you choose a managed DB service
Power, HVAC, net
Rack and stack
Server maintenance
OS patches
DB software patches
Database backups
App optimization
High availability
DB software installs
OS installation
you
Scaling

7. What are the AWS managed DB
options?

8. A managed service for each major DB type
Amazon
Redshift
Data
warehouse
Amazon
DynamoDB
Document
and key-
value store
Amazon
RDS
Relational
database
engines
Amazon
ElastiCache
In-memory
key-value
store

9. What is Amazon RDS?

10. Relational databases
Fully managed
Fast, predictable performance
Simple and fast to scale
Low cost, pay for what you use
Amazon
RDS
Amazon Aurora

11. Amazon Aurora: Fast, available, and MySQL-compatible
SQL
Trans-
actions
AZ 1 AZ 2 AZ 3
Caching
Amazon
S3
 5x faster than MySQL on
same hardware
 SysBench: 100K writes/sec
and 500K reads/sec
 Designed for 99.99%
availability
 6-way replicated storage
across 3 AZs
 Scale to 64 TB and 15 Read
Replicas

12. Use cases
Applicable wherever you need relational databases
eCommerce Gaming
Websites IT solutions
Apps
Reporting

13. RDS feature matrix
Feature Aurora MySQL PostgreSQL MariaDB Oracle SQL Server
VPC      
High availability      
Instance scaling      
Encryption      
Read replicas     Oracle
GoldenGateCross-region  
Maximum storage 64 TB 6 TB 6 TB 6 TB 6 TB 4 TB
Scale storage Auto
Scaling
   
Provisioned IOPS NA 30,000 30,000 30,000 30,000 20,000
Largest instance R3.8XL R3.8XL
M4.10XL
R3.8XL
M4.10XL
R3.8XL
M4.10XL
R3.8XL
M4.10XL
R3.8XL
M4.10XL

14. How do Amazon RDS backups work?
Automated backups
Restore your database to a point in
time
Enabled by default
Choose a retention period, up to 35
days
Manual snapshots
Build a new database instance from a
snapshot when needed
Initiated by you
Persist until you delete them
Stored in Amazon S3

15. Monthly
bill
= +
Further details at http://aws.amazon.com/rds/pricing/
You pay for the resources that you use
Storage
consumed
Duration for which DB
instances were used
(Price depends on
type of storage)
(Price depends on
type of DB instance)
Free tier (for first 12 months)
• 750 micro DB instance hours
• 20 GB of DB storage
• 20 GB for backups
• 10 million I/O operations
GBN ×

16. What is Amazon DynamoDB?

17. Amazon DynamoDB
NoSQL database
Fully managed
Single-digit millisecond latency
Massive and seamless scalability
Low cost
Amazon
DynamoDB

18. Amazon DynamoDB: a managed document and
key-value store
• Simple and fast to deploy, easy to scale
• Data is automatically replicated
• Fast, predictable performance
• Helps provide security and control
• Fine-grained access control
• No cost to get started
• Pay only for what you consume

19. Popular use cases
Ad tech IoT Gaming
Mobile
& web
Ad serving,
retargeting, ID
lookup, user
profile
management,
session-
tracking, RTB
Tracking state,
metadata and
readings from
millions of
devices, real-
time
notifications
Recording
game details,
leaderboards,
session
information,
usage history,
and logs
Storing user
profiles,
session details,
personalization
settings, entity
specific
metadata

20. Writes
Replicated continuously to 3 AZs
Persisted to disk (custom SSD)
Reads
Strongly or eventually consistent
No latency trade-off
Automatic replication for rock-solid durability and
availability

21. Simple app architecture with Amazon DynamoDB
Elastic Load
Balancing Amazon EC2
app instances
Clients
DynamoDB
Business logic

22. You pay for the resources that you use
Monthly
bill = GB +
Pricing varies by region. Further details at http://aws.amazon.com/dynamodb/pricing/
Storage
consumed
Write
capacity
units
(WCUs)
+
Read
capacity
units
(RCUs)
Free tier:
• Generous free tier of 25 GB, 25 WCUs, and 25 RCUs
• That is, you get over 60M read requests and 60M write request for free in a month
• The free tier is indefinite—you benefit from this every month

23. What is Amazon Redshift?

24. Amazon
Redshift
a lot faster
a lot cheaper
a whole lot simpler
Relational data warehouse
Massively parallel; petabyte scale
Fully managed
HDD and SSD platforms
$1,000/TB/year; starts at $0.25/hour

25. Amazon Redshift architecture
Leader node
• Simple SQL endpoint
• Stores metadata
• Optimizes query plan
• Coordinates query execution
Compute nodes
• Local columnar storage
• Parallel/distributed execution of all
queries, loads, backups, restores,
resizes
Start at just $0.25/hour, grow to 2 PB
(compressed)
• DC1: SSD; scale 160 GB–326 TB
• DS2: HDD; scale 2 TB–2 PB
10 GigE
(HPC)
Ingestion
Backup
Restore
JDBC/ODBC

26. Amazon Redshift is fast
Dramatically less I/O
Column storage
Data compression
Zone maps
Direct-attached storage
Large data block sizes
10 | 13 | 14 | 26 |…
… | 100 | 245 | 324
375 | 393 | 417…
… 512 | 549 | 623
637 | 712 | 809 …
… | 834 | 921 | 959
10
324
375
623
637
959
ID Age State Amount
123 20 CA 500
345 25 WA 250
678 40 FL 125
957 37 WA 375

27. Fully managed, continuous/incremental backups
Multiple copies within cluster
Continuous and incremental backups
to Amazon S3
Continuous and incremental backups
across regions
Streaming restore
Amazon S3
Amazon S3
Region 1
Region 2

28. Security is built-in
• Load encrypted from S3
• SSL to secure data in transit
• Amazon VPC for network isolation
• Encryption to secure data at rest
• On-premises HSM and AWS
CloudHSM support
• SOC 1, 2, and 3; PCI-DSS;
FedRAMP; BAA
10 GigE
(HPC)
Ingestion
Backup
Restore
Customer VPC
Internal
VPC
JDBC/ODBC

29. You pay for what you use
Further details at https://aws.amazon.com/redshift/pricing/
Monthly
bill = N ×
Duration for which the
nodes were used
Number of nodes
(Price depends on type
of node)
2 month free trial
Leader node is free
No upfront costs, pay as you go

30. What is Amazon ElastiCache?

31. In-memory key-value store
High-performance
Memcached and Redis
Fully managed; zero adminAmazon
ElastiCache

32. Popular use cases
Caching layer for
performance or cost
optimization
Databases
Ephemeral key-value
data
Storage
Leaderboards
In-memory lists
Session management
Event counters
High-performance
app patterns

33. Amazon ElastiCache: simple app architecture
Elastic Load
Balancing Amazon EC2
app instances
Clients
Amazon RDSAmazon
ElastiCache

34. • Fully managed
• Cache node auto-
discovery
• Multi-AZ node
placement
Key ElastiCache features
• Fully managed
• Multi-AZ with
auto-failover
• Persistence
• Read replicas

35. How ElastiCache billing works
Monthly
bill = N ×
Further details at http://aws.amazon.com/elasticache/pricing/
Duration for which the
nodes were used
Number of nodes
(Price depends on type
of node)
Free tier (for first 12 months)—750 micro cache node hours

36. To sum up…

37. What I’ll Cover
• DVSA - Who we are &
what we do?
• MOT
• Our challenge & why
AWS ?
• Why RDS ?
• What we have achieved
• Working with AWS & what’s Next
Rob Hart, Head of Solutions & Design Architecture, DVSA

38. DVSA

39. What We Do
• Driving Test
• MOT
• Operator Licensing
• Test & Inspection
• Enforcement

40. MOT Stats
80,000 users
55,000 testers
42 million
tests
per year
500 tests
performed a
minute at
peak
Over 27,000
businesses
across the
UK

41. DVSA MOT before AWS
• Scale
• Number and speed of provisioning of disks
• The need for provisioned IOP
• Speed of rollout to development at test environments
• Agility to bring new environments on line quickly
• Data transfer
• Loading many millions of records legacy to new solution

42. Choosing AWS
DVSA commissioned an independent review to evaluate
cloud providers across a number of criteria including:
• Security
• Reliability
• Availability
• Performance
• Flexibility and support for Open Standards
Against these criteria AWS was identified as the preferred
platform by DVSA

43. Choosing RDS and the Benefits
Platform as a Service
• Conservatively oversized, provisioned IOPS, maximum server sizes
• Monitoring established “right size”
Automation
• Terraform deployments
Data Management
• Backup/Snapshots
• Cloning
• Replication
Monitoring
• Comprehensive
• Out of the box

44. Considerations
Security
• RDS does not need to be accessible outside AWS
• Locked down to ensure no external access
Cost
• RDS instances run continuously
• Rightsizing is important
• Server size, IOPS requirement, storage all factors
Data Import/Export
• Database not accessed directly from outside AWS
RDS
Web
App
EC2
Import /
Export
SSH

45. RDS Options Considered

46. What We’ve Achieved with RDS
Over 32 million
tests completed
since release
143
deployments
since go-live
a year ago.
Over 5 billion
database
records

47. Working with Amazon Web Services
DVSA worked with AWS throughout the build, migration
and early live running:
• Key architectural decisions
• Best use of the platform
• Support on hand when issues were encountered in immediate
fixing and problem resolution
• Well architected review

48. What’s Next
• Operator Licencing now running on AWS in Beta with full
production rollout this year
• Moving existing applications to the AWS cloud
• Discoveries for developing new cloud native applications
Thank you!

49. Benefits of AWS managed database services
Pay only for what
you use
No upfront cost
Fully managed
services
AWS handles
installs, patching,
restarts
Easy to scale
Grow as you need
Designed for use
with other AWS
services
AWS
Data Pipeline
Amazon
EC2
Amazon
S3
Amazon
CloudWatch
Amazon
SNS
Amazon
VPC

50. Please remember to rate this
session under My Agenda on
awssummit.london