Contenu connexe Similaire à Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 2018 (20) Plus de Amazon Web Services (20) Going Deep on Amazon Aurora Serverless (DAT427-R1) - AWS re:Invent 20182. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Going Deep on Amazon Aurora
Serverless
Anoop Gupta
Software Development Manager
Amazon Web Services
D A T 4 2 7 R
Alexey Kuznetsov
Sr. Software Development Engineer
Amazon Web Services
3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
• Amazon RDS & Aurora fundamentals
• What is Amazon Aurora Serverless?
• How it works
• Q&A
4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS is . . .
Cloud native engine Open source engines Commercial engines
RDS platform
• Automatic fail-over
• Backup & recovery
• X-region replication
• Isolation & security
• Industry compliance
• Automated patching
• Advanced monitoring
• Routine maintenance
• Push-button scaling
Image credit: By Mackphillips - Own work, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=55946550
5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora is . . .. . .
Cloud native engine Open source engines Commercial engines
RDS platform
• Automatic fail-over
• Backup & recovery
• X-region replication
• Isolation & security
• Industry compliance
• Automated patching
• Advanced monitoring
• Routine maintenance
• Push-button scaling
Image credit: By Mackphillips - Own work, CC BY-SA 4.0, https://commons.wikimedia.org/w/index.php?curid=55946550
6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora - databases reimagined for the cloud
Speed and availability of high-end commercial databases
Simplicity and cost-effectiveness of open source databases
Drop-in compatibility with MySQL and PostgreSQL
Simple pay as you go pricing
Delivered as a fully managed service
7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Availability zone 1
Region
Availability zone 2 Availability zone 3
Scale-out, distributed, multi-tenant design . . .
Purpose-built log-structured,
distributed storage
Shared storage volume
Storage nodes with SSDs
Master
SQL
Transaction
s
Caching
Reader
5
Reader
9
SQL
Transaction
s
Caching
SQL
Transaction
s
Caching
Reader
1
SQL
Transaction
s
Caching
Reader
8
SQL
Transaction
s
Caching
Reader
15
SQL
Transaction
s
Caching
… … …
10GiB stripes
Master and up to 15 Readers
all point to the same storage
6-way replication, 2 per AZ
Quorums survive AZ+1 failure
8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Availability zone 1
Region
Availability zone 2 Availability zone 3
With provisioned Aurora, you size the master yourself
Shared storage volume
Storage nodes with SSDs
Master
SQL
Transaction
s
Caching
Size for the peak load
-or-
Continuously monitor and
manually scale up/down
9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora Serverless . . .
Responds to your application automatically
• Start up
• Shut down
• Scale capacity
11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Real world examples…
12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
You have some choices to make . . .
Provision for peak
Continuously monitor and
manually scale up/down
-or-
Expensive
Hard
• Requires experts
• Risks outages
Provision less than peak End-user (business) impact
-or-
13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Database capacity management
Availability zone 1
Region
App
Shared distributed storage volume
Master
14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Database capacity management
Availability zone 1
Region
App
Shared distributed storage volume
Original master Scale-up target
Add a scale-up target
15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Database capacity management
Availability zone 1
Region
App
Shared distributed storage volume
Original master New master
Cutover
16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Database capacity management
Availability zone 1
Region
App
Shared distributed storage volume
Original master New master
17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Database capacity management
Availability zone 1
Region
App
Shared distributed storage volume
Original master Scale-up target
Add a proxy, shield the application
from connection changesProxy
18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Database capacity management
Availability zone 1
Region
App
Shared distributed storage volume
New scale-up target
Proxy
New master
Cutover
19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Database capacity management – is hard
Availability zone 1
Region
App
Shared distributed storage volume
New scale-up target
Proxy
New master
20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora Serverless . . .
Responds to your application load automatically
• Scale capacity with no downtime
• Multi-tenant proxy is highly available
• Scale target has warm buffer pool
• Shuts down when not in use
21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How does it work . . .
Availability zone 1
Region
App
Shared distributed storage volume
Multi-tenant proxy layer
Warm-pool of Aurora instances
Monitoring service
23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How does it work . . .
Availability zone 1
Region
App
Shared distributed storage volume
Multi-tenant proxy layer
Warm-pool of Aurora instances
Monitoring service
24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How does it work . . .
Availability zone 1
Region
App
Shared distributed storage volume
Multi-tenant proxy layer
Warm-pool of Aurora instances
Monitoring service
25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How does it work . . .
Availability zone 1
Region
App
Shared distributed storage volume
Multi-tenant proxy layer
Warm-pool of Aurora instances
Monitoring service
26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How does it work . . .
Availability zone 1
Region
App
Shared distributed storage volume
Multi-tenant proxy layer
Warm-pool of Aurora instances
Monitoring service
27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How does it work . . .
Availability zone 1
Region
App
Shared distributed storage volume
Multi-tenant proxy layer
Warm-pool of Aurora instances
Monitoring service
28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How does it work . . .
Availability zone 1
Region
App
Shared distributed storage volume
Multi-tenant proxy layer
Warm-pool of Aurora instances
Monitoring service
29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How does it work . . .
Availability zone 1
Region
App
Shared distributed storage volume
Multi-tenant proxy layer
Warm-pool of Aurora instances
Monitoring service
30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Simpler experience: Less to worry about
• No CPU credits to monitor
• No commitment to particular availability zone
• No migrations between instance type generations
• No DB instance reservations to manage
• No instances to manage
• Encryption at REST is always enabled
• No need to manually suspend and resume database
• No DNS propagation delays
• No maintenance window
• No old database versions to upgrade
31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Introducing Amazon Relational Database Service Data API
• Simple web service protocol for database access
• SQL statements packaged as HTTP requests
• Access your database from Lambda and AppSync
• Access your database from the AWS SDK & CLI
Data API Service
Aurora Serverless
33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Introducing RDS Console Query Editor
• Access your database from
AWS Management Console
• No database client application
or terminal required
34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora Serverless – for PostgreSQL
Now in preview, sign-up today:
https://pages.awscloud.com/amazon
-aurora-postgresql-serverless-
preview.html
35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Aurora Serverless – more regions
• Aurora Serverless newly available
in:
• Seoul
• Singapore
• Sydney
• Mumbai
• N. California
• London, Paris
• Frankfurt
• Central Canada
36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Related breakouts
Thursday, November 29th
Accelerate Database Development and Testing with Amazon Aurora
11:30 a.m. - 1:45 p.m. | Mirage, Mirage Event Center C3
Thursday, November 29th
Accelerate Your Analytic Queries with Amazon Aurora Parallel Query
4:00 p.m. - 5:00 p.m. | Venetian, Level 2, Veronese 2406
Thursday, November 29th
Build on Amazon Aurora with MySQL Compatibility
4:00 p.m. – 5:00 p.m. | Mirage, Grand Ballroom B, Table 7
37. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Anoop Gupta
gupanoop@amazon.com
Alexey Kuznetsov
alexey@amazon.com
38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How to migrate?
To Aurora MySQL
To Aurora Serverless
for MySQL
Restore from snapshot ✓ ✓
Dump & load ✓ ✓
AWS Data Migration Service ✓ ✓
Transaction log replication ✓ ✗
Restore from Amazon S3 ✓ ✓*
40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Availability
Aurora MySQL
(Multi-AZ)
Aurora MySQL
(Single-AZ)
Aurora Serverless
for MySQL
Fast failover ✓ ✗ ✗
Cross-AZ failover ✓ ✗ ✓
Storage HA/durability ✓ ✓ ✓