Learning Objectives: - Learn how Performance Insights helps solve the database monitoring problem - Understand what data is collected and how to use it to determine the load on the database - Learn how to read the Performance Insights dashboard and drill down to analyze bottlenecks

1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Kyle Hailey, Principal Product
Manager
February 2018
Introducing Performance
InsightsCloud-Based Database Performance Monitoring

2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What is Performance Insights?
Customers ask for
• Visibility into performance of RDS databases
• Want to optimize cloud database workloads
• Easy tool
• Often only part time DBA or no DBA
• Single Pane of glass

3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
First Step: RDS Enhanced Monitoring
Released 2016
• OS Metrics
• Up to 1 second granularity
• Process/thread List

4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Introducing: Performance Insights
Dashboard
• DB load
• Adjustable timeframe
• Filterable by attribute (SQL, User, Host, Wait)
• SQL causing load
Phased RDS delivery
• Aurora, MySQL/MariaDB, PostgreSQL, Commercial DB
Guided discovery of performance problems
• For both beginners & experts
• Core metric “Database Load”

5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What is “Database Load”?
All engines have a connections list showing
• active
• Idle
We sample every second
• For each active session, collect
• SQL,
• State :CPU, I/O, Lock, Commit log wait, etc
• Host
• User
Expose as “Average Active Sessions” (AAS)

6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Performance Insights dashboard

7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Sampling

8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Sampling Every Second
Query run often
Fast query run rarely
Slow query
User 1
User 2
User 3
Time

9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Sampling is like film

10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Average Active Session (AAS) load graph
User 1
User 2
User 3
User 4

11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Average Active Session (AAS) load graph
User 1
User 2
User 3
User 4
Active Sessions
=
1
2
3
4

12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Active vs Idle
idleidle idle idleQuery 1 Query 2 Query 3
Time

13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Active Session State
CPU IO Wait
idleidle idle idleQuery 1 Query 2 Query 3
Time

14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AAS by session state

15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Showing per second samples

16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AAS over 1 minute averages

17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AAS compared to Max CPU
Max CPU

18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Average Active Sessions (AAS)

19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AAS rules : Using CPU count as yardstick
 AAS < 1
Database is not blocked
 AAS ~= 0
Database basically idle
Problems are in the APP not DB
 AAS < # of CPUs
CPU available
Are any single sessions 100% active?
• AAS > # of CPUs
Could have performance problems
 AAS >> # of CPUS
There is a bottleneck

20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
When users say the database is slow …
AAS = 0
You prove that it’s not the database

21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Also useful for sizing
• If load significantly less than #vCPU then oversized
• If load Is > #vCPU undersized

22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Accessing Performance Insights

23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Access to Performance Insights

24. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Access to Performance Insights
High
Load

25. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Customer Use Case : CPU Bottleneck

26. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Customer Use Case : CPU bottleneck
Wait
States

27. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CPU bottleneck
CPU
Load

28. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CPU bottleneck
Max
CPU

29. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CPU bottleneck
High
Load

30. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CPU bottleneck
CPU
Load
SQL
With
High
CPU

31. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CPU bottleneck

32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CPU bottleneck

33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Customer Use Case : Wait Bottleneck

34. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Wait Bottleneck

35. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Wait Bottleneck

36. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Dashboard : other dimensions for grouping

37. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Other Dimensions

38. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Top Host by SQL statement

39. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Live Demo

40. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Architecture

41. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Architecture
• Automated
• Light weight agent
• Data is stored in native AWS services
• Data encrypted with customer keys
• Dashboard has no impact on database

42. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Releases

43. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What is available at launch?
AVAILABLE AT LAUNCH
Aurora support
• PostgreSQL compatible edition
DB Load chart
• DB Load slicing by attributes
• Adjustable time frame 5 min to 1 day
• Wait, user, host, SQL
• Click and Drag zoom
Top N Table
• Wait, user, host, SQL

44. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What is available?
AVAILABLE AT LAUNCH
Aurora support
• PostgreSQL compatible edition
DB Load chart
• DB Load slicing by attributes
• Adjustable time frame 5 min to 1 day
• Wait, user, host, SQL
• Click and Drag zoom
Top N Table
• Wait, user, host, SQL
COMING
• API / SDK
• Metric charts (DB and OS)
• SQL Execution Plan
• Alerting
– Integration with Cloud Watch
• Other database platforms
– Aurora MySQL, RDS Postgres, RDS
MySQL, RDS MariaDB
• SQL Stats
• Long term data retention

45. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Summary

46. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Summary: Amazon RDS Performance Insights
 DB Load : Average Active Sessions
 Identifies database bottlenecks
 Easy
 Powerful
 Top SQL
 Identifies source of bottleneck
 Enables Problem Discovery
 Adjustable Time frame
 Minutes, Hour, day
 Questions:
 rdspi@amazon.com

47. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!