Contenu connexe Similaire à Oracle Open World Exadata Monitoring and Management with EM12c (20) Plus de Kellyn Pot'Vin-Gorman (20) Oracle Open World Exadata Monitoring and Management with EM12c2. EXADATA HEALTH AND RESOURCE
USAGE MONITORING
Including the Benefits of Administration Tuning Methods
Kellyn Pot’Vin
Consulting Member of Enterprise Manager Technical Team
Strategic Customer Program
Mike Chafin
Principal Member of Technical Staff
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Open World 2014
Oracle Confidential
3. Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for
information purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functionality, and should not be relied upon
in making purchasing decisions. The development, release, and timing of any features or
functionality described for Oracle’s products remains at the sole discretion of Oracle.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Confidential 3
4. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Program Agenda
1
2
3
4
5
Oracle Tuning Methodologies
Preparing for Tuning
Working through Tuning Exercise
Digging Deeper
Miscellaneous Tips
Oracle Confidential 4
5. Program Agenda with Highlight
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
1
2
3
4
5
Oracle Tuning Methodologies
Preparing for Tuning
Working through Tuning Exercise
Digging Deeper
Miscellaneous Tips
Oracle Confidential 5
6. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Evolution of Methodologies
Documented in the Oracle Documentation Set:
Database 2 Day + Performance Tuning Guide
Oracle Database Performance Tuning Guide
Exadata Performance Tuning White Paper
Each are similar, in that they offer a structural approach to problem solving using the latest tools and
technologies.
Oracle Confidential 6
7. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Tuning Level
What level is the Issue?
• Hardware
• Database
• Schema/Design
• SQL
Oracle Confidential 7
8. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Important Tuning Concepts
Tuning a database by “DBTime”
DBTime is the term used by Oracle to calculate the time used by active
CPU, IO and other foreground processes from the total time elapsed to
calculate wait events that are performed within the database.
“Tune for Time or You’re Wasting Time…”
Oracle Confidential 8
9. Program Agenda with Highlight
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
1
2
3
4
5
Oracle Tuning Methodologies
Preparing for Tuning
Working through Tuning Exercise
Digging Deeper
Miscellaneous Tips
Oracle Confidential 9
10. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Tuning Exercise Steps
• Prepare
• Compare
• Review (research, investigate)
• Rule out, Test
• Implement/Resolve
Oracle Confidential 10
11. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Prepare
Oracle Confidential 11
Collect hardware and software healthchecks
• exachk, cluvfy, emdiag,
• Healthchecks
• AWR Baseline
• Verify and/or set AWR retention period
Copy configuration files
• Automate collection and base-lining (EM jobs)
Create AWR, ASH and ADDM reports for research.
12. Stopping the Insanity Flowchart
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Confidential 12
13. The Value of Quick Check Lists
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Old School, but VALUABLE.
Oracle Confidential 13
14. Program Agenda with Highlight
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
1
2
3
4
5
Oracle Tuning Methodologies
Preparing for Tuning
Working through Tuning Exercise
Digging Deeper
Miscellaneous Tips
Oracle Confidential 14
15. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Comparison Tools
• Incredible Power in Knowing What’s Changed.
Oracle Confidential 15
16. Compare
If there is a problem what has changed?
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
And who might know?
Considerations
• Patch levels (everywhere!)
• Schema
• Tunable OS parameters
• Resource Management Plans
• Code Changes
• ADDM Comparison Report
Oracle Confidential 16
18. Compare Configuration- Database Level
• EM Job to compare one ‘reference’ database against one or more other
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
databases
• Job can be scheduled on a repetitive basis, or run ad-hoc
Oracle Confidential 18
19. Compare Configurations- Schema Level
Capture Schema baselines
Compare schema’s
• With a baseline
• Between different databases
Synchronize schema’s
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Confidential 19
20. Compare Analysis Report
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Compare ADDM
AWR Snapshot
Period 1
AWR Snapshot
Period 2
Period ADDM
• Full ADDM analysis across two AWR snapshot periods
• Detects causes, measure effects, then correlates them
Causes : Workload changes, Configuration changes
Effects : Regressed SQL, Reach resource limits (CPU, I/O, memory, interconnect)
• Makes actionable recommendations along with quantified impact
SQL Commonality
Regressed SQL
I/O Bound
Undersized SGA
21. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
IO Issues
What type of IO Issues are addressed with Exadata features?
How can temp tablespace usage be an impact to performance in an
Exadata?
• Identify IO Issues- ASH Analytics, ADDM Comparison Report
• Isolate IO Issues- Search SQL, ASH/ADDM Reports,
• Address IO Issues- IO Resource Manager, SQL Tuning Advisor,
Oracle Confidential 21
22. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Exadata and SQL Monitor
Offload Percent Efficiency Displayed in Report and UI.
• Automatically monitors long running SQL
• Enabled out-of-the-box with no performance overhead
• Monitors each SQL and PL/SQL execution
• Shows global PL/SQL and SQL level statistics
• Drill-down to slow SQL for diagnosing unexpected PL/SQL behavior
• Guides tuning efforts
Oracle Confidential 22
23. IO Bound Dashboard in ASH Analytics
• Base vs. comparison period
• Temp reads/writes specified
• Single block read latency
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
24. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Setting Thresholds
Thresholds with incident rule sets to notify when growth in resource occurs
and impacts the environment.
Oracle Confidential 24
25. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
IO Resource Manager
• IO Resource Manager, (IORM) offers ability to maintain
consistent performance levels across an engineered system.
• Allocates and limits IO per settings configured
• Simple configuration access via Enterprise Manager
Oracle Confidential 25
26. Enterprise Manager Exadata Resource Management
• Exadata plugin specifica
access to manage IO
Resources for db and across
cell nodes.
What IO resources on Exadata
are shared vs. on a non-
Exadata RAC environment?
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Confidential 26
27. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
IO Resource Management
Oracle Confidential 27
28. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Monitoring IORM
Oracle Confidential 28
29. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Monitoring Disk Utilization
Oracle Confidential 29
30. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Max Cell Disk Limits
Oracle Confidential 30
31. Why Setting Limits are Important
• No Hard Limits equate to IO being freely redistributed
• Setting limits ensures that resources are available for critical
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
databases
• Less high priority databases aren’t able to allocate more than
necessary
Oracle Confidential 31
32. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Review
• Errors in the system?
• EM Incident Manager
• Alert Log(s)
• Grid Infrastructure
• ASM
• Database
• OS logs / system logs
Oracle Confidential 32
33. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
AND Rule Out- Hardware
• Compute Node CPU
• I/O Bound / at known limits
• Exadata – Flash cache
• Mixed Workloads creating contention?
• ALL Components up!
Oracle Confidential 33
34. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Exachk-
See Oracle Support Document 1070954.1: “Oracle Exadata Database Machine Exachk or HealthCheck”
Oracle Confidential 34
35. Exachk and Healthcheck Utility Checks…
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
• Incorrect configurations
• Parameter Issues
• Recommendations, steps to correct, along with current value.
See Oracle Support Document 1070954.1: “Oracle Exadata Database
Machine Exachk or HealthCheck” and Exadata best practices in Oracle
Support Document 757552.1: “Oracle Exadata Best Practices
Oracle Confidential 35
36. Automate Exachk via Enterprise Manager
Automating will populate healthchecks to UI!
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Confidential 36
37. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Storage Grid Overview
Storage Cell monitoring and administration support
–Cell Home page and performance pages
–Actions supported: Start/stop Cell, verify connectivity, setup SSH
Automatic discovery of Cells
Management by Cell Group
–All cells used by a database automatically placed in a group
–Cell Group level administration operations (batch job monitoring)
Oracle Confidential 37
38. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
More Storage Grid Overview
Oracle Confidential 38
39. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Hardware- DB Node View
Oracle Confidential 39
40. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Hardware- Cell Server View
Oracle Confidential 40
41. Program Agenda with Highlight
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
1
2
3
4
5
Oracle Tuning Methodologies
Preparing for Tuning
Working through Tuning Exercise
Digging Deeper
Miscellaneous Tips
Oracle Confidential 41
42. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
AWR Baselines
• Collection of snapshots used for performance comparisons.
• Baselines are retained within the AWR even after the retention time for
the data has been reached.
• Exadata should have a moving and a static baseline in place to capture
different workloads.
Oracle Confidential 42
43. Details of Baseline Creation in EM
Highlight a snapshot
range to use for your
static baseline or use a
time range to base it
from.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Confidential 43
44. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
AWR Baselines
Oracle Confidential 44
45. Completing Baseline Creation in EM
Schedule the job to run
in a non-impacting
schedule and choose
not to purge.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Confidential 45
46. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
SQL Issues
SQL Tuning – what kind of problem?
• Reactive
• Transient
• Long Running SQL
• Proactive
• Persistent
• Comparative
Oracle Confidential 46
47. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Proactive SQL Tuning Choices
• SQL Performance Analyzer
• SQL Access advisor
• ASH and ADDM to prioritize further work
• Group operations (DB12)
• Create an SLA / baseline
• Use SQL Plan Baselines (SPM)
• Validate with SQL Performance Analyzer
Oracle Confidential 47
48. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Reactive SQL Tuning Choices
After all changes, including any environments are ruled out…
• Start with AWR, ADDM and ASH
• Identify outliers / worst performing (Pareto)
• Review top wait events
• SQL Tuning Advisor
• If resource constrained consider resource limiting strategies
Oracle Confidential 48
49. Database Performance Page in EM12c
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Confidential 49
50. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
ASH Analytics
Oracle Confidential 50
51. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
ASH Analytics
Requirements for 10g and 11g databases:
• Additional PL/SQL packages to be installed into the DBSNMP schema
• CONNECT, CREATE TYPE and CREATE PROCEDURE privileges
• Submit the job to install as SYS from the UI
View information in real-time in the database
Save a snapshot as HTML (or email the report) for offline analysis
• Active report, user can visualize data on multiple dimensions, (or run from command line for text version)
Help videos available:
Use Active Session History (ASH) Analytics
https://apex.oracle.com/pls/apex/f?p=44785%3A24%3A0%3A%3ANO%3A24%3AP24_CONTENT_ID%2CP24_PREV_PAGE%3A5451%2C1
Oracle Confidential 51
52. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Advisor Central
All database advisors grouped together on one launch page:
• Advisors, focused on recommendations
• Checkers, focused on diagnostics
53. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
SQL Advisors
• SQL Tuning Set
– Capture of SQL in the database
– Ideally run after a representative workload has been run
• Access Advisor
– Analyses access patterns of SQL in the cache, or from a defined workload, and gives
recommendations on how to (re)structure the database objects
• Performance Analyzer
– Analyses before and after images of SQL in a SQL Tuning Set (Testing scenarios)
– Compares results
• Tuning Advisor
– Requires Tuning Sets (Collection of SQL from the database)
– Analyses the SQL from a SQL Tuning Set and gives recommendations
Oracle Confidential 53
54. AWR Warehouse and Exadata
Scheduler jobs with Agent to
Agent push to AWR Warehouse
Target, scheduled by EM12c EM
Job Service.
AWR Warehouse
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Confidential 54
55. Query Across Entire Exadata to Show True Consolidation
Value
Adapt Valuable Exadata Specific Queries to AWR Warehouse-from
dba_hist_sys_time_model stm, dba_hist_snapshot s, gv$parameter p, dbsnmp.caw_dbid_mapping m
where stm.stat_name in ('DB CPU','background cpu time')
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
and LOWER(m.target_name)= '&dbname'
and s.dbid= m.new_dbid and s.snap_id = stm.snap_id
and s.dbid = stm.dbid and s.instance_number = stm.instance_number
and p.name = 'cpu_count' and p.inst_id = s.instance_number)
Oracle Confidential 55
56. IO Information Across Databases on Exadata?
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Oracle Confidential – Internal/Restricted/Highly Restricted 56
400000
350000
300000
250000
200000
150000
100000
50000
0
June 10, 2013
l_reads_s read_iops_max read_iops_direct read_iops_direct_max
600000
500000
400000
300000
200000
100000
0
June 10, 2014
l_reads_s read_iops_max read_iops_direct read_iops_direct_max
57. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Answer Specific IT Questions
Oracle Confidential 57
58. Program Agenda with Highlight
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
1
2
3
4
5
Oracle Tuning Methodologies
Preparing for Tuning
Working through Tuning Exercise
Digging Deeper
Miscellaneous Tips
Oracle Confidential 58
59. Making Copies of Configuration Files
Copy and automate copying of essential database files via Enterprise Manager-
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
• All instance/database init and spfiles
• Database password files
• ASM init files
• ASM password files
Create an Enterprise Manager job to copy these files on a regular basis.
Oracle Confidential 59
60. A Review of Hardware Network “Red Herrings”
• HA can mask problems, reduced capacity even while
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
meeting service levels
• Hardware Utilization Issues
• CPU is not what it may seem
• I/O Subsystem (Cell screens)
• Network Congestion (IB screens)
Oracle Confidential 60
61. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Achieving the tao of Exadata
Exadata is an Engineered System, Powerful and Complex!
• Perform Exachk reviews quarterly, (preferably monthly.)
• Install Enterprise Manager Plug-in for advanced monitoring and
enhanced performance impact detection.
• Take advantage of the great performance and tuning features included
as part of the diagnostic and tuning packs
• Use IO Resource Manager to deter from impact to critical database
systems.
Oracle Confidential 61
62. Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Want to Learn More?
Whitepapers and Links:
http://www.oracle.com/technetwork/database/availability/exadata-health-resource-
usage-2021227.pdf
http://www.oracle.com/us/products/enterprise-manager/index.html
http://docs.oracle.com/cd/E11857_01/install.111/e23441/pichk.htm
Oracle Confidential 62
63. Connect with me via Social Media:
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 63
Notes de l'éditeur This is a Title Slide with Picture slide ideal for including a picture with a brief title, subtitle and presenter information.
To customize this slide with your own picture:
Right-click the slide area and choose Format Background from the pop-up menu. From the Fill menu, click Picture and texture fill. Under Insert from: click File. Locate your new picture and click Insert. This is a Safe Harbor Front slide, one of two Safe Harbor Statement slides included in this template.
One of the Safe Harbor slides must be used if your presentation covers material affected by Oracle’s Revenue Recognition Policy
To learn more about this policy, e-mail: Revrec-americasiebc_us@oracle.com
For internal communication, Safe Harbor Statements are not required. However, there is an applicable disclaimer (Exhibit E) that should be used, found in the Oracle Revenue Recognition Policy for Future Product Communications. Copy and paste this link into a web browser, to find out more information.
http://my.oracle.com/site/fin/gfo/GlobalProcesses/cnt452504.pdf
For all external communications such as press release, roadmaps, PowerPoint presentations, Safe Harbor Statements are required. You can refer to the link mentioned above to find out additional information/disclaimers required depending on your audience.