SlideShare une entreprise Scribd logo
1  sur  33
Achieving Peak
Performance
From Your Virtual SQL Servers
DBA-218David Klee, Founder
Heraflux Technologies
About David Klee
@kleegeek
davidklee.net
gplus.to/kleegeek
linked.com/a/davidaklee
Specialties / Focus Areas / Passions:
• Performance Tuning
• Virtualization
• Infrastructure
• Troubleshooting
• High Availability
• Disaster Recovery
• Capacity Management
• Health & Efficiency
Please silence
cell phones
Explore Everything PASS Has to Offer
Free SQL Server and BI Web Events Free 1-day Training Events Regional Event
Local User Groups Around
the World
Free Online Technical Training
This is Community Business Analytics Training
Session Recordings PASS Newsletter
Session Evaluations
ways to access
Go to
passsummit.com/evals
Download the GuideBook App
and search: PASS Summit 2014
Follow the QR code link displayed
on session signage throughout the
conference venue and in the
program guide
Submit by 11:59 PM EST
Friday Nov. 7 to
WIN prizes
Your feedback is
important and valuable.
Evaluation Deadline:
11:59 PM EST, Sunday Nov. 16
• What is Virtualization?
• What does Virtualization Mean for DBAs?
• Environmental Design & Performance Impact
• SQL Server Virtual Machine Construction
• SQL Server Workload Sizing
• It’s all About the Performance!
Agenda
• Most DBA’s virtualization experience…
• Added layer – removes hardware dependency from the
OS and above
• Hardware treated as physical resources
• All resources have queues
• Expect equivalent performance
What is Virtualization?
Historical Physical Model
SAN Disk Pool
Local Disks (OS, Instance Home)
SQL Server A
SQL Server B
Data
Logs
Data
Logs
Today’s Virtualization Model
SANDisk Pool
LUN
LUN
LUN
VIRTUALIZATIONVM
VM
VM
• Single compute node hardware
• Total cluster compute capacity
• Storage speed (IOPs, throughput)
• VM maximums
• Interconnect path speed
Hard Limits (Resources) Soft Limits (Queues)
• Memory oversubscription
• CPU scheduler contention
• Shared resource utilization
• Variable resource utilization levels
• “Noisy Neighbors”
Hard vs. Soft Limits
Resources
150
GHz
CPU
4 TB
Memory
4x10GbE
Network
20 TB
Tier 1
Storage
40 TB
Tier 2
Storage
VM
16 vCPU
128 GB vRAM
VM
8 vCPU
64 GB vRAM
VM
2 vCPU
16 GB
vRAM
VM
2 vCPU
16 GB
vRAM
VM
2 vCPU
16 GB
vRAM
VM
2 vCPU
16 GB
vRAM
VM
2 vCPU
16 GB
vRAM
VM
2 vCPU
16 GB
vRAM
V I R T U A L I Z A T I O N
Queues
Hypervisor
CPU Scheduler
CPU
Execution
CPU Scheduling Queue
Memory Allocator
Mem
R / W
Mem Allocation Queue
Disk Scheduler
Disk
R / W
Disk Scheduling Queue
Network Scheduler
Network
Tran / Rec
Network Scheduling Queue
VM TASK
VM TASK
VM TASK
VM TASK
VM TASK
• Resource limits are easy to detect / work around
• Queue contention much harder
• Time in queue = time lost from VM
• Silent performance killer
• Everything in a VM must be scheduled
• … including idle resources
• Queue processing is not always FIFO
Goal: Minimize Queue Waits
• VMs cannot span physical servers
• Fastest CPU cores vs. overall core count
• Maximize host memory capacity
• No host memory overcommitment
• Monitor resource consumption & contention metrics
Host – Physical Server
• Most shared
• Most critical
• Most complex
• Most problematic
• Slowest piece of the stack
• Random I/O disk patterns
• Many individual points of contention
Storage
Storage – Contention Points
Controller
Controller
LUN
LUN
LUN
LUN
Disk Pool
VM
VM
VM
VM
• Test raw performance
• SQLIO Batch
bit.ly/1mEAS9W
• DiskSpd
bit.ly/1CeQauw
• Collect metrics:
• I/Os per second (IOPs)
• Latency (ms)
• Throughput (MB/s)
Storage - Maximums
0.00
10000.00
20000.00
30000.00
40000.00
50000.00
60000.00
70000.00
1 2 4 8 16 32 64 128
IOps Thread Intensity
IOps Per Operations per Thread
Sequential Read
Random Read
Sequential Write
Random Write
• Huge performance bottleneck potential
• Get fastest possible!
• Get most possible!
• Multi-pathing configuration / software
• Vendor-recommended HBA queue depth settings
• Verify and test end-to-end performance
Network & Storage Interconnects
• Verify network end-to-end performance
• Use iperf to test network throughput
• bit.ly/1eDCYbi
• How-To Guide: bit.ly/YET53p
Network Throughput Testing
• Co-locate VMs on same physical machine
• Same vNetwork, improved performance
Physical Proximity
• CPU
• vCPU counts
• vNUMA configuration
• Hot-add?
• Memory
• Full memory reservation
• Dynamic memory
• Hot-add?
VM Configuration
• Storage
• Virtual disks whenever
possible
• Multiple virtual disks
“Right-Size” it!
• “Right” amount of vCPU and vRAM resources
• Physical world = Size for end of life
• Virtual world = Size for right now
• Idle vCPUs will slow application VMs performance
• Analyze performance baselines and determine
the resources you need
• Repeat “right-sizing” analysis routinely
“Right-Sizing” the VM
• Not done at just vCPU count
• vNUMA configuration also matters
• Closely align with pNUMA
• Adds efficiency by aligning with underlying hardware
• Performance difference improves with larger VMs
CPU Sizing - NUMA
• Get physical machine configuration
• Try to fit VM inside one NUMA node
• Otherwise, balance across number
of NUMA nodes
• Test configurations for best results
CPU Sizing - vNUMA
• Example: 16 vCPU VM
• What’s better?
• 2 vSocket x 8 vCore?
• 4 vSocket x 4 vCore?
• 8 vSocket x 2 vCore?
• Varies by workload,
hardware
• Test it for yourself!
CPU Sizing – vNUMA Results
0
100000
200000
300000
400000
500000
600000
700000
800000
900000
8 16 64 256
Transactions/min Concurrent HammerDB Users
vNUMA SQL Server Scalability - 16 vCPUs - HammerDB
4socket x 4CPU 8socket x 2CPU 2socket x 8CPU
• SQL Server data must be in buffer pool
• More memory ≈ less I/O
• Less I/O = less waiting on shared storage & queues
• NO HOST MEMORY OVERCOMMITMENT
• Too much memory = lower consolidation ratio
• Balancing act
Memory
C: - Operating System
D: - SQL Server Instance Home
E: - System Databases (master, model, msdb) *
F: - User Database Data (1 of X)
G: - User Database Log (1 of Y)
H: - TempDB
Y: - Windows Page file **
Z: - Backups
vDisk Layout
Adjust as necessary
(but stay standardized)
• Set power settings to “High Performance” (CPU-Z)
• Set antivirus exclusions for SQL Server (tinyurl.com/sqlav)
• Ongoing OS-level performance metric collection
• No greater than five minute interval
• 24 x 7, not just as-needed
• Windows Perfmon, Microsoft SCOM,
or any other third-party utility
• tinyurl.com/kleeperfmon
Operating System
• Goal: Maximize performance while reducing resource
scheduling
• Parallelizable workloads
• Determine how parallel the workload is
• Set MaxDOP = vNUMA node core count (?)
• Cost threshold for parallelism = Not default
SQL Server
• Spread out the I/O
• File groups, data files, partitions
• Parallelism with multiple active storage paths
• Reduce I/O
• Table & index compression
• In-memory constructs
• More RAM
• SSD read / write caching
SQL Server Database
• You can virtualize it successfully!
• Understand your SQL Server workloads
• Individual
• Aggregate
• “Right-size” your VMs & baseline performance
• Routinely check ongoing performance
Conclusions
Contact Me!
davidklee.net @kleegeek
Questions?
Thanks for attending!

Contenu connexe

En vedette

Lal kitab 1952 volume 3 (Hindi)
Lal kitab 1952 volume 3 (Hindi)Lal kitab 1952 volume 3 (Hindi)
Lal kitab 1952 volume 3 (Hindi)Arun Yadav
 
OpenStack Neutron Behind The Senes
OpenStack Neutron Behind The SenesOpenStack Neutron Behind The Senes
OpenStack Neutron Behind The Senesopenstackindia
 
Notes on predictive astrology part i 12.4.09
Notes on predictive astrology part i  12.4.09 Notes on predictive astrology part i  12.4.09
Notes on predictive astrology part i 12.4.09 anthony writer
 
Effects of grahas on body- DR MOHIT LODHA
Effects of grahas on body- DR MOHIT LODHAEffects of grahas on body- DR MOHIT LODHA
Effects of grahas on body- DR MOHIT LODHAdrmohitlodha
 
LCEU13: Securing your cloud with Xen's advanced security features - George Du...
LCEU13: Securing your cloud with Xen's advanced security features - George Du...LCEU13: Securing your cloud with Xen's advanced security features - George Du...
LCEU13: Securing your cloud with Xen's advanced security features - George Du...The Linux Foundation
 
Notes on predictive astrology part ii 28062012
Notes on predictive astrology  part ii 28062012Notes on predictive astrology  part ii 28062012
Notes on predictive astrology part ii 28062012anthony writer
 
AWS Storage and Database Architecture Best Practices (DAT203) | AWS re:Invent...
AWS Storage and Database Architecture Best Practices (DAT203) | AWS re:Invent...AWS Storage and Database Architecture Best Practices (DAT203) | AWS re:Invent...
AWS Storage and Database Architecture Best Practices (DAT203) | AWS re:Invent...Amazon Web Services
 
Installing ms sql server 2012 express edition
Installing ms sql server 2012 express editionInstalling ms sql server 2012 express edition
Installing ms sql server 2012 express editionWally Pons
 

En vedette (12)

Lal kitab 1952 volume 3 (Hindi)
Lal kitab 1952 volume 3 (Hindi)Lal kitab 1952 volume 3 (Hindi)
Lal kitab 1952 volume 3 (Hindi)
 
ACI Hands-on Lab
ACI Hands-on LabACI Hands-on Lab
ACI Hands-on Lab
 
OPNFV & OpenStack
OPNFV & OpenStackOPNFV & OpenStack
OPNFV & OpenStack
 
OpenStack Neutron Behind The Senes
OpenStack Neutron Behind The SenesOpenStack Neutron Behind The Senes
OpenStack Neutron Behind The Senes
 
Notes on predictive astrology part i 12.4.09
Notes on predictive astrology part i  12.4.09 Notes on predictive astrology part i  12.4.09
Notes on predictive astrology part i 12.4.09
 
Effects of grahas on body- DR MOHIT LODHA
Effects of grahas on body- DR MOHIT LODHAEffects of grahas on body- DR MOHIT LODHA
Effects of grahas on body- DR MOHIT LODHA
 
LCEU13: Securing your cloud with Xen's advanced security features - George Du...
LCEU13: Securing your cloud with Xen's advanced security features - George Du...LCEU13: Securing your cloud with Xen's advanced security features - George Du...
LCEU13: Securing your cloud with Xen's advanced security features - George Du...
 
Notes on predictive astrology part ii 28062012
Notes on predictive astrology  part ii 28062012Notes on predictive astrology  part ii 28062012
Notes on predictive astrology part ii 28062012
 
AWS Storage and Database Architecture Best Practices (DAT203) | AWS re:Invent...
AWS Storage and Database Architecture Best Practices (DAT203) | AWS re:Invent...AWS Storage and Database Architecture Best Practices (DAT203) | AWS re:Invent...
AWS Storage and Database Architecture Best Practices (DAT203) | AWS re:Invent...
 
Session 3 Java Script
Session 3 Java ScriptSession 3 Java Script
Session 3 Java Script
 
Vedic Remedies (Gemstones)
Vedic Remedies (Gemstones)Vedic Remedies (Gemstones)
Vedic Remedies (Gemstones)
 
Installing ms sql server 2012 express edition
Installing ms sql server 2012 express editionInstalling ms sql server 2012 express edition
Installing ms sql server 2012 express edition
 

Plus de heraflux

SQL Server Introduction to Infrastructure Boot Camp
SQL Server Introduction to Infrastructure Boot CampSQL Server Introduction to Infrastructure Boot Camp
SQL Server Introduction to Infrastructure Boot Campheraflux
 
SQL Server 2017 on Linux - Administration
SQL Server 2017 on Linux - AdministrationSQL Server 2017 on Linux - Administration
SQL Server 2017 on Linux - Administrationheraflux
 
vBrownBag VMworld Europe - vNUMA and You
vBrownBag VMworld Europe - vNUMA and YouvBrownBag VMworld Europe - vNUMA and You
vBrownBag VMworld Europe - vNUMA and Youheraflux
 
Journey to Becoming an IT Consultant
Journey to Becoming an IT ConsultantJourney to Becoming an IT Consultant
Journey to Becoming an IT Consultantheraflux
 
Right-Sizing your SQL Server Virtual Machine
Right-Sizing your SQL Server Virtual MachineRight-Sizing your SQL Server Virtual Machine
Right-Sizing your SQL Server Virtual Machineheraflux
 
Scaling Up and Out your Virtualized SQL Servers
Scaling Up and Out your Virtualized SQL ServersScaling Up and Out your Virtualized SQL Servers
Scaling Up and Out your Virtualized SQL Serversheraflux
 

Plus de heraflux (6)

SQL Server Introduction to Infrastructure Boot Camp
SQL Server Introduction to Infrastructure Boot CampSQL Server Introduction to Infrastructure Boot Camp
SQL Server Introduction to Infrastructure Boot Camp
 
SQL Server 2017 on Linux - Administration
SQL Server 2017 on Linux - AdministrationSQL Server 2017 on Linux - Administration
SQL Server 2017 on Linux - Administration
 
vBrownBag VMworld Europe - vNUMA and You
vBrownBag VMworld Europe - vNUMA and YouvBrownBag VMworld Europe - vNUMA and You
vBrownBag VMworld Europe - vNUMA and You
 
Journey to Becoming an IT Consultant
Journey to Becoming an IT ConsultantJourney to Becoming an IT Consultant
Journey to Becoming an IT Consultant
 
Right-Sizing your SQL Server Virtual Machine
Right-Sizing your SQL Server Virtual MachineRight-Sizing your SQL Server Virtual Machine
Right-Sizing your SQL Server Virtual Machine
 
Scaling Up and Out your Virtualized SQL Servers
Scaling Up and Out your Virtualized SQL ServersScaling Up and Out your Virtualized SQL Servers
Scaling Up and Out your Virtualized SQL Servers
 

Dernier

Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...limedy534
 
Predictive Analysis for Loan Default Presentation : Data Analysis Project PPT
Predictive Analysis for Loan Default  Presentation : Data Analysis Project PPTPredictive Analysis for Loan Default  Presentation : Data Analysis Project PPT
Predictive Analysis for Loan Default Presentation : Data Analysis Project PPTBoston Institute of Analytics
 
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝soniya singh
 
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...soniya singh
 
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Sapana Sha
 
Identifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population MeanIdentifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population MeanMYRABACSAFRA2
 
PKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptxPKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptxPramod Kumar Srivastava
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDRafezzaman
 
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改yuu sss
 
办理学位证纽约大学毕业证(NYU毕业证书)原版一比一
办理学位证纽约大学毕业证(NYU毕业证书)原版一比一办理学位证纽约大学毕业证(NYU毕业证书)原版一比一
办理学位证纽约大学毕业证(NYU毕业证书)原版一比一fhwihughh
 
DBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfDBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfJohn Sterrett
 
RadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfRadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfgstagge
 
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdfPredicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdfBoston Institute of Analytics
 
Defining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data StoryDefining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data StoryJeremy Anderson
 
Advanced Machine Learning for Business Professionals
Advanced Machine Learning for Business ProfessionalsAdvanced Machine Learning for Business Professionals
Advanced Machine Learning for Business ProfessionalsVICTOR MAESTRE RAMIREZ
 
MK KOMUNIKASI DATA (TI)komdat komdat.docx
MK KOMUNIKASI DATA (TI)komdat komdat.docxMK KOMUNIKASI DATA (TI)komdat komdat.docx
MK KOMUNIKASI DATA (TI)komdat komdat.docxUnduhUnggah1
 
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Jack DiGiovanna
 
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样vhwb25kk
 
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一F sss
 

Dernier (20)

Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
Effects of Smartphone Addiction on the Academic Performances of Grades 9 to 1...
 
Predictive Analysis for Loan Default Presentation : Data Analysis Project PPT
Predictive Analysis for Loan Default  Presentation : Data Analysis Project PPTPredictive Analysis for Loan Default  Presentation : Data Analysis Project PPT
Predictive Analysis for Loan Default Presentation : Data Analysis Project PPT
 
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
 
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
 
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
 
Identifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population MeanIdentifying Appropriate Test Statistics Involving Population Mean
Identifying Appropriate Test Statistics Involving Population Mean
 
PKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptxPKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptx
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
 
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
专业一比一美国俄亥俄大学毕业证成绩单pdf电子版制作修改
 
办理学位证纽约大学毕业证(NYU毕业证书)原版一比一
办理学位证纽约大学毕业证(NYU毕业证书)原版一比一办理学位证纽约大学毕业证(NYU毕业证书)原版一比一
办理学位证纽约大学毕业证(NYU毕业证书)原版一比一
 
DBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfDBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdf
 
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
Deep Generative Learning for All - The Gen AI Hype (Spring 2024)
 
RadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfRadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdf
 
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdfPredicting Salary Using Data Science: A Comprehensive Analysis.pdf
Predicting Salary Using Data Science: A Comprehensive Analysis.pdf
 
Defining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data StoryDefining Constituents, Data Vizzes and Telling a Data Story
Defining Constituents, Data Vizzes and Telling a Data Story
 
Advanced Machine Learning for Business Professionals
Advanced Machine Learning for Business ProfessionalsAdvanced Machine Learning for Business Professionals
Advanced Machine Learning for Business Professionals
 
MK KOMUNIKASI DATA (TI)komdat komdat.docx
MK KOMUNIKASI DATA (TI)komdat komdat.docxMK KOMUNIKASI DATA (TI)komdat komdat.docx
MK KOMUNIKASI DATA (TI)komdat komdat.docx
 
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
Building on a FAIRly Strong Foundation to Connect Academic Research to Transl...
 
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
1:1定制(UQ毕业证)昆士兰大学毕业证成绩单修改留信学历认证原版一模一样
 
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
办理学位证中佛罗里达大学毕业证,UCF成绩单原版一比一
 

Achieving Peak Performance from your Virtualized SQL Servers

  • 1. Achieving Peak Performance From Your Virtual SQL Servers DBA-218David Klee, Founder Heraflux Technologies
  • 2. About David Klee @kleegeek davidklee.net gplus.to/kleegeek linked.com/a/davidaklee Specialties / Focus Areas / Passions: • Performance Tuning • Virtualization • Infrastructure • Troubleshooting • High Availability • Disaster Recovery • Capacity Management • Health & Efficiency
  • 4. Explore Everything PASS Has to Offer Free SQL Server and BI Web Events Free 1-day Training Events Regional Event Local User Groups Around the World Free Online Technical Training This is Community Business Analytics Training Session Recordings PASS Newsletter
  • 5. Session Evaluations ways to access Go to passsummit.com/evals Download the GuideBook App and search: PASS Summit 2014 Follow the QR code link displayed on session signage throughout the conference venue and in the program guide Submit by 11:59 PM EST Friday Nov. 7 to WIN prizes Your feedback is important and valuable. Evaluation Deadline: 11:59 PM EST, Sunday Nov. 16
  • 6. • What is Virtualization? • What does Virtualization Mean for DBAs? • Environmental Design & Performance Impact • SQL Server Virtual Machine Construction • SQL Server Workload Sizing • It’s all About the Performance! Agenda
  • 7. • Most DBA’s virtualization experience… • Added layer – removes hardware dependency from the OS and above • Hardware treated as physical resources • All resources have queues • Expect equivalent performance What is Virtualization?
  • 8. Historical Physical Model SAN Disk Pool Local Disks (OS, Instance Home) SQL Server A SQL Server B Data Logs Data Logs
  • 9. Today’s Virtualization Model SANDisk Pool LUN LUN LUN VIRTUALIZATIONVM VM VM
  • 10. • Single compute node hardware • Total cluster compute capacity • Storage speed (IOPs, throughput) • VM maximums • Interconnect path speed Hard Limits (Resources) Soft Limits (Queues) • Memory oversubscription • CPU scheduler contention • Shared resource utilization • Variable resource utilization levels • “Noisy Neighbors” Hard vs. Soft Limits
  • 11. Resources 150 GHz CPU 4 TB Memory 4x10GbE Network 20 TB Tier 1 Storage 40 TB Tier 2 Storage VM 16 vCPU 128 GB vRAM VM 8 vCPU 64 GB vRAM VM 2 vCPU 16 GB vRAM VM 2 vCPU 16 GB vRAM VM 2 vCPU 16 GB vRAM VM 2 vCPU 16 GB vRAM VM 2 vCPU 16 GB vRAM VM 2 vCPU 16 GB vRAM V I R T U A L I Z A T I O N
  • 12. Queues Hypervisor CPU Scheduler CPU Execution CPU Scheduling Queue Memory Allocator Mem R / W Mem Allocation Queue Disk Scheduler Disk R / W Disk Scheduling Queue Network Scheduler Network Tran / Rec Network Scheduling Queue VM TASK VM TASK VM TASK VM TASK VM TASK
  • 13. • Resource limits are easy to detect / work around • Queue contention much harder • Time in queue = time lost from VM • Silent performance killer • Everything in a VM must be scheduled • … including idle resources • Queue processing is not always FIFO Goal: Minimize Queue Waits
  • 14. • VMs cannot span physical servers • Fastest CPU cores vs. overall core count • Maximize host memory capacity • No host memory overcommitment • Monitor resource consumption & contention metrics Host – Physical Server
  • 15. • Most shared • Most critical • Most complex • Most problematic • Slowest piece of the stack • Random I/O disk patterns • Many individual points of contention Storage
  • 16. Storage – Contention Points Controller Controller LUN LUN LUN LUN Disk Pool VM VM VM VM
  • 17. • Test raw performance • SQLIO Batch bit.ly/1mEAS9W • DiskSpd bit.ly/1CeQauw • Collect metrics: • I/Os per second (IOPs) • Latency (ms) • Throughput (MB/s) Storage - Maximums 0.00 10000.00 20000.00 30000.00 40000.00 50000.00 60000.00 70000.00 1 2 4 8 16 32 64 128 IOps Thread Intensity IOps Per Operations per Thread Sequential Read Random Read Sequential Write Random Write
  • 18. • Huge performance bottleneck potential • Get fastest possible! • Get most possible! • Multi-pathing configuration / software • Vendor-recommended HBA queue depth settings • Verify and test end-to-end performance Network & Storage Interconnects
  • 19. • Verify network end-to-end performance • Use iperf to test network throughput • bit.ly/1eDCYbi • How-To Guide: bit.ly/YET53p Network Throughput Testing
  • 20. • Co-locate VMs on same physical machine • Same vNetwork, improved performance Physical Proximity
  • 21. • CPU • vCPU counts • vNUMA configuration • Hot-add? • Memory • Full memory reservation • Dynamic memory • Hot-add? VM Configuration • Storage • Virtual disks whenever possible • Multiple virtual disks “Right-Size” it!
  • 22. • “Right” amount of vCPU and vRAM resources • Physical world = Size for end of life • Virtual world = Size for right now • Idle vCPUs will slow application VMs performance • Analyze performance baselines and determine the resources you need • Repeat “right-sizing” analysis routinely “Right-Sizing” the VM
  • 23. • Not done at just vCPU count • vNUMA configuration also matters • Closely align with pNUMA • Adds efficiency by aligning with underlying hardware • Performance difference improves with larger VMs CPU Sizing - NUMA
  • 24. • Get physical machine configuration • Try to fit VM inside one NUMA node • Otherwise, balance across number of NUMA nodes • Test configurations for best results CPU Sizing - vNUMA
  • 25. • Example: 16 vCPU VM • What’s better? • 2 vSocket x 8 vCore? • 4 vSocket x 4 vCore? • 8 vSocket x 2 vCore? • Varies by workload, hardware • Test it for yourself! CPU Sizing – vNUMA Results 0 100000 200000 300000 400000 500000 600000 700000 800000 900000 8 16 64 256 Transactions/min Concurrent HammerDB Users vNUMA SQL Server Scalability - 16 vCPUs - HammerDB 4socket x 4CPU 8socket x 2CPU 2socket x 8CPU
  • 26. • SQL Server data must be in buffer pool • More memory ≈ less I/O • Less I/O = less waiting on shared storage & queues • NO HOST MEMORY OVERCOMMITMENT • Too much memory = lower consolidation ratio • Balancing act Memory
  • 27. C: - Operating System D: - SQL Server Instance Home E: - System Databases (master, model, msdb) * F: - User Database Data (1 of X) G: - User Database Log (1 of Y) H: - TempDB Y: - Windows Page file ** Z: - Backups vDisk Layout Adjust as necessary (but stay standardized)
  • 28. • Set power settings to “High Performance” (CPU-Z) • Set antivirus exclusions for SQL Server (tinyurl.com/sqlav) • Ongoing OS-level performance metric collection • No greater than five minute interval • 24 x 7, not just as-needed • Windows Perfmon, Microsoft SCOM, or any other third-party utility • tinyurl.com/kleeperfmon Operating System
  • 29. • Goal: Maximize performance while reducing resource scheduling • Parallelizable workloads • Determine how parallel the workload is • Set MaxDOP = vNUMA node core count (?) • Cost threshold for parallelism = Not default SQL Server
  • 30. • Spread out the I/O • File groups, data files, partitions • Parallelism with multiple active storage paths • Reduce I/O • Table & index compression • In-memory constructs • More RAM • SSD read / write caching SQL Server Database
  • 31. • You can virtualize it successfully! • Understand your SQL Server workloads • Individual • Aggregate • “Right-size” your VMs & baseline performance • Routinely check ongoing performance Conclusions

Notes de l'éditeur

  1. SQLIO Batch