SlideShare une entreprise Scribd logo
1  sur  30
01/24/14 by Shehap El Nagar
Shehap ELNagar
I am MVP,MCTS , MCITP SQL Server, I am DB consultant and Architect for lots of Banking, Telecom ,Ministries and governmental
organizations all over Gulf ,also he has deep knowledge about T-SQL performance , HW Performance issues, Data Warehousing
solutions , SQL Server Replication, Clustering solutions and Database Designs for different kinds of systems ...
The founder of the biggest SQL Server community all over the middle east http://sqlserver-performance-tuning.net/ , you can watch
its success memories at http://www.youtube.com/user/ShehapElNagar
Moderator and author at http://www.sql-server-performance.com ,
, the 1st SQL Server Author at MSDN Arabia http://msdn.microsoft.com/ar-sa/library/jj149119.aspx
, Speaker at SQL Saturday Events worldwide , local events at Saudi Arabia , many online events , more than 90 video tutorials and
also many private sessions for .net developers and Database Administrators
And also influent participator at Microsoft Forums of SQL Server at http://social.technet.microsoft.com.
More about him , you can find him on MVP Microsoft site http://mvp.microsoft.com/en-us/mvp/Shehap%20El-Nagar-5000188 .
You can contact him at the below contacts :Mail :idgdirector@yahoo.com ….Cellular phone :00966560700733
First :Overhead look on new SQL Server 2014 features
•
•

Major Improvements outlines
Evolution from SQL Server 2000 to SQL Server 2014

Second :In Memory OLTP built in
•
•
•
•
•

Definition
Architectural design
Values and benefits
Caveats and recommendations
Demo

Third :CCI (Clustered Columnstore Index)
•
•
•
•
•

•
•
•

Definition
Architectural design
Values and benefits
Caveats and recommendations
Demo

Third: Single Partition OIR , locks priority management
Definition
Values and benefits
Demo

Fifth: New HW Resources supported and IO Resource Governor
First :Overhead look on new
SQL Server 2014 features
The Evolution of Microsoft Data Platform
XML ● KPIs

SQL Server
2000

Management Studio ● Mirroring

SQL Server
2005

Compression ● Policy-Based Mgmt ● Programmability

SQL Server
2008

PowerPivot ● SharePoint Integration ● Master Data Services

SQL Server
2008 R2

Always On ● ColumnStore Index ● Data Quality Services ● Power View ● Cloud Connectivity

SQL Server
2012

In-Memory Across Workloads ● Performance & Scale ● Hybrid Cloud Optimized ● HDInsight ● Cloud BI

SQL Server
2014
Secure

Database Vulnerabilities
80

69
53

60
40
20
0

0

5

16

2006

2

28
25
16 11
9

2007

55

53

2008
SQL Server

34
21

29
8

43

8

0

43

29
6

1

6

2009
2010
2011
Oracle
MySQL
DB2

4

22 20
12

2012

18
0

0

2013

*National Institute of Standards and Technology Comprehensive Vulnerability Database 4/17/2013, Market share from IDC 2013
In-Memory OLTP
10X-30X faster for new and existing SQL Server apps

Clustered column store index
Updatable clustered columnstore index

Single Partition OIR
Single partitions for online index rebuild for a less impact

Locks priority Management
Define priority level and wait times for OIR for a less impact

Hardware scalable
IO Resource Governor and more HW resources are supported
First Myth: In Memory OLTP
Architectural design
Hekaton project to reduce the cost of query engine (35% delay) and
access engine (45% delay)
Memory optimized tables are working on memory as streamlined
No page latch, no buffer pool , no lock manager like disk based table
They are supporting Natively compiled Stored procedures which are .dll
entry points compiled to machine code using Visual C++ compilers
In Memory OLTP benefits and values
High-performance
data operations

Frictionless scale-up

Efficient, businesslogic processing

Hybrid engine and
integrated
experience

Main-memory
optimized

High concurrency

T-SQL compiled to
machine code

SQL Server
integration

• T-SQL compiled to
machine code via Visual
C compiler
• Invoking a procedure is
just a DLL entry-point
• Aggressive
optimizations at compile
time
• No change whatsoever
in your code in your

• Same manageability,
administration, and
development experience
• Integrated queries and
transactions
• Integrated HA and
backup/restore

• Indexes (hash and
range) exist only in
memory
• No buffer pool
• The Highest durability
• Columns size from 8060
bytes to 512 GB 512 GB 

• Multiversion optimistic
concurrency control
with full ACID support
• Core engine uses lockfree algorithms
• No lock manager,
latches, or spinlocks

Hardware trends
Steadily declining
memory price, NVRAM

Many-core processors

code
Stalling CPU clock rate

Business
TCO
In Memory benefits and values
Microsoft In-Memory Technologies
• In-Memory Analytics in
PowerPivot for Excel

• StreamInsight

• In-Memory OLTP
• In-Memory Columnstore
Index (in SQL Server 2014)

• In-Memory Analytics in SQL
Server Analysis Services

201
4

201
4

201
2

201
2

201
4
Caveats and Recommendations :
•Identity and Sequence
•Foreign keys and constraints
•DML triggers
•Some columns types like BLOB columns as image and varbinar (ma), XML, ROWGuid,
timestamp, text as well as ntext and CLR columns as hierarchyid,geography and geometry
•Data Compression and Clustered index but just only NONCLUSTERED HASH index
•Computed columns.
•Truncate option but just delete
•Table hints like with (nolock)..etc
•Alter natively compiled procedure is not supported but just you have to drop it and re-create it again
•Natively compiled SPs don’t support merge commands
Demo Part
Second Myth: Clustered ColumnStore Index
Architectural design
•

Nonclustered column store indexes are based
on xVelocity analytics engine and xVelocity
columnstore index

•

Store data in column-wise fashion 

•

Hekaton technique which is in contrast a
row-based technology 

•

CCI (Clustered column store index ) is a mix between
Hekaton and xVelocity analytics engine and
xVelocity columnstore index

•

CCI is the table itself as CCI includes all columns
Benefits and values of CCI
• Columnstores: clustered and updatable

No contradiction with DML as Data can be inserted, updated, or deleted
• Fast execution for data warehouse queries
• Speedups of 10x -30x
• No need for separated base table
• Saves space and Simpler management
• Eliminate need for other indexes
• Saves space and simpler management
• More data types supported for batch mode execution
• Removes many limitations from non-clustered columnstores in SQL Server 2012
Benefits and values of CCI
Batch Mode

Row Mode
Caveats and Recommendations :
•Foreign keys and constraints
•DML triggers
•Some columns types like BLOB columns as image and varbinar (max), XML,
ROWGuid, timestamp, text as well as ntext and CLR columns
as hierarchyid,geography and geometry
•Computed columns.
• Transactional replication nor peer to peer replication
Demo Part
Third Myth: Single Partition OIR and
locks priority management
Definitions and terminologies
Managed Lock Priority  is used for determining the lock
priority of OIR (online index redbud) or switch partitions
relatively to other end users transaction
Single Partition Online Index Rebuild   is used to allow
OIR for single partitions
Benefits and values
• Increased concurrency and application availability
• Saving for throughput and thus resources such as CPU ,
Memory  and IO
•

Log space is reduced much coz not all tables are going to be rebuilt once a
time but smaller chunks/partitions which permit for faster checkpoints
Fourth Myth: New HW Resources supported
and IO Resource Governor
New HW resources and IO Resource Governor
Demo Part
Q&A
Post your questions at:
http://www.sqlserver-performance-tuning.net/forums/
Thank you ..See you again

01/24/14
Performance dreams of sql server 2014

Contenu connexe

Tendances

MySQL At University Of Nottingham - 2018 MySQL Days
MySQL At University Of Nottingham - 2018 MySQL DaysMySQL At University Of Nottingham - 2018 MySQL Days
MySQL At University Of Nottingham - 2018 MySQL DaysMark Swarbrick
 
SQL Explore 2012 - Tzahi Hakikat and Keren Bartal: Extended Events
SQL Explore 2012 - Tzahi Hakikat and Keren Bartal: Extended EventsSQL Explore 2012 - Tzahi Hakikat and Keren Bartal: Extended Events
SQL Explore 2012 - Tzahi Hakikat and Keren Bartal: Extended Eventssqlserver.co.il
 
11g boot camp weblogic and adf
11g boot camp weblogic and adf11g boot camp weblogic and adf
11g boot camp weblogic and adfChad Thompson
 
SQL Explore 2012: P&T Part 3
SQL Explore 2012: P&T Part 3SQL Explore 2012: P&T Part 3
SQL Explore 2012: P&T Part 3sqlserver.co.il
 
20090425mysqlslides 12593434194072-phpapp02
20090425mysqlslides 12593434194072-phpapp0220090425mysqlslides 12593434194072-phpapp02
20090425mysqlslides 12593434194072-phpapp02Vinamra Mittal
 
Choosing the Right Big Data Tools for the Job - A Polyglot Approach
Choosing the Right Big Data Tools for the Job - A Polyglot ApproachChoosing the Right Big Data Tools for the Job - A Polyglot Approach
Choosing the Right Big Data Tools for the Job - A Polyglot ApproachDATAVERSITY
 
Clustered Columnstore Introduction
Clustered Columnstore IntroductionClustered Columnstore Introduction
Clustered Columnstore IntroductionNiko Neugebauer
 
Microsoft sql server database administration
Microsoft sql server database administrationMicrosoft sql server database administration
Microsoft sql server database administrationRahul Singh
 
KoprowskiT_SQLRelayBirmingham_SQLSecurityInTheClouds
KoprowskiT_SQLRelayBirmingham_SQLSecurityInTheCloudsKoprowskiT_SQLRelayBirmingham_SQLSecurityInTheClouds
KoprowskiT_SQLRelayBirmingham_SQLSecurityInTheCloudsTobias Koprowski
 
REDIS (Remote Dictionary Server)
REDIS (Remote Dictionary Server)REDIS (Remote Dictionary Server)
REDIS (Remote Dictionary Server)Ameya Vijay Gokhale
 
Clustered Columnstore - Deep Dive
Clustered Columnstore - Deep DiveClustered Columnstore - Deep Dive
Clustered Columnstore - Deep DiveNiko Neugebauer
 
KoprowskiT_PASSEastMidsFEB16_2AMaDisasterJustBegan
KoprowskiT_PASSEastMidsFEB16_2AMaDisasterJustBeganKoprowskiT_PASSEastMidsFEB16_2AMaDisasterJustBegan
KoprowskiT_PASSEastMidsFEB16_2AMaDisasterJustBeganTobias Koprowski
 
Project oriented online realtime training on sql
Project oriented online realtime training on sqlProject oriented online realtime training on sql
Project oriented online realtime training on sqlsssql
 
Virtual Study Beta Exam 71-663 Exchange 2010 Designing And Deploying Messagin...
Virtual Study Beta Exam 71-663 Exchange 2010 Designing And Deploying Messagin...Virtual Study Beta Exam 71-663 Exchange 2010 Designing And Deploying Messagin...
Virtual Study Beta Exam 71-663 Exchange 2010 Designing And Deploying Messagin...Tobias Koprowski
 
Ibm datastage online training in hyderabad
Ibm datastage online training in hyderabadIbm datastage online training in hyderabad
Ibm datastage online training in hyderabadGoLogica Technologies
 
PASS 2012 "Moves Like Jagger" - Upgrading to SQL Server 2012
PASS 2012 "Moves Like Jagger" - Upgrading to SQL Server 2012PASS 2012 "Moves Like Jagger" - Upgrading to SQL Server 2012
PASS 2012 "Moves Like Jagger" - Upgrading to SQL Server 2012Mark Broadbent
 
Evolutionary database design
Evolutionary database designEvolutionary database design
Evolutionary database designSalehein Syed
 
Optimize MySQL performance for developers
Optimize MySQL performance for developersOptimize MySQL performance for developers
Optimize MySQL performance for developersjackbillow
 

Tendances (20)

oracle openworld review UX presentation 2016
oracle openworld review UX presentation 2016oracle openworld review UX presentation 2016
oracle openworld review UX presentation 2016
 
MySQL At University Of Nottingham - 2018 MySQL Days
MySQL At University Of Nottingham - 2018 MySQL DaysMySQL At University Of Nottingham - 2018 MySQL Days
MySQL At University Of Nottingham - 2018 MySQL Days
 
SQL Explore 2012 - Tzahi Hakikat and Keren Bartal: Extended Events
SQL Explore 2012 - Tzahi Hakikat and Keren Bartal: Extended EventsSQL Explore 2012 - Tzahi Hakikat and Keren Bartal: Extended Events
SQL Explore 2012 - Tzahi Hakikat and Keren Bartal: Extended Events
 
11g boot camp weblogic and adf
11g boot camp weblogic and adf11g boot camp weblogic and adf
11g boot camp weblogic and adf
 
SQL Explore 2012: P&T Part 3
SQL Explore 2012: P&T Part 3SQL Explore 2012: P&T Part 3
SQL Explore 2012: P&T Part 3
 
20090425mysqlslides 12593434194072-phpapp02
20090425mysqlslides 12593434194072-phpapp0220090425mysqlslides 12593434194072-phpapp02
20090425mysqlslides 12593434194072-phpapp02
 
Choosing the Right Big Data Tools for the Job - A Polyglot Approach
Choosing the Right Big Data Tools for the Job - A Polyglot ApproachChoosing the Right Big Data Tools for the Job - A Polyglot Approach
Choosing the Right Big Data Tools for the Job - A Polyglot Approach
 
Clustered Columnstore Introduction
Clustered Columnstore IntroductionClustered Columnstore Introduction
Clustered Columnstore Introduction
 
AMIS Oracle OpenWorld 2013 Review Part 1 - Intro Overview Innovation, Hardwar...
AMIS Oracle OpenWorld 2013 Review Part 1 - Intro Overview Innovation, Hardwar...AMIS Oracle OpenWorld 2013 Review Part 1 - Intro Overview Innovation, Hardwar...
AMIS Oracle OpenWorld 2013 Review Part 1 - Intro Overview Innovation, Hardwar...
 
Microsoft sql server database administration
Microsoft sql server database administrationMicrosoft sql server database administration
Microsoft sql server database administration
 
KoprowskiT_SQLRelayBirmingham_SQLSecurityInTheClouds
KoprowskiT_SQLRelayBirmingham_SQLSecurityInTheCloudsKoprowskiT_SQLRelayBirmingham_SQLSecurityInTheClouds
KoprowskiT_SQLRelayBirmingham_SQLSecurityInTheClouds
 
REDIS (Remote Dictionary Server)
REDIS (Remote Dictionary Server)REDIS (Remote Dictionary Server)
REDIS (Remote Dictionary Server)
 
Clustered Columnstore - Deep Dive
Clustered Columnstore - Deep DiveClustered Columnstore - Deep Dive
Clustered Columnstore - Deep Dive
 
KoprowskiT_PASSEastMidsFEB16_2AMaDisasterJustBegan
KoprowskiT_PASSEastMidsFEB16_2AMaDisasterJustBeganKoprowskiT_PASSEastMidsFEB16_2AMaDisasterJustBegan
KoprowskiT_PASSEastMidsFEB16_2AMaDisasterJustBegan
 
Project oriented online realtime training on sql
Project oriented online realtime training on sqlProject oriented online realtime training on sql
Project oriented online realtime training on sql
 
Virtual Study Beta Exam 71-663 Exchange 2010 Designing And Deploying Messagin...
Virtual Study Beta Exam 71-663 Exchange 2010 Designing And Deploying Messagin...Virtual Study Beta Exam 71-663 Exchange 2010 Designing And Deploying Messagin...
Virtual Study Beta Exam 71-663 Exchange 2010 Designing And Deploying Messagin...
 
Ibm datastage online training in hyderabad
Ibm datastage online training in hyderabadIbm datastage online training in hyderabad
Ibm datastage online training in hyderabad
 
PASS 2012 "Moves Like Jagger" - Upgrading to SQL Server 2012
PASS 2012 "Moves Like Jagger" - Upgrading to SQL Server 2012PASS 2012 "Moves Like Jagger" - Upgrading to SQL Server 2012
PASS 2012 "Moves Like Jagger" - Upgrading to SQL Server 2012
 
Evolutionary database design
Evolutionary database designEvolutionary database design
Evolutionary database design
 
Optimize MySQL performance for developers
Optimize MySQL performance for developersOptimize MySQL performance for developers
Optimize MySQL performance for developers
 

Similaire à Performance dreams of sql server 2014

Performance Eye for the SQL Guy
Performance Eye for the SQL GuyPerformance Eye for the SQL Guy
Performance Eye for the SQL GuyWarwick Rudd
 
SQL Server 2014 – Features Drilldown.pptx
SQL Server 2014 – Features Drilldown.pptxSQL Server 2014 – Features Drilldown.pptx
SQL Server 2014 – Features Drilldown.pptxQuyVo27
 
SQL Server 2014 Features
SQL Server 2014 FeaturesSQL Server 2014 Features
SQL Server 2014 FeaturesKarunakar Kotha
 
Running SQL 2005? It’s time to migrate to SQL 2014!
Running SQL 2005? It’s time to migrate to SQL 2014!Running SQL 2005? It’s time to migrate to SQL 2014!
Running SQL 2005? It’s time to migrate to SQL 2014!Dell World
 
KoprowskiT_SQLRelayNottingham_BackupAndRestoreAD2015
KoprowskiT_SQLRelayNottingham_BackupAndRestoreAD2015KoprowskiT_SQLRelayNottingham_BackupAndRestoreAD2015
KoprowskiT_SQLRelayNottingham_BackupAndRestoreAD2015Tobias Koprowski
 
Oracle Database Performance Tuning Advanced Features and Best Practices for DBAs
Oracle Database Performance Tuning Advanced Features and Best Practices for DBAsOracle Database Performance Tuning Advanced Features and Best Practices for DBAs
Oracle Database Performance Tuning Advanced Features and Best Practices for DBAsZohar Elkayam
 
SQL Server Lift & Shift on Azure - SQL Saturday 921
SQL Server Lift & Shift on Azure - SQL Saturday 921SQL Server Lift & Shift on Azure - SQL Saturday 921
SQL Server Lift & Shift on Azure - SQL Saturday 921Marco Obinu
 
Oracle Enterprise Manager 12c: updates and upgrades.
Oracle Enterprise Manager 12c: updates and upgrades.Oracle Enterprise Manager 12c: updates and upgrades.
Oracle Enterprise Manager 12c: updates and upgrades.Rolta
 
"Clouds on the Horizon Get Ready for Drizzle" by David Axmark @ eLiberatica 2009
"Clouds on the Horizon Get Ready for Drizzle" by David Axmark @ eLiberatica 2009"Clouds on the Horizon Get Ready for Drizzle" by David Axmark @ eLiberatica 2009
"Clouds on the Horizon Get Ready for Drizzle" by David Axmark @ eLiberatica 2009eLiberatica
 
DB210 Smarter Database IBM Tech Forum 2011
DB210 Smarter Database   IBM Tech Forum 2011DB210 Smarter Database   IBM Tech Forum 2011
DB210 Smarter Database IBM Tech Forum 2011Laura Hood
 
Choosing the Right Business Intelligence Tools for Your Data and Architectura...
Choosing the Right Business Intelligence Tools for Your Data and Architectura...Choosing the Right Business Intelligence Tools for Your Data and Architectura...
Choosing the Right Business Intelligence Tools for Your Data and Architectura...Victor Holman
 
Sql dba 2008 r2 online training
Sql dba 2008 r2 online trainingSql dba 2008 r2 online training
Sql dba 2008 r2 online trainingsssql
 
2019 - GUOB Tech Day / Groundbreakers LAD Tour - Database Migration Methods t...
2019 - GUOB Tech Day / Groundbreakers LAD Tour - Database Migration Methods t...2019 - GUOB Tech Day / Groundbreakers LAD Tour - Database Migration Methods t...
2019 - GUOB Tech Day / Groundbreakers LAD Tour - Database Migration Methods t...Marcus Vinicius Miguel Pedro
 
KoprowskiT_SQLRelay2014#9_London_FromPlanToBackupToCloud
KoprowskiT_SQLRelay2014#9_London_FromPlanToBackupToCloudKoprowskiT_SQLRelay2014#9_London_FromPlanToBackupToCloud
KoprowskiT_SQLRelay2014#9_London_FromPlanToBackupToCloudTobias Koprowski
 
T sql performance guidelines for better db stress powers
T sql performance guidelines for better db stress powersT sql performance guidelines for better db stress powers
T sql performance guidelines for better db stress powersShehap Elnagar
 
T sql performance guidelines for better db stress powers
T sql performance guidelines for better db stress powersT sql performance guidelines for better db stress powers
T sql performance guidelines for better db stress powersShehap Elnagar
 
Implementation of Oracle ExaData and OFM 11g with Banner in HCT
Implementation of Oracle ExaData and OFM 11g with Banner in HCTImplementation of Oracle ExaData and OFM 11g with Banner in HCT
Implementation of Oracle ExaData and OFM 11g with Banner in HCTKhalid Tariq
 
Lessons from Building Large-Scale, Multi-Cloud, SaaS Software at Databricks
Lessons from Building Large-Scale, Multi-Cloud, SaaS Software at DatabricksLessons from Building Large-Scale, Multi-Cloud, SaaS Software at Databricks
Lessons from Building Large-Scale, Multi-Cloud, SaaS Software at DatabricksDatabricks
 
Building and Deploying Large Scale SSRS using Lessons Learned from Customer D...
Building and Deploying Large Scale SSRS using Lessons Learned from Customer D...Building and Deploying Large Scale SSRS using Lessons Learned from Customer D...
Building and Deploying Large Scale SSRS using Lessons Learned from Customer D...Denny Lee
 

Similaire à Performance dreams of sql server 2014 (20)

Performance Eye for the SQL Guy
Performance Eye for the SQL GuyPerformance Eye for the SQL Guy
Performance Eye for the SQL Guy
 
SQL Server 2014 – Features Drilldown.pptx
SQL Server 2014 – Features Drilldown.pptxSQL Server 2014 – Features Drilldown.pptx
SQL Server 2014 – Features Drilldown.pptx
 
SQL Server 2014 Features
SQL Server 2014 FeaturesSQL Server 2014 Features
SQL Server 2014 Features
 
Running SQL 2005? It’s time to migrate to SQL 2014!
Running SQL 2005? It’s time to migrate to SQL 2014!Running SQL 2005? It’s time to migrate to SQL 2014!
Running SQL 2005? It’s time to migrate to SQL 2014!
 
KoprowskiT_SQLRelayNottingham_BackupAndRestoreAD2015
KoprowskiT_SQLRelayNottingham_BackupAndRestoreAD2015KoprowskiT_SQLRelayNottingham_BackupAndRestoreAD2015
KoprowskiT_SQLRelayNottingham_BackupAndRestoreAD2015
 
25 snowflake
25 snowflake25 snowflake
25 snowflake
 
Oracle Database Performance Tuning Advanced Features and Best Practices for DBAs
Oracle Database Performance Tuning Advanced Features and Best Practices for DBAsOracle Database Performance Tuning Advanced Features and Best Practices for DBAs
Oracle Database Performance Tuning Advanced Features and Best Practices for DBAs
 
SQL Server Lift & Shift on Azure - SQL Saturday 921
SQL Server Lift & Shift on Azure - SQL Saturday 921SQL Server Lift & Shift on Azure - SQL Saturday 921
SQL Server Lift & Shift on Azure - SQL Saturday 921
 
Oracle Enterprise Manager 12c: updates and upgrades.
Oracle Enterprise Manager 12c: updates and upgrades.Oracle Enterprise Manager 12c: updates and upgrades.
Oracle Enterprise Manager 12c: updates and upgrades.
 
"Clouds on the Horizon Get Ready for Drizzle" by David Axmark @ eLiberatica 2009
"Clouds on the Horizon Get Ready for Drizzle" by David Axmark @ eLiberatica 2009"Clouds on the Horizon Get Ready for Drizzle" by David Axmark @ eLiberatica 2009
"Clouds on the Horizon Get Ready for Drizzle" by David Axmark @ eLiberatica 2009
 
DB210 Smarter Database IBM Tech Forum 2011
DB210 Smarter Database   IBM Tech Forum 2011DB210 Smarter Database   IBM Tech Forum 2011
DB210 Smarter Database IBM Tech Forum 2011
 
Choosing the Right Business Intelligence Tools for Your Data and Architectura...
Choosing the Right Business Intelligence Tools for Your Data and Architectura...Choosing the Right Business Intelligence Tools for Your Data and Architectura...
Choosing the Right Business Intelligence Tools for Your Data and Architectura...
 
Sql dba 2008 r2 online training
Sql dba 2008 r2 online trainingSql dba 2008 r2 online training
Sql dba 2008 r2 online training
 
2019 - GUOB Tech Day / Groundbreakers LAD Tour - Database Migration Methods t...
2019 - GUOB Tech Day / Groundbreakers LAD Tour - Database Migration Methods t...2019 - GUOB Tech Day / Groundbreakers LAD Tour - Database Migration Methods t...
2019 - GUOB Tech Day / Groundbreakers LAD Tour - Database Migration Methods t...
 
KoprowskiT_SQLRelay2014#9_London_FromPlanToBackupToCloud
KoprowskiT_SQLRelay2014#9_London_FromPlanToBackupToCloudKoprowskiT_SQLRelay2014#9_London_FromPlanToBackupToCloud
KoprowskiT_SQLRelay2014#9_London_FromPlanToBackupToCloud
 
T sql performance guidelines for better db stress powers
T sql performance guidelines for better db stress powersT sql performance guidelines for better db stress powers
T sql performance guidelines for better db stress powers
 
T sql performance guidelines for better db stress powers
T sql performance guidelines for better db stress powersT sql performance guidelines for better db stress powers
T sql performance guidelines for better db stress powers
 
Implementation of Oracle ExaData and OFM 11g with Banner in HCT
Implementation of Oracle ExaData and OFM 11g with Banner in HCTImplementation of Oracle ExaData and OFM 11g with Banner in HCT
Implementation of Oracle ExaData and OFM 11g with Banner in HCT
 
Lessons from Building Large-Scale, Multi-Cloud, SaaS Software at Databricks
Lessons from Building Large-Scale, Multi-Cloud, SaaS Software at DatabricksLessons from Building Large-Scale, Multi-Cloud, SaaS Software at Databricks
Lessons from Building Large-Scale, Multi-Cloud, SaaS Software at Databricks
 
Building and Deploying Large Scale SSRS using Lessons Learned from Customer D...
Building and Deploying Large Scale SSRS using Lessons Learned from Customer D...Building and Deploying Large Scale SSRS using Lessons Learned from Customer D...
Building and Deploying Large Scale SSRS using Lessons Learned from Customer D...
 

Dernier

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesBoston Institute of Analytics
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024SynarionITSolutions
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsRoshan Dwivedi
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024The Digital Insurer
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 

Dernier (20)

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 

Performance dreams of sql server 2014

  • 2. Shehap ELNagar I am MVP,MCTS , MCITP SQL Server, I am DB consultant and Architect for lots of Banking, Telecom ,Ministries and governmental organizations all over Gulf ,also he has deep knowledge about T-SQL performance , HW Performance issues, Data Warehousing solutions , SQL Server Replication, Clustering solutions and Database Designs for different kinds of systems ... The founder of the biggest SQL Server community all over the middle east http://sqlserver-performance-tuning.net/ , you can watch its success memories at http://www.youtube.com/user/ShehapElNagar Moderator and author at http://www.sql-server-performance.com , , the 1st SQL Server Author at MSDN Arabia http://msdn.microsoft.com/ar-sa/library/jj149119.aspx , Speaker at SQL Saturday Events worldwide , local events at Saudi Arabia , many online events , more than 90 video tutorials and also many private sessions for .net developers and Database Administrators And also influent participator at Microsoft Forums of SQL Server at http://social.technet.microsoft.com. More about him , you can find him on MVP Microsoft site http://mvp.microsoft.com/en-us/mvp/Shehap%20El-Nagar-5000188 . You can contact him at the below contacts :Mail :idgdirector@yahoo.com ….Cellular phone :00966560700733
  • 3. First :Overhead look on new SQL Server 2014 features • • Major Improvements outlines Evolution from SQL Server 2000 to SQL Server 2014 Second :In Memory OLTP built in • • • • • Definition Architectural design Values and benefits Caveats and recommendations Demo Third :CCI (Clustered Columnstore Index) • • • • • • • • Definition Architectural design Values and benefits Caveats and recommendations Demo Third: Single Partition OIR , locks priority management Definition Values and benefits Demo Fifth: New HW Resources supported and IO Resource Governor
  • 4. First :Overhead look on new SQL Server 2014 features
  • 5. The Evolution of Microsoft Data Platform XML ● KPIs SQL Server 2000 Management Studio ● Mirroring SQL Server 2005 Compression ● Policy-Based Mgmt ● Programmability SQL Server 2008 PowerPivot ● SharePoint Integration ● Master Data Services SQL Server 2008 R2 Always On ● ColumnStore Index ● Data Quality Services ● Power View ● Cloud Connectivity SQL Server 2012 In-Memory Across Workloads ● Performance & Scale ● Hybrid Cloud Optimized ● HDInsight ● Cloud BI SQL Server 2014
  • 6. Secure Database Vulnerabilities 80 69 53 60 40 20 0 0 5 16 2006 2 28 25 16 11 9 2007 55 53 2008 SQL Server 34 21 29 8 43 8 0 43 29 6 1 6 2009 2010 2011 Oracle MySQL DB2 4 22 20 12 2012 18 0 0 2013 *National Institute of Standards and Technology Comprehensive Vulnerability Database 4/17/2013, Market share from IDC 2013
  • 7.
  • 8. In-Memory OLTP 10X-30X faster for new and existing SQL Server apps Clustered column store index Updatable clustered columnstore index Single Partition OIR Single partitions for online index rebuild for a less impact Locks priority Management Define priority level and wait times for OIR for a less impact Hardware scalable IO Resource Governor and more HW resources are supported
  • 9. First Myth: In Memory OLTP
  • 10. Architectural design Hekaton project to reduce the cost of query engine (35% delay) and access engine (45% delay) Memory optimized tables are working on memory as streamlined No page latch, no buffer pool , no lock manager like disk based table They are supporting Natively compiled Stored procedures which are .dll entry points compiled to machine code using Visual C++ compilers
  • 11. In Memory OLTP benefits and values High-performance data operations Frictionless scale-up Efficient, businesslogic processing Hybrid engine and integrated experience Main-memory optimized High concurrency T-SQL compiled to machine code SQL Server integration • T-SQL compiled to machine code via Visual C compiler • Invoking a procedure is just a DLL entry-point • Aggressive optimizations at compile time • No change whatsoever in your code in your • Same manageability, administration, and development experience • Integrated queries and transactions • Integrated HA and backup/restore • Indexes (hash and range) exist only in memory • No buffer pool • The Highest durability • Columns size from 8060 bytes to 512 GB 512 GB  • Multiversion optimistic concurrency control with full ACID support • Core engine uses lockfree algorithms • No lock manager, latches, or spinlocks Hardware trends Steadily declining memory price, NVRAM Many-core processors code Stalling CPU clock rate Business TCO
  • 12. In Memory benefits and values
  • 13. Microsoft In-Memory Technologies • In-Memory Analytics in PowerPivot for Excel • StreamInsight • In-Memory OLTP • In-Memory Columnstore Index (in SQL Server 2014) • In-Memory Analytics in SQL Server Analysis Services 201 4 201 4 201 2 201 2 201 4
  • 14. Caveats and Recommendations : •Identity and Sequence •Foreign keys and constraints •DML triggers •Some columns types like BLOB columns as image and varbinar (ma), XML, ROWGuid, timestamp, text as well as ntext and CLR columns as hierarchyid,geography and geometry •Data Compression and Clustered index but just only NONCLUSTERED HASH index •Computed columns. •Truncate option but just delete •Table hints like with (nolock)..etc •Alter natively compiled procedure is not supported but just you have to drop it and re-create it again •Natively compiled SPs don’t support merge commands
  • 16. Second Myth: Clustered ColumnStore Index
  • 17. Architectural design • Nonclustered column store indexes are based on xVelocity analytics engine and xVelocity columnstore index • Store data in column-wise fashion  • Hekaton technique which is in contrast a row-based technology  • CCI (Clustered column store index ) is a mix between Hekaton and xVelocity analytics engine and xVelocity columnstore index • CCI is the table itself as CCI includes all columns
  • 18. Benefits and values of CCI • Columnstores: clustered and updatable No contradiction with DML as Data can be inserted, updated, or deleted • Fast execution for data warehouse queries • Speedups of 10x -30x • No need for separated base table • Saves space and Simpler management • Eliminate need for other indexes • Saves space and simpler management • More data types supported for batch mode execution • Removes many limitations from non-clustered columnstores in SQL Server 2012
  • 19. Benefits and values of CCI Batch Mode Row Mode
  • 20. Caveats and Recommendations : •Foreign keys and constraints •DML triggers •Some columns types like BLOB columns as image and varbinar (max), XML, ROWGuid, timestamp, text as well as ntext and CLR columns as hierarchyid,geography and geometry •Computed columns. • Transactional replication nor peer to peer replication
  • 22. Third Myth: Single Partition OIR and locks priority management
  • 23. Definitions and terminologies Managed Lock Priority  is used for determining the lock priority of OIR (online index redbud) or switch partitions relatively to other end users transaction Single Partition Online Index Rebuild   is used to allow OIR for single partitions
  • 24. Benefits and values • Increased concurrency and application availability • Saving for throughput and thus resources such as CPU , Memory  and IO • Log space is reduced much coz not all tables are going to be rebuilt once a time but smaller chunks/partitions which permit for faster checkpoints
  • 25. Fourth Myth: New HW Resources supported and IO Resource Governor
  • 26. New HW resources and IO Resource Governor
  • 28. Q&A Post your questions at: http://www.sqlserver-performance-tuning.net/forums/
  • 29. Thank you ..See you again 01/24/14

Notes de l'éditeur

  1. When it comes to security the results speak for how important we feel providing the best security is for our customers. As you can see per the latest NIST Comprehensive Vunererability Database published on 4/17/2013 we continue to lead the way 5 years in a row as the least vulnerable database amongst the Top data platforms tracked. In addition it is important to note that we ware the most utilized paid database in the market per IDC with 42% market share. When it comes to security features we have achieved CC certification at High Assurance level for SQL Server. When it comes to separation of duties, SQL Server 2014 now separates Database Administrator role from System Administrator role for greater security. In addition you can even create more granular DBA roles, with different access rights for greater compliance. For example you could have a DBA roles that can manage database but cannot see user data. SQL Server offers Transparent Data Encryption capabilities that are becoming even more important in multi-tenant environments like cloud. Encryption key management allows you to store you encryption keys on a separate server than the one running the SQL Server instance for greater security. Also if you want to reduce the attack surface area even further SQL Server 2014 also support Windows Server Core and finally the last item is not a feature but critical when it comes to achieving these great results. We have redefined our entire SQL Server engineering security processes about 6 years ago when SLAMMER hit and it is a big part of why you see the results that you do. Security is a mantra in SQL Server engineering across all disciplines from development to test. Notes: Update as of 4/17/2013 inclusive. Chart counts NIST CVE – Reported Software Flaws by --------- “published” date, utilizing the NIST ND. SQL Server Query = Vendor Name: Microsoft Corporation; Product Names: sql_server, sql_server, sql_server_desktop_engine, sql_server_express_edition, sql_server_reporting services, sql_srvsql_srv_desktop_engine; Oracle Query = Vendor Name: Oracle; Product Name: ‘Any’, all CVEs where “Vulnerable software and versions” lists a database product; DB2 Query = Vendor Name: IBM; Product Names: db2, db2_content_manager, db2_content_manager_toolkit, db2_server, db2_universal_database; MySQL Query = Vendor Name: mysql, mysql-ocaml, mysql_auction, mysql_eventum, mysql_quick_admin, mysqldumper, mysqlnewsengine; Product Name: ‘Any’ CC certification at High Assurance Level Transparent Data Encryption Encryption Key Management – (note for talktrk- mean keys can live on a separate machine than the machine running SQL Server for greater security) Redefined Engineering Security Processes
  2. Key capabilities at a high level when it comes to mission critical include In-memory capabilities across all workloads including OLTP, DW and BI. When it comes to security SQL Server has consistently been ranked the most secure with the least amount of vulnerabilities 5 years in a row including this year according to National Institute of Standards and Technology Comprehensive Vulnerability Database. SQL Server 2014 with WS 2012 and WS 2012 R2 can provide to cost effective mission critical scale across physical and virtual environments. We know mission critical is all about the 9’s when it comes to High Availability and with SQL Server 2014 we have made the customer favorite AlwaysOn feature even better to give you the 9’s you need for your mission critical applications. Finally none of these features matter unless we are there to support you in case of issues or failures and we certainly offer the live mission critical support you expect for your mission critical workloads.
  3. Move this to Futures section
  4. Move this to Futures section
  5. Move this to Futures section
  6. Lets take a look at SQL Server Scalability and how new capabilities in Windows Server 2012 and Windows Server 2012 R2 enable SQL Server to scale. When it comes to scaling compute, Windows Server 2012 not only provide scale for large mission critical databases in a physical environment but also in a virtual environment. WS 2012 supports up to 640 logical processers to tackle the largest applications. In a virtual environment you can utilize up to 64 virtual CPUs per VM and up to 1TB of memory per VM. In addition you have now have up to 64 nodes in a SQL Server cluster. You can also scale networking with network virtualization capabilities in WS 2012 R2. This helps SQL Server because it also you to move on workload from one datacenter to another without having to worry about the underlying network. With the Nic Teaming feature in WS 2012 you can pool multiple NICs with allows for greater network flexibility for SQL Server databases. You can also assign minimum and maximum bandwidth criteria to improve Network QoS. With WS2012 you can also virtualize storage allowing you to accumulate all of your storage and assign pieces to different workloads. You can also tier the storage for higher performance for example a mix of SSDs and standard disks allowing you to create tiers so you can keep hot data in the fastest tier and less utilized data in lower tiers improving performance without increasing costs. Just like WS2012 allows you to create pools of infrastructure and refine and tier those pools, SQL Server take that a step further and provides this type of tiering at the SQL Server instance level with Resource Governor. In addition to being able to pool CPU and Memory you can now with SQL Server 2014 pool IO and tier the pool per your criteria ensuring greater scale and performance predictability for your SQL Server workloads.