SlideShare une entreprise Scribd logo
1  sur  27
Télécharger pour lire hors ligne
INSIDE SQL AZURE
Self Governing, Self-Healing, Massively Scalable
Database Service in the Cloud

Cihan Biyikoglu
Program Manager - SQL Azure
AGENDA

Inside SQL Azure
• SQL Azure = SQL Server + Self Management Services
    • SQL Azure Arch Components
    • SQL Azure Maintenance Model
    • SQL Azure Network Model


•   What does this mean for data movement?
•   What does this mean for perf and scale?
•   What does this mean for your SQL Server apps?
•   What does this mean for your apps economics?
SQL AZURE ARCHITECTURE
SERVICE PROVISIONING MODEL
               • Each account has zero or more servers
   Account
                     • Azure wide, provisioned in a common portal
                     • Established a Billing instrument

               • Each server has one or more databases
   Server        •    Logical concept equal to a master DB
                 •    Contains metadata about database & usage
                 •    Unit of authentication, geo-location, billing, reporting
                 •    Generated DNS-based name

    Database   • Each database has standard SQL objects
                 • Users, Tables, Views, Indices, etc
                 • Unit of consistency
DATACENTER ARCHITECTURE
                                                                      Datacenter
                                                                       Routers


     Aggregation
     Routers and
    Load Balancers

                       Agg                       Agg                            Agg                          Agg                           Agg                     Agg
                LB           LB             LB           LB               LB            LB           LB                  LB           LB         LB         LB           LB


 Top of Rack
  Switches
         TOR          TOR        TOR     TOR     TOR          TOR        TOR     TOR         TOR      TOR          TOR        TOR                     TOR        TOR         TOR
        Nodes


                     Nodes


                                 Nodes


                                         Nodes


                                                 Nodes


                                                              Nodes

                                                                        Nodes

                                                                                Nodes


                                                                                             Nodes

                                                                                                     Nodes


                                                                                                               Nodes


                                                                                                                              Nodes




                                                                                                                                                      Nodes

                                                                                                                                                                 Nodes


                                                                                                                                                                             Nodes
Racks                        …                           …                              …                                …                 …                             …
         PDU          PDU        PDU     PDU     PDU          PDU        PDU     PDU         PDU     PDU           PDU        PDU                     PDU        PDU         PDU

  Power Distribution
        Units
NETWORK TOPOLOGY
                                                                                  Applications use standard SQL client
                                                       Application                libraries: ODBC, ADO.Net, …


                                                               Internet
                                                             Azure Cloud


                                             TDS/SSL (tcp)

      Security Boundary                                                          Load balancer forwards ‘sticky’ sessions to
                                                                 LB              TDS protocol tier



TDS (tcp)



            Gateway         Gateway            Gateway                     Gateway       Gateway              Gateway
                Gateway: DaaS protocol gateway, enforces AUTHN/AUTHZ policy; proxy to SQL Azure
TDS (tcp)


                    SQL                        SQL                             SQL                        SQL
3/8/2012                                                                                                                       6
            Scalability and Availability: Fabric, Failover, Replication, and Load balancing
SERVICES LAYER - GATEWAY

• Layer of isolation between the backend and customer traffic
  • Provisioning Billing - Server & Databases
  • Maps logical objects to physical resources
    o Physical location for SQL Azure Servers, User Databases
  • Handles login
    o Negotiates capabilities at PreLogin
    o Encryption (required), MARS
  • Inspects TDS packets for G-SQL
    o G-SQL = T-SQL Commands executed by the Gateway, such as CREATE DATABASE or CREATE
      FEDERATION
WALKTHROUGH-SQL AZURE DATABASE PROVISIONING
PLATFORM LAYER

• SQL Server Engine = Codebase SQL2012
  • Multitenant Setup – more details coming…
    o Single physical database that contain multiple logical databases with Single log file shared
      among all logical databases
    o Engine Resource Management (throttling) for fairness and protection


                                  SQL Azure - Engine Node
PLATFORM LAYER

• SQL Azure Fabric
  • SLA: Replication with auto-failover
    o Service monitoring and health management through ring topology
  • Load Balancing
    o Spread high concentration of load to balance the cluster, improve customer experience and
      improve node health
MULTI-TENANCY: RESOURCE MANAGEMENT

• Resource shared on machine with neighbor databases
  • CPU, memory, data/log spindles
  • TempDB, worker threads, network
  • Neighbors activity can affect your DB

  • Multi-tenancy management provided in SQL Azure
    o Load Balancer
    o Throttling Service
VL4SFHU
MULTI-TENANCY: LOAD BALANCER
–   Balance resource utilization across all machines
–   Minimize overloaded machines and reduce throttling
–   Swap vs. move mechanisms
–   Runs periodically, solves long term imbalance for cluster
–   Reactive Load Balancer solves short term spikes
    » React to spikes before the next regular LB run
    » Alleviate high throttling occurrences on hot machines
MULTI-TENANCY: RESOURCE THROTTLING

o Throttling Service
 •   Protect a machine from sustained high usage of system resources
 •   Evaluate actual resource usage vs. safe thresholds real-time
 •   Throttle the busiest DBs first (soft throttle)
 •   Throttle every DB if necessary (hard throttle)


o Throttling show as connection error 40501
 – “The service is currently busy. Retry the request after 10 seconds. Code: %d.”
SQL AZURE MAINTENANCE MODEL
SERVICE UPDATES

• SQL Azure requires no physical management
  • HW, Networking, OS service packs and patches, SQL Server service packs or
    patches are automatically done for you!
• Upgrade are done frequently
  • Hotfixes, Service Upgrades or Service Releases for
    o Sql azure, windows azure, windows server
MULTI PHASE UPGRADE

• Rollout in pieces
  • Fault Domains ~= Racks
  • We upgrade a fault domain at a time
    o Fault Domains are considered when placing replicas.
    o Ensure we take out one replicate of your db at a time down only.
SQL AZURE NETWORK MODEL
MICROSOFT AZURE DATA CENTERS WORLD WIDE

                                       North Europe
                            North
                          Central US

                                       West Europe


     South
   Central US                                                                                  East Asia
                                                                             Southeast Asia



                                                      Hosting locations within 100ms of the
    Regional hosting locations                        customer

                                                      At least one hosting location can be
                                                      reached within 100ms, but not two
   200ms Latency from 2
   regional hosting locations                         No points to test from or greater than
                                                      200ms latency
AZURE CROSS DATACENTER LATENCIES

                   North-central   South-central
 FromTo (ms)                                      North Europe   West Europe   East Asia   South-East Asia
                        US              US
 North-central
                        4.2            35.3            97            103.6       190.9           219.7
      US

 South-central
                       37.8             2.3           111.2          117.5        190            218.6
      US

 North Europe          99.8            111.8            2            20.9        283.3           312.3

  West Europe          107.5           118.6           21.1           2.3        291.8           320.8

    East Asia          194.5           190.8          284.2          291.7         1.6           32.6

 South-East Asia       223.1           219.2          312.9          320.1        32.2            1.9


• Client Stats & SQL Ping
DATA MOVEMENT PERFORMANCE WITH LATENCY

• If you have bandwidth you can beat latency!

 High Bandwidth, Medium Latency - 54ms




    High Bandwidth, High Latency - 169ms
                                                                                              Parallel Upload Batch Size 1K (sum rows/sec)
                                                                                              Native Sorted - Batch 10K (rows/sec)
                                                                                              Native - Batch 10K (rows/sec)
Low Bandwidth, Very High Latency - 289ms
                                                                                              Native - Batch 100 (rows/sec)


 Low Bandwidth, Medium Latency - 114ms



                                           0   1000 2000 3000 4000 5000 6000 7000 8000 9000
LETS RECAP
WHAT IS SQL AZURE?
• Database as a Service in the Cloud
  • Low Maintenance
    o Built in HA (SLA of 99.9%), Load Balanced (for db placement)
    o No Physical Maintenance Required – no wires, no patches for OS or SQL etc
  • Best Economics
    o Optimized for best economics, great price performance and high scale
    o Able to achieve all this at a new low price point and with pay as you go model
  • Rich Familiar Programming Model
    o It is SQL Server at heart!
       – Full ACID with Rich server and client side programmability options
       – Rich ecosystem of tools from BI to 3rd Party Management tools to MSOffice Integration…
TOP ARCHITECTURAL DIFFERENCES
                 SQL Server                       SQL Azure

Performance      Spectrum of HW choices           Locked HW choice
                 No HA by default                 HA and IO latency with 3 copies
                 Dedicated setup by default       Multi-tenant setup
                 Typically low latency access     Could be high latency to DC
Scale Model      Spectrum of HW choice            Locked HW choice
                 Scale-Up – limited with HW       Scale-Out with Federations– no
                                                  practical limits
Economics        Per Core or Per Server+CAL       Pay As You Go + Elastic




                 Exponential Cost with Scale-Up   Linear cost with Scale-Out
                 High Overhead on Admin           No Admin Overhead
TOP APP MODEL DIFFERENCES

• SQL Azure Application Model Difference
  • Scale-out for scale and perf
    o Take advantage of elasticity and get great economics
    o Take advantage of unlimited scale
  • Parallelize for efficiency
    o Harness many small nodes
    o Get around both network and disk IO latency
  • Code for Failure
    o Work in smaller transactions – so you can fail small
    o Integrate retry and resume logic into all operations
INSIDE SQL AZURE BY CIHAN BIYIKOGLU
Thanks for Attending
© 2011 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market
    conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation.
                                        MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Contenu connexe

En vedette

HTTP 완벽가이드- 19장 배포시스템
HTTP 완벽가이드- 19장 배포시스템HTTP 완벽가이드- 19장 배포시스템
HTTP 완벽가이드- 19장 배포시스템박 민규
 
คณิตศาสตร์
คณิตศาสตร์คณิตศาสตร์
คณิตศาสตร์jojowhisky
 
Linux kursu-arnavutkoy
Linux kursu-arnavutkoyLinux kursu-arnavutkoy
Linux kursu-arnavutkoysersld67
 
1948 creation of israel wed
1948 creation of israel wed1948 creation of israel wed
1948 creation of israel wedTravis Klein
 
KNOWLEDGE MANAGEMENT - WHERE THEY ARE GONE WRONG?
KNOWLEDGE MANAGEMENT - WHERE  THEY ARE GONE WRONG?KNOWLEDGE MANAGEMENT - WHERE  THEY ARE GONE WRONG?
KNOWLEDGE MANAGEMENT - WHERE THEY ARE GONE WRONG?Dr. Raju M. Mathew
 
Insaat kursu-bahcelievler
Insaat kursu-bahcelievlerInsaat kursu-bahcelievler
Insaat kursu-bahcelievlersersld54
 

En vedette (11)

Spain
SpainSpain
Spain
 
HTTP 완벽가이드- 19장 배포시스템
HTTP 완벽가이드- 19장 배포시스템HTTP 완벽가이드- 19장 배포시스템
HTTP 완벽가이드- 19장 배포시스템
 
Storyboard
StoryboardStoryboard
Storyboard
 
I download
I downloadI download
I download
 
คณิตศาสตร์
คณิตศาสตร์คณิตศาสตร์
คณิตศาสตร์
 
Yura
Yura Yura
Yura
 
Linux kursu-arnavutkoy
Linux kursu-arnavutkoyLinux kursu-arnavutkoy
Linux kursu-arnavutkoy
 
1948 creation of israel wed
1948 creation of israel wed1948 creation of israel wed
1948 creation of israel wed
 
KNOWLEDGE MANAGEMENT - WHERE THEY ARE GONE WRONG?
KNOWLEDGE MANAGEMENT - WHERE  THEY ARE GONE WRONG?KNOWLEDGE MANAGEMENT - WHERE  THEY ARE GONE WRONG?
KNOWLEDGE MANAGEMENT - WHERE THEY ARE GONE WRONG?
 
らくがき
らくがきらくがき
らくがき
 
Insaat kursu-bahcelievler
Insaat kursu-bahcelievlerInsaat kursu-bahcelievler
Insaat kursu-bahcelievler
 

Plus de Microsoft TechNet - Belgium and Luxembourg

Plus de Microsoft TechNet - Belgium and Luxembourg (20)

Windows 10: all you need to know!
Windows 10: all you need to know!Windows 10: all you need to know!
Windows 10: all you need to know!
 
Configuration Manager 2012 – Compliance Settings 101 - Tim de Keukelaere
Configuration Manager 2012 – Compliance Settings 101 - Tim de KeukelaereConfiguration Manager 2012 – Compliance Settings 101 - Tim de Keukelaere
Configuration Manager 2012 – Compliance Settings 101 - Tim de Keukelaere
 
Windows 8.1 a closer look
Windows 8.1 a closer lookWindows 8.1 a closer look
Windows 8.1 a closer look
 
So you’ve successfully installed SCOM… Now what.
So you’ve successfully installed SCOM… Now what.So you’ve successfully installed SCOM… Now what.
So you’ve successfully installed SCOM… Now what.
 
Data Leakage Prevention
Data Leakage PreventionData Leakage Prevention
Data Leakage Prevention
 
Deploying and managing ConfigMgr Clients
Deploying and managing ConfigMgr ClientsDeploying and managing ConfigMgr Clients
Deploying and managing ConfigMgr Clients
 
Self Service BI anno 2013 – Where Do We Come From and Where Are We Going?
Self Service BI anno 2013 – Where Do We Come From and Where Are We Going?Self Service BI anno 2013 – Where Do We Come From and Where Are We Going?
Self Service BI anno 2013 – Where Do We Come From and Where Are We Going?
 
Hands on with Hyper-V Clustering Maintenance Mode & Cluster Aware Updating
Hands on with Hyper-V Clustering Maintenance Mode & Cluster Aware UpdatingHands on with Hyper-V Clustering Maintenance Mode & Cluster Aware Updating
Hands on with Hyper-V Clustering Maintenance Mode & Cluster Aware Updating
 
SCEP 2012 inside SCCM 2012
SCEP 2012 inside SCCM 2012SCEP 2012 inside SCCM 2012
SCEP 2012 inside SCCM 2012
 
Jump start your application monitoring with APM
Jump start your application monitoring with APMJump start your application monitoring with APM
Jump start your application monitoring with APM
 
What’s new in Lync Server 2013: Persistent Chat
What’s new in Lync Server 2013: Persistent ChatWhat’s new in Lync Server 2013: Persistent Chat
What’s new in Lync Server 2013: Persistent Chat
 
What's new for Lync 2013 Clients & Devices
What's new for Lync 2013 Clients & DevicesWhat's new for Lync 2013 Clients & Devices
What's new for Lync 2013 Clients & Devices
 
Office 365 ProPlus: Click-to-run deployment and management
Office 365 ProPlus: Click-to-run deployment and managementOffice 365 ProPlus: Click-to-run deployment and management
Office 365 ProPlus: Click-to-run deployment and management
 
Office 365 Identity Management options
Office 365 Identity Management options Office 365 Identity Management options
Office 365 Identity Management options
 
SharePoint Installation and Upgrade: Untangling Your Options
SharePoint Installation and Upgrade: Untangling Your Options SharePoint Installation and Upgrade: Untangling Your Options
SharePoint Installation and Upgrade: Untangling Your Options
 
The application model in real life
The application model in real lifeThe application model in real life
The application model in real life
 
Microsoft private cloud with Cisco and Netapp - Flexpod solution
Microsoft private cloud with Cisco and Netapp -  Flexpod solutionMicrosoft private cloud with Cisco and Netapp -  Flexpod solution
Microsoft private cloud with Cisco and Netapp - Flexpod solution
 
Managing Windows RT devices in the Enterprise
Managing Windows RT devices in the Enterprise Managing Windows RT devices in the Enterprise
Managing Windows RT devices in the Enterprise
 
Moving from Device Centric to a User Centric Management
Moving from Device Centric to a User Centric Management Moving from Device Centric to a User Centric Management
Moving from Device Centric to a User Centric Management
 
Network Management in System Center 2012 SP1 - VMM
Network Management in System Center 2012  SP1 - VMM Network Management in System Center 2012  SP1 - VMM
Network Management in System Center 2012 SP1 - VMM
 

Dernier

OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfJamie (Taka) Wang
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationIES VE
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024D Cloud Solutions
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarPrecisely
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfDianaGray10
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7DianaGray10
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...DianaGray10
 

Dernier (20)

OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
20230104 - machine vision
20230104 - machine vision20230104 - machine vision
20230104 - machine vision
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve DecarbonizationUsing IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024Artificial Intelligence & SEO Trends for 2024
Artificial Intelligence & SEO Trends for 2024
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7UiPath Studio Web workshop series - Day 7
UiPath Studio Web workshop series - Day 7
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
 

Inside SQL Azure: Self Governing, Self-Healing, Massively Scalable Database Service in the Cloud

  • 1. INSIDE SQL AZURE Self Governing, Self-Healing, Massively Scalable Database Service in the Cloud Cihan Biyikoglu Program Manager - SQL Azure
  • 2. AGENDA Inside SQL Azure • SQL Azure = SQL Server + Self Management Services • SQL Azure Arch Components • SQL Azure Maintenance Model • SQL Azure Network Model • What does this mean for data movement? • What does this mean for perf and scale? • What does this mean for your SQL Server apps? • What does this mean for your apps economics?
  • 4. SERVICE PROVISIONING MODEL • Each account has zero or more servers Account • Azure wide, provisioned in a common portal • Established a Billing instrument • Each server has one or more databases Server • Logical concept equal to a master DB • Contains metadata about database & usage • Unit of authentication, geo-location, billing, reporting • Generated DNS-based name Database • Each database has standard SQL objects • Users, Tables, Views, Indices, etc • Unit of consistency
  • 5. DATACENTER ARCHITECTURE Datacenter Routers Aggregation Routers and Load Balancers Agg Agg Agg Agg Agg Agg LB LB LB LB LB LB LB LB LB LB LB LB Top of Rack Switches TOR TOR TOR TOR TOR TOR TOR TOR TOR TOR TOR TOR TOR TOR TOR Nodes Nodes Nodes Nodes Nodes Nodes Nodes Nodes Nodes Nodes Nodes Nodes Nodes Nodes Nodes Racks … … … … … … PDU PDU PDU PDU PDU PDU PDU PDU PDU PDU PDU PDU PDU PDU PDU Power Distribution Units
  • 6. NETWORK TOPOLOGY Applications use standard SQL client Application libraries: ODBC, ADO.Net, … Internet Azure Cloud TDS/SSL (tcp) Security Boundary Load balancer forwards ‘sticky’ sessions to LB TDS protocol tier TDS (tcp) Gateway Gateway Gateway Gateway Gateway Gateway Gateway: DaaS protocol gateway, enforces AUTHN/AUTHZ policy; proxy to SQL Azure TDS (tcp) SQL SQL SQL SQL 3/8/2012 6 Scalability and Availability: Fabric, Failover, Replication, and Load balancing
  • 7. SERVICES LAYER - GATEWAY • Layer of isolation between the backend and customer traffic • Provisioning Billing - Server & Databases • Maps logical objects to physical resources o Physical location for SQL Azure Servers, User Databases • Handles login o Negotiates capabilities at PreLogin o Encryption (required), MARS • Inspects TDS packets for G-SQL o G-SQL = T-SQL Commands executed by the Gateway, such as CREATE DATABASE or CREATE FEDERATION
  • 9. PLATFORM LAYER • SQL Server Engine = Codebase SQL2012 • Multitenant Setup – more details coming… o Single physical database that contain multiple logical databases with Single log file shared among all logical databases o Engine Resource Management (throttling) for fairness and protection SQL Azure - Engine Node
  • 10. PLATFORM LAYER • SQL Azure Fabric • SLA: Replication with auto-failover o Service monitoring and health management through ring topology • Load Balancing o Spread high concentration of load to balance the cluster, improve customer experience and improve node health
  • 11. MULTI-TENANCY: RESOURCE MANAGEMENT • Resource shared on machine with neighbor databases • CPU, memory, data/log spindles • TempDB, worker threads, network • Neighbors activity can affect your DB • Multi-tenancy management provided in SQL Azure o Load Balancer o Throttling Service
  • 13. MULTI-TENANCY: LOAD BALANCER – Balance resource utilization across all machines – Minimize overloaded machines and reduce throttling – Swap vs. move mechanisms – Runs periodically, solves long term imbalance for cluster – Reactive Load Balancer solves short term spikes » React to spikes before the next regular LB run » Alleviate high throttling occurrences on hot machines
  • 14. MULTI-TENANCY: RESOURCE THROTTLING o Throttling Service • Protect a machine from sustained high usage of system resources • Evaluate actual resource usage vs. safe thresholds real-time • Throttle the busiest DBs first (soft throttle) • Throttle every DB if necessary (hard throttle) o Throttling show as connection error 40501 – “The service is currently busy. Retry the request after 10 seconds. Code: %d.”
  • 16. SERVICE UPDATES • SQL Azure requires no physical management • HW, Networking, OS service packs and patches, SQL Server service packs or patches are automatically done for you! • Upgrade are done frequently • Hotfixes, Service Upgrades or Service Releases for o Sql azure, windows azure, windows server
  • 17. MULTI PHASE UPGRADE • Rollout in pieces • Fault Domains ~= Racks • We upgrade a fault domain at a time o Fault Domains are considered when placing replicas. o Ensure we take out one replicate of your db at a time down only.
  • 19. MICROSOFT AZURE DATA CENTERS WORLD WIDE North Europe North Central US West Europe South Central US East Asia Southeast Asia Hosting locations within 100ms of the Regional hosting locations customer At least one hosting location can be reached within 100ms, but not two 200ms Latency from 2 regional hosting locations No points to test from or greater than 200ms latency
  • 20. AZURE CROSS DATACENTER LATENCIES North-central South-central FromTo (ms) North Europe West Europe East Asia South-East Asia US US North-central 4.2 35.3 97 103.6 190.9 219.7 US South-central 37.8 2.3 111.2 117.5 190 218.6 US North Europe 99.8 111.8 2 20.9 283.3 312.3 West Europe 107.5 118.6 21.1 2.3 291.8 320.8 East Asia 194.5 190.8 284.2 291.7 1.6 32.6 South-East Asia 223.1 219.2 312.9 320.1 32.2 1.9 • Client Stats & SQL Ping
  • 21. DATA MOVEMENT PERFORMANCE WITH LATENCY • If you have bandwidth you can beat latency! High Bandwidth, Medium Latency - 54ms High Bandwidth, High Latency - 169ms Parallel Upload Batch Size 1K (sum rows/sec) Native Sorted - Batch 10K (rows/sec) Native - Batch 10K (rows/sec) Low Bandwidth, Very High Latency - 289ms Native - Batch 100 (rows/sec) Low Bandwidth, Medium Latency - 114ms 0 1000 2000 3000 4000 5000 6000 7000 8000 9000
  • 23. WHAT IS SQL AZURE? • Database as a Service in the Cloud • Low Maintenance o Built in HA (SLA of 99.9%), Load Balanced (for db placement) o No Physical Maintenance Required – no wires, no patches for OS or SQL etc • Best Economics o Optimized for best economics, great price performance and high scale o Able to achieve all this at a new low price point and with pay as you go model • Rich Familiar Programming Model o It is SQL Server at heart! – Full ACID with Rich server and client side programmability options – Rich ecosystem of tools from BI to 3rd Party Management tools to MSOffice Integration…
  • 24. TOP ARCHITECTURAL DIFFERENCES SQL Server SQL Azure Performance Spectrum of HW choices Locked HW choice No HA by default HA and IO latency with 3 copies Dedicated setup by default Multi-tenant setup Typically low latency access Could be high latency to DC Scale Model Spectrum of HW choice Locked HW choice Scale-Up – limited with HW Scale-Out with Federations– no practical limits Economics Per Core or Per Server+CAL Pay As You Go + Elastic Exponential Cost with Scale-Up Linear cost with Scale-Out High Overhead on Admin No Admin Overhead
  • 25. TOP APP MODEL DIFFERENCES • SQL Azure Application Model Difference • Scale-out for scale and perf o Take advantage of elasticity and get great economics o Take advantage of unlimited scale • Parallelize for efficiency o Harness many small nodes o Get around both network and disk IO latency • Code for Failure o Work in smaller transactions – so you can fail small o Integrate retry and resume logic into all operations
  • 26. INSIDE SQL AZURE BY CIHAN BIYIKOGLU Thanks for Attending
  • 27. © 2011 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.