SlideShare une entreprise Scribd logo
1  sur  23
Télécharger pour lire hors ligne
Quo vadis Linux-HA?



Developments in Linux
   Clustersoftware
   Michael Schwartzkopff
  misch@schwartzkopff.org



                   (c) Michael Schwartzkopff, 2011   1 / 26
Background




         (c) Michael Schwartzkopff, 2011   2 / 26
Linux Clustersoftware

   Linux Virtual Server
       Scales nicely...
       … but is not high available.
   Linux-HA
       Offers high availability ...
       … but does not scale.

       Code is not maintained any more.
       Is beeing replaced by a collection of other
        programs.
                                        (c) Michael Schwartzkopff, 2011   3 / 26
Linux-HA Version 1 (heartbeat)

   Two servers exchange heartbeats.
   If the standby server does not receive
    heartbeats from the active node any more it
    starts the services.
   Configuration in a plain text file haresources.
   Cons:
       No monitoring of the services.
       No management of the resources.


                                         (c) Michael Schwartzkopff, 2011   4 / 26
Linux-HA Version 2 (CRM)

   Mangement of the resources by a
    Cluster Resource Manager (CRM):
       Aktive monitoring of the reosurces by the cluster
        software.
       Up to 16 nodes in a cluster.
       Resources free moveable between the nodes.
       Communication in the cluster via heartbeat.
       Constraints determine which resource should run
        on what node.


                                        (c) Michael Schwartzkopff, 2011   5 / 26
Constraints in Linux-HAv2

   Order
    A resource should start before or after an other
    resource.
   Colocation
    A resource should run on the same node as an
    other resource.
   Location
    A resource should run on a node with specific
    attributes.

                                  (c) Michael Schwartzkopff, 2011   6 / 26
Features of Linux-HAv2?

   Pros
       Monitoring of the resources.
   Cons
       Configuration in XML.
       Administration via the command line.
       GUI not really usable.
       Not maintained any more after 2007 (version 2.1.4).




                                       (c) Michael Schwartzkopff, 2011   7 / 26
Linux-HA


Managment                        CRM


Utilities
                 heartbeat     heartbeat

Communication



                Linux-HAv1    Linux-HAv2




                                   (c) Michael Schwartzkopff, 2011   8 / 26
Restart

   If the CRM uses heartbeat only for the
    communicaton in the cluster, this could be done
    also by another program.
   The other software was OpenAIS.
   The developers organized the CRM code in a
    separate project called pacemaker. It uses
    either heartbeat or OpenAIS.
   Some utilities from the heartbeat-package
    were still nescessary.

                                 (c) Michael Schwartzkopff, 2011   9 / 26
pacemaker

Managment
                               CRM                       pacemaker


Utilities


                heartbeat    heartbeat             heart-
                                                    beat
Communication
                                                                   OpenAIS


                Linux-HAv1   Linux-HAv2                  pacemaker




                                          (c) Michael Schwartzkopff, 2011    10 / 26
pacemaker

   Uses heartbeat or OpenAIS.
   Suitable GUI.
   Own subshell additional to the CLI.
   Sandboxes for testing.
       First test what would happen, if ...
        → only afterwards activate the new configuration.
   Exact history, what happened why.



                                      (c) Michael Schwartzkopff, 2011   11 / 26
pacemaker: The GUI




             (c) Michael Schwartzkopff, 2011   12 / 26
Sandboxes with graphics!




                (c) Michael Schwartzkopff, 2011   13 / 26
The development goes on

   OpenAIS offers much more as needed by
    pacemaker. The communication stack is
    forked into a separate project called corosync.
   corosync is responsible for the
    communication in the cluster.
   OpenAIS takes care for all ”higher” services in
    a cluster.
   Simple clusters with pacemaker only need
    corosync.

                                 (c) Michael Schwartzkopff, 2011   14 / 26
Decomposition of heartbeat

   With pacemaker 1.0.5, heartbeat is
    decomposed into three projects:
       cluster-glue includes all nescessary utilities.
       The package resource-agents combines all
        resource agents, the interface between pacemaker
        and the application's binaries.
       In heartbeat (version ≥ 3.0.2) remains, what is
        left from the project.



                                      (c) Michael Schwartzkopff, 2011   15 / 26
HA-cluster with Linux

Management                               pacemaker                    pacemaker
                            CRM


                                                                       resource-
                                                                         agents
Utilities

                                                                      cluster-glue
             heartbeat    heartbeat    heart-
                                        beat


Communi-                                                           heart-         coro-
cation                                          OpenAIS
                                                                    beat          sync



             Linux-HAv1   Linux-HAv2     pacemaker               pacemaker ≥ 1.0.5


                                                (c) Michael Schwartzkopff, 2011           16 / 26
Master Control Process

   pacemaker in version 1.1 got a Master Control
    Process. So it can be started outside from
    corosync though the init-system.
   Of course, corosync has to be running.
   Causes less trouble.
   Is more stable.




                                (c) Michael Schwartzkopff, 2011   20 / 26
DRBD Managment Console

   From company Linbit.
   Written in Java.
   Originally ment to manage DRBDs
   Now full blown cluster management tool:
       Nodes, resources, constraints
       Graphical representation of the configuration
       Emphasis on virtual machines: Config & console.



                                        (c) Michael Schwartzkopff, 2011   21 / 26
Utilizations in pacemaker 1.1

   Every node has utilizations like CPUs, RAM
    configured.
   Every resource has utilizations configured.
   The cluster manager takes care that resources
    only run on nodes with enough utilizations.

   TODO: Make resource utilizations dynamic.



                                 (c) Michael Schwartzkopff, 2011   22 / 26
Role Based Access Model

   From version 1.1 administrators access to
    resources can be limited:
       You can only destroy your own resources.
   Complete RBAC model implemented.
   Think about a provider offering HA services.




                                     (c) Michael Schwartzkopff, 2011   23 / 26
External Quorum Providers

   Quorum descisions are quite simple up to now.
   corosync can use external quorum providers.
   cman is a possible external provider.
       For now it is the only one.




                                      (c) Michael Schwartzkopff, 2011   24 / 26
Beering


   Lavandevil
    Schusterusstrasse 3

    U Richard Wagner Platz: U7 / M45




                               (c) Michael Schwartzkopff, 2011   25 / 26
Thank you very much for your attention!

             Questions?




                          (c) Michael Schwartzkopff, 2011   26 / 26

Contenu connexe

Similaire à Developments in linux

Pacemaker+DRBD
Pacemaker+DRBDPacemaker+DRBD
Pacemaker+DRBD
Dan Frincu
 
LLVM-based Communication Optimizations for PGAS Programs
LLVM-based Communication Optimizations for PGAS ProgramsLLVM-based Communication Optimizations for PGAS Programs
LLVM-based Communication Optimizations for PGAS Programs
Akihiro Hayashi
 
Hacking+linux+kernel
Hacking+linux+kernelHacking+linux+kernel
Hacking+linux+kernel
robertsong
 
Network Function Virtualization : Open Source Tools
Network Function Virtualization : Open Source ToolsNetwork Function Virtualization : Open Source Tools
Network Function Virtualization : Open Source Tools
sidneel
 

Similaire à Developments in linux (20)

Pacemaker+DRBD
Pacemaker+DRBDPacemaker+DRBD
Pacemaker+DRBD
 
test
testtest
test
 
Network simulator 2 a simulation tool for linux
Network simulator 2 a simulation tool for linuxNetwork simulator 2 a simulation tool for linux
Network simulator 2 a simulation tool for linux
 
2008-11-13 CAVMEN RHEL for System z Deep Dive
2008-11-13 CAVMEN RHEL for System z Deep Dive2008-11-13 CAVMEN RHEL for System z Deep Dive
2008-11-13 CAVMEN RHEL for System z Deep Dive
 
Deployment of an HPC Cloud based on Intel hardware
Deployment of an HPC Cloud based on Intel hardwareDeployment of an HPC Cloud based on Intel hardware
Deployment of an HPC Cloud based on Intel hardware
 
FPL'2014 - FlexTiles Workshop - 3 - FlexTiles DSP Accelerators
FPL'2014 - FlexTiles Workshop - 3 - FlexTiles DSP AcceleratorsFPL'2014 - FlexTiles Workshop - 3 - FlexTiles DSP Accelerators
FPL'2014 - FlexTiles Workshop - 3 - FlexTiles DSP Accelerators
 
LLVM-based Communication Optimizations for PGAS Programs
LLVM-based Communication Optimizations for PGAS ProgramsLLVM-based Communication Optimizations for PGAS Programs
LLVM-based Communication Optimizations for PGAS Programs
 
Got Big Data? Splunk on Nutanix
Got Big Data? Splunk on NutanixGot Big Data? Splunk on Nutanix
Got Big Data? Splunk on Nutanix
 
Kernel Recipes 2016 - New hwmon device registration API - Jean Delvare
Kernel Recipes 2016 -  New hwmon device registration API - Jean DelvareKernel Recipes 2016 -  New hwmon device registration API - Jean Delvare
Kernel Recipes 2016 - New hwmon device registration API - Jean Delvare
 
Introduction to OpenVX
Introduction to OpenVXIntroduction to OpenVX
Introduction to OpenVX
 
BKK16-409 VOSY Switch Port to ARMv8 Platforms and ODP Integration
BKK16-409 VOSY Switch Port to ARMv8 Platforms and ODP IntegrationBKK16-409 VOSY Switch Port to ARMv8 Platforms and ODP Integration
BKK16-409 VOSY Switch Port to ARMv8 Platforms and ODP Integration
 
Hacking+linux+kernel
Hacking+linux+kernelHacking+linux+kernel
Hacking+linux+kernel
 
LibOS as a regression test framework for Linux networking #netdev1.1
LibOS as a regression test framework for Linux networking #netdev1.1LibOS as a regression test framework for Linux networking #netdev1.1
LibOS as a regression test framework for Linux networking #netdev1.1
 
LO-PHI: Low-Observable Physical Host Instrumentation for Malware Analysis
LO-PHI: Low-Observable Physical Host Instrumentation for Malware AnalysisLO-PHI: Low-Observable Physical Host Instrumentation for Malware Analysis
LO-PHI: Low-Observable Physical Host Instrumentation for Malware Analysis
 
Disaster Recovery in the Hadoop Ecosystem: Preparing for the Improbable
Disaster Recovery in the Hadoop Ecosystem: Preparing for the ImprobableDisaster Recovery in the Hadoop Ecosystem: Preparing for the Improbable
Disaster Recovery in the Hadoop Ecosystem: Preparing for the Improbable
 
Parallel_and_Cluster_Computing.ppt
Parallel_and_Cluster_Computing.pptParallel_and_Cluster_Computing.ppt
Parallel_and_Cluster_Computing.ppt
 
An Introduce of OPNFV (Open Platform for NFV)
An Introduce of OPNFV (Open Platform for NFV)An Introduce of OPNFV (Open Platform for NFV)
An Introduce of OPNFV (Open Platform for NFV)
 
Network Function Virtualization : Open Source Tools
Network Function Virtualization : Open Source ToolsNetwork Function Virtualization : Open Source Tools
Network Function Virtualization : Open Source Tools
 
Cluster computer
Cluster  computerCluster  computer
Cluster computer
 
ARM HPC Ecosystem
ARM HPC EcosystemARM HPC Ecosystem
ARM HPC Ecosystem
 

Plus de hik_lhz (9)

Log4c developersguide
Log4c developersguideLog4c developersguide
Log4c developersguide
 
D bus specification
D bus specificationD bus specification
D bus specification
 
自动生成 Makefile 的全过程详解!
自动生成 Makefile 的全过程详解!自动生成 Makefile 的全过程详解!
自动生成 Makefile 的全过程详解!
 
Larena3 0架构与关键技术
Larena3 0架构与关键技术Larena3 0架构与关键技术
Larena3 0架构与关键技术
 
Considerations when implementing_ha_in_dmf
Considerations when implementing_ha_in_dmfConsiderations when implementing_ha_in_dmf
Considerations when implementing_ha_in_dmf
 
8 集群
8 集群8 集群
8 集群
 
0 mq the guide
0 mq   the guide0 mq   the guide
0 mq the guide
 
Memcached内存分析、调优、集群
Memcached内存分析、调优、集群Memcached内存分析、调优、集群
Memcached内存分析、调优、集群
 
Linux集群应用实战 通过lvs+keepalived搭建高可用的负载均衡集群系统(第二讲)
Linux集群应用实战 通过lvs+keepalived搭建高可用的负载均衡集群系统(第二讲)Linux集群应用实战 通过lvs+keepalived搭建高可用的负载均衡集群系统(第二讲)
Linux集群应用实战 通过lvs+keepalived搭建高可用的负载均衡集群系统(第二讲)
 

Dernier

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 

Dernier (20)

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 

Developments in linux

  • 1. Quo vadis Linux-HA? Developments in Linux Clustersoftware Michael Schwartzkopff misch@schwartzkopff.org (c) Michael Schwartzkopff, 2011 1 / 26
  • 2. Background (c) Michael Schwartzkopff, 2011 2 / 26
  • 3. Linux Clustersoftware  Linux Virtual Server  Scales nicely...  … but is not high available.  Linux-HA  Offers high availability ...  … but does not scale.  Code is not maintained any more.  Is beeing replaced by a collection of other programs. (c) Michael Schwartzkopff, 2011 3 / 26
  • 4. Linux-HA Version 1 (heartbeat)  Two servers exchange heartbeats.  If the standby server does not receive heartbeats from the active node any more it starts the services.  Configuration in a plain text file haresources.  Cons:  No monitoring of the services.  No management of the resources. (c) Michael Schwartzkopff, 2011 4 / 26
  • 5. Linux-HA Version 2 (CRM)  Mangement of the resources by a Cluster Resource Manager (CRM):  Aktive monitoring of the reosurces by the cluster software.  Up to 16 nodes in a cluster.  Resources free moveable between the nodes.  Communication in the cluster via heartbeat.  Constraints determine which resource should run on what node. (c) Michael Schwartzkopff, 2011 5 / 26
  • 6. Constraints in Linux-HAv2  Order A resource should start before or after an other resource.  Colocation A resource should run on the same node as an other resource.  Location A resource should run on a node with specific attributes. (c) Michael Schwartzkopff, 2011 6 / 26
  • 7. Features of Linux-HAv2?  Pros  Monitoring of the resources.  Cons  Configuration in XML.  Administration via the command line.  GUI not really usable.  Not maintained any more after 2007 (version 2.1.4). (c) Michael Schwartzkopff, 2011 7 / 26
  • 8. Linux-HA Managment CRM Utilities heartbeat heartbeat Communication Linux-HAv1 Linux-HAv2 (c) Michael Schwartzkopff, 2011 8 / 26
  • 9. Restart  If the CRM uses heartbeat only for the communicaton in the cluster, this could be done also by another program.  The other software was OpenAIS.  The developers organized the CRM code in a separate project called pacemaker. It uses either heartbeat or OpenAIS.  Some utilities from the heartbeat-package were still nescessary. (c) Michael Schwartzkopff, 2011 9 / 26
  • 10. pacemaker Managment CRM pacemaker Utilities heartbeat heartbeat heart- beat Communication OpenAIS Linux-HAv1 Linux-HAv2 pacemaker (c) Michael Schwartzkopff, 2011 10 / 26
  • 11. pacemaker  Uses heartbeat or OpenAIS.  Suitable GUI.  Own subshell additional to the CLI.  Sandboxes for testing.  First test what would happen, if ... → only afterwards activate the new configuration.  Exact history, what happened why. (c) Michael Schwartzkopff, 2011 11 / 26
  • 12. pacemaker: The GUI (c) Michael Schwartzkopff, 2011 12 / 26
  • 13. Sandboxes with graphics! (c) Michael Schwartzkopff, 2011 13 / 26
  • 14. The development goes on  OpenAIS offers much more as needed by pacemaker. The communication stack is forked into a separate project called corosync.  corosync is responsible for the communication in the cluster.  OpenAIS takes care for all ”higher” services in a cluster.  Simple clusters with pacemaker only need corosync. (c) Michael Schwartzkopff, 2011 14 / 26
  • 15. Decomposition of heartbeat  With pacemaker 1.0.5, heartbeat is decomposed into three projects:  cluster-glue includes all nescessary utilities.  The package resource-agents combines all resource agents, the interface between pacemaker and the application's binaries.  In heartbeat (version ≥ 3.0.2) remains, what is left from the project. (c) Michael Schwartzkopff, 2011 15 / 26
  • 16. HA-cluster with Linux Management pacemaker pacemaker CRM resource- agents Utilities cluster-glue heartbeat heartbeat heart- beat Communi- heart- coro- cation OpenAIS beat sync Linux-HAv1 Linux-HAv2 pacemaker pacemaker ≥ 1.0.5 (c) Michael Schwartzkopff, 2011 16 / 26
  • 17. Master Control Process  pacemaker in version 1.1 got a Master Control Process. So it can be started outside from corosync though the init-system.  Of course, corosync has to be running.  Causes less trouble.  Is more stable. (c) Michael Schwartzkopff, 2011 20 / 26
  • 18. DRBD Managment Console  From company Linbit.  Written in Java.  Originally ment to manage DRBDs  Now full blown cluster management tool:  Nodes, resources, constraints  Graphical representation of the configuration  Emphasis on virtual machines: Config & console. (c) Michael Schwartzkopff, 2011 21 / 26
  • 19. Utilizations in pacemaker 1.1  Every node has utilizations like CPUs, RAM configured.  Every resource has utilizations configured.  The cluster manager takes care that resources only run on nodes with enough utilizations.  TODO: Make resource utilizations dynamic. (c) Michael Schwartzkopff, 2011 22 / 26
  • 20. Role Based Access Model  From version 1.1 administrators access to resources can be limited:  You can only destroy your own resources.  Complete RBAC model implemented.  Think about a provider offering HA services. (c) Michael Schwartzkopff, 2011 23 / 26
  • 21. External Quorum Providers  Quorum descisions are quite simple up to now.  corosync can use external quorum providers.  cman is a possible external provider.  For now it is the only one. (c) Michael Schwartzkopff, 2011 24 / 26
  • 22. Beering  Lavandevil Schusterusstrasse 3 U Richard Wagner Platz: U7 / M45 (c) Michael Schwartzkopff, 2011 25 / 26
  • 23. Thank you very much for your attention! Questions? (c) Michael Schwartzkopff, 2011 26 / 26