Clusters (Distributed computing)

Clusters Paul Krzyzanowski [email_address] [email_address] Distributed Systems Except as otherwise noted, the content of this presentation is licensed under the Creative Commons Attribution 2.5 License.

Designing highly available systems ,[object Object],[object Object],[object Object],[object Object],[object Object]

Designing highly scalable systems ,[object Object],[object Object],[object Object],[object Object],[object Object]

Clustering ,[object Object],[object Object],[object Object]

Ideally… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

we don’t get all that (yet) (at least not in one package)

Clustering types ,[object Object],[object Object],[object Object],[object Object]

High Performance Computing (HPC)

The evolution of supercomputers ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Clustering for performance ,[object Object],[object Object],[object Object],[object Object]

What makes it possible ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What can you run? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Beowulf configuration ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Programming tools: MPI ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Programming tools: PVM ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Beowulf programming tools ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Another example ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Another example ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Batch processing ,[object Object],[object Object],[object Object],[object Object],[object Object]

Single-queue work distribution ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Batch Processing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Grid Computing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Open Grid Services Architecture (OGSA) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Globus services ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Functions of a load balancer ,[object Object],[object Object],[object Object]

Redirection ,[object Object],[object Object]

Redirection ,[object Object],[object Object],Public domain keyboard image from http://en.wikipedia.org/wiki/Image:Computer_keyboard.gif Public domain Mac Pro image from http://en.wikipedia.org/wiki/Image:Macpro.png www.mysite.com

Redirection ,[object Object],[object Object],www.mysite.com REDIRECT www03.mysite.com

Redirection ,[object Object],[object Object],www03.mysite.com

Redirection ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Software load balancer ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Software load balancer www.mysite.com

Software load balancer www.mysite.com src=bobby, dest=www03

Software load balancer www.mysite.com response src=bobby, dest=www03

Load balancing router ,[object Object],[object Object],[object Object],[object Object]

Load balancing router ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Sessions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

High availability (HA) Class Level Annual Downtime Continuous 100% 0 Six nines (carrier class switches) 99.9999% 30 seconds Fault Tolerant (carrier-class servers) 99.999% 5 minutes Fault Resilient 99.99% 53 minutes High Availability 99.9% 8.3 hours Normal availability 99-99.5% 44-87 hours

Clustering: high availability ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Clustering: high availability ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Example: Windows Server 2003 clustering ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Example: Windows Server 2003 clustering ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

HA issues ,[object Object],[object Object],[object Object],[object Object]

Heartbeat network ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Failover Configuration Models ,[object Object],[object Object],[object Object],[object Object]

Design options for failover ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Design options for failover ,[object Object],[object Object],[object Object],[object Object],[object Object]

System support for HA ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Shared resources (disk) ,[object Object],[object Object],[object Object],[object Object],[object Object]

Shared resources (disk) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Cluster interconnects ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Achieving High Availability heartbeat 2 heartbeat 3 Server A Server B Fibre channel switch Fibre channel switch Fabric A Fabric B Storage Area Networks Local Area Networks switch B switch A heartbeat

Achieving High Availability heartbeat 2 heartbeat 3 Server A Server B Ethernet switch A’ Ethernet switch B’ ethernet A ethernet B Local Area Networks (for iSCSI) Local Area Networks switch B Switch A heartbeat

HA Storage: RAID ,[object Object]

RAID 0: Performance ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Disk 0 Block 4 Block 2 Block 0 Disk 1 Block 5 Block 3 Block 1

RAID 1: HA ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Disk 0 Block 2 Block 1 Block 0 Disk 1 Block 2 Block 1 Block 0

RAID 3 and RAID 4: HA ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Disk 3 Parity 2 Parity 1 Parity 0 Disk 2 Block 2c Block 1c Block 0c Disk 1 Block 2b Block 1b Block 0b Disk 0 Block 2a Block 1a Block 0a

RAID 5: HA ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Disk 2 Block 2b Parity 1 Block 0c Disk 3 Block 2c Block 1c Parity 0 Disk 1 Parity 2 Block 1b Block 0b Disk 0 Block 2a Block 1a Block 0a

RAID 1+0 ,[object Object],[object Object],[object Object]

Clusters (Distributed computing)

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

En vedette

En vedette (15)

Similaire à Clusters (Distributed computing)

Similaire à Clusters (Distributed computing) (20)

Plus de Sri Prasanna

Plus de Sri Prasanna (20)

Dernier

Dernier (20)

Clusters (Distributed computing)