Tutorial on Parallel Computing and Message Passing Model - C5

Communicators Marcirio Silveira Chaves [email_address] Tutorial on Parallel Computing and Message Passing Model Part II - Day 5

Objectives ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Communicator Basics ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Communicator Basics ,[object Object],[object Object],June - 2009 LNEC-DHA-NTI A matrix-multiplication problem that is to be computed in parallel.

Communicator Basics ,[object Object],June - 2009 LNEC-DHA-NTI A 2-dimensional grid of processes arranged in rows and columns corresponding to the rows and columns of the matrices A and B. wherein element cij of matrix C is to be computed on process p(i, j) , where

Communicator Basics ,[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Types of Communicators ,[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Types of Communicators ,[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Types of Communicators ,[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Creating Intracommunicators ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Splitting an Existing Intracommunicator ,[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Splitting an Existing Intracommunicator ,[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI ,[object Object],[object Object]

Splitting an Existing Intracommunicator ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Splitting an Existing Intracommunicator ,[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Splitting an Existing Intracommunicator ,[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI Creating 3 new intracommunicators by splitting an existing intracommunicator containing 8 processes. process p0 p1 p2 p3 p4 p5 p6 p7 rank 0 1 2 3 4 5 6 7 color 1 2 2 4 1 1 2 1 key 3 5 5 2 2 1 2 3

Duplicating an Existing Intracommunicator ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Modifying a Group of Processes ,[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Modifying a Group of Processes ,[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Modifying a Group of Processes June - 2009 LNEC-DHA-NTI Creating a new intracommunicator based on a modified group of processes.

Modifying a Group of Processes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Modifying a Group of Processes ,[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI Fortran: include "mpif.h" integer comm_world, ierr, group_world comm_world = MPI_COMM_WORLD call MPI_Comm_group(comm_world, group_world, ierr)

Modifying a Group of Processes ,[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Modifying a Group of Processes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Modifying a Group of Processes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI group1 : [ p0, p1, p2, p3, p4, p5, p6 ] group2 : [ p3, p6, p0, p2, p7, p8 ]

Modifying a Group of Processes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI group1 : [ p0, p1, p2, p3, p4, p5, p6 ] group2 : [ p3, p6, p0, p2, p7, p8 ]

Modifying a Group of Processes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI group1 : [ p0, p1, p2, p3, p4, p5, p6 ] group2 : [ p3, p6, p0, p2, p7, p8 ]

Modifying a Group of Processes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI group1 : [ p0, p1, p2, p3, p4, p5, p6 ] group2 : [ p3, p6, p0, p2, p7, p8 ]

Modifying a Group of Processes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Modifying a Group of Processes ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Modifying a Group of Processes ,[object Object],June - 2009 LNEC-DHA-NTI include "mpif.h" integer comm_world, group_world, comm_worker, group_worker, ierr ... comm_world = MPI_COMM_WORLD call MPI_Comm_group(comm_world, group_world, ierr) call MPI_Group_excl(group_world, 1, ranks, group_worker, ierr) ! process 0 not member call MPI_Comm_create(comm_world, group_worker, comm_worker, ierr) ,[object Object],[object Object],[object Object],[object Object],[object Object]

Modifying a Group of Processes ,[object Object],June - 2009 LNEC-DHA-NTI include "mpif.h" integer comm_world, group_world, comm_worker, group_worker, ierr ... comm_world = MPI_COMM_WORLD call MPI_Comm_group(comm_world, group_world, ierr) call MPI_Group_excl(group_world, 1, ranks, group_worker, ierr) ! process 0 not member call MPI_Comm_create(comm_world, group_worker, comm_worker, ierr) ,[object Object],[object Object],[object Object],[object Object]

Creating Intercommunicators ,[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Creating Intercommunicators ,[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Creating An Intercommunicator From Two Intracommunicators ,[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Creating An Intercommunicator From Two Intracommunicators ,[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI Creating an intercommunicator by joining two existing intracommunicators.

Creating An Intercommunicator From Two Intracommunicators ,[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI Creating an intercommunicator by joining two existing intracommunicators.

Creating an Intercommunicator from an Existing Intercommunicator ,[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Creating an Intercommunicator from an Existing Intercommunicator ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

Accessing Information from an Intercommunicator ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],June - 2009 LNEC-DHA-NTI

[object Object],June - 2009 LNEC-DHA-NTI  Nano- Self Test – Communicators  http://ci-tutor.ncsa.uiuc.edu/content.php?cid=1317 Practical Section

Tutorial on Parallel Computing and Message Passing Model - C5

Recommended

Recommended

More Related Content

Similar to Tutorial on Parallel Computing and Message Passing Model - C5

Similar to Tutorial on Parallel Computing and Message Passing Model - C5 (20)

More from Marcirio Chaves

More from Marcirio Chaves (14)

Tutorial on Parallel Computing and Message Passing Model - C5

Editor's Notes