Lesson 13 Date: 4/25/2018

High Performance Computing (part II: MPI)

Linux System Administration

Message Passing Interface (MPI) MPI is the standard of programming parallel applications using message passing. Processes run on network distributed hosts and communicate by exchanging messages. A community of communicating processes is called a Communicator. The default communicator is called MPI_COMM_WORLD. Inside a communicator, each process is attributed a "process ID", called rank.

Agenda HPC paradigms Message Passing Interface (MPI) General MPI Program Structure Point to Point Communication MPI Standard Data Types MPI Send/Receive example MPI Collective Communications Collective Communication Example Master-Slave Task Farming Computing Partial Sums Exercise: User accounts for MPI Exercise: OpenMPI installation Exercise: MPI code compilation and run in OpenMPI VM cluster for MPI Exercise: Cluster node deployment Exercise: MPI run on a cluster References Take me to the Course Website