Lesson 13 Date: 4/25/2018

High Performance Computing (part II: MPI)

Linux System Administration

Master-Slave Task Farming A process with rank=0 forms tasks for slaves (rank > 0), sends it to them then receives computed results. The slaves receive the tasks, compute them and send the results to the master.

Agenda HPC paradigms Message Passing Interface (MPI) General MPI Program Structure Point to Point Communication MPI Standard Data Types MPI Send/Receive example MPI Collective Communications Collective Communication Example Master-Slave Task Farming Computing Partial Sums Exercise: User accounts for MPI Exercise: OpenMPI installation Exercise: MPI code compilation and run in OpenMPI VM cluster for MPI Exercise: Cluster node deployment Exercise: MPI run on a cluster References Take me to the Course Website