Lesson 13 Date: 5/1/2019

High Performance Computing (part II: MPI)

Linux System Administration

References LLNL Introduction to Parallel Computing LLNL OpenMP tutorial LinuxPRO magazine 9/2008: Parallel Programming with OpenMP LLNL MPI Tutorial Open MPI web site SSH Host-based Authentication

Agenda HPC paradigms Message Passing Interface (MPI) General MPI Program Structure Point to Point Communication MPI Standard Data Types MPI Send/Receive example MPI Collective Communications Collective Communication Example Master-Slave Task Farming Computing Partial Sums Exercise: User accounts for MPI Exercise: OpenMPI installation Exercise: MPI code compilation and run in OpenMPI VM cluster for MPI Exercise: Cluster node deployment Exercise: MPI run on a cluster References Take me to the Course Website