MPI Courses and Certifications

Parallel Computing with MPI

14 ratings at Coursera

Transform serial algorithms into parallel programs with MPI: blocking and nonblocking communication, load balancing, custom communicators, derived datatypes, and parallel I/O with HDF5.

• Coursera
• 5 weeks, 2 hours a week
• Self-Paced
• Paid Course

NHR@FAU

Asynchronous MPI Communication with OpenMP Tasks - Spawning Task Dependency Graphs Across Nodes

Explore asynchronous MPI communication with OpenMP tasks to improve parallel code scalability. Learn to integrate MPI detached communication for real asynchronous execution across processes.

• YouTube
• 1 hour 4 minutes
• Self-Paced
• Free Video

NHR@FAU

New Features in MPI 4.0

Explore new features in MPI 4.0, including large-count routines, persistent collectives, and the Sessions Model. Learn about hardware-based communicator splitting and improvements in error handling.

• YouTube
• 56 minutes
• Self-Paced
• Free Video

LinaroOrg

Linaro Forge Thread Affinity Advisor - Optimizing the Performance of Your MPI OpenMP Jobs

Discover how to optimize MPI/OpenMP job performance with Linaro Forge's Thread Affinity Advisor, focusing on proper thread affinity configuration to prevent silent performance degradation, especially when porting to new systems.

• YouTube
• 22 minutes
• Self-Paced
• Free Video

Codeynamics

Parallel Computing in OpenFOAM Using MPI - DecomposePar and ReconstructPar Tutorial

Learn to set up parallel computing with MPI in OpenFOAM, including decomposePar and reconstructPar operations, for enhanced simulation efficiency.

• YouTube
• 16 minutes
• Self-Paced
• Free Video

DevConf

MPI Meets Machine Learning - Unlocking PyTorch Distributed for Scaling AI Workloads

Discover how PyTorch distributed computing bridges HPC and deep learning, exploring FSDP, tensor parallelism, and scaling techniques for massive AI model training across hundreds of nodes.

• YouTube
• 38 minutes
• Self-Paced
• Free Video

Distributed Programming in Java

507 ratings at Coursera

Build distributed Java applications with Hadoop and Spark MapReduce, sockets, RMI, multicast, Kafka and MPI, then combine distribution with multithreading using actors and reactive programming.

• Coursera
• 7 weeks, 3 hours a week
• Self-Paced
• Paid Course

Career Certificate

High-Performance and Parallel Computing

185 ratings at Coursera

Write efficient, scalable code for high-performance systems: Linux shell scripting, code optimization, profiling to find bottlenecks, HPC and cloud architectures, and parallel programming with MPI.

• Coursera
• 4 weeks, 10 hours a week
• Self-Paced
• Paid Course
• 3 courses

Birla Institute Of Technology And Science–Pilani (BITS–Pilani)

Multicore and GPGPU Programming

Build high-performance parallel applications with Pthreads, OpenMP, MPI, and CUDA, tuning locks, memory hierarchies, warp execution, and workload balance across multicore CPUs and GPUs.

• Coursera
• 10 weeks, 6 hours a week
• Self-Paced
• Paid Course

Birla Institute Of Technology And Science–Pilani (BITS–Pilani)

Multicore and GPGPU Programming

Build high-performance parallel programs: multicore architectures, NUMA and caching, Pthreads locks and shared-memory data structures, OpenMP, MPI, and CUDA execution and memory models.

• Coursera
• 12 weeks, 6 hours a week
• Self-Paced
• Paid Course

OpenFabrics Alliance

Open MPI and Libfabric Integration for the Frontier Supercomputer

Delve into high-performance computing optimization through Open MPI and libfabric implementation on Frontier supercomputer, focusing on AMD MI250X architecture and HPE Slingshot NICs integration.

• YouTube
• 27 minutes
• Self-Paced
• Free Video

OpenFabrics Alliance

High Performance Scalable Support for Big Data Stacks with MPI - Leveraging MPI4Spark and MPI4Dask

Discover how MPI4Spark and MPI4Dask enhance big data frameworks by leveraging high-speed networks and HPC systems for improved performance and scalability in distributed computing environments.

• YouTube
• 33 minutes
• Self-Paced
• Free Video

IIT Kharagpur;  NPTEL

High Performance Computing for Scientists and Engineers

Introduces parallel scientific computing through OpenMP, MPI, and CUDA, with matrix solvers, GPU kernels, and performance evaluation.

• Swayam
• 8 weeks
• Available until Oct 9, 2026
• Free Online Course

Learn modern Fortran programming through parallel computing with OpenMP, OpenACC, CUDA Fortran, and MPI.

• Independent
• Self-Paced
• Free Online Course

NHR@FAU

Parallel Programming 2020

Master OpenMP and MPI programming techniques for high-performance computing through comprehensive lectures covering computer architecture, parallelism concepts, and hybrid programming approaches.

• YouTube
• 12 hours 30 minutes
• Self-Paced
• Free Video