Parallel Computing Courses and Certifications

Stanford CS149 - Parallel Computing 2023

10 ratings

Master parallel computing fundamentals from multi-core CPUs to GPUs, covering hardware design, programming techniques, and performance optimization for modern systems.

• YouTube
• 1 day 19 minutes
• Self-Paced
• Free Video

Introducing Chapel: A Programming Language for Productive Parallel Computing from Laptops to Supercomputers

Explore Chapel, a programming language for efficient parallel computing across devices. Learn key features and applications in aerodynamics, data science, and atmospheric research.

• YouTube
• 43 minutes
• Self-Paced
• Free Video

Parallel Computing in R

This course covers in detail the tools available in R for parallel computing.

• DataCamp
• 4 hours
• Self-Paced
• Free Trial Available

High-Performance and Parallel Computing

179 ratings at Coursera

Unlock parallel computing skills for scientists and engineers, covering Linux, optimization, profiling, and MPI programming to accelerate complex simulations and data processing.

• Coursera
• 4 weeks, 10 hours/week
• Self-Paced
• Paid Course
• 3 courses

Introduction to High-Performance and Parallel Computing

165 ratings at Coursera

Explore high-performance computing fundamentals, from Linux basics to parallel programming models. Gain skills in big-data analysis, machine learning, and code optimization for scientific and engineering applications.

• Coursera
• 14 hours 4 minutes
• Self-Paced
• Paid Course

Concurrency, Multithreading and Parallel Computing in Java

3831 ratings at Udemy

Multithreading and Concurrency, Parallel Computation and MapReduce in Java + Fork-Join and Stream API, Virtual Threads

• Udemy
• 14 hours 16 minutes
• Self-Paced
• Paid Course

Parallel Computing with MPI

13 ratings at Coursera

Master parallel programming with MPI for high-performance computing, covering communication techniques, performance optimization, and advanced concepts for scalable solutions.

• Coursera
• 7 hours 58 minutes
• Self-Paced
• Paid Course

Introduction to Linear Models and Matrix Algebra

12 ratings

Learn to use R programming to apply linear models to analyze data in life sciences.

• edX
• 4 weeks, 2-4 hours/week
• Self-Paced
• Free Online Course (Audit)

Explore superscalar processors, instruction pipelining, and data-level parallelism techniques like vector processing and GPUs to enhance computational efficiency and throughput.

• Codecademy
• 1 hour
• Self-Paced
• Free Trial Available

Learn strategies for optimizing single-core performance and explore parallel computing techniques including multithreading, distributed computing, and GPU utilization.

• JuliaAcademy
• 4-5 hours
• Self-Paced
• Free Online Course

Parallel Computing Video Series: Wolfram U

Explore optimization techniques and parallel programming in Wolfram Language. Master single-kernel optimization, multi-kernel utilization, and cluster management for enhanced computational efficiency.

• Wolfram U
• 1 hour
• Self-Paced
• Free Online Course

Scalable Parallel Computing Lab, SPCL @ ETH Zurich

Measurement and Analysis of Application Performance on Exascale GPU-accelerated Systems

Discover how HPCToolkit enables instruction-level performance measurement and analysis on GPU-accelerated exascale systems, with techniques for efficient data handling, parallel analysis, and visualization of terabytes of performance data.

• YouTube
• 1 hour 14 minutes
• Self-Paced
• Free Video

MLOps World: Machine Learning in Production

Scaling Large Language Models - Getting Started with Large-Scale Parallel Training of LLMs

Master parallel training strategies for billion-parameter LLMs through hands-on implementation of data, tensor, and pipeline parallelism techniques.

• YouTube
• 1 hour 19 minutes
• Self-Paced
• Free Video

MLOps World: Machine Learning in Production

Scaling Large Language Models - Getting Started with Large-Scale Parallel Training of LLMs

Master parallel training strategies for billion-parameter LLMs through hands-on implementation of data, tensor, and pipeline parallelism techniques.

• YouTube
• 1 hour 20 minutes
• Self-Paced
• Free Video

Simons Institute

Managing Parallelism

Explore advanced techniques for managing parallelism in computing systems with insights from Google Research's cutting-edge approaches to parallel algorithm design.

• YouTube
• 1 hour 17 minutes
• Self-Paced
• Free Video