MIT HAN Lab Courses

LServe: Efficient Long-sequence LLM Serving with Unified Sparse Attention

Discover how LServe enables efficient long-sequence LLM serving through unified sparse attention, improving performance for large language models with extended context windows.

• YouTube
• 12 minutes
• Self-Paced
• Free Video

Accelerating Large Language Models and Generative AI

Discover efficient acceleration techniques for Large Language Models and Generative AI in this insightful talk by Professor Song Han from MIT HAN Lab at the HPCA 2025 EMC2 Workshop.

• YouTube
• 42 minutes
• Self-Paced
• Free Video

LEGO: Spatial Accelerator Generation and Optimization for Tensor Applications

Discover a novel approach to spatial accelerator generation and optimization for tensor applications with MIT's LEGO framework, presented at HPCA 2025.

• YouTube
• 16 minutes
• Self-Paced
• Free Video

On-device Training and Transfer Learning - Lecture 21

Explore advanced techniques for on-device ML training, covering gradient security, memory optimization, transfer learning, and quantization methods for efficient model deployment.

• YouTube
• 1 hour 5 minutes
• Self-Paced
• Free Video

On-device Training and Transfer Learning in Machine Learning - Lecture 21

Dive into advanced on-device ML training techniques, covering gradient security, memory optimization, transfer learning, and quantization methods for efficient model deployment and adaptation.

• YouTube
• 1 hour 5 minutes
• Self-Paced
• Free Video

Distributed Training Methods for Efficient Machine Learning - Part 1

Explore distributed training fundamentals, from data parallelism to advanced techniques like ZeRO and pipeline parallelism, enhancing your ML model deployment capabilities.

• YouTube
• 1 hour 10 minutes
• Self-Paced
• Free Video

Distributed Training: Hybrid Parallelism and Gradient Optimization - Lecture 20

Delve into advanced distributed training concepts, exploring hybrid parallelism, gradient compression techniques, and strategies to overcome bandwidth and latency bottlenecks in ML systems.

• YouTube
• 59 minutes
• Self-Paced
• Free Video

EfficientML.AI - Introduction to Efficient Machine Learning

Master efficient machine learning techniques and optimization strategies for deploying ML models in resource-constrained environments, focusing on practical implementation methods and performance enhancement.

• YouTube
• 1 hour 41 minutes
• Self-Paced
• Free Video

Distributed Training: Hybrid Parallelism and Gradient Optimization - Lecture 20

Delve into advanced distributed training concepts, covering hybrid parallelism, gradient compression techniques, and strategies for optimizing bandwidth and latency in ML systems.

• YouTube
• 59 minutes
• Self-Paced
• Free Video

Distributed Training Methods and Parallelization Techniques - Lecture 19

Explore advanced distributed training concepts, from data parallelism and communication primitives to pipeline, tensor, and sequence parallelism methods for efficient machine learning systems.

• YouTube
• 1 hour 10 minutes
• Self-Paced
• Free Video

EfficientML.AI - Introduction to Efficient Machine Learning

Master efficient machine learning techniques and optimization strategies for deploying ML models in resource-constrained environments, focusing on practical implementation and performance tuning.

• YouTube
• 1 hour 41 minutes
• Self-Paced
• Free Video

Knowledge Distillation in Efficient Machine Learning - Lecture 9

Explore knowledge distillation techniques for efficient machine learning, covering theory, applications, and practical implementation strategies.

• YouTube
• 59 minutes
• Self-Paced
• Free Video

Knowledge Distillation in Efficient Machine Learning - Lecture 9

Explore knowledge distillation techniques for efficient machine learning, covering theory, applications, and practical implementation strategies.

• YouTube
• 58 minutes
• Self-Paced
• Free Video

Neural Architecture Search Part II - Lecture 8

Explore advanced neural architecture search techniques, including evolutionary algorithms and reinforcement learning for optimizing deep learning models.

• YouTube
• 1 hour 16 minutes
• Self-Paced
• Free Video

Neural Architecture Search Part II - Lecture 8

Explore advanced neural architecture search techniques, including evolutionary algorithms and reinforcement learning, to optimize deep learning models for efficiency and performance.

• YouTube
• 1 hour 16 minutes
• Self-Paced
• Free Video