Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

EfficientML.ai - Efficient Deep Learning Computing Techniques - MIT 6.5940 Fall 2023

MIT HAN Lab via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore efficient deep learning computing techniques through this comprehensive MIT course that addresses the computational challenges of large generative models like language models and diffusion models. Master essential optimization methods including model compression, pruning, quantization, and neural architecture search to deploy powerful AI applications on resource-constrained devices. Delve into distributed training strategies, data and model parallelism, gradient compression, and on-device fine-tuning techniques that make large-scale models more accessible. Learn application-specific acceleration methods for large language models, diffusion models, video recognition, and point cloud processing, while gaining exposure to emerging quantum machine learning concepts. Engage with hands-on deployment exercises featuring large language models such as LLaMA 2 on laptop computers. Progress through 23 detailed lectures covering neural network fundamentals, advanced pruning and sparsity techniques, multi-part quantization methods, neural architecture search strategies, knowledge distillation, TinyML for microcontrollers, transformer architectures, vision transformers, GANs, distributed training methodologies, transfer learning, prompt engineering, quantum computing basics, and noise-robust quantum machine learning approaches.

Syllabus

EfficientML.ai Lecture 1 - Introduction (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 1 - Introduction (MIT 6.5940, Fall 2023, Zoom recording)
EfficientML.ai Lecture 2 - Basics of Neural Networks (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 2 - Basics of Neural Networks (MIT 6.5940, Fall 2023, Zoom recording)
EfficientML.ai Lecture 3 - Pruning and Sparsity (Part I) (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 3 - Pruning and Sparsity (Part I) (MIT 6.5940, Fall 2023, Zoom recording)
EfficientML.ai Lecture 4 - Pruning and Sparsity (Part II) (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 4 - Pruning and Sparsity (Part II) (MIT 6.5940, Fall 2023, Zoom recording)
EfficientML.ai Lecture 5 - Quantization (Part I) (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 5 - Quantization (Part I) (MIT 6.5940, Fall 2023, Zoom recording)
EfficientML.ai Lecture 6 - Quantization (Part II) (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 6 - Quantization (Part II) (MIT 6.5940, Fall 2023, Zoom recording)
EfficientML.ai Lecture 7 - Neural Architecture Search (Part I) (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 7 - Neural Architecture Search (Part I) (MIT 6.5940, Fall 2023, Zoom)
EfficientML.ai Lecture 8 - Neural Architecture Search (Part II) (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 8 - Neural Architecture Search (Part II) (MIT 6.5940, Fall 2023, Zoom)
EfficientML.ai Lecture 9 - Knowledge Distillation (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 9 - Knowledge Distillation (MIT 6.5940, Fall 2023, Zoom)
EfficientML.ai Lecture 10 - MCUNet: TinyML on Microcontrollers (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 10 - MCUNet: TinyML on Microcontrollers (MIT 6.5940, Fall 2023, Zoom)
EfficientML.ai Lecture 11 - TinyEngine and Parallel Processing (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 11 - TinyEngine and Parallel Processing (MIT 6.5940, Fall 2023, Zoom)
EfficientML.ai Lecture 12 - Transformer and LLM (Part I) (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 12 - Transformer and LLM (Part I) (MIT 6.5940, Fall 2023, Zoom)
EfficientML.ai Lecture 13 - Transformer and LLM (Part II) (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 13 - Transformer and LLM (Part II) (MIT 6.5940, Fall 2023, Zoom)
EfficientML.ai Lecture 14 - Vision Transformer (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 14 - Vision Transformer (MIT 6.5940, Fall 2023, Zoom)
EfficientML.ai Lecture 15 - GAN, Video, and Point Cloud (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 15 - GAN, Video, and Point Cloud (MIT 6.5940, Fall 2023, Zoom)
EfficientML.ai Lecture 16 - Diffusion Model (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 16 - Diffusion Model (MIT 6.5940, Fall 2023, Zoom)
EfficientML.ai Lecture 17: Distributed Training (Part I) (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 17: Distributed Training (Part I) (MIT 6.5940, Fall 2023, Zoom)
EfficientML.ai Lecture 18: Distributed Training (Part II) (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 18: Distributed Training (Part II) (MIT 6.5940, Fall 2023, Zoom)
EfficientML.ai Lecture 19: On-Device Training and Transfer Learning (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 19: On-Device Training and Transfer Learning (MIT 6.5940, Fall 2023, Zoom)
EfficientML.ai Lecture 20: Efficient Fine-tuning and Prompt Engineering (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 20: Efficient Fine-tuning and Prompt Engineering (MIT 6.5940,Fall 2023,Zoom)
EfficientML.ai Lecture 21: Basics of Quantum Computing (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 21: Basics of Quantum Computing (MIT 6.5940, Fall 2023, Zoom)
EfficientML.ai Lecture 22: Quantum Machine Learning (MIT 6.5940, Fall 2023)
EfficientML.ai Lecture 22: Quantum Machine Learning (MIT 6.5940, Fall 2023, Zoom)
EfficientML.ai Lecture 23: Noise Robust Quantum ML (MIT 6.5940, Fall 2023)

Taught by

MIT HAN Lab

Reviews

Start your review of EfficientML.ai - Efficient Deep Learning Computing Techniques - MIT 6.5940 Fall 2023

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.