Model Compression Courses and Certifications

Arm Education;  University of Cambridge

AI at the Edge on Arm: Understanding and Deploying LLMs for Mobile Devices

AI at the Edge will be powered by Arm. Discover the tools and techniques you’ll need to deploy Language Models (LMs) on ubiquitous Arm-based mobile phones.

• edX
• 6 weeks, 2-3 hours a week
• On-Demand
• Free Online Course (Audit)

Packt

Accelerate Model Training with PyTorch 2.X

Master PyTorch 2.X optimization techniques to dramatically accelerate model training through compilation, mixed precision, distributed strategies, and efficient data pipelines.

• Coursera
• 8 hours 10 minutes
• On-Demand
• Paid Course

The Machine Learning Engineer

LLM Quantization: Porque el Tamaño Importa

Aprende a aplicar la cuantización en LLMs para optimizar el rendimiento y reducir el tamaño de modelos sin sacrificar calidad.

• YouTube
• 43 minutes
• On-Demand
• Free Video

SK AI SUMMIT 2024

거대 인공지능 모델 시대에 스타트업의 차별화 방향 - AI 모델 경량화 기술을 중심으로

Discover how startups can differentiate through AI model optimization and edge computing, focusing on lightweight neural networks for wearable devices while maintaining high performance.

• YouTube
• 23 minutes
• On-Demand
• Free Video

SK AI SUMMIT 2024

모두를 위한 AI 최적화 - 경량화에서 추론까지 End-to-End AI 최적화 인프라 플랫폼 NetsPresso 기술 소개

Discover NetsPresso, an end-to-end AI optimization platform that automates model design, compression, inference optimization, and deployment for various NPUs and edge devices.

• YouTube
• 24 minutes
• On-Demand
• Free Video

tinyML

Structured Quantization for Neural Network Language Model Compression

探讨神经网络语言模型的结构化量化压缩技术,展示如何在不损失性能的情况下实现70-100倍的高压缩率,适用于资源受限场景。

• YouTube
• 32 minutes
• On-Demand
• Free Video

TensorFlow Lite for Edge Devices - Tutorial

Explore TensorFlow Lite for efficient on-device inference. Learn edge computing, model conversion, quantization, and compression techniques for deploying deep learning models on resource-constrained devices.

• freeCodeCamp
• On-Demand
• Free Video

Microcredential

Manage Your LLMs with LLMOps

Master LLMOps from foundational programming techniques to production deployment, covering fine-tuning, vector databases, agents, and enterprise-scale applications.

• LinkedIn Learning
• On-Demand
• Free Trial Available

Sustainability in the Digital Age: Efficient AI Techniques in the LLM Era

Explore efficient AI methodologies including model compression, quantization, and collaborative inference to build sustainable systems while reducing energy consumption.

• openHPI
• 2 weeks
• On-Demand
• Free Online Course

MIT HAN Lab

EfficientML.ai - Efficient Deep Learning Computing Techniques - MIT 6.5940 Fall 2023

Master efficient deep learning techniques to deploy large models on resource-constrained devices, covering pruning, quantization, neural architecture search, and hands-on LLaMA 2 deployment.

• YouTube
• 2 days 6 hours 2 minutes
• On-Demand
• Free Video

LoRKD - Low-Rank Knowledge Decomposition for Medical Foundation Models

Discover how to decompose medical foundation models into specialized lightweight experts using Low-Rank Knowledge Decomposition for enhanced task performance.

• YouTube
• 49 minutes
• On-Demand
• Free Video

Trelis Research

How to Quantize a Large Language Model with GGUF or AWQ

1 review

Learn to quantize large language models using GGUF and AWQ. Explore techniques, compare methods, and gain practical skills for efficient model compression and deployment.

• YouTube
• 26 minutes
• On-Demand
• Free Video

MIT HAN Lab

Quantization for Efficient Machine Learning - Part I - Lecture 5

Explore quantization techniques for efficient machine learning, covering fundamental concepts and practical applications in neural network optimization.

• YouTube
• 1 hour 15 minutes
• On-Demand
• Free Video

MIT HAN Lab

EfficientML.ai: Introduction to Efficient Machine Learning - Lecture 1

Explore efficient machine learning techniques and their applications in this comprehensive introduction to EfficientML.ai from MIT's Prof. Song Han.

• YouTube
• 1 hour 17 minutes
• On-Demand
• Free Video

MIT HAN Lab

EfficientML.ai: Introduction to Efficient Machine Learning - Lecture 1

Explore efficient machine learning techniques and their applications in this introductory lecture from MIT's EfficientML course, led by Prof. Song Han.

• YouTube
• 1 hour 17 minutes
• On-Demand
• Free Video