Model Optimization Courses and Certifications

Neural Magic

Unlock Faster and More Efficient LLMs with SparseGPT - Neural Magic

Optimize LLMs with SparseGPT: prune and quantize models for efficient CPU deployment at GPU speeds. Explore one-shot compression, benchmarks, and practical implementation.

• YouTube
• 42 minutes
• On-Demand
• Free Video

AI Engineer

A Practical Guide to Efficient AI

Discover practical techniques to optimize AI model efficiency, covering architecture selection, quantization, and prompt optimization for scalable deployment and on-device AI applications.

• YouTube
• 18 minutes
• On-Demand
• Free Video

Discover AI

The Dark Truth Behind AI Benchmarks

Uncover the hidden flaws in AI benchmarks and learn how Apple researchers reveal optimization tricks that manipulate scores, plus scaling laws for LLM performance.

• YouTube
• 39 minutes
• On-Demand
• Free Video

AI Engineer

Introduction to LLM Serving with SGLang

Master SGLang framework for high-speed LLM serving, covering deployment optimization and when to use it over vLLM, Ollama, and TensorRT-LLM for production workloads.

• YouTube
• 44 minutes
• On-Demand
• Free Video

Discover AI

LoftQ: Understanding LoRA-Fine-Tuning-aware Quantization for LLMs

Dive into LoftQ, a groundbreaking LLM quantization method that combines with LoRA to achieve superior performance and efficiency in large language models.

• YouTube
• 14 minutes
• On-Demand
• Free Video

Open Data Science

Bringing Choice, Automation and Performance to ML Deployment with Apache TVM and the OctoML Platform

Explore Apache TVM for ML deployment across diverse hardware, offering performance optimization and portability. Learn about OctoML's Octomizer for continuous model optimization and benchmarking.

• YouTube
• 30 minutes
• On-Demand
• Free Video

MLOps World: Machine Learning in Production

A Gentle Introduction to Sparsity with a Concrete Example

Explore sparsification techniques for ML models, including popular methods and a concrete example to understand their benefits.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Data Science Conference

Optimizing AI Inference with ML Compilers and Hardware

Explore how ML compilers and hardware innovations optimize AI inference, addressing LLM complexity challenges and showcasing specialized hardware solutions for efficient AI deployment.

• YouTube
• 34 minutes
• On-Demand
• Free Video

Conf42

Aggressive LLMs Optimization - Making Them Work on Tiny Devices

Discover aggressive optimization techniques to deploy large language models on resource-constrained devices using GPT-2 as a practical example with hands-on experiments.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Neural Magic

The State of LLM Compression — From Research to Production

Explore the evolving landscape of LLM compression techniques, from cutting-edge research to practical implementation, examining quantization and sparsity tradeoffs for optimizing generative AI systems in production environments.

• YouTube
• 1 hour
• On-Demand
• Free Video

The Machine Learning Engineer

BitNet.cpp - CPU Inference Framework for 1-bit Large Language Models

Explore BitNet CPP's optimized framework for efficient 1-bit LLM inference, featuring specialized kernels for fast, lossless CPU-based processing of 1.58-bit models.

• YouTube
• 52 minutes
• On-Demand
• Free Video

EDGE AI FOUNDATION

MobileLLM - Optimizing Sub-billion Parameter Language Models for On-Device Use Cases

Discover how MobileLLM optimizes language models for mobile devices through innovative architecture design, achieving superior performance with fewer parameters and reduced computational costs.

• YouTube
• 20 minutes
• On-Demand
• Free Video

Introduction to Deep Learning in Python

50 ratings at DataCamp

Learn the fundamentals of neural networks and how to build deep learning models using Keras 2.0 in Python.

• DataCamp
• 4 hours
• On-Demand
• Free Trial Available

Scalable AI Models with PyTorch Lightning

Streamline your AI projects by building modular models and mastering advanced optimization with PyTorch Lightning!

• DataCamp
• 3 hours
• On-Demand
• Free Trial Available

Databricks

AutoML Toolkit Deep Dive - Automating Feature Engineering and Model Optimization

Explore Databricks Labs' AutoML Toolkit for automating feature engineering, model selection, tuning, and deployment. Learn to accelerate machine learning workflows and enhance productivity.

• YouTube
• 1 hour
• On-Demand
• Free Video