GGUF Courses and Certifications

Trelis Research

How to Quantize a Large Language Model with GGUF or AWQ

1 rating

Learn to quantize large language models using GGUF and AWQ. Explore techniques, compare methods, and gain practical skills for efficient model compression and deployment.

• YouTube
• 26 minutes
• Self-Paced
• Free Video

AI Bites

GGUF Quantization of Large Language Models Using LLAMA.cpp

Master GGUF quantization techniques to run large language models efficiently on personal devices using LLAMA.cpp, enabling GPU-free inference and deployment on laptops, phones, and watches.

• YouTube
• 12 minutes
• Self-Paced
• Free Video

Olivio Sarikas

QWEN GGUF - Quick Select, Fast Render, Low VRAM Tutorial

Master Qwen GGUF image generation with optimized workflows for low VRAM systems, including model setup, settings configuration, and quick selection techniques for faster results.

• YouTube
• 13 minutes
• Self-Paced
• Free Video

Software Engineering Courses - SE Courses

BF16 vs GGUF, FP8 Scaled, NVFP4 Speed and Quality Compared - ComfyUI CUDA 13 Gains - FLUX 2 Klein 9B

Discover precision formats comparison (BF16, GGUF, FP8, NVFP4) for AI models, speed benchmarks, quality analysis, ComfyUI CUDA 13 upgrades, and quantization tools for optimal performance.

• YouTube
• 19 minutes
• Self-Paced
• Free Video

Venelin Valkov

Quantizing LLMs and Converting to GGUF Format for Faster and Smaller Models

Master the process of LLM quantization and GGUF conversion, optimizing model performance through llama.cpp and Ollama while maintaining accuracy for efficient deployment on resource-limited devices.

• YouTube
• 14 minutes
• Self-Paced
• Free Video

The Machine Learning Engineer

MLOps: Comparing Microsoft Phi3 Mini 128k in GGUF, MLFlow, and ONNX Formats

Explore Microsoft Phi3 Mini 128k model: compare inference time and precision across MLFlow, GGUF, and ONNX formats. Learn quantization techniques and performance optimization for various platforms.

• YouTube
• 45 minutes
• Self-Paced
• Free Video

The Machine Learning Engineer

MLOps: Logging and Loading Microsoft Phi3 Mini 128k in GGUF with MLflow

Learn to log and load quantized LLama.cpp models in MLflow, create Python classes, and perform inference using Microsoft Phi3 mini 128k in GGUF format.

• YouTube
• 18 minutes
• Self-Paced
• Free Video

Pragmatic AI Labs

Production ML with Hugging Face

Master production ML deployment using the Sovereign Rust Stack with zero Python dependencies across GPU, CPU, WebAssembly, and edge targets through hands-on projects.

• Coursera
• 5 hours 27 minutes
• Self-Paced
• Paid Course

Pragmatic AI Labs

Deterministic LLM programming

Master deterministic LLM programming with AWS Bedrock, RAG pipelines, local inference via llama.cpp, and quality evaluation for production-grade AI systems.

• Coursera
• 5 hours 11 minutes
• Self-Paced
• Paid Course

Edge AI with SLMs: Fine-Tuning & Local Deployment

55 ratings at Udemy

The complete guide to running private, offline AI on mobile & IoT. Master LoRA, Quantization, and Small Language Models.

• Udemy
• 1 hour 52 minutes
• Self-Paced
• Paid Course

How to Benchmark Embedding Models On Your Own Data

Master embedding model evaluation using your own data through PDF text extraction, chunking strategies, question generation with LLMs, and statistical benchmarking techniques.

• freeCodeCamp
• 3 hours 48 minutes
• Self-Paced
• Free Video

The Machine Learning Engineer

MLOps with MLFlow: Comparing Microsoft Phi3 Mini 128k in GGUF, MLFlow, and ONNX Formats

Explora el modelo Phi3 Mini 128k en formatos MLFlow, GGUF y ONNX. Compara rendimiento y precisión en diferentes configuraciones. Aprende a implementar y optimizar modelos de lenguaje para diversas plataformas.

• YouTube
• 51 minutes
• Self-Paced
• Free Video

The Machine Learning Engineer

MLOps: Saving and Loading Microsoft Phi3 Mini 128k in GGUF Format with MLflow

Aprende a guardar y cargar el modelo Phi3 128k en formato GGUF int8 usando MLflow para inferencia en diferentes entornos.

• YouTube
• 17 minutes
• Self-Paced
• Free Video

Mervin Praison

Fine-Tuning and Deploying LLaMA 3.1 on Hugging Face and Ollama

Step-by-step guide to fine-tune LLaMA 3.1 with custom data, save on Hugging Face and Ollama, and deploy for enhanced AI performance tailored to specific business needs.

• YouTube
• 15 minutes
• Self-Paced
• Free Video

Discover AI

LLM Quantization Tutorial: QLoRA, GPTQ, and LLama.cpp Implementation for LLama 2

Master LLM quantization techniques and implement efficient model compression using QLoRA, GPTQ, and Llamacpp, with practical guidance for running optimized LLMs locally across different platforms.

• YouTube
• 27 minutes
• Self-Paced
• Free Video