llama.cpp Courses and Certifications

AI Bites

GGUF Quantization of Large Language Models Using LLAMA.cpp

Master GGUF quantization techniques to run large language models efficiently on personal devices using LLAMA.cpp, enabling GPU-free inference and deployment on laptops, phones, and watches.

• YouTube
• 12 minutes
• On-Demand
• Free Video

Donato Capitella

Building a Two-Node AMD Strix Halo Cluster for LLMs with llama.cpp RPC - MiniMax-M2 and GLM 4.6

Master building a two-node AMD Strix Halo cluster for large language model inference using llama.cpp RPC, featuring 256GB unified memory and performance benchmarks.

• YouTube
• 27 minutes
• On-Demand
• Free Video

Donato Capitella

Dual AMD Radeon 9700 AI PRO - Building a 64GB LLM/AI Server with Llama.cpp

Explore building a 64GB VRAM AI workstation with dual AMD Radeon 9700 AI PRO GPUs, covering hardware setup, Linux configuration with ROCm/Vulkan, and LLM performance testing.

• YouTube
• 51 minutes
• On-Demand
• Free Video

The Machine Learning Engineer

MLOPS LLMs - Converting Microsoft Phi3 to GGUF Format with LLaMA.cpp

Aprende a cuantizar el modelo Phi3 mini a diferentes tipos de datos utilizando LLama.cpp para optimizar el rendimiento y la eficiencia.

• YouTube
• 31 minutes
• On-Demand
• Free Video

Donato Capitella

Running Large Language Models on AMD Strix Halo AI Ryzen MAX+ 395 - GLM 4.5-Air-106B and Qwen3-235B Tutorial

Discover how to run massive language models like Qwen3-235B and GLM 4.5-Air-106B on AMD Strix Halo systems using up to 128GB unified memory with proper kernel configuration and tuning.

• YouTube
• 27 minutes
• On-Demand
• Free Video

Chris Hay

Llama.cpp's New Svelte-Based Web UI - Performance and Benchmarking

Discover Llama.cpp's lightning-fast Svelte webui, benchmark it against Ollama, and learn to run llama.cpp with your existing Ollama downloads for optimal LLM performance.

• YouTube
• 17 minutes
• On-Demand
• Free Video

Trelis Research

LLM Tool Use - GPT4o-mini, Groq, and Llama.cpp

Explore advanced LLM tool use techniques with GPT4o-mini, Groq, and Llama.cpp. Learn function calling, zero-shot prompting, and local inference for efficient AI development.

• YouTube
• 1 hour 20 minutes
• On-Demand
• Free Video

The Machine Learning Engineer

Code Understanding with Langchain, CodeLLama, Llama.cpp and OpenAI

Explore Langchain for Python code understanding, integrating CodeLLama, Llama.cpp, and OpenAI for enhanced machine learning capabilities.

• YouTube
• 26 minutes
• On-Demand
• Free Video

The Machine Learning Engineer

Installing LLaMA.cpp - Text Generation and Embeddings with Langchain

Learn to implement LLaMA.cpp in WSL, integrate with Langchain for text generation, and create embeddings using LLaMA 3.2 3B Instruct, Nomic 1.5, and DeepSeek 1.5 models.

• YouTube
• 44 minutes
• On-Demand
• Free Video

Pragmatic AI Labs Microcredential

Generative AI Fundamentals

Master Generative AI fundamentals through hands-on experience with cloud services, language models, and architectural patterns. Gain practical skills with Azure, AWS, and local deployment options for improved productivity and innovation.

• edX
• On-Demand
• $1,493.00
• 6 courses

Discover AI

LLM Quantization Tutorial: QLoRA, GPTQ, and LLama.cpp Implementation for LLama 2

Master LLM quantization techniques and implement efficient model compression using QLoRA, GPTQ, and Llamacpp, with practical guidance for running optimized LLMs locally across different platforms.

• YouTube
• 27 minutes
• On-Demand
• Free Video

How to Benchmark Embedding Models On Your Own Data

Master embedding model evaluation using your own data through PDF text extraction, chunking strategies, question generation with LLMs, and statistical benchmarking techniques.

• freeCodeCamp
• 3 hours 48 minutes
• On-Demand
• Free Video

James Briggs

AI in Practice - Building Real-World AI Systems with Modern Frameworks

Explore practical frameworks and methods for building real-world AI systems, from chatbot guardrails to RAG optimization and agent development.

• YouTube
• 6 hours 22 minutes
• On-Demand
• Free Video

The Machine Learning Engineer

MLOPS LLMs: Converting Microsoft Phi3 to GGUF Format with LLaMA.cpp

Aprende a cuantizar el modelo Microsoft Phi3 a formatos bf16, fp16 o q8_0 utilizando LLaMA.cpp para optimizar el rendimiento de LLMs.

• YouTube
• 23 minutes
• On-Demand
• Free Video

The Machine Learning Engineer

LLMOps: Installing LLaMA.cpp - Text Generation and Embeddings with Langchain

Aprende a implementar LLaMA.cpp en WSL, domina la integración con Langchain para generación de texto y creación de embeddings usando modelos como LLama 3.2 3B y Nomic 1.5.

• YouTube
• 49 minutes
• On-Demand
• Free Video