llama.cpp Courses and Certifications

Donato Capitella

Dual AMD Radeon 9700 AI PRO - Building a 64GB LLM/AI Server with Llama.cpp

Explore building a 64GB VRAM AI workstation with dual AMD Radeon 9700 AI PRO GPUs, covering hardware setup, Linux configuration with ROCm/Vulkan, and LLM performance testing.

• YouTube
• 51 minutes
• Self-Paced
• Free Video

AI Bites

GGUF Quantization of Large Language Models Using LLAMA.cpp

Master GGUF quantization techniques to run large language models efficiently on personal devices using LLAMA.cpp, enabling GPU-free inference and deployment on laptops, phones, and watches.

• YouTube
• 12 minutes
• Self-Paced
• Free Video

Donato Capitella

Building a Two-Node AMD Strix Halo Cluster for LLMs with llama.cpp RPC - MiniMax-M2 and GLM 4.6

Master building a two-node AMD Strix Halo cluster for large language model inference using llama.cpp RPC, featuring 256GB unified memory and performance benchmarks.

• YouTube
• 27 minutes
• Self-Paced
• Free Video

Beginning Llamafile for Local Large Language Models (LLMs)

Run large language models locally with llamafile and llama.cpp, exposing REST endpoints for text generation, tokenization, and embeddings, and calling them with curl and Python.

• Coursera
• 3 hours 56 minutes
• Self-Paced
• Paid Course

Pragmatic AI Labs

Beginning Llamafile

Learn to serve powerful language models as practical, scalable web APIs using the llama.cpp server. Keep your data private and avoid cloud latency and fees.

• edX
• 2 weeks, 1-3 hours a week
• Self-Paced
• Free Online Course (Audit)

Working with Llama 3

2380 ratings at DataCamp

Learn to use the Llama Large-Language Model (LLM) What is the Llama LLM, and how can you use it to enhance your projects?

• DataCamp
• 2 hours
• Self-Paced
• Free Trial Available

Donato Capitella

Running Large Language Models on AMD Strix Halo AI Ryzen MAX+ 395 - GLM 4.5-Air-106B and Qwen3-235B Tutorial

Discover how to run massive language models like Qwen3-235B and GLM 4.5-Air-106B on AMD Strix Halo systems using up to 128GB unified memory with proper kernel configuration and tuning.

• YouTube
• 27 minutes
• Self-Paced
• Free Video

Chris Hay

Llama.cpp's New Svelte-Based Web UI - Performance and Benchmarking

Discover Llama.cpp's lightning-fast Svelte webui, benchmark it against Ollama, and learn to run llama.cpp with your existing Ollama downloads for optimal LLM performance.

• YouTube
• 17 minutes
• Self-Paced
• Free Video

Trelis Research

LLM Tool Use - GPT4o-mini, Groq, and Llama.cpp

Explore advanced LLM tool use techniques with GPT4o-mini, Groq, and Llama.cpp. Learn function calling, zero-shot prompting, and local inference for efficient AI development.

• YouTube
• 1 hour 20 minutes
• Self-Paced
• Free Video

Llama for Python Programmers

19 ratings at Coursera

Build Python applications on Llama 2: run open-source models on self-hosted hardware with llama.cpp, and shape output with tokenization, few-shot prompting, and grammars.

• Coursera
• 3 weeks, 2 hours a week
• Self-Paced
• Paid Course

Board Infinity

Deploying Deep Learning: Quantization, Serving, and Edge AI

Compress and deploy LLMs: apply INT4/INT8 quantization with AWQ and GPTQ, serve models through vLLM, Triton and ONNX Runtime, and containerize inference APIs for edge devices.

• Coursera
• 4 weeks, 5 hours a week
• Self-Paced
• Paid Course

Pragmatic AI Labs

Deterministic LLM programming

Build production LLM systems on AWS Bedrock: configure knowledge bases with S3 for RAG, compile llama.cpp for local GGUF inference, and evaluate LLM quality.

• Coursera
• 4 weeks, 1 hour a week
• Self-Paced
• Paid Course

Pragmatic AI Labs

AWS Generative AI and Foundation Models

Build generative AI solutions on AWS with Amazon Bedrock, RAG pipelines, and Amazon Q Developer, then compile llama.cpp and deploy GGUF-packaged open-source LLMs on EC2 GPUs.

• Coursera
• 2 weeks, 3 hours a week
• Self-Paced
• Paid Course

Pragmatic AI Labs Career Certificate

Generative AI Fundamentals

Learn to leverage generative AI, LLMs, Small Language Models, prompt engineering, and MLOps best practices to optimize software development workflows and boost productivity using cloud services and lo

• edX
• 19 weeks, 1-6 hours a week
• Self-Paced
• $1,493.00
• 6 courses

James Briggs

AI in Practice - Building Real-World AI Systems with Modern Frameworks

Explore practical frameworks and methods for building real-world AI systems, from chatbot guardrails to RAG optimization and agent development.

• YouTube
• 6 hours 22 minutes
• Self-Paced
• Free Video