Running LLMs Locally Courses and Certifications

Foundations of Local Large Language models

20 ratings at Coursera

Run large language models on your own machine: set up local environments, query them through web UIs and APIs, add RAG, fine-tune Mistral-7b, and deploy.

• Coursera
• 3 weeks, 8 hours a week
• Self-Paced
• Paid Course

Local LLMs with llamafile

Package open-source AI models into portable llamafile executables, deploy them on Windows, macOS and Linux, monitor GPU usage, and query llamafile APIs with Python.

• Coursera
• 3 hours 1 minute
• Self-Paced
• Paid Course

Local LLMs via Ollama & LM Studio - The Practical Guide

1798 ratings at Udemy

Run open large language models like Gemma, Llama or DeepSeek locally to perform AI inference on consumer hardware.

• Udemy
• 3 hours 55 minutes
• Self-Paced
• Paid Course

Coursera

Understanding Open AI Workspaces

Set up local and cloud workspaces for open source LLMs: run models with Ollama, build multi-container Docker setups, and configure Jupyter and Colab GPU access.

• Coursera
• 3 weeks, 2 hours a week
• Self-Paced
• Paid Course

Pragmatic AI Labs

Applied Local Large Language Models

Unlock the power of large language models on your machine. Master setup and interaction with cutting-edge LLMs through intuitive web interfaces and APIs. Explore diverse tools, programming languages,

• edX
• 4 weeks, 3-6 hours a week
• Self-Paced
• Free Online Course (Audit)

Pragmatic AI Labs

LLM Server

In this course you will learn how to set up a GPU Server on your own infrastructure, download open source models, and build applications with those models programmatically and with Agents

• edX
• 4 weeks, 3-6 hours a week
• Self-Paced
• Free Online Course (Audit)

JetBrains

Build a Local AI Assistant with LLMs

13 ratings

Build a local RAG assistant: run an LLM with Ollama, chunk PDFs into embeddings in Qdrant, and expose FastAPI query endpoints with an HTMX interface.

• Coursera
• 6 weeks, 4 hours a week
• Self-Paced
• Paid Course

Llama Fundamentals

This track equips you with the skills to implement Llama 3 for tasks ranging from running inference on pre-trained models to fine-tuning for custom use cases.

• DataCamp
• 4 hours
• Self-Paced
• Free Trial Available

Open Source LLMOps Solutions

31 ratings at Coursera

Run open source LLMs locally and in the cloud: use HuggingFace Transformers and llamafile, fine-tune Mistral or LLaMA, and deploy models with ONNX and vLLM.

• Coursera
• 4 weeks, 9 hours a week
• Self-Paced
• Paid Course

Databricks to Local LLMs

13 ratings at Coursera

Build data pipelines in Databricks with notebooks, clusters and Delta Lake, then run and operationalize local LLMs like Mixtral via Hugging Face Candle and llamafile.

• Coursera
• 4 weeks, 7 hours a week
• Self-Paced
• Paid Course

Beginning Llamafile for Local Large Language Models (LLMs)

Run large language models locally with llamafile and llama.cpp, exposing REST endpoints for text generation, tokenization, and embeddings, and calling them with curl and Python.

• Coursera
• 3 hours 56 minutes
• Self-Paced
• Paid Course

Open-source LLMs: Uncensored & secure AI locally with RAG

1917 ratings at Udemy

Private ChatGPT Alternatives: Llama3, Mistral a. more with Function Calling, RAG, Vector Databases, LangChain, AI-Agents

• Udemy
• 10 hours 3 minutes
• Self-Paced
• Paid Course

LLM Mastery: ChatGPT, Gemini, Claude, Llama, OpenAI & APIs

1307 ratings at Udemy

Basics to AI-Agents: OpenAI API, Gemini API, Open-source LLMs, GPT-5, RAG, LangChain Apps, Colab and Prompt Engineering

• Udemy
• 19 hours 56 minutes
• Self-Paced
• Paid Course

Generative AI for Data Science

29 ratings at Coursera

Apply generative AI across data science workflows: run and fine-tune local LLMs with LoRA and quantization, automate SMS campaign feature engineering, and address privacy and bias.

• Coursera
• 5 weeks, 1 hour a week
• Self-Paced
• Paid Course

Health Informatics Capstone & Innovation Project

Build a healthcare AI project: deploy lightweight local LLMs with LMStudio, score their safety against RxNorm drug fact sheets, and craft an innovation plan using NABC and SWOT.

• Coursera
• 2 weeks, 5 hours a week
• Self-Paced
• Paid Course