LLM Evaluation Courses and Certifications

Career Certificate

Optimizing Prompts with DSPy

Build robust AI systems with DSPy by defining modular tasks, evaluating outputs, and iteratively optimizing prompts and models.

• CodeSignal
• 6 hours
• Self-Paced
• Free Certificate
• 3 courses

DeepLearning.AI;  Amazon Web Services

Generative AI with Large Language Models

3650 ratings at Coursera

Learn how transformer-based LLMs work end to end: pre-training, empirical scaling laws, fine-tuning and evaluation, reinforcement learning, and deploying LLM-powered applications.

• Coursera
• 3 weeks, 5 hours a week
• Self-Paced
• Paid Course

Coursera Career Certificate

Harnessing LLMs: Strategy, Fine-Tuning & Evaluation

100 ratings at Coursera

Evaluate LLM business opportunities, select models with Hugging Face, fine-tune them for specific tasks, apply RAG patterns, evaluate outputs, and deploy production chatbots and apps.

• Coursera
• 4 weeks, 10 hours a week
• Self-Paced
• Paid Course
• 9 courses

Edureka

Generative AI Architecture and Application Development

15 ratings at Coursera

Build LLM-powered applications: pre-train and fine-tune large language models, develop with LangChain, add retrieval-augmented generation over vector stores, and evaluate with perplexity and BLEU.

• Coursera
• 7 weeks, 2 hours a week
• Self-Paced
• Paid Course

Red Teaming LLM Applications

64 ratings at Coursera

Attack chatbot applications with prompt injections to uncover LLM vulnerabilities, applying manual and automated red-teaming techniques and a full red-teaming assessment.

• Coursera
• 1 hour 30 minutes
• Self-Paced
• Free Online Course

Packt

Essential Guide to LLMOps

1 rating

Learn to run large language models in production: build LLMOps pipelines for data processing, model development, inference and serving, monitoring, governance, and compliance.

• Coursera
• 8 weeks, 1 hour a week
• Self-Paced
• Paid Course

Career Certificate

LLM Application Engineering and Development Certification

28 ratings at Coursera

Build LLM applications with LangChain: design chains, memory, and agents, add embeddings and semantic retrieval, fine-tune with PEFT and RLHF, and evaluate with ROUGE and GLUE.

• Coursera
• 4 weeks, 10 hours a week
• Self-Paced
• Paid Course
• 4 courses

Pretraining LLMs

22 ratings at Coursera

Pretrain an LLM from scratch or continue pretraining an existing model: build datasets from web text, package data for Hugging Face, configure training runs, and evaluate with benchmarks.

• Coursera
• 1 hour 3 minutes
• Self-Paced
• Free Online Course

Whizlabs

NVIDIA: Large Language Models and Generative AI Deployment

11 ratings at Coursera

Learn to train, optimize, and deploy large language models: data cleaning, few-shot and instruction tuning, RLHF, PEFT and prompt tuning, perplexity metrics, and ONNX monitoring.

• Coursera
• 3 weeks, 1 hour a week
• Self-Paced
• Paid Course

Improving Accuracy of LLM Applications

10 ratings at Coursera

Build a text-to-SQL agent, measure it with an evaluation framework, and cut hallucinations through instruction tuning, memory tuning, LoRA, and MoME on Llama models.

• Coursera
• 1 hour 2 minutes
• Self-Paced
• Free Online Course

[NEW] The Ultimate Claude Certified Associate Cert. Training

1026 ratings at Udemy

[Latest Syllabus] Pass The CCAO-F Exam On Your First Attempt | 2 Full Practice Exams And Section Quizzes

• Udemy
• 6 hours
• Self-Paced
• Paid Course

Generative AI in Practice Part 2

Build production-ready generative AI systems with CrewAI multi-agent workflows, Gradio and Streamlit interfaces, vision evaluation, agent SDKs, and safety guardrails.

• Coursera
• 7 weeks, 1 hour a week
• Self-Paced
• Paid Course

Coursera

Selecting the Right LLM with Hugging Face

Navigate the Hugging Face Hub to compare LLMs by size, compute requirements, specialization, and licensing, then test, score, and select the best model for a task.

• Coursera
• 3 hours 17 minutes
• Self-Paced
• Paid Course

Edureka

Prompt Engineering for LLMs

Design, evaluate, and scale LLM prompts: apply few-shot and chain-of-thought patterns, manage context and conversational memory, and build reusable, multimodal prompt systems.

• Coursera
• 4 weeks, 2 hours a week
• Self-Paced
• Paid Course

Coursera Career Certificate

LLM Engineering That Works: Prompting, Tuning, and Retrieval

Build production-grade LLM applications: prompt design, model tuning, retrieval, architecture design, evaluation, deployment, and monitoring of reliable, ethical, cost-efficient AI systems.

• Coursera
• 8 weeks, 10 hours a week
• Self-Paced
• Paid Course
• 6 courses