LLMOps Courses and Certifications

The Machine Learning Engineer

LLMOps: Comparison of OpenVino, ONNX, TensorRT, and PyTorch Inference

Explore model conversion to ONNX, OpenVino, and Tensor-RT formats for optimized CPU and GPU inference, comparing performance against native PyTorch.

• YouTube
• 40 minutes
• On-Demand
• Free Video

The Machine Learning Engineer

LLMOPs: Multimodal Prompting and Inference with Phi-3 Vision 128K Instruct on CPU - ONNX 4-Bit Quantization in C#

Explore multimodal prompting and CPU inference using Phi 3 Vision 128K Instruct, quantized to 4 bits in ONNX format, with C# implementation for efficient machine learning operations.

• YouTube
• 23 minutes
• On-Demand
• Free Video

The Machine Learning Engineer

LLMOps: Quantization Models and Inference with ONNX Generative Runtime

Explore ONNX runtime GPU support for inference with generative models, including Phi3-mini quantization and conversion techniques.

• YouTube
• 30 minutes
• On-Demand
• Free Video

The Machine Learning Engineer

LLMOps: LLMs Memory and Compute Optimizations

Explore FlashAttention, GQA, FSDP, and DDP techniques to enhance LLM efficiency, training, and fine-tuning in self-attention layers.

• YouTube
• 24 minutes
• On-Demand
• Free Video

MLOps.community

Design and Development Principles for LLMOps - MLOps Podcast #254

Explore design and development principles for LLMOps with Andy McMahon. Learn about software engineering practices, new techniques, and the transition from MLOps to LLMOps in this insightful discussion.

• YouTube
• 1 hour 10 minutes
• On-Demand
• Free Video

MLOps.community

Making Sense of LLMOps - Impact, Risk, and Maturity Assessment

Explore LLMOps essentials: impact assessment, risk management, and maturity evaluation. Gain insights on bridging gaps between data science, infrastructure, and IT teams for effective LLM deployment.

• YouTube
• 26 minutes
• On-Demand
• Free Video

MLOps.community

Charting LLMOps Odyssey - Navigating Large Language Model Operations

Navigate the iterative development of LLM applications, addressing unique challenges in LLMOps design. Learn strategies for overcoming obstacles and adapting to the evolving landscape of large language model operations.

• YouTube
• 39 minutes
• On-Demand
• Free Video

MLOps.community

Navigating the Emerging LLMOps Stack

Explore the emerging LLMOps Stack, including tools and best practices for maximizing LLM potential in organizations. Gain insights from an experienced AI/ML engineering leader.

• YouTube
• 13 minutes
• On-Demand
• Free Video

MLOps.community

LLMOps and GenAI at Enterprise Scale - Challenges and Opportunities

Explore challenges and opportunities in deploying GenAI solutions at enterprise scale. Learn about LLMOps, model selection, emerging stacks, and best practices for robust implementation.

• YouTube
• 13 minutes
• On-Demand
• Free Video

MLOps World: Machine Learning in Production

Deploying GenAI Applications to Enterprises: Custom Evaluation Models and LLMOps Workflow - MLOps World

Explore challenges and solutions in deploying conversational AI to enterprises, focusing on accuracy optimization, LLMOps workflows, and infrastructure requirements for scalable implementation.

• YouTube
• 49 minutes
• On-Demand
• Free Video

Databricks

A Practitioner's Perspective on LLMOps - Challenges and Solutions in Operationalizing LLM Applications

Explore LLMOps: addressing challenges in LLM application development, focusing on cost optimization, risk mitigation, and stakeholder collaboration. Gain practical insights from real-world case studies.

• YouTube
• 37 minutes
• On-Demand
• Free Video

The Machine Learning Engineer

LLMOps - MCP Servers: Practical Example of Research and Mailing Tool

Discover how to implement Model Context Protocol (MCP) servers for LLMOps, building client-server applications with research tools, document creation, and email integration.

• YouTube
• 55 minutes
• On-Demand
• Free Video

The Machine Learning Engineer

LLMOps - MCP Client: Connecting Python and JavaScript to MCP Servers

Discover how to build MCP Clients that transform Claude AI into a professional financial assistant capable of real-time stock analysis, web searches, and automated report generation.

• YouTube
• 1 hour 3 minutes
• On-Demand
• Free Video

The Machine Learning Engineer

LLMOps - MCP Host: Use Your Own MCP Server with Claude Desktop App

Explore Claude Desktop's native application features and learn to integrate custom MCP servers for enhanced AI workflow automation and productivity.

• YouTube
• 1 hour 2 minutes
• On-Demand
• Free Video

fwd:cloudsec

Securing Organizations' ML and LLMOps Deployments - A Platform Architect's Journey Onboarding LLM and MLOps Tools

Explore security-focused architectures for ML/LLM deployments across multi-cloud environments, covering AWS/Azure controls, data access patterns, and compliance in regulated industries.

• YouTube
• 36 minutes
• On-Demand
• Free Video