Inference Courses and Certifications

Cloud Native Inference at Scale - Unlocking LLM Deployments with KServe

Discover how KServe enables scalable LLM inference on Kubernetes, tackling unique challenges like token-by-token generation, bursty traffic, and GPU optimization for cost-efficient deployments.

• YouTube
• 19 minutes
• Self-Paced
• Free Video

DPDK Project

Machine Learning Inference Support in DPDK for Network Applications

Discover how to implement machine learning inference in DPDK for network applications, focusing on low-latency predictions, hardware acceleration, and datapath integration for optimal performance.

• YouTube
• 22 minutes
• Self-Paced
• Free Video

Open Compute Project

Leveraging ODSA's BoW Die-to-Die Link Technology for Generative AI Inference Transformation

Discover how d-Matrix's Corsair accelerator revolutionizes Generative AI inference through innovative chiplet architecture, digital-in-memory computing, and ODSA BoW die-to-die interconnect technology.

• YouTube
• 21 minutes
• Self-Paced
• Free Video

Institute for Pure & Applied Mathematics (IPAM)

Equilibrium is Inference - Lessons from Liquid-Liquid Phase Separation Models

Delve into the relationship between equilibrium systems and information processing, exploring neural computation models and their applications in molecular systems and phase separation dynamics.

• YouTube
• 53 minutes
• Self-Paced
• Free Video

AWS Events

Generative AI Inference with AWS Graviton Processors

Discover how AWS Graviton processors optimize generative AI workloads, featuring practical demonstrations of inference tasks and price-performance benefits for cloud computing deployments.

• YouTube
• 20 minutes
• Self-Paced
• Free Video

Topos Institute

Charles Peirce, Inference, and Category Theory

Explore how category theorists utilize Peirce's logical calculus, examining connections between his inference types (deduction, induction, abduction) and category-theoretic concepts of composition, extension, and lift.

• YouTube
• 1 hour 5 minutes
• Self-Paced
• Free Video

Graham Neubig

CMU LLM Inference - Beam Search and Variants

Explore beam search algorithms and their variants for LLM inference, examining the inadequacies of mode-based approaches in natural language processing applications.

• YouTube
• 1 hour 12 minutes
• Self-Paced
• Free Video

Graham Neubig

Common Sampling Methods for Modern NLP - CMU LLM Inference 3

Explore common sampling methods for modern NLP and understand diversity-quality tradeoffs in language model inference through practical examples and analysis.

• YouTube
• 1 hour 2 minutes
• Self-Paced
• Free Video

Devoxx

Large Scale Distributed LLM Inference with LLM-D and Kubernetes

Explore large-scale LLM deployment using LLM-D, a Kubernetes-based framework for distributed inference with optimized routing and cost-efficient GPU utilization.

• YouTube
• 1 hour 44 minutes
• Self-Paced
• Free Video

DevOpsDays Tel Aviv

Building a Production-Grade AI/ML Inference Platform on Kubernetes

Discover how to design and operate AI/ML inference workloads on Kubernetes for production environments, covering deployment, scaling, and optimization strategies.

• YouTube
• 34 minutes
• Self-Paced
• Free Video

DevConf

Scaling Generative AI Inference with llm-d

Discover how to deploy and serve large generative AI models at scale using llm-d, an open-source Kubernetes-native inference stack with optimized performance across hardware accelerators.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Fields Institute

Probabilistic Numerics for Inference with Simulations

Explore probabilistic numerics for inference with simulations, covering high-dimensional models, numerical methods, and innovative approaches to machine learning challenges.

• YouTube
• 1 hour 6 minutes
• Self-Paced
• Free Video

Alan Turing Institute

From Denoising Diffusion Models to Transport for Generative Modeling and Inference

Explore advanced generative modeling techniques, from denoising diffusion models to transport-based approaches, focusing on diffusion Schrödinger bridge and its numerical approximation for improved inference.

• YouTube
• 44 minutes
• Self-Paced
• Free Video

International Centre for Theoretical Sciences

Neural Simulation-based Inference - Lecture 2

Explore advanced neural simulation-based inference techniques for high energy physics, focusing on applications in data analysis and new physics discovery at particle colliders.

• YouTube
• 1 hour 32 minutes
• Self-Paced
• Free Video

International Centre for Theoretical Sciences

Neural Simulation-based Inference - Lecture 5

Explore neural simulation-based inference techniques for high energy physics data analysis, focusing on advanced machine learning applications in particle physics research.

• YouTube
• 1 hour 40 minutes
• Self-Paced
• Free Video