Inference Courses and Certifications

Serverless for ML Inference on Kubernetes - Panacea or Folly

Explore serverless ML inference on Kubernetes: performance, costs, and architecture. Gain insights from benchmarking experiments to optimize your ML inference system.

• YouTube
• 27 minutes
• On-Demand
• Conference Talk

Enabling Elastic Inference on Edge With Knative and EDL

Explore Baidu's approach to edge-based model inference using Knative and EDL, reducing network load and latency while improving recommendation accuracy in 5G environments.

• YouTube
• 27 minutes
• On-Demand
• Conference Talk

Building an ML Inference Platform with Knative - Serverless Containers on Kubernetes

Leveraging Knative for scalable ML inference platforms: simplifying deployment, enabling serverless containers, and optimizing performance for production-ready machine learning applications.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Bringing the Power of ONNX to Apache Spark - Integrating Deep Learning Inference

Explore integrating ONNX with Spark for efficient deep learning inference pipelines. Learn about Ascend Hardware Platform's ONNX contributions and Spark community's simplified API for DL inferencing.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Embedded Deep Learning Super Resolution on GStreamer Using ONNX Inference Runtime

Explore embedded deep learning super-resolution techniques using ONNX Inference Runtime and GStreamer, covering problem-solving, implementation, and performance analysis.

• YouTube
• 27 minutes
• On-Demand
• Free Video

International Centre for Theoretical Sciences

Tumor Phylogeny Inference from Single-cell Datasets - Lecture 2

Explore tumor evolution through single-cell data analysis. Learn advanced techniques for inferring phylogenetic relationships and understanding cancer progression at the cellular level.

• YouTube
• 1 hour 11 minutes
• On-Demand
• Free Video

Association for Computing Machinery (ACM)

Talaria - Interactively Optimizing Machine Learning Models for Efficient Inference

Visualize and optimize on-device machine learning models with Talaria, balancing size, latency, and power for efficient inference. Explore interactive tools for compiling, visualizing, and simulating model optimizations.

• YouTube
• 15 minutes
• On-Demand
• Free Video

USENIX

Understanding Security Implications of Exposed Cloud Services through Automated Capability Inference

Explores security risks of over-privileged cloud credentials in mobile apps, revealing potential data attacks and new threat vectors through analysis of 1.3 million apps across major cloud platforms.

• YouTube
• 14 minutes
• On-Demand
• Conference Talk

Simons Institute

Decision Diagrams for Efficient Inference and Optimization in Expressive Discrete-Continuous Domains

Explore extended algebraic decision diagrams (XADDs) for representing piecewise functions, enabling efficient computations and novel solutions in probabilistic inference, optimization, and decision-making.

• YouTube
• 45 minutes
• On-Demand
• Free Video

Software Engineering Courses - SE Courses

Doubling Stable Diffusion Inference Speed with RTX Acceleration and TensorRT - A Comprehensive Guide

Comprehensive guide on boosting Stable Diffusion performance with RTX Acceleration TensorRT, covering installation, optimization, and troubleshooting for various models and extensions.

• YouTube
• 42 minutes
• On-Demand
• Free Video

Alan Turing Institute

HypoSVI- Earthquake Hypocentre Inversion With Stein Variational Inference and Physics Informed Neural Networks

Explore physics-informed deep learning for environmental sciences, covering PINNs for Eikonal equations, probabilistic inversion for earthquake location, and neural operators for in-ice navigation.

• YouTube
• 50 minutes
• On-Demand
• Free Video

Cloud Native Sustainable LLM Inference in Action

Explore sustainable LLM inference using cloud-native tech. Learn about energy monitoring, AI accelerator optimization, and balancing efficiency with environmental impact. Includes live demo of vLLM in a Kubernetes cluster.

• YouTube
• 1 hour 24 minutes
• On-Demand
• Free Video

Effortless Scalability - Orchestrating Large Language Model Inference with Kubernetes

Explore automating deployment of large AI models on Kubernetes, leveraging CRDs for seamless management and optimizing GPU utilization through preset configurations and auto-provisioning.

• YouTube
• 23 minutes
• On-Demand
• Free Video

A Scalable Platform for Training and Inference Using Kubeflow at CERN

Explore CERN's Kubeflow-based machine learning platform for data preparation, analysis, training, and inference in physics research, with insights from the ATLAS experiment.

• YouTube
• 29 minutes
• On-Demand
• Free Video

Gopher Academy

Everything You Always Wanted to Know About Type Inference in Go

Explore Go's type inference feature: its magic, potential, and impact on code cleanliness. Gain insights into this powerful aspect of Go's generic functions.

• YouTube
• 39 minutes
• On-Demand
• Free Video