CNCF [Cloud Native Computing Foundation] Courses

Making Long-context LLM Inference 10x Faster and 10x Cheaper Through Knowledge Sharing

Discover how to optimize LLM inference through knowledge-sharing systems, reducing costs and processing time by implementing efficient KV cache management in Kubernetes environments.

• YouTube
• 36 minutes
• Self-Paced
• Free Video

Unlocking the Potential of Large Language Models in Production - Best Practices and Solutions

Discover practical solutions for deploying and scaling LLMs in production using cloud-native technologies, with insights on benchmarking, optimization, monitoring, and efficient resource management.

• YouTube
• 36 minutes
• Self-Paced
• Free Video

Unlocking the Future of GPU Scheduling in Kubernetes with Reinforcement Learning

Explore innovative GPU scheduling solutions in Kubernetes using reinforcement learning, focusing on optimizing resource utilization and addressing fragmentation challenges in multi-GPU setups.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Efficient LLM Deployment - A Unified Approach with Ray, VLLM, and Kubernetes

Explore a comprehensive AI stack for deploying large language models efficiently, integrating Kubernetes, Ray framework, and vLLM for optimized performance and scalability across cloud environments.

• YouTube
• 27 minutes
• Self-Paced
• Free Video

Best of Both Worlds: Integrating Slurm with Kubernetes in a Kubernetes Native Way

Discover how K-Foundry bridges Slurm and Kubernetes, enabling seamless integration of HPC workloads through unified API management and optimized resource orchestration for AI/ML applications.

• YouTube
• 34 minutes
• Self-Paced
• Free Video

Cloud-Native AI: Wasm in Portable, Secure AI/ML Workloads

Discover how WebAssembly enables portable and secure AI/ML workloads in cloud environments, focusing on deploying models like Llama3 and Mixtral using Rust for optimal performance across platforms.

• YouTube
• 29 minutes
• Self-Paced
• Free Video

Stop Kubernetes' Revolving Door: A Hands-on Tutorial to Secure a Kubernetes Cluster

Master essential Kubernetes security practices through hands-on exercises covering authentication, authorization, network policies, and pod security to effectively protect and fortify your clusters.

• YouTube
• 1 hour 19 minutes
• Self-Paced
• Free Video

Micro-Segmentation and Multi-Tenancy - The Brown M&Ms of Platform Engineering

Explore essential concepts of multi-tenancy and micro-segmentation in cloud-native systems, focusing on implementing secure workload isolation and automated policy management for platform engineering success.

• YouTube
• 36 minutes
• Self-Paced
• Free Video

Using OpenTelemetry for Deep Observability Within Messaging Queues

Discover how OpenTelemetry's semantic conventions enable comprehensive monitoring of messaging queues, correlating producer-to-consumer spans and metrics for enhanced system observability and performance optimization.

• YouTube
• 25 minutes
• Self-Paced
• Free Video

Effective Data Platforming with Open Source Tools for Faster Insights

Discover how to build robust data streaming platforms using open-source tools like Strimzi, Kafka, and Confluent, while applying core software engineering principles for optimal architecture and performance.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

How We Scale a Distributed SQL Database to 1 PB

Discover how TiDB overcomes scalability challenges in distributed SQL databases, exploring solutions for workload management, data partitioning, and cluster performance optimization to achieve petabyte-scale operations.

• YouTube
• 34 minutes
• Self-Paced
• Free Video

One Gateway API to Rule Them All - Unifying Kubernetes Network Traffic Configuration

Explore unified network traffic management in Kubernetes using Gateway API, covering ingress, egress, and mesh configurations with practical demonstrations using Linkerd for real-world implementations.

• YouTube
• 40 minutes
• Self-Paced
• Free Video

Love Thy Noisy Neighbor - Strategies for Mitigating Performance Interference in Cloud-Native Systems

Explore strategies for managing performance interference in cloud-native systems, focusing on resource isolation techniques used by major tech companies to optimize Kubernetes deployments.

• YouTube
• 36 minutes
• Self-Paced
• Free Video

Harnessing the Power of Envoy Proxy for Building an LLM Gateway

Discover how to build a secure and efficient LLM gateway using Envoy Proxy's extensible architecture for credential management, prompt guarding, content safety, and usage controls in high-performance environments.

• YouTube
• 38 minutes
• Self-Paced
• Free Video

Kubernetes at Scale: Practical Solutions for Enhanced CNI and Kubelet Performance

Dive into practical strategies for optimizing Kubernetes CNI and Kubelet performance, covering IP allocation, registry pulls, disk throttling, and scaling solutions for enhanced cluster stability.

• YouTube
• 21 minutes
• Self-Paced
• Free Video