On-Prem Load Balancing Reimagined - Serving 20 Million QPS With Gateway API and EnvoyGateway
CNCF [Cloud Native Computing Foundation] via YouTube
Overview
Coursera Spring Sale
40% Off Coursera Plus Annual!
Grab it
Learn how The Trade Desk evolved their HAProxy Community Edition load-balancing architecture running on bare metal into a cloud-native, Kubernetes-based Envoy Gateway platform powered by Gateway API in this 29-minute conference talk. Discover the migration process for core services handling 20 million queries per second, including service discovery refactoring and EnvoyGateway extensions with advanced controls such as Circuit Breakers and Zone Aware Routing. Explore key architectural decisions, automation strategies, upstream Envoy contributions, and lessons learned from breaking things along the way to execute a smooth, large-scale migration from traditional load balancing to modern cloud-native infrastructure. Gain insights into achieving richer control, smarter traffic distribution, and higher resilience across topology zones in on-premises environments.
Syllabus
On-Prem Load Balancing Reimagined: Serving 20 Million QPS With Gateway API and Envoy... Isaac Wilson
Taught by
CNCF [Cloud Native Computing Foundation]