Adventures in Rate Limiting: Spotify's Journey Writing a Scalable Envoy Rate Limiter in Golang

This conference talk explores Spotify's journey in developing a scalable rate limiting solution for Envoy proxy. Learn how Spotify tackled significant cost and operational challenges with Envoy's global rate-limiting, which was adding latency to the request path and generating costs equivalent to running the Envoy proxies themselves. The speakers detail their innovative approach of creating a distributed Envoy rate limiter implemented as a Golang filter with a backing Java service. Discover the reasoning behind Spotify's decision to develop this new rate limiting approach, how their solution scales to meet the demands of their large infrastructure, and gain insights into the practical experience of writing complex filters in Golang. This technical presentation is ideal for engineers facing similar scaling challenges in their cloud native environments.