Scaling Telemetry Systems with Streaming

This technical talk examines how a platform engineering team evolved a Kafka cluster and its producers and consumers as incoming telemetry volume increased more than tenfold. It discusses broker sizing, storage durability, network optimization, partitioning, consumer updates, configuration changes, and chaos testing.