Reliable K8s Resource Submission and Bookkeeping

This conference talk explores the challenges and solutions for reliable Kubernetes resource submission and status tracking at Bloomberg's cloud-native container orchestration platform. Learn how the team handles large volumes of resource creation requests across multiple clusters, examining their current implementation using in-cluster pull agents and source-of-truth systems. The speakers compare this approach with their proposed solution that leverages a highly available PostgreSQL database, Kubernetes resource watcher, and Apache Kafka. Discover a design architecture that enhances reliability for resource submission and post-deployment status tracking in enterprise-scale Kubernetes environments. The presentation provides valuable insights for platform engineers managing growing Kubernetes deployments with increasing reliability requirements.