Orchestrating at Scale - How Instacart Manages 20M+ Daily Workflows

This conference talk by Anant Agarwal, Staff Software Engineer at Instacart, delves into the challenges and solutions of orchestrating data workflows at massive scale. Discover how Instacart manages over 20 million daily workflows and the technical architecture behind coordinating complex data operations that power one of the world's largest on-demand platforms. Gain valuable insights into building and scaling workflow orchestration systems, managing distributed systems, and implementing effective data pipelines. Perfect for engineers working on large-scale data infrastructure or those interested in how major platforms handle massive data orchestration challenges.