Mastering Large-Scale Shuffle - The Dream11 Playbook with Remote Shuffle Service

Learn how Dream11 engineers tackle large-scale data shuffle challenges through their innovative Remote Shuffle Service implementation in this 18-minute conference talk from The ASF's Data Storage & Computing Track, where Technical Leads Amit Shinde and Mehul Batra share their production-tested playbook for optimizing shuffle operations, reducing network overhead, and improving performance in distributed computing environments at scale.