Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Learn how Ant Group implements large-scale data shuffling operations using Apache Celeborn in this 35-minute conference talk from The ASF's Data Storage & Computing Track. Discover the technical challenges and solutions involved in managing massive data shuffle operations at enterprise scale, as software engineer and tech leader Erik Fang shares insights from Ant Group's real-world implementation. Explore the architecture, performance optimizations, and operational considerations when deploying Apache Celeborn for handling large-scale distributed data processing workloads in production environments.
Syllabus
Large-scale Shuffle with Apache Celeborn at Ant Group
Taught by
The ASF