Learn AI, Data Science & Business — Earn Certificates That Get You Hired
Power BI Fundamentals - Create visualizations and dashboards from scratch
Overview
Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
Learn how Ant Group implements large-scale data shuffling operations using Apache Celeborn in this 35-minute conference talk from The ASF's Data Storage & Computing Track. Discover the technical challenges and solutions involved in managing massive data shuffle operations at enterprise scale, as software engineer and tech leader Erik Fang shares insights from Ant Group's real-world implementation. Explore the architecture, performance optimizations, and operational considerations when deploying Apache Celeborn for handling large-scale distributed data processing workloads in production environments.
Syllabus
Large-scale Shuffle with Apache Celeborn at Ant Group
Taught by
The ASF