Learn AI, Data Science & Business — Earn Certificates That Get You Hired
2,000+ Free Courses with Certificates: Coding, AI, SQL, and More
Overview
AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Explore the challenges and solutions of scaling Apache Spark on Kubernetes to Apple's massive scale in this informative conference talk. Discover which customer workloads easily ported to Apache Spark on Kubernetes and which ones faced difficulties. Learn valuable considerations and best practices for both operators and end users of Apache Spark-Kubernetes platforms. Gain insights into migrating from YARN with HDFS to Kubernetes, and understand how to effectively deploy new enhancements like shuffle tracking and graceful decommissioning. Determine when to use these features and when to avoid them. Whether you're an operator or end user, this talk will equip you with essential knowledge to optimize your Apache Spark on Kubernetes journey.
Syllabus
Scaling Apache Spark on Kube to Apple Scale - Amanda Moran & Holden Karau, Apple
Taught by
CNCF [Cloud Native Computing Foundation]