![CNCF [Cloud Native Computing Foundation]](https://www.classcentral.com/cdn-cgi/image/height=60,format=auto,quality=85/images/logos/institutions/cncf-cloud-native-computing-foundation-hz.png){kind=small}
AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Explore the challenges and solutions of running Apache Spark on Kubernetes at scale in this insightful conference talk. Discover how to leverage open-source technologies like Apache YuniKorn, Spark K8s operator, and Cloud primitives to evolve ML data infrastructure in the cloud. Learn about considerations for multi-tenancy, observability, scalability, and cost-effectiveness when implementing Spark on Kubernetes for large-scale production environments. Gain valuable insights on overcoming roadblocks such as dev-ops complexity, multi-cluster management, job scheduling, and autoscaling to maximize data processing capabilities on the cloud.
![CNCF [Cloud Native Computing Foundation]](https://www.classcentral.com/cdn-cgi/image/height=40,format=auto,quality=85/images/logos/institutions/cncf-cloud-native-computing-foundation-hz.png){kind=small}
