Spark on Kubernetes: Building an Elastic Service - Apple's Approach
CNCF [Cloud Native Computing Foundation] via YouTube
Master Production-Ready Machine Learning, Step by Step
Power BI Fundamentals - Create visualizations and dashboards from scratch
Overview
Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
This talk examines the architecture of a large-scale Spark service on Kubernetes and its production autoscaling approach. It discusses multi-tenant capacity controls, physical isolation, and bin-packing to improve CPU and memory utilization.
Syllabus
Introduction
Bowen Li Apple
Outline
Why Cloud
Design Principles
Elastic Spark Architecture
Open Source
Node Groups Layout
Cluster Autoscaling
Production Status
Key takeaways
Whats next
Taught by
CNCF [Cloud Native Computing Foundation]