Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

CNCF [Cloud Native Computing Foundation]

Spark on Kubernetes - Best Practice and Performance

CNCF [Cloud Native Computing Foundation] via YouTube

Start learning Write review
CodeSignal Ad

Learn the Skills Netflix, Meta, and Capital One Actually Hire For

Learn More → Coursera Ad

AI, Data Science & Cloud Certificates from Google, IBM & Meta

Learn More →

Overview

Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
This talk explains how to offer Apache Spark as a service on Kubernetes and tune Spark and Kubernetes configurations for resource use and performance. It uses TPC-DS workloads to show the effects of configuration changes and discusses multi-tenancy and high availability.

Syllabus

Introduction
What is Spark
Why do we need Kubernetes
Architecture
Spark Application
Spark on accumulated status
Applications
Storage
Service
Structure
HDFS
Catalog
Highs
Environments
Benchmark Configuration
Benchmark Results
Data Locality
Our Experience
Summary

Taught by

CNCF [Cloud Native Computing Foundation]

Reviews

Start your review of Spark on Kubernetes - Best Practice and Performance

Start learning

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.