Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Spark Connect - Flexible, Local Access to Apache Spark at Scale

Databricks via YouTube

Start learning Write review
Coursera Ad

Save 43% on 1 Year of Coursera Plus

Learn More → Scrimba Ad

Free courses from frontend to fullstack and AI

Learn More →

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore Spark Connect, a built-in Apache Spark functionality that enables running Spark jobs without managing clusters, versions, or upgrades in this 32-minute conference talk. Discover how Spark Connect abstracts away Spark clusters by leveraging the DataFrame API and unresolved logical plans, fundamentally shifting your approach from cluster management to job-focused development. Learn how this technology makes Spark code more portable and platform-agnostic while enabling support for additional programming languages like Go. Understand the architectural principles behind Spark Connect and how it simplifies distributed data processing by providing flexible, local access to Apache Spark at scale. Gain insights into practical applications and implementation strategies that can streamline your data engineering workflows and reduce operational complexity.

Syllabus

Spark Connect: Flexible, Local Access to Apache Spark at Scale

Taught by

Databricks

Reviews

Start your review of Spark Connect - Flexible, Local Access to Apache Spark at Scale

Start learning

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.