Apache Spark 3 - Beyond Basics and Cracking Job Interviews

This advanced course develops Apache Spark 3 skills beyond the fundamentals, covering cluster architecture, deployment modes, job execution, Spark SQL, memory management, adaptive query execution, data skew, partitioning, caching, and scheduling. It also addresses topics relevant to Databricks certification and Spark job interviews.

Syllabus

Apache Spark 3 - Beyond Basics and Cracking Job Interviews | Course Introduction.
Spark Cluster and Runtime Architecture.
Spark Submit and Some Important Options.
Deploy Modes - Client and Cluster mode.
Spark Jobs - Stage, Shuffle, Task, Slots.
Spark SQL Engine and Query Planning.
Lets Practice - Quiz 1 Solution Video.
Lets Practice - Quiz 2 Solution Video.
Spark Memory Allocation.
Spark Memory Management.
Spark Adaptive Query Execution.
Spark AQE Dynamic Join Optimization.
Handling Data Skew in Spark Joins.
Spark Dynamic Partition Pruning.
Data Caching in Spark.
Repartition and Coalesce.
Dataframe Hints.
Broadcast Variables.
Accumulators.
Speculative Execution.
Dynamic Resource Allocation.
Spark Schedulers.
Lets Practice Quiz 3 Solution Video.
Lets Practice Quiz 4 Solution Video.