Apache Spark Courses and Certifications

Databricks

Getting Started with Apache Spark on Kubernetes

Learn to deploy and optimize Apache Spark on Kubernetes with hands-on demos, covering environment setup, application sizing, performance tuning, and monitoring for efficient data pipeline management.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Databricks

Fine-Tuning and Enhancing Performance of Apache Spark Jobs

Explore best practices for optimizing Apache Spark jobs, including resource allocation, parameter tuning, and performance enhancement techniques. Learn to identify bottlenecks and implement solutions for improved efficiency.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Databricks

Running Apache Spark on Kubernetes - Best Practices and Pitfalls

Learn best practices and pitfalls for running Apache Spark on Kubernetes, covering setup, performance optimization, resource management, security, and future developments in this comprehensive overview.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Databricks

Introducing Apache Spark 3.0 - A Decade of Progress and Future Outlook

Apache Spark 3.0: Reflecting on a decade of progress and unveiling new features to enhance data processing accessibility, speed, and compatibility across various sources and environments.

• YouTube
• 29 minutes
• On-Demand
• Free Video

Databricks

Apache Spark Core - Practical Optimization Techniques - Partition Shaping and Job Optimization

Explore Apache Spark optimization techniques, including partition shaping, join and aggregate optimizations, and multi-dimensional parallelism to maximize cluster utilization and eliminate data skew.

• YouTube
• 1 hour 32 minutes
• On-Demand
• Free Video

Bryan Cafferky

Master Databricks and Apache Spark - Introduction

Learn the fundamentals of Databricks and Apache Spark, exploring scale-up vs. scale-out concepts and laying the groundwork for mastering these powerful data processing tools.

• YouTube
• 32 minutes
• On-Demand
• Free Video

Bryan Cafferky

Create a Spark Cluster - Master Databricks and Apache Spark Step by Step - Lesson 4

Learn to create and use Apache Spark clusters, understand their differences from Databricks, and explore data querying with Zeppelin notebooks in this step-by-step guide.

• YouTube
• 21 minutes
• On-Demand
• Free Video

CodeWithYu

Realtime Socket Streaming with Apache Spark - End-to-End Data Engineering Project

Build a real-time data streaming pipeline using TCP/IP Socket, Apache Spark, OpenAI LLM, Kafka, and Elasticsearch. Process 7 million records for sentiment analysis and efficient data indexing.

• YouTube
• 1 hour 42 minutes
• On-Demand
• Free Video

Databricks

An Introduction to Machine Learning with Apache Spark

Discover Apache Spark's machine learning capabilities through data import, feature engineering, model pipelines, and distributed training techniques.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Databricks

Apache Spark ML and Distributed Learning - Complete Course Series

Discover Apache Spark ML fundamentals through data import, exploratory analysis, pipelines, featurization, and model training in this hands-on learning experience.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Distributed Computing & AI with Spark

Gain insights into building, training, and customizing models with TensorFlow and Keras, from simple networks to advanced pre-trained models with transfer learning, culminating in an image classification project.

• Pragmatic Institute
• 4 hours
• On-Demand
• Paid Course

Introduction to Spark with sparklyr in R

Learn how to run big data analysis using Spark and the sparklyr package in R, and explore Spark MLIb in just 4 hours.

• DataCamp
• 4 hours
• On-Demand
• Free Trial Available

Introduction to Spark SQL in Python

Learn how to manipulate data and create machine learning feature sets in Spark using SQL in Python.

• DataCamp
• 4 hours
• On-Demand
• Free Trial Available

Spark and Data Lakes

In this course, you will learn about the big data ecosystem and how to use Spark to work with massive datasets. You’ll also learn about how to store big data in a data lake and query it with Spark.

• Udacity
• 10 hours
• On-Demand
• Paid Course

Spark for Data Engineering

Gain insights into Apache Spark for large-scale data engineering, mastering data processing, transformation, and analysis through hands-on projects and dedicated support.

• Pragmatic Institute
• 4 hours
• On-Demand
• Paid Course