Spark Streaming Courses and Certifications

Advanced Big Data Systems | 高级大数据系统

高级大数据系统的实现、优化和应用，包括分布式文件系统、MapReduce/Spark、Storm/Spark streaming、Mahout等系统的原理、实现、策略优化。

• edX
• 16 weeks, 3-5 hours/week
• Self-Paced
• Free Online Course

Packt

Apache Spark with Scala – Hands-On with Big Data!

Master Apache Spark and Scala for big data processing. Set up your environment, learn RDDs, SparkSQL, and advanced programming. Apply machine learning, streaming, and graph processing to real-world datasets.

• Coursera
• 11 hours 11 minutes
• Self-Paced
• Paid Course

EDUCBA

Apache Spark with Scala: Master Data Building & Analysis

Master Apache Spark with Scala to build scalable big data applications, implement real-time streaming, and create fault-tolerant data pipelines for analytics roles.

• Coursera
• 8 hours 44 minutes
• Self-Paced
• Paid Course

CodeWithYu

Realtime Socket Streaming with Apache Spark - End-to-End Data Engineering Project

Build a real-time data streaming pipeline using TCP/IP Socket, Apache Spark, OpenAI LLM, Kafka, and Elasticsearch. Process 7 million records for sentiment analysis and efficient data indexing.

• YouTube
• 1 hour 42 minutes
• Self-Paced
• Free Video

Credential

Data Streaming

148 ratings at Udacity

Develop real-time data processing skills using Apache Spark, Kafka, and streaming technologies. Build fluency in modern data engineering tools and create live analytics applications.

• Udacity
• 53 hours
• Self-Paced
• Paid Course

Azure DataBricks - Data Engineering With Real Time Project

696 ratings at Udemy

Real Time Project on Retail Data - PySpark ,SQL, Delta/Delta Live Table,Unity Catalogue, AutoLoader & Performance Tuning

• Udemy
• 16 hours 56 minutes
• Self-Paced
• Paid Course

Devoxx

Dive into Spark Streaming

Explore Spark Streaming's API, real-time data processing challenges, and key internal processes for successful production deployment through practical examples.

• YouTube
• 1 hour
• Self-Paced
• Conference Talk

Databricks

Building a Streaming Microservice Architecture with Apache Spark Structured Streaming

Explore building a scalable, fault-tolerant streaming microservice architecture using Apache Spark, Kafka, gRPC, and Delta Lake for real-time data processing and reliable insights.

• YouTube
• 39 minutes
• Self-Paced
• Free Video

Building Robust Streaming Data Pipelines with Apache Spark

Learn to build robust streaming data pipelines using Apache Spark, Kafka, and Camel. Explore ETL challenges, data management, and lessons from running these technologies in Docker.

• YouTube
• 42 minutes
• Self-Paced
• Free Video

NashKnolX

State Storage in Spark Structured Streaming

Learn to configure and manage state storage in Spark Structured Streaming for efficient data processing and analysis.

• YouTube
• 1 hour
• Self-Paced
• Free Video

StreamNative

Unlock Next-Gen Stateful Streaming in Apache Spark with transformWithState and Streaming Platforms

Discover Apache Spark's transformWithState operator for building sophisticated, low-latency streaming applications with real-time fraud detection and session analytics examples.

• YouTube
• 27 minutes
• Self-Paced
• Free Video

Databricks

Spark 4.0 and Delta 4.0 For Streaming Data

Explore Spark 4.0 and Delta 4.0's new features for real-time data ingestion and querying, including Python custom data sources, Variant types, and Delta liquid clustering.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Databricks

Real-Time Mode Technical Deep Dive - How We Built Sub-300 Millisecond Streaming Into Apache Spark

Discover how Databricks engineers built real-time mode for Apache Spark Structured Streaming, achieving sub-300ms latencies through concurrent scheduling and non-blocking shuffle architecture.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Databricks

Building Real-Time Sport Model Insights with Spark Structured Streaming

Discover how DraftKings uses Spark Structured Streaming and Kafka to transform sports betting simulation data into real-time trader insights for precise odds pricing.

• YouTube
• 35 minutes
• Self-Paced
• Free Video

Simplifying data pipelines with Apache Kafka

Learn to streamline data pipelines using Apache Kafka. Explore architecture, command-line tools, Java API for producers and consumers, and integration with Kafka Connect and Spark Streaming.

• Cognitive Class
• 3 hours
• Self-Paced
• Free Online Course