Batch Data Processing Courses and Certifications

AWS Certified Data Engineer Associate 2026 - Hands On!

12178 ratings at Udemy

AWS DEA-C01 certification prep course with exercises and 2 full-length practice exams. Redshift, Glue, Athena, and more

• Udemy
• 1 day 24 minutes
• On-Demand
• Paid Course

Streaming Concepts

Learn about the difference between batching and streaming, scaling streaming systems, and real-world applications.

• DataCamp
• 2 hours
• On-Demand
• Free Trial Available

Databricks

Elixir for Data Engineering - Batch and Stream Processing

Discover how Elixir can revolutionize data engineering with distributed processing, Airflow integration, and Kafka event handling. Learn practical examples for efficient batch and stream processing.

• YouTube
• 24 minutes
• On-Demand
• Free Video

Confluent

Streaming vs. Batch Processing: The Future of Data Architecture

Explore the future of data processing with industry experts as they debate streaming vs. batch, adoption challenges, and best practices for real-time data architecture.

• YouTube
• 44 minutes
• On-Demand
• Free Video

Building a Batch Processing Platform for Data Pipelines Using Argo and Kubernetes

Explore Intuit's scalable batch processing platform using Kubernetes and Argo for efficient data pipeline management, addressing scheduling, orchestration, and dependency challenges in AI and data engineering.

• YouTube
• 29 minutes
• On-Demand
• Free Video

Anyscale

Scaling Training and Batch Inference - A Deep Dive into Ray AIR's Data Processing Engine

Dive into Ray AIR's data processing engine for efficient ML pipeline scaling. Learn distributed data sharding, parallel I/O, GPU optimization, and autoscaling for improved performance and scalability.

• YouTube
• 44 minutes
• On-Demand
• Free Video

The ASF

Apache Paimon - A Unified Data Lake for Stream, Batch, and OLAP Processing

Explore Apache Paimon's capabilities as a unified data lake system, integrating stream processing, batch operations, and OLAP functionalities for modern data architecture.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Data Council

The Middle Ground: Balancing Batch and Real-Time Processing in a Data Lakehouse

Explore how data lakehouse architectures can bridge batch processing and real-time streaming, supporting both high-frequency, low-latency queries and resource-intensive batch analytics on a single platform.

• YouTube
• 14 minutes
• On-Demand
• Free Video

Databricks

Demystifying Delta Lake - Data Reliability for Data Lakes

Explore Delta Lake's reliability features for data lakes with Apache Spark creator Michael Armbrust. Learn about ACID transactions, metadata handling, and unified data processing.

• YouTube
• 26 minutes
• On-Demand
• Free Video

CodeEmporium

Transformer Encoder in 100 Lines of Code

Learn to implement a Transformer Encoder from scratch in Python. Explore key concepts like attention mechanisms, layer normalization, and feed-forward networks through hands-on coding.

• YouTube
• 50 minutes
• On-Demand
• Free Video

Crea canalizaciones de datos por lotes en Google Cloud

45 ratings at Coursera

Aprende a construir canalizaciones de datos por lotes en Google Cloud, explorando paradigmas EL, ELT y ETL, y utilizando herramientas como BigQuery, Dataproc, Cloud Data Fusion y Dataflow.

• Coursera
• 10 hours 37 minutes
• On-Demand
• Paid Course

Créer des pipelines de données en batch sur Google Cloud

Apprenez à créer des pipelines de données par lot sur Google Cloud, en explorant différentes méthodes et outils comme BigQuery, Dataproc, Dataflow et Cloud Data Fusion pour optimiser le traitement des données.

• Coursera
• 9 hours 16 minutes
• On-Demand
• Paid Course

Building Batch Data Pipelines on Google Cloud - Locales

Aprenda a construir pipelines de dados em lote no Google Cloud, explorando tecnologias como BigQuery, Spark no Dataproc, Cloud Data Fusion e Dataflow para transformação e processamento eficiente de dados.

• Google Skills
• Finished
• Paid Course

Google Cloud;  Google

Building Batch Data Pipelines on GCP auf Deutsch

Erlernen Sie verschiedene Methoden zur Erstellung von Batch-Datenpipelines in Google Cloud, einschließlich BigQuery, Spark, Data Fusion und Dataflow, mit praktischen Übungen.

• Coursera
• 2 weeks
• Finished
• Free Online Course (Audit)