Data Pipelines Courses and Certifications

The ASF

Application of Apache SeaTunnel - The Next Generation of Ultra-High Performance Big Data Integration

Explore Apache SeaTunnel's data synchronization pipeline and Zeta engine for efficient, real-time integration of diverse data sources. Learn architecture, use cases, and future roadmap.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Data Council

Building a Reliable, Secure and Efficient Event Ingestion Pipeline

Explore challenges in data pipelines, from client interactions to backend complexities. Gain insights into building reliable, secure, and efficient event ingestion systems.

• YouTube
• 31 minutes
• On-Demand
• Free Video

Data Council

Streaming CDC Data from PostgreSQL to Snowflake - Challenges and Solutions

Uncover streaming ETL secrets: Postgres to Snowflake data ingestion, change data capture, dynamic tables, and Snowpipe streaming. Learn solutions for lower latency, cost savings, and enhanced scalability.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Data Council

Building a Flexible Data Platform for LLM Training Data

Explore LLM training data platforms: architecture, ingestion, preprocessing, and scaling challenges. Learn from Cohere's experience in managing petabyte-scale datasets for high-quality model training.

• YouTube
• 37 minutes
• On-Demand
• Free Video

Data Council

Bridging the Gap Between Batch and Real-Time with Mixed-Latency Pipelines

Explore mixed-latency data platforms, manage data freshness, and tackle pipeline bottlenecks. Learn to merge batch and low-latency processing while maintaining explicit lineage for reliable data products.

• YouTube
• 13 minutes
• On-Demand
• Free Video

Data Council

Continuous Data Pipeline for Real-Time Benchmarking and Data Set Augmentation

Generate datasets and real-time precision/recall splits to detect data shifts, prioritize data collection, and retrain models for improved ML system accuracy and performance.

• YouTube
• 15 minutes
• On-Demand
• Free Video

SF Python

Data Pipeline Scorecard: Evaluating Python Processing Approaches

Explore data processing approaches in Python, comparing different methods and their practical applications for building efficient data pipelines and optimizing workflow performance.

• YouTube
• 29 minutes
• On-Demand
• Free Video

Conf42

Real-Time Data for Generative Feedback Loop Automation

Dive into real-time data automation with Generative Feedback Loops (GFL), exploring practical implementations, pipeline construction, and hands-on demonstrations for automated data processing systems.

• YouTube
• 28 minutes
• On-Demand
• Free Video

All Things Open

Build Response Pipelines - A Hands-On Mezmo Workshop

Discover how to build effective response pipelines using Mezmo through practical, hands-on techniques and real-world implementation strategies.

• YouTube
• 38 minutes
• On-Demand
• Free Video

LeadDev

Supply Chain - Data Infrastructure Pipeline

Discover how modern data pipelines transform supply chain operations through real-time insights, improved data quality, and ML-powered predictions for enterprise-grade scalability.

• YouTube
• 11 minutes
• On-Demand
• Free Video

Build Batch Data Pipelines on Google Cloud

1711 ratings at Coursera

Learn to build efficient batch data pipelines on Google Cloud using BigQuery, Dataproc, Data Fusion, and Dataflow. Gain hands-on experience with EL, ELT, and ETL paradigms for optimal data processing.

• Coursera
• 10 hours 53 minutes
• On-Demand
• Paid Course

Build Streaming Data Pipelines on Google Cloud

1264 ratings at Coursera

Learn to build real-time streaming data pipelines on Google Cloud using Pub/Sub, Dataflow, BigQuery, and Bigtable. Gain hands-on experience in processing, transforming, and analyzing streaming data for business insights.

• Coursera
• 8 hours 11 minutes
• On-Demand
• Paid Course

The Complete Hands-On Introduction to Apache Airflow 3

13835 ratings at Udemy

Learn to author, schedule and monitor data pipelines through practical examples using Apache Airflow

• Udemy
• 4 hours 37 minutes
• On-Demand
• Paid Course

AWS Certified Data Engineer Associate 2026 - Hands On!

12178 ratings at Udemy

AWS DEA-C01 certification prep course with exercises and 2 full-length practice exams. Redshift, Glue, Athena, and more

• Udemy
• 1 day 24 minutes
• On-Demand
• Paid Course

CodeWithYu

Building Robust Data Pipelines for Modern Data Engineering - End-to-End Project

Develop robust data pipelines using Apache Spark, Azure Databricks, and DBT. Master end-to-end data engineering with Azure, covering ingestion, integration, and transformation in a modern data architecture.

• YouTube
• 1 hour 59 minutes
• On-Demand
• Free Video