Data Pipelines Courses and Certifications

DeepLearning.AI;  Amazon Web Services

Source Systems, Data Ingestion, and Pipelines

135 ratings at Coursera

Explore source systems, implement batch and streaming pipelines, automate data workflows, and monitor data quality using AWS and open-source tools for efficient data management.

• Coursera
• 1 day 10 hours 27 minutes
• On-Demand
• Paid Course

Coursera

Orchestrate & Recover Real-Time Data Pipelines

Master production-grade data pipeline orchestration with automated recovery, fault tolerance, and disaster recovery using Airflow, Prefect, and real-world reliability patterns.

• Coursera
• 4 hours 22 minutes
• On-Demand
• Paid Course

Coursera

Automate, Optimize, and Benchmark Data Pipelines

Master pipeline performance evaluation and automation scripting to build faster, more efficient data systems through benchmarking and configuration-driven workflows.

• Coursera
• 1 hour 58 minutes
• On-Demand
• Paid Course

Coursera

Data Pipelines and SQL for Product Analytics

Master data pipeline construction and SQL optimization for product analytics using real-world datasets exceeding 10 million rows across multiple platforms.

• Coursera
• 8 hours 52 minutes
• On-Demand
• Paid Course

EDUCBA

Apply ETL Testing Techniques for Retail Data Pipelines

Master ETL testing for retail data pipelines through hands-on validation of pricing logic, multi-store consolidation, and layered data transformations using real-world scenarios.

• Coursera
• 5 hours 21 minutes
• On-Demand
• Paid Course

Coursera

Build & Transform Data Pipelines

Master automated data pipeline creation using Python, dbt, and Airflow to transform raw data into analytics-ready insights on cloud platforms like AWS and Snowflake.

• Coursera
• 1 hour 40 minutes
• On-Demand
• Paid Course

ETL and ELT in Python

29 ratings at DataCamp

Learn to build effective, performant, and reliable data pipelines using Extract, Transform, and Load principles.

• DataCamp
• 4 hours
• On-Demand
• Free Trial Available

Establishing Data Infrastructure

Learn to build scalable data infrastructure, identify data producers/consumers, design effective pipelines, and create a comprehensive data strategy for your business needs.

• Udacity
• 17 hours
• On-Demand
• Paid Course

Databricks

Observability for Data Pipelines with OpenLineage

Explore data pipeline observability using OpenLineage, enhancing reliability and auditability. Learn how metadata collection enables understanding of data flow and dependencies across teams and technologies.

• YouTube
• 24 minutes
• On-Demand
• Free Video

Databricks

Dumb-Proofing Data Pipelines: Techniques for Configurable and Maintainable ETL - Databricks

Techniques to create configurable, maintainable data pipelines. Learn to externalize configurations, validate inputs, and leverage Scala features for robust, easily deployable ETL processes.

• YouTube
• 22 minutes
• On-Demand
• Free Video

Databricks

Code Once, Use Often - Declarative Data Pipelines

Learn to build efficient, reusable data pipelines using declarative approaches. Explore techniques for reducing food waste through data-driven solutions and automation in this developer-focused session.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Anyscale

Ray Workflow - Durable Ray Tasks for Efficient, Flexible Data Pipelines

Explore efficient, flexible data pipelines using Ray Workflow. Learn to implement durable Ray tasks for ETL workloads and ML pipelines, combining workflow system advantages with Ray's data processing capabilities.

• YouTube
• 37 minutes
• On-Demand
• Free Video

Scaling Data Pipelines: Memory Optimization and Failure Control

Discover techniques for optimizing memory and building resilient data pipelines with checkpointing and retry logic to handle massive data volumes efficiently for AI and big data workflows.

• YouTube
• 16 minutes
• On-Demand
• Free Video

Data Council

Evolving Data Pipelines at Scale with SQLMesh

Discover SQLMesh: revolutionize data pipeline development with virtual environments, automated testing, and accurate change previews inspired by industry giants.

• YouTube
• 30 minutes
• On-Demand
• Free Video

SF Python

Design Patterns for Data Pipelines Beyond ETL

Discover essential design patterns for managing complex data pipelines in Python, focusing on advanced transformation techniques and Django integration for robust ETL workflows.

• YouTube
• 42 minutes
• On-Demand
• Free Video