Data Pipelines Courses and Certifications

DeepLearning.AI;  Amazon Web Services

Source Systems, Data Ingestion, and Pipelines

135 ratings at Coursera

Explore source systems, implement batch and streaming pipelines, automate data workflows, and monitor data quality using AWS and open-source tools for efficient data management.

• Coursera
• 1 day 10 hours 27 minutes
• Self-Paced
• Paid Course

Coursera

Data Pipelines and SQL for Product Analytics

Master data pipeline construction and SQL optimization for product analytics using real-world datasets exceeding 10 million rows across multiple platforms.

• Coursera
• 8 hours 52 minutes
• Self-Paced
• Paid Course

Coursera

Automate, Optimize, and Benchmark Data Pipelines

Master pipeline performance evaluation and automation scripting to build faster, more efficient data systems through benchmarking and configuration-driven workflows.

• Coursera
• 1 hour 58 minutes
• Self-Paced
• Paid Course

Coursera

Data Quality and Debugging for Reliable Pipelines

Master data quality testing, root cause analysis, and Python debugging to build reliable, production-ready data pipelines using YAML test suites, monitoring dashboards, and advanced debugging tools.

• Coursera
• 7 hours 18 minutes
• Self-Paced
• Paid Course

Coursera

Build & Transform Data Pipelines

Master automated data pipeline creation using Python, dbt, and Airflow to transform raw data into analytics-ready insights on cloud platforms like AWS and Snowflake.

• Coursera
• 1 hour 40 minutes
• Self-Paced
• Paid Course

Coursera

Orchestrate & Recover Real-Time Data Pipelines

Master production-grade data pipeline orchestration with automated recovery, fault tolerance, and disaster recovery using Airflow, Prefect, and real-world reliability patterns.

• Coursera
• 4 hours 22 minutes
• Self-Paced
• Paid Course

Coursera

ML Data Pipelines and Communicating AI Insights

Master ML data pipelines using Python, Pandas, Apache Spark, and SQL. Build ETL workflows, apply feature engineering, evaluate model performance, and communicate AI insights through visualizations and structured reporting.

• Coursera
• 11 hours 40 minutes
• Self-Paced
• Paid Course

EDUCBA

Apply ETL Testing Techniques for Retail Data Pipelines

Master ETL testing for retail data pipelines through hands-on validation of pricing logic, multi-store consolidation, and layered data transformations using real-world scenarios.

• Coursera
• 5 hours 21 minutes
• Self-Paced
• Paid Course

Coursera

Ensure Data Integrity: Build Quality Pipelines

Master building bulletproof data quality pipelines using Great Expectations and dbt. Implement automated YAML-based validation suites to catch integrity issues before they impact downstream systems.

• Coursera
• 1 hour 29 minutes
• Self-Paced
• Paid Course

ETL and ELT in Python

29 ratings at DataCamp

Learn to build effective, performant, and reliable data pipelines using Extract, Transform, and Load principles.

• DataCamp
• 4 hours
• Self-Paced
• Free Trial Available

Scaling Data Pipelines: Memory Optimization and Failure Control

Discover techniques for optimizing memory and building resilient data pipelines with checkpointing and retry logic to handle massive data volumes efficiently for AI and big data workflows.

• YouTube
• 16 minutes
• Self-Paced
• Free Video

Databricks

Observability for Data Pipelines with OpenLineage

Explore data pipeline observability using OpenLineage, enhancing reliability and auditability. Learn how metadata collection enables understanding of data flow and dependencies across teams and technologies.

• YouTube
• 24 minutes
• Self-Paced
• Free Video

Databricks

Dumb-Proofing Data Pipelines: Techniques for Configurable and Maintainable ETL - Databricks

Techniques to create configurable, maintainable data pipelines. Learn to externalize configurations, validate inputs, and leverage Scala features for robust, easily deployable ETL processes.

• YouTube
• 22 minutes
• Self-Paced
• Free Video

Databricks

Code Once, Use Often - Declarative Data Pipelines

Learn to build efficient, reusable data pipelines using declarative approaches. Explore techniques for reducing food waste through data-driven solutions and automation in this developer-focused session.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Anyscale

Ray Workflow - Durable Ray Tasks for Efficient, Flexible Data Pipelines

Explore efficient, flexible data pipelines using Ray Workflow. Learn to implement durable Ray tasks for ETL workloads and ML pipelines, combining workflow system advantages with Ray's data processing capabilities.

• YouTube
• 37 minutes
• Self-Paced
• Free Video