Data Pipelines Courses and Certifications

Serverless Data Processing with Dataflow: Develop Pipelines

In this second installment of the Dataflow course series, we are going to be diving deeper on developing pipelines using the Beam SDK.

• edX
• 3 weeks, 5-6 hours a week
• On-Demand
• Free Online Course (Audit)

Coursera

Optimize SQL: Build Fast Data Pipelines

Master building scalable data pipelines with parameterized SQL scripts, performance optimization techniques, and automated ETL processes for production-ready analytics.

• Coursera
• 1 hour 44 minutes
• On-Demand
• Paid Course

Coursera

Automate Data Pipelines: Schema Evolution

Master schema evolution in data pipelines using Apache Airflow to build failure-resistant ETL workflows that adapt to changing data structures and prevent costly breakdowns.

• Coursera
• 2 hours 5 minutes
• On-Demand
• Paid Course

Coursera

Automate Data Deployments with CI/CD Pipelines

Master enterprise-grade CI/CD pipelines to automate data deployments, configure GitHub Actions workflows, and transform manual processes into reliable production systems.

• Coursera
• 1 hour 26 minutes
• On-Demand
• Paid Course

Packt

Orchestrating Data Pipelines and Advanced Data Strategies

Master AWS data engineering by orchestrating pipelines, migrating datasets, and implementing advanced strategies using Step Functions, DMS, DataSync, and QuickSight.

• Coursera
• 8 hours 28 minutes
• On-Demand
• Paid Course

Ingest data with Microsoft Fabric

Learn data ingestion techniques in Microsoft Fabric using Dataflows Gen2, Apache Spark, and Data Factory pipelines. Explore visual and code-based approaches for efficient data transformation and loading into lakehouses.

• Microsoft Learn
• 4 hours 49 minutes
• On-Demand
• Free Online Course

Appen

Data Science Pipelines

Pipelines are essential tools for data scientists. They enable you to seamlessly combine various different features and preprocessing approaches into a single pipeline object. In this course, you will build reproducible, modular scikit-learn pipelines th…

• Udacity
• 18 hours
• On-Demand
• Paid Course

Databricks Certified Data Engineer Associate Cert Prep: 4 Production Pipelines

19 ratings at LinkedIn Learning

Boost your skills as a data science professional to prepare for the fourth section of the Databricks Certified Data Engineer Associate certification exam.

• LinkedIn Learning
• 19 minutes
• On-Demand
• Free Trial Available

Simplifying data pipelines with Apache Kafka

Learn to streamline data pipelines using Apache Kafka. Explore architecture, command-line tools, Java API for producers and consumers, and integration with Kafka Connect and Spark Streaming.

• Cognitive Class
• 3 hours
• On-Demand
• Free Online Course

Transfer and transform data with Azure Synapse Analytics pipelines

Learn to create data pipelines, implement data flows, and integrate Apache Spark notebooks in Azure Synapse Analytics for efficient data transfer and transformation.

• Microsoft Learn
• 1 hour 59 minutes
• On-Demand
• Free Online Course

Deploy and maintain data pipelines and workloads with Azure Databricks

Master data pipeline deployment and maintenance using Azure Databricks with Lakehouse architecture, Lakeflow Jobs, Git workflows, and performance monitoring techniques.

• Microsoft Learn
• 6 hours 11 minutes
• On-Demand
• Free Online Course

Building an Open Source Streaming Analytics Stack with Kafka and Druid

Learn to build a robust streaming analytics stack using Kafka and Druid for real-time data processing, flexible querying, and maintaining data integrity in high-volume environments.

• YouTube
• 41 minutes
• On-Demand
• Free Video

AWS Events

Netflix Maestro: Orchestrating Scaled Data and ML Workflows in the Cloud

Discover Netflix's Maestro orchestration system for managing large-scale data and ML workflows, featuring advanced scalability, nested structures, and efficient lineage tracking capabilities.

• YouTube
• 23 minutes
• On-Demand
• Free Video

Data Council

Declarative Orchestration: Why You've Been Thinking About the Wrong DAG the Entire Time

Explore declarative, asset-oriented orchestration in data pipelines. Learn how this approach simplifies tasks, ensures data integrity, and implements Data Mesh as a living asset graph.

• YouTube
• 32 minutes
• On-Demand
• Free Video

Data Analysis with Python

19629 ratings at Coursera

Learn to analyze data using Python, from importing and cleaning to exploratory analysis and building machine learning models. Gain hands-on experience with popular libraries and real-world datasets.

• Coursera
• 17 hours 2 minutes
• On-Demand
• Paid Course