Data Pipelines Courses and Certifications

LeadDev

Supply Chain - Data Infrastructure Pipeline

Discover how modern data pipelines transform supply chain operations through real-time insights, improved data quality, and ML-powered predictions for enterprise-grade scalability.

• YouTube
• 11 minutes
• Self-Paced
• Free Video

Databricks

Generative Hyperloop Design - Managing Massively Scaled Simulations for Demand Modeling

Explore large-scale simulation framework for Hyperloop design, utilizing cloud computing, data pipelines, and machine learning to address key technical and business questions for safe and efficient mass transportation.

• YouTube
• 26 minutes
• Self-Paced
• Free Video

Open Data Science

Orchestrating Data Assets Instead of Tasks, With Dagster - Sandy Ryza

Explore data orchestration with Dagster, focusing on managing data assets over tasks. Learn about pipeline development, testing, deployment, and monitoring in data engineering and machine learning.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

Database Native Support for CDC Streaming Pipeline

Explore a database-native solution for Cassandra's CDC logs, addressing common challenges and proposing an improved architecture based on industry insights and managed CDC solutions.

• YouTube
• 24 minutes
• Self-Paced
• Free Video

Build Batch Data Pipelines on Google Cloud

1713 ratings at Coursera

Learn to build efficient batch data pipelines on Google Cloud using BigQuery, Dataproc, Data Fusion, and Dataflow. Gain hands-on experience with EL, ELT, and ETL paradigms for optimal data processing.

• Coursera
• 10 hours 53 minutes
• Self-Paced
• Paid Course

Build Streaming Data Pipelines on Google Cloud

1268 ratings at Coursera

Learn to build real-time streaming data pipelines on Google Cloud using Pub/Sub, Dataflow, BigQuery, and Bigtable. Gain hands-on experience in processing, transforming, and analyzing streaming data for business insights.

• Coursera
• 8 hours 11 minutes
• Self-Paced
• Paid Course

Career Certificate

Data Engineering with AWS

7 ratings

Learn to design data models, build warehouses and lakes, automate pipelines, and work with massive datasets using AWS. Gain practical skills in ETL, PostgreSQL, Cassandra, Spark, and Airflow.

• Udacity
• 39 hours
• Self-Paced
• Paid Course

Career Certificate

Generative AI for Data Engineers

11711 ratings at Coursera

Explore generative AI applications in data engineering, from ETL pipelines to prompt engineering techniques. Learn popular models for text, code, image, audio, and video generation using tools like IBM Watsonx.

• Coursera
• 8 weeks, 2 hours/week
• Self-Paced
• Paid Course
• 2 courses

CodeWithYu

Building Robust Data Pipelines for Modern Data Engineering - End-to-End Project

Develop robust data pipelines using Apache Spark, Azure Databricks, and DBT. Master end-to-end data engineering with Azure, covering ingestion, integration, and transformation in a modern data architecture.

• YouTube
• 1 hour 59 minutes
• Self-Paced
• Free Video

Data Pipelines with TensorFlow Data Services

536 ratings at Coursera

Streamline ETL tasks, optimize data pipelines, and publish datasets using TensorFlow Data Services. Learn to load, process, and share standardized data efficiently for machine learning models.

• Coursera
• 11 hours 13 minutes
• Self-Paced
• Paid Course

Data Engineer in Python

Gain in-demand skills to efficiently ingest, clean, manage data, and schedule and monitor pipelines, setting you apart in the data engineering field.

• DataCamp
• 1 day 16 hours
• Self-Paced
• Free Trial Available

Introduction to dbt

This course introduces dbt for data modeling, transformations, testing, and building documentation.

• DataCamp
• 4 hours
• Self-Paced
• Free Trial Available

Data Processing in Shell

Learn powerful command-line skills to download, process, and transform data, including machine learning pipeline.

• DataCamp
• 4 hours
• Self-Paced
• Free Trial Available

DevOps Concepts

In this Introduction to DevOps, you’ll master the DevOps basics and learn the key concepts, tools, and techniques to improve productivity.

• DataCamp
• 4 hours
• Self-Paced
• Free Trial Available

Learn to design, query, and build in Snowflake - mastering Snowflake SQL for transformation and modeling to become a job-ready Data Engineer.

• DataCamp
• 1 day 8 hours
• Self-Paced
• Free Trial Available