Data Pipelines Courses and Certifications

Build reliable, scalable data pipelines with dbt Fundamentals, a hands-on track designed for data analysts, data engineers, analytics engineers.

• DataCamp
• 8 hours
• Self-Paced
• Free Trial Available

Data Ingestion and Semantic Models with Microsoft Fabric

Learn to bring data into Microsoft Fabric, covering Pipelines, Dataflows, Shortcuts, Semantic Models, security, and model refresh.

• DataCamp
• 4 hours
• Self-Paced
• Free Trial Available

Introduction to Data Quality with Great Expectations

Ensure high data quality in data science and data engineering workflows with Python's Great Expectations library.

• DataCamp
• 4 hours
• Self-Paced
• Free Trial Available

Designing Forecasting Pipelines for Production

Learn how to design, automate, and monitor scalable forecasting pipelines in Python.

• DataCamp
• 4 hours
• Self-Paced
• Free Trial Available

Data Transformation with Spark SQL in Databricks

Build end-to-end data pipelines - from cleaning and aggregation to streaming and orchestration.

• DataCamp
• 3 hours
• Self-Paced
• Free Trial Available

Data Pipeline Automation in Snowflake

Load, automate, and optimize data pipelines in Snowflake using COPY INTO, Snowpipe, streams, tasks, dynamic tables, and query performance tools.

• DataCamp
• 3 hours
• Self-Paced
• Free Trial Available

Google Cloud에서 일괄 데이터 파이프라인 빌드하기

Google Cloud에서 배치 데이터 파이프라인 구축: EL, ELT, ETL 패러다임 이해 및 BigQuery, Dataproc, Data Fusion, Dataflow 등 다양한 기술을 활용한 데이터 변환 및 처리 방법 학습

• Coursera
• 8 hours 32 minutes
• Self-Paced
• Paid Course

Dataflow를 사용한 서버리스 데이터 처리: 운영

Dataflow 운영 모델의 모니터링, 로깅, 디버깅, 성능 최적화, CI/CD, 안정성 및 Flex 템플릿을 마스터하여 안정적인 파이프라인을 구축하세요.

• Coursera
• 9 weeks, 1 hour a week
• Self-Paced
• Paid Course

ETL and Data Pipelines with Shell, Airflow and Kafka

460 ratings at Coursera

Learn to build data pipelines using Shell, Airflow, and Kafka. Master ETL and ELT processes, explore tools for data extraction, transformation, and loading, and gain hands-on experience with Apache Airflow and Kafka.

• Coursera
• 17 hours 47 minutes
• Self-Paced
• Paid Course

Gopher Academy

Plowing Through Data - Building Flexible Pipelines with Go

Discover how to build scalable data pipelines using Go's parametric polymorphism for processing agricultural data from fields, labs, and applications with flexibility and ease.

• YouTube
• 22 minutes
• Self-Paced
• Free Video

GOTO Conferences

Data Pipelines à La Mode

Explore pure data pipelines: reproducible, version-tracked, and efficient. Learn techniques from distributed build systems to improve algorithm updates and avoid redundant work.

• YouTube
• 48 minutes
• Self-Paced
• Conference Talk

Confluent

Data Pipelines Evolution from Batch to Streaming

Explore the evolution from batch to streaming data pipelines using Apache Flink and Kafka. Learn strategies for seamless transition, including query-based connectors, change data capture, and handling late events.

• YouTube
• 41 minutes
• Self-Paced
• Free Video

Google Cloud Tech

Build Continuous Data and AI Pipelines with BigQuery Continuous Queries

Revolutionize data engineering with BigQuery continuous queries for real-time AI insights. Explore event-driven pipelines using Vertex AI, Pub/Sub, and Bigtable through Cloud SQL.

• YouTube
• 41 minutes
• Self-Paced
• Free Video

Rust

Serverless Data Pipelines in Rust - Rust Vienna Meetup

Explore building serverless data pipelines in Rust using DataFusion and object store, with deployment on AWS Lambda. Learn scalable techniques for complex pipelines in production environments.

• YouTube
• 41 minutes
• Self-Paced
• Free Video

EuroPython Conference

Modern Data Science with Vaex - A New Approach to DataFrames and Pipelines

Explore efficient data processing for large datasets using Vaex, combining computational graphs and lazy evaluations with memory-mapped storage and out-of-core algorithms.

• YouTube
• 51 minutes
• Self-Paced
• Conference Talk