DataGalaxy Courses

The Data Engineering Lifecycle - Understanding Data Processing and Management

Discover a technology-agnostic approach to data engineering, exploring practical mental models and essential undercurrents for effectively managing data workflows in your career.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Cross-Platform Data Lineage with OpenLineage - Tracing Data Across Apache Spark and Airflow

Discover how OpenLineage enables cross-platform data tracing, focusing on Apache Spark and Airflow integration. Learn architecture fundamentals and see real-time pipeline monitoring through practical demonstrations.

• YouTube
• 45 minutes
• On-Demand
• Free Video

Next Generation Data Products Build on Databricks Lakehouse - Delta Live Tables and SQL Warehousing

Discover how to build reliable batch and streaming data pipelines using Delta Live Tables and Databricks SQL, focusing on simplified ETL development, automated testing, and scalable data warehouse operations.

• YouTube
• 37 minutes
• On-Demand
• Free Video

Getting Started with Redpanda Streaming Data Platform

Dive into Redpanda's streaming data platform architecture, installation methods, deployment strategies, and practical use cases for building efficient data streaming solutions.

• YouTube
• 49 minutes
• On-Demand
• Free Video

The Future of Data Integration - Harnessing Airbyte's Custom Connector

Discover how to build custom data connectors with Airbyte's CDK, from setting up standard connections to creating bespoke API connectors for enhanced data integration workflows.

• YouTube
• 41 minutes
• On-Demand
• Free Video

Modern Data Cataloging in 2023 and Beyond

Discover modern data cataloging trends and best practices through DataGalaxy's vision, exploring innovative approaches for effective data management and organization in today's evolving landscape.

• YouTube
• 27 minutes
• On-Demand
• Free Video