The ASF Courses

Integrated Audits: Streamlined Data Observability with Apache Iceberg

Explore streamlined data observability using Apache Iceberg's Integrated Audits pattern for massive-scale data validation and quality assurance.

• YouTube
• 39 minutes
• Self-Paced
• Free Video

Morel: A Data-Parallel Programming Language - Lecture

Explore Morel, a functional programming language with relational extensions, designed for efficient data-parallel processing on various scales. Learn its evolution and capabilities in graph and recursive queries.

• YouTube
• 49 minutes
• Self-Paced
• Free Video

Iceberg's Best Secret: Exploring Metadata Tables

Explore Iceberg's metadata tables to gain insights, optimize queries, and enhance data management. Learn advanced techniques for auditing, quality control, and performance improvement in Apache Iceberg.

• YouTube
• 38 minutes
• Self-Paced
• Free Video

Git for Data Lakes: How LakeFS Scales Data Versioning to Billions of Objects

Learn how lakeFS enables Git-like versioning for data lakes, solving challenges of object storage and scaling to billions of objects without compromising performance. Explore branching, committing, and merging for petabyte-scale data management.

• YouTube
• 43 minutes
• Self-Paced
• Free Video

Elastic Heterogeneous Cluster and Heterogeneity-Aware Job Configuration

Explore Apache Daffodil's internal organization, DFDL schema compiler, and multiple runtime environments. Learn about new features like the VSCode-based data debugger.

• YouTube
• 42 minutes
• Self-Paced
• Free Video

Dive into Avro: Everything a Data Engineer Needs to Know

Explore Apache Avro's key features, best practices, and schema evolution for optimized data serialization in big data systems and event-driven architectures.

• YouTube
• 40 minutes
• Self-Paced
• Free Video

Daffodil: How Functional Programming Leads to Tight C Code at Runtime

Explore how functional programming in Daffodil leads to efficient C code runtime, covering innovations, data conversion, and optimization techniques for space applications.

• YouTube
• 42 minutes
• Self-Paced
• Free Video

Big Data Workflow Scheduling - Introducing Apache DolphinScheduler

Explore Apache DolphinScheduler's distributed workflow scheduling capabilities, architecture, and new features. Learn task management, multi-cloud support, and Python API for efficient big data orchestration.

• YouTube
• 41 minutes
• Self-Paced
• Free Video

Batch and Stream Analysis with TypeScript Using Apache Beam

Explore batch and stream analysis using Beam's Typescript SDK. Learn API choices, usability, and functionality through demos. Discover how to leverage Typescript for efficient data processing workflows.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Apache Arrow and Go: A Match Made in Data

Explore Apache Arrow's Go implementation, covering Arrow and Parquet libraries, Flight server/client, C Data API integration, and performance optimization techniques.

• YouTube
• 42 minutes
• Self-Paced
• Free Video

Pretend It's a Movie: How to Build Excitement for Your Apache Project

Learn to craft compelling narratives for Apache projects using movie marketing techniques. Develop engaging pitches, taglines, and stories to excite diverse audiences and build thriving open-source communities.

• YouTube
• 20 minutes
• Self-Paced
• Free Video

Community Census: Understanding Users and Maintainer Personas with a Community Survey

Discover how to conduct a community survey to understand user demographics and project health. Learn about maintainer personas and their roles in open source governance.

• YouTube
• 19 minutes
• Self-Paced
• Free Video

Breaking Barriers: A Strategic Framework for Collaborative Governance in Software

Explore a strategic framework for inclusive software governance, breaking barriers to participation and leveraging diverse networks for enhanced collaboration and decision-making.

• YouTube
• 20 minutes
• Self-Paced
• Free Video

Incremental Snapshots and Backups in KVM Plugin for Apache CloudStack

Explore the implementation of incremental snapshots/backups for KVM in Apache CloudStack, enhancing storage efficiency and network performance for cloud environments.

• YouTube
• 14 minutes
• Self-Paced
• Free Video

Four Tricks to Leverage Your Apache Airflow Pipelines

Leverage CSV files, Google Sheets, Airflow Connections, and event-driven techniques to optimize Apache Airflow pipelines and streamline data engineering workflows.

• YouTube
• 19 minutes
• Self-Paced
• Free Video