The ASF Courses

How to Build a Large-Scale API Hub

Explore building a large-scale API hub, covering API management, automated delivery, and lifecycle. Learn to address challenges in distributed organizations and add business value.

• YouTube
• 23 minutes
• Self-Paced
• Free Video

Practical Implementation of Apache Shenyu Microservice Gateway for Billions of Traffic

Implement Apache Shenyu microservice gateway for high-traffic scenarios. Learn gateway concepts, customization, and real-world use cases from an experienced engineer.

• YouTube
• 25 minutes
• Self-Paced
• Free Video

OpenLineage: An Open Standard for Data Lineage

Explore OpenLineage, an open framework for data lineage metadata collection. Learn its purpose, data model, and integration with tools like Apache Airflow and Spark to enhance pipeline understanding and management.

• YouTube
• 40 minutes
• Self-Paced
• Free Video

Integrated Audits: Streamlined Data Observability with Apache Iceberg

Explore streamlined data observability using Apache Iceberg's Integrated Audits pattern for massive-scale data validation and quality assurance.

• YouTube
• 39 minutes
• Self-Paced
• Free Video

Morel: A Data-Parallel Programming Language - Lecture

Explore Morel, a functional programming language with relational extensions, designed for efficient data-parallel processing on various scales. Learn its evolution and capabilities in graph and recursive queries.

• YouTube
• 49 minutes
• Self-Paced
• Free Video

Iceberg's Best Secret: Exploring Metadata Tables

Explore Iceberg's metadata tables to gain insights, optimize queries, and enhance data management. Learn advanced techniques for auditing, quality control, and performance improvement in Apache Iceberg.

• YouTube
• 38 minutes
• Self-Paced
• Free Video

Git for Data Lakes: How LakeFS Scales Data Versioning to Billions of Objects

Learn how lakeFS enables Git-like versioning for data lakes, solving challenges of object storage and scaling to billions of objects without compromising performance. Explore branching, committing, and merging for petabyte-scale data management.

• YouTube
• 43 minutes
• Self-Paced
• Free Video

Elastic Heterogeneous Cluster and Heterogeneity-Aware Job Configuration

Explore Apache Daffodil's internal organization, DFDL schema compiler, and multiple runtime environments. Learn about new features like the VSCode-based data debugger.

• YouTube
• 42 minutes
• Self-Paced
• Free Video

Dive into Avro: Everything a Data Engineer Needs to Know

Explore Apache Avro's key features, best practices, and schema evolution for optimized data serialization in big data systems and event-driven architectures.

• YouTube
• 40 minutes
• Self-Paced
• Free Video

Daffodil: How Functional Programming Leads to Tight C Code at Runtime

Explore how functional programming in Daffodil leads to efficient C code runtime, covering innovations, data conversion, and optimization techniques for space applications.

• YouTube
• 42 minutes
• Self-Paced
• Free Video

Batch and Stream Analysis with TypeScript Using Apache Beam

Explore batch and stream analysis using Beam's Typescript SDK. Learn API choices, usability, and functionality through demos. Discover how to leverage Typescript for efficient data processing workflows.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Apache Arrow and Go: A Match Made in Data

Explore Apache Arrow's Go implementation, covering Arrow and Parquet libraries, Flight server/client, C Data API integration, and performance optimization techniques.

• YouTube
• 42 minutes
• Self-Paced
• Free Video

Pretend It's a Movie: How to Build Excitement for Your Apache Project

Learn to craft compelling narratives for Apache projects using movie marketing techniques. Develop engaging pitches, taglines, and stories to excite diverse audiences and build thriving open-source communities.

• YouTube
• 20 minutes
• Self-Paced
• Free Video

Community Census: Understanding Users and Maintainer Personas with a Community Survey

Discover how to conduct a community survey to understand user demographics and project health. Learn about maintainer personas and their roles in open source governance.

• YouTube
• 19 minutes
• Self-Paced
• Free Video

Breaking Barriers: A Strategic Framework for Collaborative Governance in Software

Explore a strategic framework for inclusive software governance, breaking barriers to participation and leveraging diverse networks for enhanced collaboration and decision-making.

• YouTube
• 20 minutes
• Self-Paced
• Free Video