The ASF Courses

Caching Framework for Exabyte-Scale Data Lakes

Optimize exabyte-scale data lakes with open-source caching framework. Improve performance, reduce costs, and tackle challenges in complex data environments using Hadoop, Parquet, Hudi, and Alluxio.

• YouTube
• 40 minutes
• On-Demand
• Free Video

Snapshots for an Object Store: Challenges and Implementation in Apache Ozone

Explore challenges and design of snapshot feature for object storage systems, focusing on Apache Ozone. Learn about benefits over object versioning and implementation details.

• YouTube
• 41 minutes
• On-Demand
• Free Video

Four Technical Value Drivers of a Data Lakehouse with Iceberg

Explore four key technical value drivers of data lakehouses and how Apache Iceberg enhances these capabilities for data practitioners across various roles.

• YouTube
• 21 minutes
• On-Demand
• Free Video

When Hardware Fails, Ozone Prevails: Self-Healing Capabilities in Apache Ozone

Explore Ozone's self-healing capabilities for managing massive data storage, from single bit flips to complete node failures, ensuring data integrity at every stage.

• YouTube
• 33 minutes
• On-Demand
• Free Video

Kafka Monitoring: What Matters - Key Metrics and Performance Indicators

Explore key metrics for monitoring Kafka at scale, focusing on lag performance. Learn to interpret indicators, create dashboards, and set up proactive alerts for effective troubleshooting.

• YouTube
• 37 minutes
• On-Demand
• Free Video

New Features of Apache NiFi - Tips and Techniques

Explore Apache NiFi's latest features, processors, and best practices. Build efficient data flows using cutting-edge techniques, with tips and guides for optimal implementation.

• YouTube
• 39 minutes
• On-Demand
• Free Video

Real-time AI Made Easy - Harnessing Generative AI Functions in Apache Kafka and Apache Pulsar

Harness Generative AI Functions in Apache Kafka and Pulsar for real-time AI applications. Explore Vector Search, Computing Embeddings, and Chat Completion use cases with a live demonstration.

• YouTube
• 42 minutes
• On-Demand
• Free Video

Efficiently Stream Data into Your Medallion Architecture with Apache Hudi

Explore efficient data streaming into medallion architecture using Apache Hudi. Learn about record-level indexing, fast upserts, and database-style change data capture for optimized incremental processing.

• YouTube
• 42 minutes
• On-Demand
• Free Video

Utilizing Real-Time Transit Data for Travel Optimization

Optimize travel using real-time transit data from NYC's MTA. Learn to process and analyze public data feeds with Apache tools for efficient route planning and decision-making.

• YouTube
• 42 minutes
• On-Demand
• Free Video

Inference at Scale with Apache Beam

Learn to deploy and scale machine learning models efficiently using Apache Beam for distributed inference on CPUs and GPUs, with practical insights on parallelizing workloads.

• YouTube
• 34 minutes
• On-Demand
• Free Video

Demystifying Apache Airflow - Separating Facts from Fiction

Unpack critiques of Apache Airflow, analyze its strengths and weaknesses, debunk myths, and compare with competitors. Make informed decisions about workflow management platforms.

• YouTube
• 36 minutes
• On-Demand
• Free Video

The Free Lunch is Over: Dealing with Unstructured Data in the Era of LLMs

Explore unstructured data processing using ML, LLMs, and Apache tools. Learn to handle audio, images, and text with vector embeddings for natural language analysis in data engineering pipelines.

• YouTube
• 37 minutes
• On-Demand
• Free Video

The Making of an Exabyte-scale Data Lakehouse Using Apache Ozone

Explore the creation of an exabyte-scale Data Lakehouse using Apache Ozone. Learn about integration efforts, scalability benefits, and optimizations for high-performance queries and reduced costs.

• YouTube
• 41 minutes
• On-Demand
• Free Video

Iceberg REST Catalog: Benefits, Migration, and Extensions

Explore Apache Iceberg's REST catalog for unified, secure data access. Learn its benefits, migration process, and extended functionality beyond Spark and Flink. Gain insights for implementing REST catalog in your data infrastructure.

• YouTube
• 39 minutes
• On-Demand
• Free Video

Building a Semantic and Metrics Layer Using Calcite

Explore semantic layers for efficient data management. Learn to define business views, query measures, and optimize performance using Apache Calcite's advanced features.

• YouTube
• 40 minutes
• On-Demand
• Free Video