Apache Parquet Courses and Certifications

Databricks

Fast Copy-On-Write in Apache Parquet for Data Lakehouse Upserts

Efficient partial copy-on-write technique for Apache Parquet, enabling faster ACID upserts in data lakehouses. Speeds up compliance and change data capture processes by up to 20x compared to existing methods.

• YouTube
• 35 minutes
• On-Demand
• Free Video

The ASF

Anatomy of Reading Apache Parquet Files in Apache Impala

Explore Apache Impala's efficient Parquet file reading process, including data caching, memory management, and parallelism for optimized big data query execution.

• YouTube
• 26 minutes
• On-Demand
• Free Video

StreamNative

Avro, Arrow, Protobuf, Parquet and Why - Data Serialization Formats for Streaming

Explore data serialization formats beyond JSON to optimize streaming performance, manage schemas effectively, and enhance data processing efficiency in modern systems.

• YouTube
• 42 minutes
• On-Demand
• Free Video

The ASF

Optimizing Parquet Storage - Metadata Management, Performance Tuning and Seamless Migration

Discover advanced Parquet optimization techniques including metadata management, performance tuning strategies, and seamless migration approaches for data lakes and warehouses.

• YouTube
• 29 minutes
• On-Demand
• Free Video

EuroPython Conference

Using Pandas and Dask to Work with Large Columnar Datasets in Apache Parquet

Explore efficient techniques for handling large columnar datasets using Pandas and Dask with Apache Parquet, including partitioning, row group skipping, and optimized data layout for faster queries.

• YouTube
• 39 minutes
• On-Demand
• Conference Talk

Data Council

Building InfluxDB 3.0 with Apache Arrow, DataFusion, Flight and Parquet

Explore InfluxDB 3.0's innovative design using Apache Arrow, DataFusion, Flight, and Parquet. Discover how this deconstructed database system enables fast, high-quality data analysis and advanced interoperability.

• YouTube
• 36 minutes
• On-Demand
• Free Video

Data Council

Time Series Analytics with Apache Arrow, Pandas, and Parquet - A 101 Introduction

Explore efficient time-series data handling using Apache Arrow and Parquet. Master open-source technologies for high-performance analytics applications.

• YouTube
• 32 minutes
• On-Demand
• Free Video

The ASF

Innovative Lakehouse Design Atop Apache Iceberg, Apache Arrow and Apache Parquet

Explore innovative lakehouse architecture leveraging Apache Iceberg, Arrow, and Parquet for high-performance data analytics and ecosystem compatibility in cloud environments.

• YouTube
• 48 minutes
• On-Demand
• Free Video

SF Python

Time Series Analytics with Apache Arrow, Pandas and Parquet - A Beginner's Guide

Discover how to build high-performance time series analytics applications using Apache Arrow Flight, Parquet, and Pandas, focusing on efficient data processing and querying techniques for columnar databases.

• YouTube
• 33 minutes
• On-Demand
• Free Video

SNIAVideo

Open Standards for Open Lakehouses - Understanding Apache Iceberg, Parquet, Arrow, and Nessie

Discover how open-source standards like Apache Iceberg and Nessie power data lakehouses, enabling flexible and cost-effective data platforms while minimizing vendor lock-in and data movement challenges.

• YouTube
• 43 minutes
• On-Demand
• Free Video

CMU Database Group

Building InfluxDB 3.0 with the FDAP Stack - Apache Flight, DataFusion, Arrow and Parquet

Dive into the architecture and implementation of InfluxDB 3.0, exploring how Apache Flight, DataFusion, Arrow, and Parquet combine to create a modern time-series database system.

• YouTube
• 1 hour 10 minutes
• On-Demand
• Free Video

Data Lake, Firehose, Glue, Athena, S3 and AWS SDK for .NET

711 ratings at Udemy

Leverage AWS Kinesis Data Firehose, AWS Glue, S3, Athena and the AWS SDK to build a Data Lake.

• Udemy
• 1 hour 55 minutes
• On-Demand
• Paid Course

Databricks

Recent Parquet Improvements in Apache Spark - Vectorized Complex Types and Column Index Support

Explore recent improvements in Apache Spark's Parquet performance, including vectorized read support for complex types and column index support, leading to significant speed enhancements and efficient data processing.

• YouTube
• 37 minutes
• On-Demand
• Free Video

Altinity

Petabyte-Scale Data Analytics with ClickHouse, S3 Storage, and Data Lakes

Master real-time analytics at petabyte scale using ClickHouse with S3 storage and data lakes. Learn design patterns, storage policies, and best practices for high-performance cloud clusters.

• YouTube
• 1 hour 9 minutes
• On-Demand
• Free Video

Data Council

Ten Years of Building Open Source Standards: From Parquet to Arrow to OpenLineage

Explore the journey of building open-source data standards, from Apache Parquet to Arrow to OpenLineage. Gain insights into successful project ideation, growth, and ecosystem impact in data management.

• YouTube
• 35 minutes
• On-Demand
• Free Video