Parquet Courses and Certifications

Databricks

The Parquet Format and Performance Optimization Opportunities

Explore Parquet format intricacies, columnar storage basics, and optimization techniques for Spark workloads. Learn about encoding, compression, predicate pushdown, and Delta Lake to enhance analytical performance.

• YouTube
• 41 minutes
• On-Demand
• Free Video

The ASF

Bytedance's Parquet Format Optimization for Cost Reduction and Efficiency

Optimize Parquet file operations for big data efficiency. Learn binary copy techniques to enhance file overwriting, merge small files, and implement column-level TTL, boosting performance 10+ times.

• YouTube
• 23 minutes
• On-Demand
• Free Video

Databricks

Recent Parquet Improvements in Apache Spark - Vectorized Complex Types and Column Index Support

Explore recent improvements in Apache Spark's Parquet performance, including vectorized read support for complex types and column index support, leading to significant speed enhancements and efficient data processing.

• YouTube
• 37 minutes
• On-Demand
• Free Video

Beyond TSDB - Unlocking Prometheus with Parquet for Modern Scale

Discover how Grafana Labs, AWS, and Cloudflare replaced Prometheus TSDB with Apache Parquet to solve high cardinality issues and improve query performance in cloud-native monitoring.

• YouTube
• 29 minutes
• On-Demand
• Free Video

Coursera

Real-time analytics with Spark: User Activity Monitoring

Master real-time data processing with Apache Spark Structured Streaming, from configuring micro-batches to deploying production pipelines for monitoring user activity and extracting actionable insights.

• Coursera
• 1 hour 57 minutes
• On-Demand
• Paid Course

Coursera

Apply Data Lake Transactions & Versioning

Master transactional data lake management with ACID guarantees, versioning, and schema evolution using open-source tools for reliable enterprise-grade data pipelines.

• Coursera
• 1 hour 42 minutes
• On-Demand
• Paid Course

EuroPython Conference

Using Pandas and Dask to Work with Large Columnar Datasets in Apache Parquet

Explore efficient techniques for handling large columnar datasets using Pandas and Dask with Apache Parquet, including partitioning, row group skipping, and optimized data layout for faster queries.

• YouTube
• 39 minutes
• On-Demand
• Conference Talk

PyCon US

Employing NumPy's NPY Format for Faster Than Parquet DataFrame Storage

Explore faster DataFrame storage using NumPy's NPY format, outperforming Parquet in read/write times while supporting all DataFrame characteristics and NumPy dtypes.

• YouTube
• 28 minutes
• On-Demand
• Conference Talk

Data Council

Building InfluxDB 3.0 with Apache Arrow, DataFusion, Flight and Parquet

Explore InfluxDB 3.0's innovative design using Apache Arrow, DataFusion, Flight, and Parquet. Discover how this deconstructed database system enables fast, high-quality data analysis and advanced interoperability.

• YouTube
• 36 minutes
• On-Demand
• Free Video

Data Council

Time Series Analytics with Apache Arrow, Pandas, and Parquet - A 101 Introduction

Explore efficient time-series data handling using Apache Arrow and Parquet. Master open-source technologies for high-performance analytics applications.

• YouTube
• 32 minutes
• On-Demand
• Free Video

Data Council

Ten Years of Building Open Source Standards: From Parquet to Arrow to OpenLineage

Explore the journey of building open-source data standards, from Apache Parquet to Arrow to OpenLineage. Gain insights into successful project ideation, growth, and ecosystem impact in data management.

• YouTube
• 35 minutes
• On-Demand
• Free Video

Beyond Parquet and ORC: Upgrading Data Infrastructure for Multi-modal AI with Lance Columnar Format

Discover Lance, a new columnar format optimized for AI workloads, offering superior performance over Parquet and ORC for vector search, deep learning, and unstructured data analysis in data lakehouses.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Databricks

Fast Copy-On-Write in Apache Parquet for Data Lakehouse Upserts

Efficient partial copy-on-write technique for Apache Parquet, enabling faster ACID upserts in data lakehouses. Speeds up compliance and change data capture processes by up to 20x compared to existing methods.

• YouTube
• 35 minutes
• On-Demand
• Free Video

StreamNative

Avro, Arrow, Protobuf, Parquet and Why - Data Serialization Formats for Streaming

Explore data serialization formats beyond JSON to optimize streaming performance, manage schemas effectively, and enhance data processing efficiency in modern systems.

• YouTube
• 42 minutes
• On-Demand
• Free Video

Centrum Fizyki Teoretycznej PAN

Capturing Nonlocal Correlations in Electronic Systems - Two-Particle Response and Parquet Equations

Explore two-particle response functions and parquet equations for calculating nonlocal electronic correlations in materials, with focus on optical conductivity and vertex corrections.

• YouTube
• 53 minutes
• On-Demand
• Free Video