Databricks Courses

Data Warehousing on the Lakehouse - Unifying Data, AI, and Analytics

Unify data, AI, and analytics with the lakehouse architecture. Learn success stories, use cases, and best practices for ingesting, storing, and governing data at scale for SQL and BI workloads using Databricks SQL.

• YouTube
• 39 minutes
• Self-Paced
• Free Video

Tech Talk - Top Tuning Tips for Spark 3.0 and Delta Lake on Databricks

Learn top tuning tips for Apache Spark 3.0 and Delta Lake on Databricks. Discover optimal join strategies, machine sizing, merge operation speedups, and job simplification techniques for enhanced big data processing.

• YouTube
• 52 minutes
• Self-Paced
• Free Video

Delta Lake 2.0 Overview - New Features and Community Collaborations

Overview of Delta Lake 2.0 features, integrations, and community collaboration. Highlights include data skipping, Change Data Feed, column mapping, multi-cluster S3 writes, and support for various languages and platforms.

• YouTube
• 38 minutes
• Self-Paced
• Free Video

Gazelle-JNI: Offloading Spark SQL to Native Engines for Execution Acceleration

Explore Gazelle-Jni, a middle layer integrating native SQL engines with Spark SQL for accelerated execution through Substrait-transformed physical plan offloading.

• YouTube
• 41 minutes
• Self-Paced
• Free Video

Democratizing Metrics at Airbnb - Minerva Platform Architecture and Future Plans

Explore Airbnb's Minerva platform for data consistency at scale, architectural improvements for flexibility, and plans for open-sourcing this centralized metrics solution.

• YouTube
• 29 minutes
• Self-Paced
• Free Video

Enable Production ML with Databricks Feature Store

Simplify production ML with Databricks Feature Store. Learn to overcome data challenges, enable real-time inference, and streamline ML projects using a unified data lakehouse platform integrated with Apache Spark and MLflow.

• YouTube
• 33 minutes
• Self-Paced
• Free Video

DataFusion and Apache Arrow: Supercharging Data Analytics with a Rust-Based Query Engine

Explore Rust, Apache Arrow, and DataFusion to accelerate modern data stacks. Learn implementation timelines, optimization techniques, and key features for efficient data analysis and querying.

• YouTube
• 29 minutes
• Self-Paced
• Free Video

Building Recommendation Systems Using Graph Neural Networks

Explore graph neural networks for recommendation systems, focusing on RECKON's encoder-decoder architecture to improve entity intelligence and personalize user experiences.

• YouTube
• 26 minutes
• Self-Paced
• Free Video

Intermittent Demand Forecasting at Scale Using Meta-Modeling - Deep Auto-Regressive Linear Dynamic Systems

Discover Walmart's innovative solution for predicting demand of slow-moving items using meta-modeling, combining linear dynamic systems and deep auto-regressive networks for accurate forecasts across thousands of SKUs and stores.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Databricks and Enterprise Observability with Overwatch - Understanding Cost, Utilization, and Workloads

Explore Overwatch's capabilities for monitoring Databricks platform costs, utilization, and workloads. Learn implementation, use cases, and solutions to common observability challenges.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Elixir for Data Engineering - Batch and Stream Processing

Discover how Elixir can revolutionize data engineering with distributed processing, Airflow integration, and Kafka event handling. Learn practical examples for efficient batch and stream processing.

• YouTube
• 24 minutes
• Self-Paced
• Free Video

Cloud Fetch: High-Bandwidth Connectivity for BI Tools - Databricks

Explore high-bandwidth connectivity for BI tools using Cloud Fetch, a parallel data extraction mechanism that significantly speeds up query result retrieval from Databricks SQL endpoints.

• YouTube
• 20 minutes
• Self-Paced
• Free Video

Recent Parquet Improvements in Apache Spark - Vectorized Complex Types and Column Index Support

Explore recent improvements in Apache Spark's Parquet performance, including vectorized read support for complex types and column index support, leading to significant speed enhancements and efficient data processing.

• YouTube
• 37 minutes
• Self-Paced
• Free Video

An Introduction to Open Source Presto

Explore Presto, a distributed SQL engine for data lake analytics. Learn its features, benefits, and use cases through an introduction and demo on AWS implementation.

• YouTube
• 21 minutes
• Self-Paced
• Free Video

Time Series Forecasting with PyCaret

Explore automated time series forecasting with PyCaret's low-code module. Learn setup, EDA, training, and forecasting techniques to streamline your predictive modeling workflow.

• YouTube
• 24 minutes
• Self-Paced
• Free Video