Databricks Courses

Large Scale Geospatial Indexing and Analysis on Apache Spark

Explore large-scale geospatial indexing and analysis using Apache Spark, covering challenges, frameworks, data structures, and practical applications in cloud-first architecture with Databricks.

• YouTube
• 23 minutes
• On-Demand
• Free Video

KFServing - Model Monitoring with Apache Spark and Feature Store

Explore an open-source platform for scalable model serving and monitoring using KFServing, Hopsworks Feature Store, and Spark Streaming. Learn continuous data drift detection and see a live demonstration.

• YouTube
• 29 minutes
• On-Demand
• Free Video

Funnel Analysis with Apache Spark and Druid for Advertising Campaign Effectiveness

Learn to perform funnel analysis at scale using Apache Spark, Druid, and DataSketches. Discover techniques for measuring campaign effectiveness and analyzing user behavior in chronological order for large-scale advertising campaigns.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Introduction, Principles and Origin of Dagster

Introduction to Dagster: A data orchestrator for the entire application lifecycle. Covers principles, development, deployment, and monitoring. Includes demo and code snippets showcasing Dagit UI and Dagster programming model.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Efficient Distributed Hyperparameter Tuning with Apache Spark

Learn to efficiently distribute hyperparameter tuning workloads using Apache Spark, avoiding common pitfalls and optimizing performance. Explore best practices with Hyperopt and joblib-spark for scaling ML model training.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Democratizing Data Quality Through a Centralized Platform at Zillow

Explore Zillow's centralized platform for data quality, enabling stakeholders to define expectations, perform validations, and monitor data health across complex organizations.

• YouTube
• 54 minutes
• On-Demand
• Free Video

Degrading Performance - Understanding and Solving Small Files Syndrome

Learn how small files impact data pipeline performance, understand cloud storage and Apache Spark interactions, and discover DeltaLake solutions for improved efficiency in handling massive datasets.

• YouTube
• 27 minutes
• On-Demand
• Free Video

Data Discovery at Databricks with Amundsen - Improving Productivity and Trust

Explore how Databricks leverages Amundsen for efficient data discovery, improving productivity by surfacing relevant datasets, SQL dashboards, and metadata programmatically.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Automated Testing for Conversational AI: From Manual to Automated Approaches

Explore automated testing for chatbots and voice assistants, covering key challenges, best practices, and hands-on experience with Botium to ensure AI-powered conversational interfaces perform as intended.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Azure Databricks Security Best Practices for Enterprise Analytics and AI

Explore enterprise-level security practices for Azure Databricks, covering RBAC, network isolation, and Azure-specific features to deploy and manage secure analytics and AI environments.

• YouTube
• 24 minutes
• On-Demand
• Free Video

Automated Metadata Management in Data Lakes - A CI/CD Driven Approach

Discover a CI/CD-driven approach to automated metadata management in data lakes, focusing on balancing development speed, governance, and schema evolution for rapidly growing organizations.

• YouTube
• 28 minutes
• On-Demand
• Free Video

Architect's Open-Source Guide for Data Mesh Architecture

Explore Data Mesh architecture, its principles, benefits, and implementation challenges. Learn about open-source tools like Apache Spark for building effective Data Mesh systems in real-world scenarios.

• YouTube
• 31 minutes
• On-Demand
• Free Video

Advanced SQL for Data Scientists

Master essential SQL skills for data science: statistics, data prep, advanced filtering, window functions, and analytics tool integration.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Turbocharging Spark with Samsung SmartSSD Computational Storage Devices

Discover how Samsung SmartSSD® with Xilinx FPGAs accelerates Spark, offering 2x-8x performance gains without code changes. Learn about the technology, benchmarks, and TCO savings.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Photon: Accelerating SQL Queries on Databricks Lakehouse Platform

Explore Photon, a C++ component for efficient query execution in Databricks Lakehouse. Learn about its vectorized processing, compatibility with Apache Spark, and performance enhancements for data-driven decision-making.

• YouTube
• 30 minutes
• On-Demand
• Free Video