Databricks Courses

Getting Started with Apache Spark on Kubernetes

Learn to deploy and optimize Apache Spark on Kubernetes with hands-on demos, covering environment setup, application sizing, performance tuning, and monitoring for efficient data pipeline management.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Delta Lake: Optimizing Merge Operations

Explore Delta Lake merge optimization techniques, including inner and full outer joins, partition pruning, and file pruning. Learn tips for handling large merges efficiently.

• YouTube
• 24 minutes
• On-Demand
• Free Video

Building a Cloud Data Lake with Databricks and AWS - Best Practices and Implementation

Explore building a cloud data lake using Databricks and AWS. Learn about data lake architecture, AWS services, Delta Lake for reliability and performance, and best practices for implementation.

• YouTube
• 29 minutes
• On-Demand
• Free Video

DBT Using Databricks and Delta

Learn to leverage Data Build Tool (DBT) with Databricks and Delta for efficient data lake management, including SQL-first approach, upsert capabilities, and Azure integration for enhanced observability.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Stateful Streaming with Apache Spark - Updating Decision Logic at Runtime

Learn how to implement stateful streaming with Spark, focusing on updating decision logic at runtime for real-time offer personalization in loyalty programs like PAYBACK.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Model Experiments Tracking and Registration Using MLflow on Databricks

Automate ML model experimentation and tracking using MLflow on Databricks. Learn to streamline data preparation, model development, and artifact management for efficient machine learning workflows.

• YouTube
• 23 minutes
• On-Demand
• Free Video

ML Production Pipelines: Building and Deploying a Classification Model

Learn to build and deploy production-ready machine learning pipelines using Python, Databricks, and MLflow. Explore training and prediction workflows, model registration, and deployment options for both batch and on-demand processing.

• YouTube
• 27 minutes
• On-Demand
• Free Video

Leveraging Apache Spark and Delta Lake for Efficient Data Encryption at Scale

Efficient data encryption solution for privacy compliance using Apache Spark and Delta Lake. Automates consumer deletion requests, enhances security, and maintains data integrity while ensuring accessibility when needed.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Common Strategies for Improving Performance on Delta Lakehouse

Explore techniques to enhance Delta Lakehouse query performance, including data skipping, optimizing Z-Order, SQL partitions, and Delta Cache. Learn to analyze and tune queries for better results.

• YouTube
• 31 minutes
• On-Demand
• Free Video

Building an MLOps Platform with MLflow for Rapid Model Productionalization

Discover how DataSentics built an MLOps platform around MLflow to streamline model productionalization, reducing deployment time to minutes. Learn about real-life experiences, platform demo, and lessons learned.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Productionizing Real-time Serving with MLflow

Explore production-grade MLflow serving: containerization, custom middlewares, monitoring, logging, and performance optimization for high-scale deployment of machine learning models as REST API endpoints.

• YouTube
• 28 minutes
• On-Demand
• Free Video

MLflow at Company Scale - Scaling and Optimizing for High-Volume Machine Learning

Learn how Criteo scaled MLflow to handle massive data volumes, including horizontal scaling, monitoring, SSO integration, and hadoop cluster integration for data scientists.

• YouTube
• 27 minutes
• On-Demand
• Free Video

Diving into Delta Lake: Understanding the Transaction Log

Explore Delta Lake's transaction log: its structure, functionality, and role in ACID transactions, metadata handling, time travel, and concurrent operations. Gain insights into this core component.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Digital Ethics in Technology and Innovation

Explore key digital ethics principles and real-life examples of ethical solutions in technology. Learn about safety, privacy, transparency, and responsible innovation in uncertain times.

• YouTube
• 20 minutes
• On-Demand
• Free Video

Data Privacy Techniques with Apache Spark - Defensive and Offensive Approaches

Explore data privacy techniques for Apache Spark, including offensive and defensive approaches, k-anonymity, and quasi-identifiers. Learn implementation strategies and how Databricks Delta enhances dataset privacy.

• YouTube
• 27 minutes
• On-Demand
• Free Video