Databricks Courses

Delight - Improved Apache Spark UI for Performance Troubleshooting

Explore Delight, a free monitoring dashboard for Apache Spark. Learn to troubleshoot and optimize data engineering pipelines using system metrics and Spark information for improved performance and cost-effectiveness.

• YouTube
• 21 minutes
• Self-Paced
• Free Video

Deep Dive into New Features of Apache Spark 3.1

Explore Apache Spark 3.1's new features: ANSI SQL compliance, streaming enhancements, Python improvements, and performance optimizations for faster, easier, and smarter data processing.

• YouTube
• 49 minutes
• Self-Paced
• Free Video

Data Quality Tools Comparison for Continuous Data Imports

Comparison of open-source data quality tools for continuous imports, covering maturity, documentation, extensibility, and features like data profiling and anomaly detection.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Conversational AI with Transformer Models - Building Blocks and Optimization Techniques

Explore building conversational AI agents using transformer models, covering advantages over RNN/LSTM, knowledge distillation, and model compression techniques for efficient production deployment.

• YouTube
• 36 minutes
• Self-Paced
• Free Video

Configuration-Driven Reporting on Large Datasets Using Apache Spark

Configurable enterprise framework for generating and distributing diverse reports from large financial datasets using Apache Spark, with dynamic scheduling and data transformation capabilities.

• YouTube
• 27 minutes
• Self-Paced
• Free Video

Comprehensive View on Intervals in Apache Spark 3.2

Explore Apache Spark 3.2's interval enhancements, including ANSI SQL conformance, new interval types, and improved APIs. Learn to construct, use, and manage intervals effectively in Spark SQL and PySpark.

• YouTube
• 25 minutes
• Self-Paced
• Free Video

Build Real-Time Applications with Databricks Streaming - Fire Department Use Case

Learn to build real-time applications using Databricks Streaming, focusing on a fire department use case. Explore architecture, data sources, and implementation for live tracking of equipment, personnel, and incidents.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Automated Background Removal Using PyTorch - Wehkamp's Image Processing Pipeline

Discover an automated pipeline for efficient background removal in product images using PyTorch and machine learning, enhancing visual experiences for e-commerce customers.

• YouTube
• 23 minutes
• Self-Paced
• Free Video

Wizard Driven AI Anomaly Detection with Databricks in Azure

Explore wizard-driven AI anomaly detection for fraud prevention using Databricks. Learn unsupervised and supervised methods, aggregation frameworks, and human-in-the-loop feedback to improve models over time.

• YouTube
• 23 minutes
• Self-Paced
• Free Video

Scaling AI at H&M - Democratizing and Accelerating AI Usage

H&M's evolving AI platform democratizes and accelerates AI usage across the group, focusing on speed to production, data abstraction, feature store, and pipeline orchestration for efficient model management and development.

• YouTube
• 28 minutes
• Self-Paced
• Free Video

Real-World Evidence and Patient Analytics Using Databricks - A Use Case

Explore real-world health data analytics using Databricks, including insights generation, data security, and advanced use cases. Learn about big data ingestion and cloud-based platform industrialization for life sciences.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

Scaling Privacy in a Spark Ecosystem

Learn strategies for scaling privacy in Spark ecosystems, balancing customer rights with business needs. Explore centralized access control, auditing, and reporting in open data environments.

• YouTube
• 26 minutes
• Self-Paced
• Free Video

The Shift to Data Mesh: Fundamentals and Implementation Strategies

Explore Data Mesh fundamentals and how Avanade helps clients adopt a distributed, domain-led approach to improve data modeling, governance, and incremental transformation for faster performance.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

Migrating ETL Workflows to Apache Spark at Scale - Pinterest's Experience

Explore Pinterest's journey migrating ETL workflows to Apache Spark, covering challenges, solutions, and performance improvements. Learn about semantic gaps, thrift objects, and innovative Spark profiling techniques.

• YouTube
• 25 minutes
• Self-Paced
• Free Video

Managing Millions of Tests Using Databricks - Automated Monitoring and Reporting System

Explore automated test monitoring and reporting for Databricks Runtime using Delta, analyzing results from various sources to track quality and efficiently report failures to owners.

• YouTube
• 25 minutes
• Self-Paced
• Free Video