Databricks Courses

Optimizing Geospatial Queries with Dynamic File Pruning in Databricks Delta

Optimize geospatial queries using z-ordering and dynamic file pruning techniques in Databricks Delta, significantly improving query times for petabyte-scale data through specific data generation and SQL query design strategies.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Frequently Bought Together Recommendations Using Embeddings - Challenges and Solutions

Explore embedding-based "frequently bought together" recommendations for e-commerce, covering model training, productionization, metrics, and serving strategies. Learn practical tips for large-scale implementation.

• YouTube
• 22 minutes
• On-Demand
• Free Video

Data Mesh in Practice - Beyond the Data Lake for Fashion E-Commerce

Explore Zalando's journey from centralized Data Lake to distributed Data Mesh architecture, emphasizing data ownership, quality, and accessibility through decentralized domain-focused approach and Data Products concept.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Demystifying Delta Lake - Data Reliability for Data Lakes

Explore Delta Lake's reliability features for data lakes with Apache Spark creator Michael Armbrust. Learn about ACID transactions, metadata handling, and unified data processing.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Implementing a GAN to Remove People from Images - Databricks Lightning Talk

Learn to implement a pix2pix GAN on Databricks for removing people from images, exploring the basics, idea, demo, and analysis of this innovative image editing technique.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Taking Machine Learning to Production with MLflow - New Features and Best Practices

Explore MLflow's latest features for productionizing machine learning, including model management, CI/CD, data schemas, and integration with PyTorch for seamless deployment and operation of ML applications.

• YouTube
• 41 minutes
• On-Demand
• Free Video

SQL Analytics and the Lakehouse Architecture - Data + AI Summit EU 2020 Keynote

Explore lakehouse architecture, Delta Lake, and SQL Analytics for unified data management. Learn how this approach combines data warehouse capabilities with data lake flexibility, enabling faster analytics and decision-making.

• YouTube
• 54 minutes
• On-Demand
• Free Video

How Apache Spark 3.0 and Delta Lake Enhance Data Lake Reliability

Explore Apache Spark 3.0 and Delta Lake's enhancements for data lake reliability, including ACID transactions, schema enforcement, and time travel. Learn about performance improvements and new features in Databricks Runtime 7.0 Beta.

• YouTube
• 58 minutes
• On-Demand
• Free Video

Taking Deep Learning to Production with MLflow and RedisAI

Explore MLflow and RedisAI integration for efficient deep learning model deployment, featuring multi-framework support, auto-batching, and DAGing capabilities in a reliable runtime environment.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Encoding Multi-Layered Vega-Lite COVID-19 Geodata Visualizations with MLflow

Learn to create and manage multi-layered Vega-Lite visualizations for COVID-19 geodata using MLflow, enhancing data communication and lifecycle management for powerful insights.

• YouTube
• 54 minutes
• On-Demand
• Free Video

User Behavior Hashing for Audience Expansion - Deep Learning Approach

Explore deep learning-based hashing for sequential behavior data, utilizing Spark for large-scale preprocessing and distributed inference on Databricks with Pandas UDF.

• YouTube
• 27 minutes
• On-Demand
• Free Video

Fugue: Unifying Big Data Analytics Ecosystems for ETL and Machine Learning

Unifying big data ecosystems with Fugue: SQL-like framework for ETL and ML pipelines, compatible with Spark, TensorFlow, and more. Simplifies development, improves performance, and enhances maintainability.

• YouTube
• 22 minutes
• On-Demand
• Free Video

Understanding and Improving Code Generation in Spark

Explore Spark's code generation techniques, challenges with large queries, and Workday's improvements for handling whole-stage codegen, enhancing performance in production workloads.

• YouTube
• 24 minutes
• On-Demand
• Free Video

Presto on Apache Spark - A Tale of Two Computation Engines

Explore the integration of Presto and Spark, combining low-latency evaluation with robust execution for enhanced SQL experience in both interactive and batch use cases at Facebook scale.

• YouTube
• 25 minutes
• On-Demand
• Free Video

From Idea to Model: Productionizing Data Pipelines with Apache Airflow

Learn to productionize data pipelines using Apache Airflow, bridging data science and engineering. Explore collaborative workflows, custom operators, and scalable solutions for efficient model deployment and iteration.

• YouTube
• 22 minutes
• On-Demand
• Free Video