Databricks Courses

Delivery of Deep Transformer NLP Models Using MLflow and AWS SageMaker for Enterprise AI

Learn to deploy deep transformer NLP models using MLflow and AWS SageMaker for enterprise AI, covering the full machine learning lifecycle and CI/CD pipelines for production-quality implementation.

• YouTube
• 23 minutes
• On-Demand
• Free Video

Cloud-Native Apache Spark Scheduling with YuniKorn on Kubernetes

Explore cloud-native Apache Spark scheduling on Kubernetes using YuniKorn. Learn about efficient resource management, quota handling, and auto-scaling for large-scale Spark jobs in cloud environments.

• YouTube
• 36 minutes
• On-Demand
• Free Video

Building a Pipeline for State-of-the-Art NLP Using Hugging Face Tools

Learn to build state-of-the-art NLP pipelines using Hugging Face tools. Explore tokenization, transformer networks, and various NLP tasks like sentiment analysis and question answering.

• YouTube
• 49 minutes
• On-Demand
• Free Video

Bringing Satellite and Drone Imagery into Data Science Workflows

Explore satellite and drone imagery analysis in data science workflows using RasterFrames, a Spark SQL extension with Python API for processing spatial image data and integrating with ML frameworks.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Scaling Data and ML with Apache Spark and Feast - Feature Engineering for Production

Explore scaling data and ML with Apache Spark and Feast, focusing on feature engineering challenges and solutions for big data-driven machine learning in production environments.

• YouTube
• 38 minutes
• On-Demand
• Free Video

Accelerating Apache Spark Shuffle for Data Analytics on Cloud with Remote Persistent Memory Pools

Innovative solution for accelerating Apache Spark shuffle operations using remote persistent memory pools, improving performance, scalability, and reliability in cloud-based big data analytics.

• YouTube
• 33 minutes
• On-Demand
• Free Video

Geospatial Data Analysis in Apache Spark - Challenges and Solutions

Explore geospatial data challenges in Apache Spark, comparing libraries, and learning best practices for data ingestion, storage, and retrieval using spatial indexing techniques.

• YouTube
• 36 minutes
• On-Demand
• Free Video

Adaptive Query Execution: Speeding Up Spark SQL at Runtime

Explore Spark SQL's Adaptive Query Execution framework, which optimizes query plans at runtime using real-time statistics for improved performance in data processing and analysis.

• YouTube
• 46 minutes
• On-Demand
• Free Video

The Apache Spark File Format Ecosystem - Optimizing Storage for Performance

Explore key file formats in Spark ecosystem: Parquet, ORC, Avro. Learn core concepts, optimization techniques, and how to select the right format for performant data processing and AI/ML workflows.

• YouTube
• 29 minutes
• On-Demand
• Free Video

Generative Hyperloop Design - Managing Massively Scaled Simulations for Demand Modeling

Explore large-scale simulation framework for Hyperloop design, utilizing cloud computing, data pipelines, and machine learning to address key technical and business questions for safe and efficient mass transportation.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Deep Dive into GPU Support in Apache Spark 3.x - Accelerator-Aware Scheduling and RAPIDS Plugin

Explore GPU acceleration in Apache Spark 3.x, covering task scheduling, columnar processing, and the RAPIDS plugin for enhanced ETL, ML, and DL performance without code changes.

• YouTube
• 47 minutes
• On-Demand
• Free Video

Building a Real-Time Feature Store for Machine Learning at iFood

Discover how iFood built a real-time feature store using Databricks and Spark Structured Streaming to process event streams, store data, and develop reliable code for efficient machine learning model predictions.

• YouTube
• 27 minutes
• On-Demand
• Free Video

Automated and Explainable Deep Learning for Clinical Language Understanding

Explore advanced deep learning techniques for clinical NLP, including automated model training, explainable AI, and scalable architectures to extract critical healthcare insights from unstructured medical notes.

• YouTube
• 35 minutes
• On-Demand
• Free Video

Using Apache Spark and Differential Privacy for 2020 Census Data Protection

Explore how Apache Spark and differential privacy protect 2020 Census data, balancing accuracy and confidentiality. Learn about the innovative TopDown Algorithm and custom monitoring systems.

• YouTube
• 29 minutes
• On-Demand
• Free Video

Improving Broadcast Joins in Apache Spark SQL

Discover techniques to enhance broadcast joins in Apache Spark SQL, including executor-side broadcasting and memory optimization, for improved performance in large-scale ETL pipelines and complex data processing tasks.

• YouTube
• 28 minutes
• On-Demand
• Free Video