Databricks Courses

Scaling Security Threat Detection with Apache Spark and Databricks

Explore advanced security threat detection using Apache Spark and Databricks. Learn about innovative solutions for notebook-based testing, self-tuning alerts, automated investigations, and custom SDK development for enhanced cybersecurity.

• YouTube
• 24 minutes
• On-Demand
• Free Video

Pandas UDFs and Python Type Hints in Apache Spark 3.0

Explore redesigned pandas UDFs in Apache Spark 3.0, leveraging Python type hints for clearer, more Pythonic data science workflows and improved static analysis capabilities.

• YouTube
• 22 minutes
• On-Demand
• Free Video

Scalable AutoML for Time Series Forecasting Using Ray

Explore scalable AutoML for time series forecasting using Ray, covering feature generation, model selection, and hyper-parameter tuning. Learn from real-world applications and experiences in various industries.

• YouTube
• 22 minutes
• On-Demand
• Free Video

Accelerating the ML Lifecycle with Enterprise-Grade Feature Stores

Explore enterprise-grade feature store for ML lifecycle acceleration, addressing data engineering challenges, and empowering data scientists to streamline ML application delivery with centralized data management and instant feature serving.

• YouTube
• 29 minutes
• On-Demand
• Free Video

How Adobe Processes 2 Million Records Per Second Using Apache Spark

Explore Adobe's high-performance data processing using Apache Spark, covering optimization techniques, join strategies, structured streaming, skew handling, and integration with Redis for enhanced efficiency.

• YouTube
• 41 minutes
• On-Demand
• Free Video

Accelerating Data Processing in Spark SQL with Pandas UDFs - Optimization Techniques

Learn to optimize Spark SQL data processing using Pandas UDFs. Discover techniques to speed up queries, profile jobs efficiently, and leverage custom UDFs for significant performance gains in large-scale data pipelines.

• YouTube
• 27 minutes
• On-Demand
• Free Video

Productionizing Machine Learning Pipelines with Databricks and Azure ML

Jumpstart ML projects with Databricks and Azure ML. Learn to build, track, and deploy production-ready pipelines using tools like MLflow, TensorFlow, and PyTorch for efficient, reproducible data science workflows.

• YouTube
• 49 minutes
• On-Demand
• Free Video

Azure and Databricks Enabling Personalized Customer Experience at CVS Health

Explore how CVS Health leveraged Azure and Databricks to personalize customer experiences, implement machine learning models, and drive business value through data-driven decision-making and experimentation.

• YouTube
• 34 minutes
• On-Demand
• Free Video

Apache Spark vs Databricks - On-Premise Performance Comparison

Comparison of on-premise Databricks and open-source Spark implementations, showcasing 10x performance gains in cyber workloads and addressing challenges of air-gapped analytics solutions.

• YouTube
• 21 minutes
• On-Demand
• Free Video

Deep Learning for Price Action Prediction Using Databricks and AWS

Explore deep learning techniques to enhance price action prediction using Databricks and AWS. Learn to optimize technical indicators and train models with Amazon SageMaker for improved financial forecasting.

• YouTube
• 36 minutes
• On-Demand
• Free Video

Data Quality Approach for Netflix Personalization Systems

Explore Netflix's approach to data quality for personalization systems, covering automated monitoring, visualization, and regression control methods using Spark-powered infrastructure.

• YouTube
• 28 minutes
• On-Demand
• Free Video

DataSketches: A Production Quality Sketching Library for Big Data Analysis

Explore sketching algorithms for efficient big data analysis, enabling fast approximate answers to complex queries and real-time processing of massive datasets in production environments.

• YouTube
• 29 minutes
• On-Demand
• Free Video

Hyperspace - An Indexing Subsystem for Apache Spark

Explore Hyperspace, an indexing subsystem for Apache Spark that enhances query performance and reduces resource costs. Learn about its design, implementation, and benefits for data analytics on large datasets.

• YouTube
• 32 minutes
• On-Demand
• Free Video

Automating FAA's SWIM Data Ingestion and Analysis with Databricks

Automating FAA's SWIM data ingestion and analysis using cloud-based services, showcasing infrastructure setup, configuration, and insights derived from flight data for improved air transportation management.

• YouTube
• 26 minutes
• On-Demand
• Free Video

The Killer Feature Store - Orchestrating Spark ML Pipelines and MLflow for Production

Explore feature store implementation as an orchestration engine for ML pipeline stages using Spark and MLflow, focusing on deployment management, A/B testing, discovery, and governance.

• YouTube
• 25 minutes
• On-Demand
• Free Video