Databricks Courses

Sound Data Engineering in Rust - From Bits to DataFrames

Explore Rust for efficient data engineering, from low-level bit manipulation to high-performance DataFrames using Apache Arrow. Learn optimization techniques and benchmarks for improved data processing.

• YouTube
• 35 minutes
• Self-Paced
• Free Video

Building a Lakehouse Architecture for Business Data Empowerment

Explore building a data platform using LakeHouse Architecture, focusing on data curation, GDPR compliance, and open-source technologies to empower businesses with reliable, timely, and accessible data.

• YouTube
• 36 minutes
• Self-Paced
• Free Video

How to Make Apache Spark on Kubernetes Run Reliably on Spot Instances

Learn to run Apache Spark on Kubernetes using spot instances for cost savings. Discover best practices, code examples, and techniques to handle spot interruptions while maintaining reliability and performance.

• YouTube
• 33 minutes
• Self-Paced
• Free Video

Unsupervised Machine Learning for Scaling Data Quality Monitoring in Databricks

Explore unsupervised ML algorithms for scalable data quality monitoring in Databricks, covering implementation, strengths, weaknesses, and practical applications for effective data management.

• YouTube
• 37 minutes
• Self-Paced
• Free Video

Low-Code Machine Learning on Databricks with AutoML

Discover how to build, train, and deploy ML models using Databricks AutoML and low-code tools, empowering users of all expertise levels to create predictive analytics solutions.

• YouTube
• 34 minutes
• Self-Paced
• Free Video

Improving Apache Spark Application Processing Time - Configuration and Optimization Techniques

Optimize Spark streaming app performance through configurations, code improvements, and custom data source implementation for processing 700 MB/s of compressed data with strict KPIs.

• YouTube
• 25 minutes
• Self-Paced
• Free Video

Implementing End-to-End Demand Forecasting with Databricks and MLflow

Discover how to implement a scalable demand forecasting solution using Databricks and MLflow, improving retail efficiency and reducing food waste through accurate production and delivery planning.

• YouTube
• 36 minutes
• Self-Paced
• Free Video

Orchestration Made Easy with Databricks Workflows

Discover Databricks Workflows: a managed orchestration service for streamlined data pipelines. Learn to create, run, and monitor reliable workflows, implement recovery actions, and explore new features for efficient data management.

• YouTube
• 35 minutes
• Self-Paced
• Free Video

Administrator Best Practices for Scaling and Securing Databricks Deployments

Optimize Databricks administration for enterprise-scale deployments. Learn best practices, new capabilities, and customer insights for efficient onboarding, security, and workspace management.

• YouTube
• 40 minutes
• Self-Paced
• Free Video

Building a Petabyte-Scale Cybersecurity Data Mesh in Azure with Delta Lake - HSBC Case Study

Explore HSBC's innovative approach to building a petabyte-scale cybersecurity data mesh in Azure, leveraging Delta Lake to address unique challenges and empower analysts with a unified, scalable platform.

• YouTube
• 33 minutes
• Self-Paced
• Free Video

Protecting PII and PHI Data in Data Lakes with Column-Level Encryption

Explore column-level encryption techniques for protecting sensitive data in data lakes, including design, implementation, and key management, with a focus on securing PII/PHI information.

• YouTube
• 33 minutes
• Self-Paced
• Free Video

Apache Spark on Kubernetes - Lessons Learned from Launching Millions of Spark Executors

Lessons learned from running massive Spark workloads on Kubernetes at Apple, covering orchestration, resource management, monitoring, and optimization for scalability and performance.

• YouTube
• 35 minutes
• Self-Paced
• Free Video

Securing Databricks on AWS Using PrivateLink - Deployment and Automation

Learn to secure Databricks on AWS using PrivateLink, covering architecture, setup, and automation. Gain insights on minimizing public internet data transfers for enhanced security and cost-efficiency.

• YouTube
• 31 minutes
• Self-Paced
• Free Video

PySpark in Apache Spark 3.3 and Beyond

Explore PySpark's evolution in Apache Spark 3.3, including improved Pandas API, enhanced productivity features, and future developments. Learn about new functionalities, usability improvements, and performance enhancements.

• YouTube
• 35 minutes
• Self-Paced
• Free Video

Data Lakehouse and Data Mesh - Two Sides of the Same Coin

Explore how Data Lakehouse and Data Mesh complement each other in modern data management, combining technological advancements with organizational strategies for effective analytics.

• YouTube
• 41 minutes
• Self-Paced
• Free Video