Databricks Courses

Operationalizing Apache Spark MLlib Models with SAS Model Manager

Learn to operationalize Apache Spark MLlib models using SAS Model Manager and Workflow Manager. Discover how to automate and govern the entire model lifecycle, from building to monitoring, accelerating deployment while maintaining control.

• YouTube
• 23 minutes
• On-Demand
• Free Video

Benchmarks and How-Tos for Convolutional Neural Networks on HorovodRunner-Enabled Apache Spark Clusters

Explore benchmarks and implementation techniques for distributed deep learning using HorovodRunner on Apache Spark clusters, focusing on CNN tasks and scaling efficiency for both GPU and CPU clusters.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Redash - Open Source SQL Analytics on Data Lakes

Explore open-source SQL analytics on data lakes using Redash. Learn to create dashboards, develop workflows, and connect to Databricks for comprehensive analytics with Managed Delta Lake.

• YouTube
• 23 minutes
• On-Demand
• Free Video

Data Microservices in Apache Spark Using Apache Arrow Flight

Explore efficient machine learning pipelines using Apache Arrow Flight in Spark, enabling faster data transport and simplified microservices for improved ML model production.

• YouTube
• 24 minutes
• On-Demand
• Free Video

Tuning Machine Learning Models - Scaling, Workflows, and Architecture

Automating and scaling ML model tuning using Hyperopt and Apache Spark. Best practices for workflows, architecture, and optimization in hyperparameter tuning for improved performance and accuracy.

• YouTube
• 24 minutes
• On-Demand
• Free Video

Data Science Across Data Sources with Apache Arrow - Accelerating Analytics and Interoperability

Explore Apache Arrow's columnar in-memory data representation for real-time analytics across distributed systems. Learn how it accelerates data processing and enables interoperability between various analytical tools and data sources.

• YouTube
• 37 minutes
• On-Demand
• Free Video

Productionalizing Models through CI/CD Design with MLflow

Explore MLflow integration with CI/CD for streamlined model deployment. Learn to design and implement automated pipelines using the model registry, enhancing efficiency in machine learning workflows.

• YouTube
• 36 minutes
• On-Demand
• Free Video

AutoML Toolkit Deep Dive - Automating Feature Engineering and Model Optimization

Explore Databricks Labs' AutoML Toolkit for automating feature engineering, model selection, tuning, and deployment. Learn to accelerate machine learning workflows and enhance productivity.

• YouTube
• 1 hour
• On-Demand
• Free Video

Apache Spark NLP for Healthcare - Building Real-World AI Systems

Explore real-world healthcare AI systems using NLP, covering patient risk prediction, diagnosis automation, and revenue optimization. Learn key considerations for building domain-specific models and scalable ML pipelines.

• YouTube
• 37 minutes
• On-Demand
• Free Video

Building a Data Platform for Mission-Critical Analytics on AWS with Databricks

Explore building enterprise data lakes on AWS with Databricks, complementing AWS strategy. Learn from HP's success in transforming business through unified data analytics and overcoming data lake challenges.

• YouTube
• 30 minutes
• On-Demand
• Free Video

Delta from a Data Engineer's Perspective - Creating Robust Big Data Solutions

Explore a data engineer's challenges in creating robust Big Data solutions, covering Delta, Spark streaming, schema enforcement, and time travel functionality in data processing.

• YouTube
• 41 minutes
• On-Demand
• Free Video

Running Apache Spark on Kubernetes - Best Practices and Pitfalls

Learn best practices and pitfalls for running Apache Spark on Kubernetes, covering setup, performance optimization, resource management, security, and future developments in this comprehensive overview.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Portable and Scalable Data Visualization Techniques for Apache Spark and Python Notebooks

Explore portable and scalable data visualization techniques for Apache Spark and Python notebooks, covering strategies, packages, headless rendering, animations, and big data integration.

• YouTube
• 27 minutes
• On-Demand
• Free Video

Productionizing Machine Learning with Microservices Architecture

Learn to deploy ML models as microservices using Spark, enabling auto-scaling, versioning, and security. Discover how to aggregate real-time and historical data for inferencing and create actionable insights.

• YouTube
• 35 minutes
• On-Demand
• Free Video

Preventing Common Pitfalls in Production Streaming Jobs

Explore key strategies for optimizing streaming jobs in production, covering input parameters, stateful streaming, output configurations, and job modifications to ensure performance and fault tolerance.

• YouTube
• 54 minutes
• On-Demand
• Free Video