Learn the Skills Netflix, Meta, and Capital One Actually Hire For
The Most Addictive Python and SQL Courses
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore a 21-minute conference talk introducing Delight, a free and cross-platform monitoring dashboard for Apache Spark. Learn how this tool complements the Spark UI by displaying system metrics and Spark information on a unified timeline. Discover how Delight can be installed using an open-source Spark agent and works with any Spark platform. Follow along as the co-founders of Data Mechanics demonstrate real-world performance troubleshooting sessions, showcasing how Delight and Spark UI can jointly identify application bottlenecks. Gain insights into making data engineering pipelines more cost-effective and stable. The talk covers Delight's vision, its functionality, and future developments in Apache Spark monitoring.
Syllabus
Introduction
Delight Data Mechanics
Delight Vision
How Delight Works
Whats Next
Taught by
Databricks