Learn Backend Development Part-Time, Online
Launch a New Career with Certificates from Google, IBM & Microsoft
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore a conference talk from OSDI '23 that introduces Hydro, an innovative surrogate-based hyperparameter tuning service designed for datacenters. Learn about the challenges of hyperparameter tuning for large-scale deep learning models and how Hydro addresses these issues through job-level and cluster-level optimizations. Discover the two key components of Hydro: the Tuner, which generates and optimizes surrogate models, and the Coordinator, which improves tuning efficiency and resource utilization. Gain insights into the experimental results that demonstrate Hydro's ability to significantly reduce tuning makespan without compromising quality. Access the source code and delve into the potential impact of this technology on deep learning model development and datacenter resource management.
Syllabus
OSDI '23 - Hydro: Surrogate-Based Hyperparameter Tuning Service in Datacenters
Taught by
USENIX