From Python to PySpark and Back Again - Unifying Single-Host and Distributed Deep Learning with Maggy
Databricks via YouTube
The Fastest Way to Become a Backend Developer Online
Power BI Fundamentals - Create visualizations and dashboards from scratch
Overview
Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore distributed deep learning with Maggy, an open-source framework that bridges the gap between single-host Python and cluster-scale PySpark programs. Learn how to create reusable training functions that seamlessly transition from laptop development to cluster environments. Discover best practices for writing TensorFlow programs, factoring out dependencies, and implementing popular programming idioms. Experience the power of iterative model development in a single Jupyter notebook, mixing vanilla Python and PySpark-specific code. Gain insights into the benefits of distributed deep learning, including faster training with multiple GPUs, parallel hyperparameter tuning, and ablation studies. Understand how Maggy enables DRY (Don't Repeat Yourself) code principles in training functions, allowing for efficient development across different computing environments. Witness a practical demonstration of Maggy's capabilities and learn how to leverage this framework to streamline your deep learning workflows.
Syllabus
Intro
Model Development
Software Engineering
Transparent Code
Building Blocks
Code
Demonstration
Summary
Taught by
Databricks