Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Google

Scaling Up - Sharding and Parallelism Part 3

Google via YouTube

Overview

Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Learn how to implement complete sharding and parallelism solutions in JAX by exploring the training loop, data loading, checkpointing, and a practical Transformer block example in this 13-minute tutorial from Google's three-part series on scaling machine learning models.

Syllabus

Scaling Up (Part 3)

Taught by

Google Developers

Reviews

Start your review of Scaling Up - Sharding and Parallelism Part 3

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.