Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Google

Scaling Up - Sharding and Parallelism Part 3

Google via YouTube

Overview

Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Learn how to implement complete sharding and parallelism solutions in JAX by exploring the training loop, data loading, checkpointing, and a practical Transformer block example in this 13-minute tutorial from Google's three-part series on scaling machine learning models.

Syllabus

Scaling Up (Part 3)

Taught by

Google Developers

Reviews

Start your review of Scaling Up - Sharding and Parallelism Part 3

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.