Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Google

Google DeepMind: 07 Accelerate Your Model

Google via Google Skills

Overview

Build a Learning Habit
Download Class Central's free printable study calendar
Download for Free
Train more powerful models with a single GPU. In this course, you will learn how hardware can speed up model training and the key considerations when training models on a GPU. First, you will learn how to estimate the number of computations and the amount of computer memory required to train large neural networks. You will then discover techniques for reducing the computing and memory requirements when training a model. Techniques which you will apply for fine-tuning a Gemma model with 4 billion parameters. Finally, you will consider the potential environmental impacts of machine learning, with a focus on where questions of energy, water, and e-waste intersect with justice and equity.

Syllabus

  • Introduction
    • Efficiency versus performance
    • Maximize a GPU
    • Learning objectives
    • How to get the most out of this course
    • Lab: Compare Models of Different Sizes
    • The GPU architecture
    • Environmental impacts of LLMs
    • Stakeholder map of environmental impacts
    • Knowledge check 1
  • Compute
    • What happens in the GPU during training and inference?
    • Lab: Estimate Training FLOPs
    • Smart numbers
    • Techniques for reducing computation effort
    • Mapping your carbon footprint
    • Knowledge check 2
  • GPU memory
    • Lab: Hitting a Wall
    • What needs to be stored in the GPU?
    • Lab: Estimate GPU Memory
    • Lab: Fine-Tune a Model with bfloat16
    • Knowledge check 3
  • Other considerations
    • Gradient accumulation
    • Lab: Apply Gradient Accumulation
    • Advanced scaling techniques
    • Knowledge check 4
  • Challenge
    • AI and environmental justice
    • Design a sustainability plan for your LLM project
    • Knowledge check 5
  • Continue your journey
    • Summary
    • Looking forward
    • Additional resources and further reading
    • Glossary
    • Feedback
  • Your Next Steps
    • Claim credential

Reviews

Start your review of Google DeepMind: 07 Accelerate Your Model

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.