Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Google

How to Use TPUs for Inference

Google via Google Skills

Go to class Write review
DataCamp Ad

PowerBI Data Analyst - Create visualizations and dashboards from scratch

Learn More → Coursera Ad

AI, Data Science & Cloud Certificates from Google, IBM & Meta

Learn More →

Overview

Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
This course is for developers interested in learning how to use TPUs for inference—from architecture to deployment, and how to solve common implementation challenges.

Syllabus

  • An introduction to TPUs
    • Introduction: How to use TPUs for inference
    • What are Cloud TPUs?
    • Google Cloud TPUs architecture
    • Reviewing the core TPU concepts
    • Consumption options
    • Quiz
  • Big decisions, deployment, and performance monitoring
    • Addressing common challenges
    • Use vLLM to increase throughput and reduce latency when serving large AI models
    • vLLM for LLM inference
    • vLLM demo
    • GKE scaling
    • Using profiling to understand your model's inference performance
    • Join our community
    • Quiz
  • Appendix
    • Reading List
  • Your Next Steps
    • Completion

Tags

Reviews

Start your review of How to Use TPUs for Inference

Go to class

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Sign up for free
Someone learning on their laptop while sitting on the floor.