Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore key considerations for choosing cloud tensor processing units (TPUs) and NVidia-powered graphics processing unit (GPU) VMs for high-performance AI inference on Google Cloud. Learn about the strengths of each accelerator for various workloads, including large language models and generative AI. Discover deployment and optimization techniques for inference pipelines using TPUs or GPUs. Understand cost implications and explore strategies for cost optimization. This 37-minute conference talk from Google Cloud Next 2024 features insights from speakers Alexander Spiridonov, Omer Hasan, UÄŸur Arpaci, and Kirat Pandya, providing valuable guidance for deploying AI models at scale with Google Cloud's range of accelerator options.
