Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Agent Sandbox and Pod Snapshots - Supercharging Agents on GKE

Google Cloud Tech via YouTube

Overview

Coursera Spring Sale
40% Off Coursera Plus Annual!
Grab it
Explore the critical infrastructure decisions for deploying AI agents in production through this 41-minute podcast episode featuring Google Cloud experts discussing the technical architecture required for secure, scalable agent deployment. Learn to navigate the serverless versus Kubernetes debate for AI agent runtimes, with specific focus on Google Kubernetes Engine (GKE) capabilities. Discover how to safely execute LLM-generated code without compromising infrastructure security through agent sandboxing techniques using gVisor isolation. Master the implementation of Pod snapshotting technology that dramatically reduces startup latency from seconds to milliseconds, enabling more efficient agent scaling. Follow along with practical demonstrations of deploying Agent Development Kit (ADK) agents on GKE, configuring Kubernetes YAML files, and implementing security measures for code-executing agents. Understand the technical trade-offs between Cloud Run's simplicity and GKE's control for different agent use cases, while exploring advanced features like Pod snapshots that extend beyond sandbox applications to improve overall Kubernetes workload efficiency.

Syllabus

00:00 - Introduction
00:18 - Where does an agent live?
01:03 - Welcome to the Agent Factory
01:17 - Introducing our guest, Brandon Royal
01:49 - Agenda for the episode
02:22 - Why choose GKE for your agent runtime?
04:55 - Agents and models on GKE
06:58 - Agent Development Kit ADK and GKE
07:23 - [Demo] Deploying an ADK agent on GKE
13:58 - Kubernetes YAML configuration
15:20 - Code execution agent and the sandbox challenge
19:18 - Building fences for code executing agents in Kubernetes
20:25 - [Demo] Agent sandbox
27:41 - Addressing latency with Pod snapshotting
29:39 - [Demo] Pod snapshotting
38:10 - Efficiency benefits of Pod snapshotting
39:29 - Pod snapshotting beyond sandboxes
40:31 - Conclusion

Taught by

Google Cloud Tech

Reviews

Start your review of Agent Sandbox and Pod Snapshots - Supercharging Agents on GKE

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.