Designing Local Generative AI Inference with AWS IoT Greengrass

Explore how to design and operate local Generative AI inference architectures using AWS IoT Greengrass in this conference talk from AWS re:Invent 2025. Discover when and why local execution is preferred over cloud-based inference for certain use cases, and learn practical implementation strategies through a live demonstration featuring a robotic arm. Compare cloud-based versus local inference approaches by examining critical trade-offs including latency considerations, connectivity requirements, and model update frequency challenges. Gain insights into delivering and updating AI models at the edge to ensure reliable, ongoing deployment of Generative AI solutions in real-world environments. Master the technical considerations for implementing edge-based AI inference while maintaining operational efficiency and model performance in distributed IoT systems.