Scaling AI Model Serving - QoS, Multimodality, and Beyond

Learn how to scale AI model serving systems to handle quality of service requirements, multimodal data processing, and advanced deployment challenges in this comprehensive 78-minute technical lecture from the Centre for Networked Intelligence at IISc, covering essential strategies for building robust, production-ready AI inference systems that can efficiently serve multiple types of models while maintaining performance guarantees and handling complex real-world deployment scenarios.