Reconciling Accuracy, Cost, and Latency of Inference Serving Systems

In this 1 hour 21 minute talk, Professor Pooyan Jamshidi from the AI Institute at UofSC (#AIISC) explores the critical challenge of balancing accuracy, cost, and latency in inference serving systems. Discover how these three competing factors must be reconciled when deploying machine learning models in production environments, and learn about cutting-edge approaches to optimize these trade-offs for more efficient AI systems.