Completed
Model-Autoscaler at each worker
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
INFaaS - Automated Model-less Inference Serving
Automatically move to the next video in the Classroom when playback concludes
- 1 Intro
- 2 Model Registration
- 3 Diverse application requirements
- 4 Today's Inference serving
- 5 Goals & Requirements
- 6 INFaaS overview
- 7 The model-less abstraction
- 8 Existing systems
- 9 Autoscaling
- 10 Model-Autoscaler at each worker
- 11 Evaluation
- 12 How well does INFaaS scale with load?
- 13 Putting it all together
- 14 Conclusion
