Completed
0:00 Serving Orpheus Text-to-Speech model with continuous batching
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Serve a Text to Speech Model with vLLM
Automatically move to the next video in the Classroom when playback concludes
- 1 0:00 Serving Orpheus Text-to-Speech model with continuous batching
- 2 0:44 Setup Demo with a one-click template from Runpod
- 3 4:12 Running inference on a fine-tuned model poor quality, maybe don’t use fp8, and tune more
- 4 5:25 Inference on the default orpheus model, “tara”
- 5 7:37 How vLLM works with Orpheus and how to decode audio tokens
- 6 12:38 Conclusion and Resources
