Serving Voice AI at $1/hr - Open-source, LoRAs, Latency, Load Balancing

Serving Voice AI at $1/hr - Open-source, LoRAs, Latency, Load Balancing

AI Engineer via YouTube Direct link

02:15 Gabber's Mission for Consumer AI

2 of 10

2 of 10

02:15 Gabber's Mission for Consumer AI

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Serving Voice AI at $1/hr - Open-source, LoRAs, Latency, Load Balancing

Automatically move to the next video in the Classroom when playback concludes

  1. 1 00:00 Introduction to Gabber and Real-Time AI
  2. 2 02:15 Gabber's Mission for Consumer AI
  3. 3 04:17 The Orpheus Voice Model
  4. 4 05:43 Challenges in Voice Cloning
  5. 5 07:44 Latency Management and "Head of Line Silence"
  6. 6 11:07 Infrastructure for Batch Inference
  7. 7 11:36 Leveraging vLLM and Dynamic Quantization
  8. 8 13:21 Load Balancing with a Consistent Hash Ring
  9. 9 14:17 System Architecture Overview
  10. 10 15:07 Conclusion and Open Source Shout-outs

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.