Completed
The Knowledge Cutoff & Long-Tail Problem
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Memory in LLMs - Weights and Activations
Automatically move to the next video in the Classroom when playback concludes
- 1 The Knowledge Cutoff & Long-Tail Problem
- 2 Three Methods for Knowledge Injection Context, RAG, Weights
- 3 Limitations of "Full Context" Cost & Latency
- 4 The Transformer Bottleneck: Self-Attention Complexity
- 5 Context Rot: Performance degradation in long context
- 6 Q&A: The Return of Federated Learning
- 7 Q&A: Specialized Knowledge Models vs. Karpathy’s "Reasoning Engines"
- 8 Q&A: Temporal Information & Future Research
