Make Too Much Knowledge Just Enough - Massive Scale RAG & GraphRAG with Open Source

Explore the challenges and solutions of building large-scale Retrieval Augmented Generation (RAG) and GraphRAG systems in this 34-minute talk from Data Council's 2025 GenAI Applications series. Skyler Thomas, Co-Founder & CTO of Cake AI, shares practical insights from implementing systems that handle hundreds of millions of documents, going beyond basic extract-and-search approaches to address complex orchestration requirements. Learn valuable strategies for scaling to billions of vectors and implementing monitoring for distributed RAG orchestrations using open standards like OpenTelemetry. Whether developing production RAG systems or troubleshooting sophisticated vector workflows, gain essential perspectives on making overwhelming amounts of knowledge manageable and useful through advanced retrieval techniques.