Nearest Neighbors and Distant Words - Unleashing the Power of ANN in LLMs

Watch a 30-minute conference talk from ElixirConf EU 2024 exploring how to enhance Large Language Model applications through Approximate Nearest Neighbors (ANN) retrieval methods. Learn to move beyond basic LLM implementations by understanding the essential steps of model selection, data gathering, fine-tuning, and embedding techniques. Discover practical insights into integrating ANN with popular models like OpenAI and LLaMA2 to improve response quality while optimizing costs and addressing technical limitations. Follow along with live demonstrations in a Livebook notebook format as speakers Milad Rastian and Mikk Rätsep share their expertise in building more sophisticated LLM applications.