The Linear Algebra of Large Language Models

Explore the mathematical foundations of Large Language Models in this 30-minute conference talk by Yousef Saad at the Centre International de Rencontres Mathématiques in Marseille, France. Delve into the linear algebra concepts underlying these powerful AI systems, gaining insights into their structure and functionality. Recorded during the thematic meeting on "Algèbre linéaire numérique" on September 17, 2024, this presentation offers a deep dive into the mathematical principles driving modern language processing technologies. Access additional features such as chapter markers, keywords, abstracts, and bibliographies through CIRM's Audiovisual Mathematics Library, allowing for targeted viewing and comprehensive understanding of the subject matter.