The Celestial Mechanics of Attention Mechanisms
MLOps World: Machine Learning in Production via YouTube
Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore how embeddings and attention mechanisms function in transformer models through an innovative physical analogy comparing them to gravitational forces between celestial objects in space. Learn the fundamental concepts behind these crucial components of modern AI systems as Luis Serrano, Founder and CEO of Serrano Academy and author of "Grokking Machine Learning," breaks down complex transformer architecture using accessible metaphors from physics. Discover how attention mechanisms allow models to focus on relevant parts of input data, similar to how gravitational forces determine the interactions between planets and stars. Gain insights from a speaker with extensive experience at leading tech companies including Cohere, Google, and Apple, who has also worked as a quantum AI research scientist and created educational content for over 175,000 YouTube followers. This 38-minute conference talk from MLOps World is designed to be accessible to all audiences regardless of their machine learning background, making advanced concepts in natural language processing and transformer models understandable through the lens of celestial mechanics.
Syllabus
The Celestial Mechanics of Attention Mechanisms
Taught by
MLOps World: Machine Learning in Production