Overview
Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore the revolutionary shift toward small language models in this 26-minute conference talk that examines how compact AI models are transforming the landscape by making advanced capabilities accessible in resource-constrained environments. Learn about the evolution beyond the traditional scaling approach of ever-larger models and discover how on-device language models are reshaping AI accessibility. Dive deep into SmolLM, a series of powerful yet compact large language models, with detailed coverage of data curation strategies and practical implementation approaches. Understand the technical foundations behind small model development and gain insights into leveraging these efficient models for on-device applications across various use cases. The presentation covers the strategic importance of model compression, the challenges of maintaining performance while reducing size, and the practical considerations for deploying small language models in production environments where computational resources are limited.
Syllabus
SmolLM: The Rise of Smol Models
Taught by
MLOps World: Machine Learning in Production