Live Online Classes in Design, Coding & AI — Small Classes, Free Retakes
Learn EDR Internals: Research & Development From The Masters
Overview
AI, Data Science & Cloud Certificates from Google, IBM & Meta — 40% Off
One plan covers every Professional Certificate on Coursera. 40% off Coursera Plus Annual.
Unlock All Certificates
Explore the capabilities of TinyLlama, a 1.1B Llama 2 model, in this 13-minute video tutorial. Discover the story behind TinyLlama's development, understand the concept of Chinchilla optimality, and learn about the training process. Follow along to run TinyLlama in Google Colab using the provided notebook link. Get hands-on experience with Jupyter Tiny Llama, including features like chatting with TinyLlama and other Llama models, saving and re-uploading chats. Access additional resources such as TinyLlama's GitHub repository, HuggingFace page, and live training link. Gain insights into the Chinchilla paper and find a Jupyter Lab installation guide. By the end of the video, grasp TinyLlama's capabilities and potential applications in natural language processing tasks.
Syllabus
TinyLlama: A 1.1B Llama 2 model
The story of TinyLlama
What is Chinchilla optimal?
Training TinyLlama
Run TinyLlama in Google Colab
Jupyter Tiny Llama
Recap of TinyLlama's capabilities
Taught by
Trelis Research