Yannic Kilcher Courses

LLaMA- Open and Efficient Foundation Language Models - Paper Explained

2 reviews

Detailed explanation of Meta's LLaMA language models, covering training data, architecture, implementation, and performance. Explores how smaller models can outperform larger ones with optimized training.

• YouTube
• 41 minutes
• On-Demand
• Free Video

Reinforced Self-Training for Language Modeling - Paper Explained

Explores Reinforced Self-Training, a novel approach for improving language models using offline reinforcement learning, offering efficiency advantages over traditional online methods.

• YouTube
• 53 minutes
• On-Demand
• Free Video

Efficient Streaming Language Models with Attention Sinks - Paper Explained

Explore efficient streaming language models using attention sinks, enabling infinite sequence lengths without fine-tuning. Learn about the phenomenon, experimental evidence, and practical applications in AI.

• YouTube
• 32 minutes
• On-Demand
• Free Video

Building a CPU Using GPT for Every Instruction

Explore building a CPU using GPT for every instruction, compiling C code to LLVM-IR. Learn about compilers, virtual machines, and innovative applications of language models in computing.

• YouTube
• 22 minutes
• On-Demand
• Free Video

GPT-4 Solves MIT Exam with 100% Accuracy - OpenLLaMA 13B Released

Análisis crítico de un estudio sobre GPT-4 resolviendo exámenes del MIT, revelando problemas metodológicos y discutiendo las implicaciones para la evaluación de modelos de IA en educación.

• YouTube
• 31 minutes
• On-Demand
• Free Video

DeepFloyd IF - Pixel-Based Text-to-Image Diffusion

Interview with DeepFloyd creators on their open-source text-to-image model IF, discussing its implementation, capabilities, and advancements in pixel-based diffusion technology for AI-generated imagery.

• YouTube
• 54 minutes
• On-Demand
• Free Video

Retentive Network - A Successor to Transformer for Large Language Models

Explores Retentive Network as an alternative to Transformer, offering training parallelism and efficient inference for large language models. Discusses retention mechanism, computation paradigms, and experimental results.

• YouTube
• 28 minutes
• On-Demand
• Free Video

RWKV- Reinventing RNNs for the Transformer Era

Explore RWKV, a novel architecture combining Transformer and RNN strengths. Learn about its linear attention mechanism, scalability, and performance in NLP tasks.

• YouTube
• 1 hour 2 minutes
• On-Demand
• Free Video

Scaling Transformer to 1M Tokens and Beyond with RMT - Paper Explained

Explore the Recurrent Memory Transformer technique for scaling transformers to process 1 million tokens, examining its strengths, weaknesses, and potential impact on long-term dependency handling in NLP tasks.

• YouTube
• 25 minutes
• On-Demand
• Free Video

Tree of Thoughts - Deliberate Problem Solving with Large Language Models

Explores Tree-of-Thoughts prompting, enhancing language models' problem-solving abilities through strategic exploration, evaluation, and backtracking across multiple reasoning paths.

• YouTube
• 29 minutes
• On-Demand
• Free Video

Tree-Ring Watermarks - Fingerprints for Diffusion Images That Are Invisible and Robust

Explores a novel watermarking technique for diffusion models that embeds invisible, robust fingerprints in generated images, discussing its implementation, effects, and potential applications beyond copyright protection.

• YouTube
• 36 minutes
• On-Demand
• Free Video

AI Alignment Livestream - OpenAssistant "Just Chatting"

Explore AI alignment and OpenAssistant in this livestream. Yannic Kilcher discusses key concepts, challenges, and developments in the field of artificial intelligence alignment.

• YouTube
• 55 minutes
• On-Demand
• Free Video

GPT-4 Is Here! What We Know So Far - Full Analysis

Comprehensive analysis of GPT-4's capabilities, improvements, and potential impact on AI technology, based on OpenAI's latest release and research findings.

• YouTube
• 34 minutes
• On-Demand
• Free Video

Open Assistant Inference Backend Development

Hands-on coding session building streaming inference into Hugging Face's text generation server, covering CUDA, Python, Rust, gRPC, WebSockets, and server-sent events for AI development.

• YouTube
• 1 hour 21 minutes
• On-Demand
• Free Video

ChatGPT - This AI Has a Jailbreak! - Unbelievable AI Progress

Explore ChatGPT's capabilities, origins, and potential risks. Learn about its underlying technology, amazing features, and ways to bypass safety mechanisms, while considering OpenAI's vision for the future.

• YouTube
• 32 minutes
• On-Demand
• Free Video