Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

New AI Post-Training - Add RL as Orthogonal Vector to SFT

Discover AI via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore a groundbreaking approach to AI post-training that combines reinforcement learning (RL) with supervised fine-tuning (SFT) as orthogonal vectors. Delve into the research paper "Knowledge is Not Enough: Injecting RL Skills for Continual Adaptation" by researchers from Peking University's Institute for Artificial Intelligence and BIGAI. Learn how this innovative methodology addresses the limitations of traditional knowledge-based training by incorporating RL skills that enable continuous adaptation in AI systems. Discover the theoretical foundations and practical implications of treating RL and SFT as orthogonal components in the training process, and understand how this approach can enhance AI model performance and adaptability. Examine the research findings that demonstrate why knowledge alone is insufficient for optimal AI performance and how reinforcement learning skills can be systematically integrated to create more robust and adaptive AI systems.

Syllabus

New AI Post-Training: Add RL as orthogonal vector to SFT

Taught by

Discover AI

Reviews

Start your review of New AI Post-Training - Add RL as Orthogonal Vector to SFT

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.