Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Linux Foundation

Beyond Transformers - Introduction to RWKV Architecture and World Tokenizer

Linux Foundation via YouTube

Overview

Coursera Flash Sale
40% Off Coursera Plus for 3 Months!
Grab it
Explore the future of AI beyond transformers in this conference talk introducing RWKV, a linear transformer architecture with significantly lower inference costs. Discover how this open-source model, developed under the Linux Foundation, offers a lightweight solution capable of running on CPUs and mobile devices. Learn about RWKV's architecture, scalability, and performance, as well as the innovative World Tokenizer designed to address limitations in non-English language processing. Gain insights into how RWKV aims to build a more efficient and inclusive AI model for global use, and understand the potential benefits of the World Tokenizer for all AI models, not just RWKV.

Syllabus

Beyond Transformers - Intro to RWKV Architecture & The World To... Eugene Cheah & Harrison Vanderbyl

Taught by

Linux Foundation

Reviews

Start your review of Beyond Transformers - Introduction to RWKV Architecture and World Tokenizer

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.