Google, IBM & Meta Certificates — All 10,000+ Courses at 40% Off
One annual plan covers every course and certificate on Coursera. 40% off for a limited time.
Get Full Access
Explore the groundbreaking Reformer model in this informative video, which addresses the resource-intensive nature of the famous Transformer architecture. Learn how the Reformer combines Locality Sensitive Hashing and concepts from Reversible Networks to significantly reduce memory usage and enable processing of much longer input sequences. Discover how this innovative approach allows for handling up to 16K tokens with just 16GB of memory, making it a game-changer for natural language processing tasks. Delve into the technical details of the model's O(LlogL) complexity, reversible residual layers, and their impact on efficiency. Gain insights into the Reformer's performance, which rivals traditional Transformer models while offering substantial improvements in memory efficiency and processing speed for long sequences.
