Learn AI, Data Science & Business — Earn Certificates That Get You Hired
AI Engineer - Learn how to integrate AI into software applications
Overview
Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
This course reviews the original “Attention Is All You Need” paper and implements a complete Transformer from scratch in PyTorch. It covers multi-head attention, Transformer blocks, encoder and decoder components, assembly, and debugging with a small example.
Syllabus
- Introduction
- Paper Review
- Attention Mechanism
- TransformerBlock
- Encoder
- DecoderBlock
- Decoder
- Putting it togethor to form The Transformer
- A Small Example
- Fixing Errors
- Ending
Taught by
Aladdin Persson