Completed
Windowed-Multi-head Self Attention
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Swin Transformer Explained
Automatically move to the next video in the Classroom when playback concludes
- 1 What is the Swin Transformer?
- 2 Historical context to understand why Swin Transformers exist
- 3 Problems with vanilla transformer architectures with images
- 4 Swin Transformer architecuture at a high level
- 5 What is the “Swin Transformer Block”
- 6 Deep dive into the Swin Transformer block architecture
- 7 Windowed-Multi-head Self Attention
- 8 Shifted Window Multi-head self attention
- 9 Patch Merging
- 10 Swin Transformer + Feature Pyramid Network as backbone
- 11 Performance
- 12 Quiz Time
- 13 Summary