Masked Self-Attention from Scratch in Python

Masked Self-Attention from Scratch in Python

Yacine Mahdid via YouTube Direct link

- Self-Attention Theory: 0:32

2 of 9

2 of 9

- Self-Attention Theory: 0:32

Class Central Classrooms beta

YouTube videos curated by Class Central.

Classroom Contents

Masked Self-Attention from Scratch in Python

Automatically move to the next video in the Classroom when playback concludes

  1. 1 - Introduction: 0:00
  2. 2 - Self-Attention Theory: 0:32
  3. 3 - Algorithm Recipe: 2:18
  4. 4 - Code Step 1 - Compute QKV: 7:26
  5. 5 - Code Step 2 Compute attention scores: 9:18
  6. 6 - Code Step 3 Applying Mask: 10:10
  7. 7 - Code Step 4 Softmax Calculation: 10:37
  8. 8 - Code Step 5 Computing the Output: 12:50
  9. 9 - Conclusion: 13:27

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.