Learn AI, Data Science & Business — Earn Certificates That Get You Hired
Learn Excel and Financial Modeling the Way Finance Teams Actually Use Them
Overview
Google, IBM & Meta Certificates – 40% Off
One Coursera Plus subscription covers most Professional Certificates on Coursera.
Unlock All Certificates
This course walks through implementing a Transformer decoder from scratch, including its forward pass and core decoder-layer components such as masking, attention, normalization, dropout, and feed-forward activation.
Syllabus
Introduction
Parameters of Transformer
Inputs and Outputs of Transformer
Masking
Instantiating Decoder
Decoder Forward Pass
Decoder Layer
Masked Multi Head Self Attention
Dropout + Layer Normalization
Multi Head Cross Attention
Feed Forward, Activation
Completing the decoder flow
Taught by
CodeEmporium