Transformer Architecture Courses and Certifications

Deconstructing the Transformer Architecture

Master the Transformer architecture by building Multi-Head Attention, feed-forward networks, positional encodings, and complete encoder/decoder layers as reusable PyTorch modules from scratch.

• CodeSignal
• 4 hours
• On-Demand
• Free Certificate

Microcredential

Exploring the Transformer Architecture

Master Transformer architecture by building attention mechanisms from scratch, then fine-tune state-of-the-art NLP models using Hugging Face for real-world deployment.

• CodeSignal
• 14 hours
• On-Demand
• Free Certificate
• 4 courses

Evolution of the Transformer Architecture Used in LLMs (2017-2025) - Full Course

Explore the evolution of Transformer architecture in LLMs from 2017-2025, covering positional encoding, attention mechanisms, normalization methods, and activation functions with hands-on examples.

• freeCodeCamp
• 2 hours 50 minutes
• On-Demand
• Free Video

Lennart Svensson

Introduction to Transformer Architecture - Complete Video Series

1 review

Dive into transformer architecture fundamentals through self-attention, encoders, decoders, and applications in NLP tasks like translation and text generation.

• YouTube
• 1 hour 40 minutes
• On-Demand
• Free Video

Donato Capitella

The Transformer Architecture: Understanding Self-Attention and Positional Encoding

Delve into the revolutionary Transformer architecture, exploring self-attention mechanisms, positional encoding, and key components that revolutionized natural language processing and machine learning.

• YouTube
• 15 minutes
• On-Demand
• Free Video

Introduction to LLMs in Python

Learn the nuts and bolts of LLMs and the revolutionary transformer architecture they are based on!

• DataCamp
• 3 hours
• On-Demand
• Free Trial Available

LLM Inference Optimization

1 rating at Udacity

Master advanced techniques to optimize large language model inference performance, including quantization, speculative decoding, and model parallelism for faster deployment.

• Udacity
• 11 hours
• On-Demand
• Paid Course

CodeEmporium

Deep Dive into the Transformer Encoder Architecture

Detailed exploration of transformer encoder architecture, covering embeddings, positional encodings, self-attention mechanisms, and key components for effective natural language processing.

• YouTube
• 21 minutes
• On-Demand
• Free Video

Intro to Large Language Models (LLMs)

3181 ratings at Udemy

Transform Your LLMs Knowledge From an Interested Field Observer to a Well-equipped NLP Developer

• Udemy
• 2 hours 33 minutes
• On-Demand
• Paid Course

Generative AI Language Modeling with Transformers

140 ratings at Coursera

Learn to apply transformer-based models for NLP tasks, covering encoder-decoder architectures, attention mechanisms, and implementations of BERT and GPT models using PyTorch for text classification and translation.

• Coursera
• 9 hours 18 minutes
• On-Demand
• Paid Course

Transformer Models and BERT Model

1 review

Explore Transformer architecture and BERT model, learning key components like self-attention and applications in text classification, question answering, and natural language inference.

• Google Skills
• 30 minutes
• On-Demand
• Free Certificate

Shaping the Future of AI from the History of Transformer Architectures - Stanford CS25

Explore the evolution of Transformer architectures and AI development with OpenAI researcher Hyung Won Chung, focusing on historical motivations and future projections in the field.

• YouTube
• 37 minutes
• On-Demand
• Free Video

Alfredo Canziani

Self - Cross, Hard - Soft Attention and the Transformer

Explore attention mechanisms and Transformer architecture, covering self/cross and hard/soft attention, key-value stores, and practical implementation in PyTorch for advanced deep learning applications.

• YouTube
• 1 hour 12 minutes
• On-Demand
• Free Video

Alfredo Canziani

Attention and the Transformer

Explore self-attention, key-value stores, and transformer architecture in deep learning. Learn to implement attention mechanisms and understand encoder-decoder paradigms for advanced neural network design.

• YouTube
• 1 hour 18 minutes
• On-Demand
• Free Video

Discover AI

NEW Distributed Neural Graph Architecture for AI

Discover how distributed neural graph architectures can replace traditional transformer layers, combining transformer and mamba blocks for enhanced AI reasoning capabilities.

• YouTube
• 39 minutes
• On-Demand
• Free Video