Transformers Courses and Certifications

Neural Breakdown with AVB

From Attention to Generative Language Models - Building Transformers from Scratch

Master the fundamentals of Causal Generative Language Models through hands-on Pytorch implementation, covering attention mechanisms, transformers, and neural architectures with practical code examples.

• YouTube
• 47 minutes
• Self-Paced
• Free Video

Neural Breakdown with AVB

Transformers and the End of Inductive Bias in Neural Networks

Discover how Transformer architectures revolutionized deep learning by breaking away from traditional neural network biases, exploring their data-driven approach versus CNNs and RNNs.

• YouTube
• 12 minutes
• Self-Paced
• Free Video

Valence Labs

Transformers Meet Directed Graphs - Exploring Direction-Aware Positional Encodings

Explore direction-aware positional encodings for transformers on directed graphs, enhancing performance in code understanding and sorting network correctness testing.

• YouTube
• 1 hour 15 minutes
• Self-Paced
• Free Video

Yannic Kilcher

Energy-Based Transformers are Scalable Learners and Thinkers - Paper Review

Explore Energy-Based Transformers that enable System 2 thinking through energy minimization, achieving 35% better scaling and 29% improved inference performance across text and vision tasks.

• YouTube
• 48 minutes
• Self-Paced
• Free Video

AI Bites

Transformers² - Self-Adaptive LLMs and SVD Fine-tuning

Discover the groundbreaking Singular Value Fine-tuning (SVF) approach for LLMs, offering superior performance to LoRA through self-adaptive weight modifications and dynamic model adjustments.

• YouTube
• 14 minutes
• Self-Paced
• Free Video

Neural Breakdown with AVB

Byte Latent Transformers - Understanding Meta's BLT Model for Efficient Language Processing

Dive into Meta's Byte Latent Transformers (BLT) architecture, exploring how this innovative approach uses byte-level processing and dynamic compute allocation to enhance language model efficiency and performance.

• YouTube
• 37 minutes
• Self-Paced
• Free Video

Architectures - Transformers - Lecture 8

Discover transformer architecture fundamentals through tokens, attention mechanisms, and positional encoding while exploring connections to MLPs, GNNs, and CNNs in this MIT deep learning lecture.

• YouTube
• 1 hour 15 minutes
• Self-Paced
• Free Video

Deep Learning for Natural Language - Transformers - Lecture 7

Explore Transformers architecture for natural language processing through practical airline travel examples in this MIT deep learning lecture.

• YouTube
• 1 hour 17 minutes
• Self-Paced
• Free Video

Deep Learning for Natural Language - Transformers, Self-Supervised Learning - Lecture 8

Dive into transformers and self-supervised learning techniques for natural language processing in this MIT deep learning lecture.

• YouTube
• 1 hour 17 minutes
• Self-Paced
• Free Video

tinyML

Delta Keyword Transformer: Bringing Transformers to the Edge Through Dynamically Pruned Multi-Head Self-Attention

Explore cutting-edge techniques for optimizing Transformers in edge computing, focusing on the Delta Keyword Transformer and its dynamic pruning approach for efficient multi-head self-attention.

• YouTube
• 21 minutes
• Self-Paced
• Free Video

Data Council

HuggingFace and Ray AIR Integration: A Python Developer's Guide to Scaling Transformers

Scale Hugging Face Transformers beyond a single machine using Ray AI Runtime. Learn to implement end-to-end workflows for advanced ML models, from data ingest to fine-tuning and serving.

• YouTube
• 24 minutes
• Self-Paced
• Free Video

Valerio Velardo - The Sound of AI

Transformers Explained - Part 1: Generative Music AI

Comprehensive exploration of transformer architectures in AI, covering intuition, theory, and mathematical formalization, with focus on their application in music and audio processing.

• YouTube
• 1 hour 13 minutes
• Self-Paced
• Free Video

Valerio Velardo - The Sound of AI

Transformers for Generative Music AI - Part 2: Decoder and Music Generation

Explore transformer architecture for music AI, focusing on decoder components, masked attention, and practical tips for generating music. Dive into future research and neuro-symbolic integration for robust music generation.

• YouTube
• 1 hour 4 minutes
• Self-Paced
• Free Video

Envato Tuts+

Transformers: Introduction and Fundamentals - Day 1

Explore the fundamentals of Transformers, a powerful deep learning architecture revolutionizing natural language processing and beyond.

• YouTube
• 44 minutes
• Self-Paced
• Free Video

Simons Institute

Understanding the Expressive Power of Transformers Through Formal Language Theory

Explore the intersection of formal language theory and machine learning, focusing on transformer expressiveness and recent developments in understanding their learning capabilities.

• YouTube
• 37 minutes
• Self-Paced
• Free Video