Transformer Architecture Courses and Certifications

Coursera

NLP: Fine-Tune & Preprocess Text

Master BERT fine-tuning and spaCy preprocessing pipelines to transform unstructured text into actionable insights for domain-specific NLP applications.

• Coursera
• 1 hour 40 minutes
• Self-Paced
• Paid Course

Coursera Credential

Tokens to Deployment: NLP, Language Models, & Production API

Master the complete NLP lifecycle—from tokenization and transformer pipelines to fine-tuning, multimodal ETL, and deploying secure, production-ready APIs using Hugging Face, PyTorch, and more.

• Coursera
• 4 weeks, 10 hours/week
• Self-Paced
• Paid Course
• 9 courses

Coursera

Career Development for Multimodal Intelligence

Master multimodal AI career positioning by transforming vision, audio, and language expertise into a compelling professional narrative with strategic portfolio and targeted career materials.

• Coursera
• 1 hour 32 minutes
• Self-Paced
• Paid Course

Board Infinity

Generative AI: Fine-Tuning LLMs and Diffusion Models

Master fine-tuning LLMs with LoRA, QLoRA, and Diffusion Models using Hugging Face tools, building controllable image pipelines and a specialist LLM adapter from dataset creation to evaluation.

• Coursera
• 18 hours
• Self-Paced
• Paid Course

Andrej Karpathy

Let's Build GPT - From Scratch, in Code, Spelled Out

Comprehensive tutorial on building a GPT model from scratch, covering key concepts like self-attention, multi-headed attention, and transformer architecture. Includes practical coding examples and insights into modern language models.

• YouTube
• 1 hour 56 minutes
• Self-Paced
• Free Video

Google Cloud Tech

Introduction to Generative AI

Explore the fundamentals of Generative AI, its applications, model types, and usage principles in this concise overview.

• YouTube
• 22 minutes
• Self-Paced
• Free Video

Stanford Seminar - Decision Transformer: Reinforcement Learning via Sequence Modeling

2 ratings

Innovative approach to reinforcement learning using sequence modeling and Transformer architecture, offering simplicity and scalability while matching or exceeding state-of-the-art performance in various tasks.

• YouTube
• 1 hour 21 minutes
• Self-Paced
• Free Video

Serrano.Academy

Transformer Models: Understanding Their Architecture and Functionality - Part 3

Demystifying Transformer models with visuals and examples, covering key concepts like attention mechanism, tokenization, embeddings, and fine-tuning for various NLP tasks.

• YouTube
• 44 minutes
• Self-Paced
• Free Video

Discover AI

Byte Latent Transformer: Token-Free Architecture Using Entropy-Based Byte Prediction

Dive into the innovative Byte Latent Transformer architecture, exploring entropy-based byte prediction, causal local attention mechanisms, and cross-attention for latent patches in tokenizer-free models.

• YouTube
• 38 minutes
• Self-Paced
• Free Video

UofU Data Science

Attention and Transformer Encoder Architecture

Master the inner workings of Transformer encoders and attention mechanisms in deep learning, exploring their architecture, self-attention calculations, and practical applications in modern AI.

• YouTube
• 1 hour 17 minutes
• Self-Paced
• Free Video

Databricks

Pioneering a Hybrid SSM Transformer Architecture - Jamba Foundation Model

Explore AI21 Labs' Jamba: a groundbreaking hybrid Transformer-Mamba MoE model with unparalleled throughput and a 256K context window, revolutionizing large language model development.

• YouTube
• 33 minutes
• Self-Paced
• Free Video

CodeEmporium

Blowing Up Transformer Decoder Architecture

Detailed exploration of Transformer Decoder architecture, covering key components like masked self-attention, cross-attention, and position encoding. Includes implementation insights and training considerations.

• YouTube
• 26 minutes
• Self-Paced
• Free Video

MLOps World: Machine Learning in Production

Vamba - Understanding Hour-Long Videos with Hybrid Mamba-Transformer Architecture

Discover how VAMBA hybrid Mamba-Transformer architecture processes hour-long videos efficiently, achieving 50% memory reduction and 4.6% accuracy improvement over traditional models.

• YouTube
• 29 minutes
• Self-Paced
• Free Video

Data Science Dojo

Transformer Models - Hands-On Workshop on Architecture and Modern Applications

Discover transformer architectures through visual explanations and hands-on coding. Build understanding of embeddings, attention mechanisms, RAG, and AI agents with no ML background needed.

• YouTube
• 3 hours
• Self-Paced
• Free Video

AWS Events

The New AI Architecture That Adapts and Thinks Just Like Humans - Baby Dragon Hatchling Post-Transformer Architecture

Discover Baby Dragon Hatchling architecture that overcomes traditional AI limitations through biologically-inspired networks, enabling continuous adaptation and interpretability.

• YouTube
• 17 minutes
• Self-Paced
• Free Video