Transformer Architecture Courses and Certifications

Alfredo Canziani

Self - Cross, Hard - Soft Attention and the Transformer

Explore attention mechanisms and Transformer architecture, covering self/cross and hard/soft attention, key-value stores, and practical implementation in PyTorch for advanced deep learning applications.

• YouTube
• 1 hour 12 minutes
• Self-Paced
• Free Video

Alfredo Canziani

Attention and the Transformer

Explore self-attention, key-value stores, and transformer architecture in deep learning. Learn to implement attention mechanisms and understand encoder-decoder paradigms for advanced neural network design.

• YouTube
• 1 hour 18 minutes
• Self-Paced
• Free Video

Discover AI

Reversible Transformer - GPU Memory Optimization Using ReFORMER and Reversible Residual Layers

Delve into GPU memory optimization techniques for transformers, exploring reversible residual layers and locality-sensitive hashing to enhance deep neural network efficiency and performance.

• YouTube
• 18 minutes
• Self-Paced
• Free Video

Discover AI

NEW Distributed Neural Graph Architecture for AI

Discover how distributed neural graph architectures can replace traditional transformer layers, combining transformer and mamba blocks for enhanced AI reasoning capabilities.

• YouTube
• 39 minutes
• Self-Paced
• Free Video

Graham Neubig

Attention and Transformers in Advanced NLP - Lecture 4

Explore attention mechanisms, Transformer architecture, and key components like multi-head attention and positional encodings in advanced natural language processing.

• YouTube
• 1 hour 19 minutes
• Self-Paced
• Free Video

AI Bites

Mixture of Transformers for Multi-modal Foundation Models

Explore Meta's Mixture-of-Transformers (MoT) architecture, a revolutionary approach to handling multi-modal AI tasks combining text, speech, images, and videos with enhanced efficiency and performance.

• YouTube
• 16 minutes
• Self-Paced
• Free Video

Valence Labs

Self-Speculative Masked Diffusions

Discover how self-speculative masked diffusions reduce computational burden in discrete data generation by 2x through non-factorized predictions and novel speculative sampling.

• YouTube
• 51 minutes
• Self-Paced
• Free Video

AWS Events

NFL Next Gen Stats - Decoding Defensive Coverage Using Transformer Architectures

Discover how NFL and AWS decode defensive football strategies using advanced transformer architectures and spatio-temporal ML models for real-time coverage analysis.

• YouTube
• 32 minutes
• Self-Paced
• Free Video

Large Language Models (LLMs) Concepts

76 ratings at DataCamp

Discover the full potential of LLMs with our conceptual course covering LLM applications, training methodologies, ethical considerations, and latest research.

• DataCamp
• 2 hours
• Self-Paced
• Free Trial Available

Develop AI-powered applications with Snowflake. Master data management and generative AI to create intelligent solutions in the cloud.

• DataCamp
• 6 hours
• Self-Paced
• Free Trial Available

Transformer Models and BERT Model - 简体中文

本课程向您介绍 Transformer 架构和 Bidirectional Encoder Representations from Transformers (BERT) 模型。您将了解 Transformer 架构的主要组成部分，例如自注意力机制，以及该架构如何用于构建 BERT 模型。您还将了解可以使用 BERT 的不同任务，例如文本分类、问答和自然语言推理。完成本课程估计需要大约 45 分钟。

• Coursera
• 48 minutes
• Self-Paced
• Paid Course

Google DeepMind’s AI Research Foundations curriculum will deepen your understanding of the AI technologies behind language models.

• DataCamp
• 33 hours
• Self-Paced
• Free Trial Available

Google DeepMind: Fine-Tune Your Model

Unleash the power of language models with fine-tuning. In this course, you will learn how to adjust a pre-trained model to a specific task.

• DataCamp
• 8 hours
• Self-Paced
• Free Trial Available

DeepLearning.AI;  Amazon Web Services

Generative AI with Large Language Models

3604 ratings at Coursera

Explore generative AI fundamentals, LLM architecture, and real-world applications. Learn to optimize, fine-tune, and deploy models while addressing challenges and opportunities in this emerging field.

• Coursera
• 16 hours 23 minutes
• Self-Paced
• Paid Course

Transformer Models and BERT Model

125 ratings at Coursera

Explore Transformer architecture and BERT model, learning key components like self-attention and applications in text classification, question answering, and natural language inference.

• Coursera
• 51 minutes
• Self-Paced
• Paid Course