Multimodal Models Courses and Certifications

MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Models

Explore MM-SafetyBench, a comprehensive benchmark for evaluating safety aspects of multimodal large language models in just 30 minutes from University of Central Florida researchers.

• YouTube
• 30 minutes
• Self-Paced
• Free Video

MLLMGUARD: A Multi-dimensional Safety Evaluation Suite for Multimodal Large Language Models

Explore MLLMGUARD, a comprehensive safety evaluation framework for assessing potential risks and vulnerabilities in multimodal large language models.

• YouTube
• 26 minutes
• Self-Paced
• Free Video

Association for Computing Machinery (ACM)

Office in the Loop for Building HVAC Control with Multimodal Foundation Models

Discover how multimodal foundation models can optimize HVAC control systems in office buildings, improving energy efficiency and occupant comfort through innovative AI-driven solutions.

• YouTube
• 18 minutes
• Self-Paced
• Free Video

Fields Institute

Financial Risk Contagion Models Using Dynamic Multimodal Graph Learning

Explore advanced graph learning techniques for modeling financial risk contagion, focusing on dynamic multimodal approaches and their applications in quantitative finance.

• YouTube
• 50 minutes
• Self-Paced
• Free Video

Valence Labs

Multimodal Language Models for Mapping the Genotype-Phenotype Relationship

Explore multimodal language models for mapping genotype-phenotype relationships. Learn about integrated genetics frameworks and their applications in analyzing cellular heterogeneity and gene polyfunctionality.

• YouTube
• 57 minutes
• Self-Paced
• Free Video

Data Science Conference

Large Multimodal Models: From Browsers to Embodied AI

Explore the evolution of large multimodal AI models and their transition from text prediction to real-world applications, emphasizing safety alignment and human-centric design principles for autonomous systems.

• YouTube
• 26 minutes
• Self-Paced
• Free Video

Graham Neubig

Evaluation and Multimodal Models in Advanced NLP - Lecture 17

Dive into advanced NLP concepts covering evaluation methods for language models and the integration of multimodal systems, exploring key metrics and techniques for assessing model performance.

• YouTube
• 1 hour 11 minutes
• Self-Paced
• Free Video

Center for Language & Speech Processing(CLSP), JHU

Localization vs. Semantics: Visual Representations in Unimodal and Multimodal Models

Explore visual representations in unimodal and multimodal models, comparing their strengths in label prediction and dense prediction tasks. Gain insights into language's role in visual learning.

• YouTube
• 10 minutes
• Self-Paced
• Free Video

Association for Computing Machinery (ACM)

Self-Improving Teacher Cultivates Better Student: Distillation Calibration for Multimodal Large Language Models - Lecture 3.3

Explore innovative distillation calibration techniques for multimodal large language models, focusing on self-improving teacher methods to enhance student model performance.

• YouTube
• 14 minutes
• Self-Paced
• Free Video

Data Council

Building a Data Foundation for Multimodal Foundation Models

Discover the challenges and solutions for building petabyte-scale multimodal feature lakehouses for foundation model training, balancing data quality with quantity while supporting both analytical querying and high-performance feature serving.

• YouTube
• 34 minutes
• Self-Paced
• Free Video

Center for Language & Speech Processing(CLSP), JHU

Introduction to Multimodal Large Language Models II - Day 10 Afternoon

Explore advanced multimodal large language models through hands-on Python exercises, AF2/AF3 implementation, and MMAU-Pro training with expert researchers from UAM and UMD.

• YouTube
• 1 hour 21 minutes
• Self-Paced
• Free Video

Center for Language & Speech Processing(CLSP), JHU

Introduction to Multimodal Large Language Models II - Day 10 Afternoon

Explore advanced multimodal large language models through expert slides covering practical implementations and cutting-edge techniques in this JSALT tutorial.

• YouTube
• 1 hour 21 minutes
• Self-Paced
• Free Video

Center for Language & Speech Processing(CLSP), JHU

Introduction to Multimodal Large Language Models I - Day 10 Morning

Dive into multimodal large language models, covering LLM basics, transformers, CLIP/CLAP for images/audio, training methods, and audio language model development with practical applications.

• YouTube
• 2 hours 40 minutes
• Self-Paced
• Free Video

Center for Language & Speech Processing(CLSP), JHU

Introduction to Multimodal Large Language Models I - Day 10 Morning

Discover how multimodal large language models integrate text, audio, and visual data through expert-led tutorial slides from leading researchers at JSALT 2025.

• YouTube
• 2 hours 40 minutes
• Self-Paced
• Free Video

UofU Data Science

Multilingual and Multimodal Large Language Models

Explore the fascinating world of multilingual and multimodal Large Language Models, understanding their capabilities, applications, and future potential in AI development.

• YouTube
• 1 hour 15 minutes
• Self-Paced
• Free Video