Multimodal Models Courses and Certifications

MLLMGUARD: A Multi-dimensional Safety Evaluation Suite for Multimodal Large Language Models

Explore MLLMGUARD, a comprehensive safety evaluation framework for assessing potential risks and vulnerabilities in multimodal large language models.

• YouTube
• 26 minutes
• On-Demand
• Free Video

Valence Labs

Multimodal Language Models for Mapping the Genotype-Phenotype Relationship

Explore multimodal language models for mapping genotype-phenotype relationships. Learn about integrated genetics frameworks and their applications in analyzing cellular heterogeneity and gene polyfunctionality.

• YouTube
• 57 minutes
• On-Demand
• Free Video

ChemicalQDevice

High Dimensional and Complex Spectrometric Data Analysis of an Organic Compound Using Large Multimodal Models

Explore advanced spectrometric data analysis using Large Multimodal Models to identify complex organic compounds, focusing on (S)-ibuprofen ethylester as a case study.

• YouTube
• 24 minutes
• On-Demand
• Free Video

ChemicalQDevice

ChemRxiv: Large Multimodal Models for Chemical Research with Document Retrieval

Explore AI's impact on chemical research through spectra and reaction analysis, leveraging Large Multimodal Models for rapid processing and enhanced image-related tasks.

• YouTube
• 27 minutes
• On-Demand
• Free Video

Association for Computing Machinery (ACM)

Self-Improving Teacher Cultivates Better Student: Distillation Calibration for Multimodal Large Language Models - Lecture 3.3

Explore innovative distillation calibration techniques for multimodal large language models, focusing on self-improving teacher methods to enhance student model performance.

• YouTube
• 14 minutes
• On-Demand
• Free Video

Center for Language & Speech Processing(CLSP), JHU

Localization vs. Semantics: Visual Representations in Unimodal and Multimodal Models

Explore visual representations in unimodal and multimodal models, comparing their strengths in label prediction and dense prediction tasks. Gain insights into language's role in visual learning.

• YouTube
• 10 minutes
• On-Demand
• Free Video

Data Council

Building a Data Foundation for Multimodal Foundation Models

Discover the challenges and solutions for building petabyte-scale multimodal feature lakehouses for foundation model training, balancing data quality with quantity while supporting both analytical querying and high-performance feature serving.

• YouTube
• 34 minutes
• On-Demand
• Free Video

Unlocking Insights From Multimodal PDFs Using OpenSearch and Vision-Language Models

Discover how to extract insights from multimodal PDFs using OpenSearch, OCR, ML models, and Vision-Language Models like ColPali for intelligent conversational search applications.

• YouTube
• 33 minutes
• On-Demand
• Free Video

Center for Language & Speech Processing(CLSP), JHU

Introduction to Multimodal Large Language Models II - Day 10 Afternoon

Explore advanced multimodal large language models through hands-on Python exercises, AF2/AF3 implementation, and MMAU-Pro training with expert researchers from UAM and UMD.

• YouTube
• 1 hour 21 minutes
• On-Demand
• Free Video

Center for Language & Speech Processing(CLSP), JHU

Introduction to Multimodal Large Language Models II - Day 10 Afternoon

Explore advanced multimodal large language models through expert slides covering practical implementations and cutting-edge techniques in this JSALT tutorial.

• YouTube
• 1 hour 21 minutes
• On-Demand
• Free Video

Center for Language & Speech Processing(CLSP), JHU

Introduction to Multimodal Large Language Models I - Day 10 Morning

Dive into multimodal large language models, covering LLM basics, transformers, CLIP/CLAP for images/audio, training methods, and audio language model development with practical applications.

• YouTube
• 2 hours 40 minutes
• On-Demand
• Free Video

Center for Language & Speech Processing(CLSP), JHU

Introduction to Multimodal Large Language Models I - Day 10 Morning

Discover how multimodal large language models integrate text, audio, and visual data through expert-led tutorial slides from leading researchers at JSALT 2025.

• YouTube
• 2 hours 40 minutes
• On-Demand
• Free Video

Valence Labs

Towards Multimodal Foundation Models in Molecular Cell Biology

Explore how multimodal foundation models can revolutionize molecular cell biology by integrating diverse omics data for unprecedented cellular characterization and AI-driven insights.

• YouTube
• 1 hour 7 minutes
• On-Demand
• Free Video

AI Institute at UofSC - #AIISC

Developing Explainable Multimodal AI Models on the Life-Cycle of Rare Event Prediction

Gain insights into developing explainable multimodal AI models for rare event prediction through hands-on sessions covering data generation, preprocessing, model development, and evaluation using a new multimodal dataset.

• YouTube
• 1 hour 34 minutes
• On-Demand
• Free Video

Data Science Conference

Large Multimodal Models: From Browsers to Embodied AI

Explore the evolution of large multimodal AI models and their transition from text prediction to real-world applications, emphasizing safety alignment and human-centric design principles for autonomous systems.

• YouTube
• 26 minutes
• On-Demand
• Free Video