The Fastest Way to Become a Backend Developer Online
Learn AI, Data Science & Business — Earn Certificates That Get You Hired
Overview
Google, IBM & Meta Certificates – 40% Off
One plan covers every Professional Certificate on Coursera.
Unlock All Certificates
Explore a comprehensive lecture on improving neural network reliability under distribution shift, focusing on OpenAI's CLIP model for image-text data learning. Delve into a large-scale experimental study comparing over 200 models and test conditions, highlighting CLIP's exceptional robustness. Discover new methods for reliable model fine-tuning through weight interpolation. Investigate the source of CLIP's robustness, revealing the crucial role of pre-training datasets over language supervision. Gain insights into ongoing efforts to enhance pre-training datasets, including the LAION-5B project and DataComp experiments aimed at increasing dataset-induced robustness.
Syllabus
A data-centric view on reliable generalization: From ImageNet to LAION-5B
Taught by
Simons Institute