OpenAI CLIP - Connecting Text and Images - Paper Explained
Aleksa Gordić - The AI Epiphany via YouTube
The Private Equity Associate Certification
Learn Generative AI, Prompt Engineering, and LLMs for Free
Overview
Syllabus
OpenAI's CLIP
Detailed explanation of the method
Comparision with SimCLR
How does the zero-shot part work
WIT dataset
Why this method, hint efficiency
Zero-shot - generalizing to new tasks
Prompt programming and ensembling
Zero-shot perf
Few-shot comparison with best baselines
How good the zero-shot classifier is?
Compute error correlation
Quality of CLIP's embedding space
Robustness to distribution shift
Limitations MNIST failure
A short recap
Taught by
Aleksa Gordić - The AI Epiphany