Multimodal
2021
INTERMEDIATEFeaturedLearning Transferable Visual Models From Natural Language Supervision
Alec Radford, Jong Wook Kim, Chris Hallacy, et al. · 2021
CLIP. Contrastive pretraining on 400M image-text pairs produces a zero-shot classifier that rivals supervised ImageNet models — a cornerstone of multimodal learning.
What you'll get
- Outline: a plain-English breakdown of the paper's core idea, prerequisites, and the concepts you'll need to implement it.
- Exercises: five to ten hands-on tasks, each with a concept card, a prompt, a starter code stub, and a collapsible reference solution.
- Runnable notebook: a single
.ipynbyou can download and open in Jupyter or VS Code to work through every exercise. - Extensions: suggested follow-up experiments so you don't stop at a faithful reimplementation.