Language Models are Few-Shot Learners

Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, et al. · 2020

GPT-3. Shows that scale alone unlocks in-context learning — a 175B parameter LM can tackle new tasks from a handful of examples in the prompt.

What you'll get

Outline: a plain-English breakdown of the paper's core idea, prerequisites, and the concepts you'll need to implement it.
Exercises: five to ten hands-on tasks, each with a concept card, a prompt, a starter code stub, and a collapsible reference solution.
Runnable notebook: a single .ipynb you can download and open in Jupyter or VS Code to work through every exercise.
Extensions: suggested follow-up experiments so you don't stop at a faithful reimplementation.