question
active
question:what-is-it-about-the-data-that-only-a-larger-model-can-learn-such-that-the-smaller-model-cannot-even-after-observing-infinite-data

what is it about the data that only a larger model can learn, such that the smaller model cannot, even after observing infinite data?

Motivating question.

Source paper

extracted_from
Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention
(2026) · Jing Huang · Daniel Wurgaft · Rachit Bansal · Laura Ruis +5

Neighborhood — ranked by edge-count