finding
active
finding:at-equal-general-lm-loss-larger-models-achieve-lower-task-loss-when-frequency-is-low-2-4e-7-similar-trajectories-at-higher-frequency

At equal general LM loss, larger models achieve lower task loss when frequency is low (2.4e-7); similar trajectories at higher frequency

Fig. 22.

Source paper

extracted_from
Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention
(2026) · Jing Huang · Daniel Wurgaft · Rachit Bansal · Laura Ruis +5

Neighborhood — ranked by edge-count