finding
active
finding:at-one-instance-per-batch-2-4e-7-larger-models-reach-lower-task-loss-at-the-same-compute-smaller-models-plateau

At one instance per batch (2.4e-7), larger models reach lower task loss at the same compute; smaller models plateau

Fig. 23.

Source paper

extracted_from
Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention
(2026) · Jing Huang · Daniel Wurgaft · Rachit Bansal · Laura Ruis +5

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.