question
active
question:if-a-model-sees-too-many-observations-of-the-same-task-does-it-perhaps-undergo-overfitting-and-does-scaling-help-avoid-this-via-double-descent

if a model sees too many observations of the same task, does it perhaps undergo overfitting, and does scaling help avoid this via double descent?

Future work for frequent tasks.

Source paper

extracted_from
Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention
(2026) · Jing Huang · Daniel Wurgaft · Rachit Bansal · Laura Ruis +5

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.