finding
active
finding:1b-model-batch-gradient-similarity-to-task-reference-is-0-08-0-02-at-injection-steps-300m-is-0-04-0-04

1B model batch-gradient similarity to task reference is 0.08±0.02 at injection steps; 300M is 0.04±0.04

Fig. 9.

Source paper

extracted_from
Why Larger Models Learn More: Effects of Capacity, Interference, and Rare-Task Retention
(2026) · Jing Huang · Daniel Wurgaft · Rachit Bansal · Laura Ruis +5

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.