finding
active
finding:positional-efficacy-for-middle-groups-declines-as-n-grows-from-3-to-20Positional efficacy for middle groups declines as n grows from 3 to 20
Figures 14–17.
Source paper
extracted_from(2025) · Yoav Gur-Arieh · Mor Geva · Atticus Geiger
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Challenges prevailing view.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Scale trend.
- Positional mechanism accounts for only ~20% of behavior in middle entity groups for n=20 on gemma-2-2b-itfinding0.777Core result.
- Learned parameters.
- Figure 2.
- Hidden states of middle entity groups become less linearly separable by position as n growsfinding0.741Fig. 22.
- Proposes middle-range entity quality as the criterion for judging the success of a building process
- At 10,000 tokens positional information is nearly nonexistent for first half of groups except firstfinding0.725Padding result.
- Interpretation of padding results.