finding
active
finding:at-10-000-tokens-positional-information-is-nearly-nonexistent-for-first-half-of-groups-except-firstAt 10,000 tokens positional information is nearly nonexistent for first half of groups except first
Padding result.
Source paper
extracted_from(2025) · Yoav Gur-Arieh · Mor Geva · Atticus Geiger
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Interpretation of padding results.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Explains hard-to-read dataset patterns.
- Positional mechanism accounts for only ~20% of behavior in middle entity groups for n=20 on gemma-2-2b-itfinding0.757Core result.
- Fig. 19.
- Design choice validated empirically.
- Structure of the computational pathway.
- §5.5.
- Competition.
- Challenges prevailing view.