finding
active
finding:positional-lexical-binding-in-entity-tokens-at-layers-12-19-reflexive-at-layers-6-12Positional/lexical binding in entity tokens at layers 12–19, reflexive at layers 6–12
Fig. 19.
Source paper
extracted_from(2025) · Yoav Gur-Arieh · Mor Geva · Atticus Geiger
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Central thesis.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Lexical signal can be derived locally from query token while reflexive must be retrieved from entity tokenshypothesis0.793Tested with knockout.
- Layer localization.
- Modulation by target position.
- Reflexive signal retrieved from entity tokens.
- Blocking attention to query token in layers 11–16 drops accuracy from 98% to 37%; with next token 8%finding0.763Attention knockout.
- Challenges prevailing view.
- At 10,000 tokens positional information is nearly nonexistent for first half of groups except firstfinding0.757Padding result.
- §D.3.