finding
active
finding:binding-information-accumulates-in-last-token-residual-at-layers-16-18-of-gemma-2-2b-itBinding information accumulates in last-token residual at layers 16–18 of gemma-2-2b-it
Layer localization.
Source paper
extracted_from(2025) · Yoav Gur-Arieh · Mor Geva · Atticus Geiger
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Central thesis.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Fig. 19.
- Fig. 10.
- Blocking attention to query token in layers 11–16 drops accuracy from 98% to 37%; with next token 8%finding0.773Attention knockout.
- Long-context generalization.
- Fig. 2a,e.
- Interpretation of probe vs judge gap.
- Structured number feature.
- Structure of the computational pathway.