finding
active
finding:same-set-head-attends-from-knicks-to-kidd-but-not-nets-to-kiddSame-set head attends from Knicks to Kidd but not Nets to Kidd
Hint at suppression.
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Supported by geometry and 98% result but not a full account.
Related by similarity (5)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Will a head perform 'the same algorithm' across prompts, or are individual heads polysemantic?question0.689Head polysemanticity.
- Custom sentences with odd one out.
- Are heads mediating the same edge attending for the same reason, suggesting attention head superposition?question0.675Distributed functional units.
- Empirical observation from examining expanded OV/QK matrices; approximately 10 out of 12 heads show significant copying
- Proposition 2, guarding against conflating analogy with identity.