quote
active
quote:for-many-prompts-the-question-of-which-head-s-mediated-an-edge-and-why-those-heads-attended-where-they-did-is-the-crux-of-the-computationfor many prompts, the question of which head(s) mediated an edge, and why those heads attended where they did, is the crux of the computation.
Motivation.
Source paper
extracted_fromNeighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Motivating problem.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Are heads mediating the same edge attending for the same reason, suggesting attention head superposition?question0.803Distributed functional units.
- Key finding of the Bayesian illustrative analysis in Section 7.4.7.
- Will a head perform 'the same algorithm' across prompts, or are individual heads polysemantic?question0.783Head polysemanticity.
- QK attribution for MC heads.
- QK attribution of antonym heads.
- Central theme.
- A pair of query and key subcomponents distributed across attention heads performs syntax-boundary routingfinding0.767VPD recovers an attention algorithm for routing across syntactic boundaries, distributed across heads.
- About chain-of-thought and process safety.