claim
active
claim:the-four-heads-span-how-far-the-headvis-workflow-gets-youThe four heads span how far the HeadVis workflow gets you
Summary of case studies.
Neighborhood — ranked by edge-count
Papers (1)
paper
- HeadVis: An Interactive Tool For Investigating Attention Headsmentionssupports
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Configurable scatter plot of heads by metrics to find interesting heads.
- Will a head perform 'the same algorithm' across prompts, or are individual heads polysemantic?question0.704Head polysemanticity.
- Suspected but no confirmed example in real LLM.
- Implies features of rank greater than one.
- Striking mechanistic finding that injection creates universally detectable perturbation in residual stream immediately downstream
- Attention heads whose QK twists count manifolds to detect approaching line end.
- Central theme.
- Mathematical equivalence enabling independent analysis of each attention head