claim
active
claim:the-line-width-head-is-polysemantic-implementing-several-unrelated-behaviorsThe line width head is polysemantic, implementing several unrelated behaviors
Author is fairly confident.
Neighborhood — ranked by edge-count
Papers (1)
paper
Findings (2)
finding
- PCA of Q, K, O separates line width head behaviors into distinct clustersassociated_withsupportsConfirms three behaviors.
- Identified from attention patterns in Haiku 3.5.
Claims (1)
claim
- Theoretical point.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Early-layer head counting characters since newline, found polysemantic.
- Prediction for future decomposition.
- Will a head perform 'the same algorithm' across prompts, or are individual heads polysemantic?question0.772Head polysemanticity.
- Constraint not surfaced by attributions.
- A head can implement multiple behaviors via high-rank output without superposition.
- Best guess but not fully convinced; lacks crisp text description to test.
- Central theme.
- Precise characterization of why polysemanticity poses a combinatorial obstacle to circuit analysis