finding
active
finding:in-the-aunt-mary-sue-prompt-qk-attributions-matrix-has-rank-at-least-2-with-no-strong-cross-termsIn the Aunt Mary Sue prompt, QK attributions matrix has rank at least 2 with no strong cross terms
Parallel independent QK interactions.
Source paper
extracted_fromNeighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Attentional circuits employ many computations and heuristics in parallel, even in simple contextssupportsNew mechanism insight.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Preliminary analyses suggest QK attribution matrices per head and position pair are approximately low-rankfinding0.813Motivates distillation.
- Central claim.
- Writes attention scores/head output as sums of feature interactions; core HeadVis capability.
- Quadratic scaling.
- Table 2; e.g., Identity +1.8 for turn-averaged.
- Quantifies method limitations.
- Feature attribution (gradient-based) correlates 0.8 with ablation effects on the 'John' and 'Kobe' examples.finding0.746Validation of attribution as a fast proxy for causal importance.
- Future work.