claim
active
claim:concordance-discordance-heads-use-qk-circuits-to-check-for-concordant-properties-between-query-and-key-featuresConcordance/discordance heads use QK circuits to check for concordant properties between query and key features
Preliminary conclusion.
Source paper
extracted_fromNeighborhood — ranked by edge-count
Papers (1)
paper
Findings (3)
finding
- QK attribution.
- Causal validation.
- Basis-independent corroboration.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Concordance heads (QK circuits) could serve as the consistency-checking circuit for distinguishing intended vs. unintended outputshypothesis0.893Speculated mechanism for prefill detection.
- Heads that detect concordance or discordance of a stated answer with the posed computation.
- Head-level causal evidence.
- Generalization to arithmetic.
- Interpretation of steering asymmetry.
- Asymmetry suggesting more things must go right.
- Speculation that QK circuit 'concordance heads' underlie the ability to distinguish intended from unintended outputs.
- Key decomposition enabling separate analysis of where attention goes and what it does