concept
active
concept:concordance-headsConcordance heads
QK circuit heads hypothesized to measure likelihood of an output given prior activations, used in prefill detection.
Neighborhood — ranked by edge-count
Papers (1)
paper
Concepts (1)
concept
- Concordance and discordance headsrelated_toHeads that detect concordance or discordance of a stated answer with the posed computation.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Concordance heads (QK circuits) could serve as the consistency-checking circuit for distinguishing intended vs. unintended outputshypothesis0.745Speculated mechanism for prefill detection.
- Preliminary conclusion.
- Attention heads whose output direction is opposite to the aggregate attention persona vector; hypothesized to maintain coherency
- Generalization to arithmetic.
- Hypothesized heads that invert semantic meaning of features; not confirmed.
- Mechanistic circuits in transformers documented by Olsson et al. 2022, cited as evidence for pattern-repository assumption
- Asymmetry suggesting more things must go right.
- Head-level causal evidence.