finding
active
finding:answer-selection-ov-circuit-always-copies-attended-content-while-qk-matches-content-marked-relevant-to-about-to-produce-matching-contentAnswer selection OV circuit always copies attended content while QK matches 'content marked relevant' to 'about to produce matching content'
Across MCQ, sentiment, dialogue.
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Generalizes beyond multiple choice.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Concordance heads (QK circuits) could serve as the consistency-checking circuit for distinguishing intended vs. unintended outputshypothesis0.770Speculated mechanism for prefill detection.
- Key decomposition enabling separate analysis of where attention goes and what it does
- Third of three speculative claims asserting that learned features are not model-specific but represent universal solutions to learning problems
- Supports monosemantic reading.
- Preliminary conclusion.
- Writes attention scores/head output as sums of feature interactions; core HeadVis capability.
- Reframing observation: the canonical K/Q/V decomposition is computationally convenient but not the most interpretable representation
- Normative vision for how the circuits agenda could resolve the pre-paradigmatic state of interpretability