claim
active
claim:induction-qk-circuits-combine-searching-for-any-name-and-searching-for-names-of-aunts-unclesInduction QK circuits combine searching for any name and searching for names of aunts/uncles
Interpretation of induction heads.
Source paper
extracted_fromNeighborhood — ranked by edge-count
Papers (1)
paper
Findings (2)
finding
- QK attribution of induction-relevant heads.
- Steering validation.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- The bilinear circuit formed by W_E^T W_QK^h W_E that determines which source token a destination token attends to
- The mechanistic explanation of how induction heads are implemented in two-layer models
- Key decomposition enabling separate analysis of where attention goes and what it does
- Preliminary conclusion.
- Fuzziness lives in QK.
- Concordance heads (QK circuits) could serve as the consistency-checking circuit for distinguishing intended vs. unintended outputshypothesis0.717Speculated mechanism for prefill detection.
- Across MCQ, sentiment, dialogue.
- Third of three speculative claims asserting that learned features are not model-specific but represent universal solutions to learning problems