finding
active
finding:in-the-aunt-sally-prompt-query-side-aunt-features-interact-with-key-side-name-and-aunt-uncle-name-features-in-haiku-induction-headsIn the Aunt Sally prompt, query-side Aunt features interact with key-side name and aunt/uncle-name features in Haiku induction heads
QK attribution of induction-relevant heads.
Source paper
extracted_fromNeighborhood — ranked by edge-count
Papers (1)
paper
Claims (2)
claim
- Attentional circuits employ many computations and heuristics in parallel, even in simple contextssupportsNew mechanism insight.
- Induction QK circuits combine searching for any name and searching for names of aunts/unclessupportsInterpretation of induction heads.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Steering validation.
- Precursor to induction.
- Steering validation for antonym mechanism.
- Causal validation.
- The mechanistic explanation of how induction heads are implemented in two-layer models
- QK attribution of antonym heads.
- Fuzziness lives in QK.
- QK attribution for MC heads.