finding
active
finding:fuzzy-poetry-induction-head-qk-matches-ea-sound-at-line-end-query-with-newline-after-ee-sound-key-featureFuzzy poetry induction head QK matches '-ea sound at line end' query with 'newline after ee sound' key feature
Fuzziness lives in QK.
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (2)
claim
- Central interpretation of induction case study.
- Interpretation of attributions.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Fuzzy poetry induction head OV circuit is identical to literal induction (newline value to 'say \n' output)finding0.838Copying behavior unchanged.
- Fuzzy induction heads match words across languages, antonyms, structural positions and kinship termsfinding0.763Variety of fuzzy matching found.
- The mechanistic explanation of how induction heads are implemented in two-layer models
- Preliminary conclusion.
- Induction QK circuits combine searching for any name and searching for names of aunts/unclesclaim0.718Interpretation of induction heads.
- Causal validation.
- Early-layer induction heads do literal copying while mid-layer heads do fuzzier inductionfinding0.715Layer-dependent induction on Haiku 3.5.
- Induction performed in the feature basis rather than token space.