claim
active
claim:the-fuzziness-of-fuzzy-induction-lives-entirely-in-qk-ov-copies-like-literal-inductionThe fuzziness of fuzzy induction lives entirely in QK; OV copies like literal induction
Interpretation of attributions.
Neighborhood — ranked by edge-count
Papers (1)
paper
Findings (2)
finding
- Fuzziness lives in QK.
- Copying behavior unchanged.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Central interpretation of induction case study.
- Early-layer induction heads do literal copying while mid-layer heads do fuzzier inductionfinding0.755Layer-dependent induction on Haiku 3.5.
- Quantitative verification that the copying and matching structure predicted by the mechanistic theory is present in all observed induction heads
- Fuzzy induction heads match words across languages, antonyms, structural positions and kinship termsfinding0.742Variety of fuzzy matching found.
- Induction performed in the feature basis rather than token space.
- Key decomposition enabling separate analysis of where attention goes and what it does
- Limitation of existing decompositions.
- Causal validation.