finding
active
finding:middle-layer-features-are-more-language-agnostic-claude-3-5-haiku-shows-higher-cross-language-generalization-than-a-smaller-model-especially-for-non-shared-alphabet-pairsMiddle-layer features are more language-agnostic; Claude 3.5 Haiku shows higher cross-language generalization than a smaller model, especially for non-shared-alphabet pairs.
Multilingual features grow with scale.
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (2)
claim
- Multilingual circuits.
- The model translates concepts to a common universal mental language in intermediate activations.supportsDiscussion abstraction.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Decomposition into shared and model-specific features.
- Capabilities.
- Planning in poems.
- Family of count features.
- Features respond to concepts across languages and in images, not just text.
- The middle layer residual stream features are causally implicated in multi-step reasoning.claim0.766Features for Kobe Bryant, California, Lakers participate in computing the capital answer.
- Features smeared across layers cannot be fully disentangled by SAE on a single residual stream.
- Methodological claim about the scientific value of combining causal abstraction with representational geometry analysis