finding
active
finding:chinese-feature-s-largest-virtual-weights-cjk-byte-prefixes-are-helpfulChinese feature's largest virtual weights (。, CJK byte prefixes) are helpful
Naive weight magnitude works here.
Source paper
extracted_fromNicholas L. Turner · Jeffrey Wu · Joshua Batson
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Large virtual weights are not inherently misleading but not guaranteed to be helpful or effectivesupportsCaution for practitioners.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Contrast with answer selection.
- Used to project features through QK weights and find aligned features.
- Interpretation.
- Canonical featurization.
- Third empirical pattern.
- Operation component is language-independent.
- Features respond to concepts across languages and in images, not just text.
- Interpretive claim that circuits render raw weights interpretable as algorithmic structures