finding
active
finding:alive-high-cosine-latents-fire-on-single-digit-and-alphabet-tokensAlive high-cosine latents fire on single digit and alphabet tokens
Possible manifold signal.
Source paper
extracted_from(2025) · Michaud, Eric J. · Gorton, Liv · McGrath, Tom
Neighborhood — ranked by edge-count
Papers (1)
paper
Hypotheses (1)
hypothesis
- Latents near digit/alphabet manifolds may have tiled a manifold with one killed to reduce L0supportsSpeculative explanation.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Training artifact.
- Third empirical pattern.
- Inception-v1 SAE shows meaningful fraction of latents with very high nearest-neighbor cosinefinding0.745Fig 8; may be duplication.
- Model diffing identifies a small, interpretable set of latents responsible for emergent misalignment
- Reveals that contrastive search yields a heterogeneous set, not all functioning as true off-topic detectors
- Special tokens have very large magnitude, so their SAE features also have large magnitude and sit far from other pointshypothesis0.725First explanation for isolated features.