finding
active
finding:in-one-262k-gemma-scope-sae-10-100-latents-with-cosine-0-97-had-dead-nearest-neighbors

In one 262k Gemma Scope SAE, 10-100 latents with cosine>0.97 had dead nearest neighbors

Training artifact.

Source paper

extracted_from
Understanding sparse autoencoder scaling in the presence of feature manifolds
(2025) · Michaud, Eric J. · Gorton, Liv · McGrath, Tom

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.