hypothesis
active
hypothesis:special-tokens-have-very-large-magnitude-so-their-sae-features-also-have-large-magnitude-and-sit-far-from-other-points

Special tokens have very large magnitude, so their SAE features also have large magnitude and sit far from other points

First explanation for isolated features.

Source paper

extracted_from
Mapping the Latent Space of Llama 3.3 70B - Goodfire
Thomas McGrath

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.