hypothesis
active
hypothesis:frequently-repeated-chat-features-e-g-knowledge-cutoff-are-memorized-by-the-sae-and-base-model-causing-isolation

Frequently repeated chat features (e.g. knowledge cutoff) are memorized by the SAE and base model, causing isolation

Second explanation for isolated features.

Source paper

extracted_from
Mapping the Latent Space of Llama 3.3 70B - Goodfire
Thomas McGrath

Neighborhood — ranked by edge-count

Concepts (1)

concept

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.