question
active
question:can-a-subset-of-features-optimally-reconstruct-the-mean-of-the-activations-while-the-full-set-of-features-reconstructs-the-per-token-activations

can a subset of features optimally reconstruct the mean of the activations while the full set of features reconstructs the per-token activations?

Motivates nested SAE.

Source paper

extracted_from
Turn-Averaged SAEs for Feature Discovery and Long-Context Attribution
(2026) · Kevin Der · Harish Kamath · Thompson, Ben

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.