claim
active
claim:if-the-sae-sparsity-budget-k-is-at-most-the-manifold-dimension-support-switching-must-occur-under-low-error

If the SAE sparsity budget K is at most the manifold dimension, support switching must occur under low error.

Proposition 4.2.

Source paper

extracted_from
Priors in Time: Missing Inductive Biases for Language Model Interpretability
(2025) · Lubana, Ekdeep Singh · Rager, Can · Hindupur, Sai Sumedh R. · Costa, Valerie +12

Neighborhood — ranked by edge-count

Concepts (2)

concept
  • Phenomenon where a feature in a small SAE splits into multiple finer features in a larger SAE.
  • Different latent sets activating for nearby points.