hypothesis
active
hypothesis:higher-sparsity-forces-composition-of-multiple-concepts-into-fewer-active-latents-harming-disentanglement

Higher sparsity forces composition of multiple concepts into fewer active latents, harming disentanglement

Explains TPP/RAVEL preferring high L0.

Source paper

extracted_from
SAEBench: A Comprehensive Benchmark for Sparse Autoencoders in Language Model Interpretability
(2025) · Adam Karvonen · Can Rager · Johnny Lin · Curt Tigges +11

Neighborhood — ranked by edge-count