finding
active
finding:moderate-l0-of-50-150-balances-metrics-lower-l0-helps-interpretability-higher-l0-improves-reconstruction-ravel-tpp-and-absorption

Moderate L0 of 50-150 balances metrics; lower L0 helps interpretability; higher L0 improves reconstruction, RAVEL, TPP and absorption

Task-dependent optimal sparsity.

Source paper

extracted_from
SAEBench: A Comprehensive Benchmark for Sparse Autoencoders in Language Model Interpretability
(2025) · Adam Karvonen · Can Rager · Johnny Lin · Curt Tigges +11

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.