finding
active
finding:matryoshka-batch-topk-saes-perform-best-on-5-of-8-metrics-in-the-l0-40-200-range-on-65k-gemma-2-2b-despite-worse-sparsity-fidelity-than-topk-batchtopk

Matryoshka Batch TopK SAEs perform best on 5 of 8 metrics in the L0 40-200 range on 65k Gemma-2-2B despite worse sparsity-fidelity than TopK/BatchTopK

Central result.

Source paper

extracted_from
SAEBench: A Comprehensive Benchmark for Sparse Autoencoders in Language Model Interpretability
(2025) · Adam Karvonen · Can Rager · Johnny Lin · Curt Tigges +11

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.