finding
active
finding:absorption-scores-worsen-with-dictionary-size-for-all-architectures-except-matryoshka-which-degrades-only-slightly

Absorption scores worsen with dictionary size for all architectures except Matryoshka, which degrades only slightly

Inverse scaling.

Source paper

extracted_from
SAEBench: A Comprehensive Benchmark for Sparse Autoencoders in Language Model Interpretability
(2025) · Adam Karvonen · Can Rager · Johnny Lin · Curt Tigges +11

Neighborhood — ranked by edge-count

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.