concept
active
concept:sparsity-fidelity-tradeoffSparsity-Fidelity Tradeoff
Traditional proxy evaluation criterion for SAEs.
Neighborhood — ranked by edge-count
Papers (1)
paper
Frameworks (1)
framework
- SAEBenchextendsEvaluation suite of eight metrics across four capabilities.
Concepts (1)
concept
- Sparsity-reconstruction tradeoffrelated_toThe balance between how sparse and how faithful a decomposition is; VPD achieves a better tradeoff than transcoders.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Conclusion.
- Frontier ranking differs from other metrics.
- Motivates multi-metric evaluation.
- Alternative sparsity notion proposed for predictive component.
- Playful and poetic amplification support.
- Known tension in dialogue generation where increasing diversity may reduce response relevancy
- Isotonic R² measuring fraction of variance in self-report explained by probe score under monotonicity assumption; the paper's primary fidelity metric
- Property that features activate on only a small fraction of inputs; enables compressed sensing and is what allows superposition to work