paper
referenced-only
2022
paper:2022-takingTaking features out of superposition with sparse autoencoders
Similar preprints — Semantic Scholar
Cited by (2)
- Stochastic Parameter Decomposition
Rank-one subcomponents trained against stochastic ablation masks recover ground-truth mechanisms in toy networks that Attribution-based Parameter Decomposition (APD) could not decompose, while removin
- From Directions to Cones: Exploring Multidimensional Representations of Propositional Facts in LLMs
Propositional truth in LLMs is not encoded as a single linear direction but as a multi-dimensional subspace that can be characterized by concept cones—sets of all nonnegative linear combinations of or