claim
active
claim:because-superposition-is-a-phase-there-may-exist-a-regime-for-every-model-with-no-superpositionBecause superposition is a phase, there may exist a regime for every model with no superposition
Cause for hope.
Neighborhood — ranked by edge-count
Papers (1)
paper
- Toy Models of Superpositionmentions
Findings (2)
finding
- Both empirical and theoretical phase diagrams.
- Upper bound on superposition.
Questions (1)
question
- Most pragmatically important question.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Analogy to many ice phases.
- Low-rank matrices W^TW.
- superposition is deeply linked to the ability to identify and enumerate over all features in a modelquote0.792Safety rationale.
- Supported by Table 1.
- Central thesis.
- If we don't give a model enough neurons to implement this solution, how does it do computation in superposition?question0.783Left to future work.
- Main contribution for interpretability.
- Superposition begins with less important features in antipodal pairs, then transitions to other geometriesfinding0.778Toy model sparsity sweep.