claim
active
claim:there-is-an-exact-correspondence-between-polytopes-and-strategies-for-superpositionThere is an exact correspondence between polytopes and strategies for superposition
Low-rank matrices W^TW.
Neighborhood — ranked by edge-count
Papers (1)
paper
- Toy Models of Superpositionmentions
Concepts (1)
concept
- Tegum productscitesPolytope construction explaining orthogonal factors in feature geometry.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Supported by Table 1.
- Because superposition is a phase, there may exist a regime for every model with no superpositionclaim0.795Cause for hope.
- Central thesis.
- Correlated feature results.
- superposition is deeply linked to the ability to identify and enumerate over all features in a modelquote0.788Safety rationale.
- Superposition begins with less important features in antipodal pairs, then transitions to other geometriesfinding0.784Toy model sparsity sweep.
- Specific phrases or sequences memorized via binary features in superposition, enabling narrow pattern matching despite few neurons
- Superposition maximalist stance.