question
active
question:how-many-features-should-we-expect-to-be-stored-in-superpositionHow many features should we expect to be stored in superposition?
Open question.
Neighborhood — ranked by edge-count
Papers (1)
paper
- Toy Models of Superpositionmentions
Frameworks (1)
framework
- Compressed SensingcitesMathematical framework enabling recovery of high-dimensional sparse vectors from low-dimensional projections; theoretically underpins sparse autoencoder approach
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- superposition is deeply linked to the ability to identify and enumerate over all features in a modelquote0.785Safety rationale.
- Open question.
- Open question.
- Open question.
- Mechanistic finding by Bricken et al. 2023 about how LLMs store features; cited as operational justification for pattern-repository assumption
- Open question.
- Core mechanism statement.
- Analogy to many ice phases.