concept
active
concept:asymmetric-superposition-motifAsymmetric superposition motif
Computation motif converting positive interference into negative.
Neighborhood — ranked by edge-count
Papers (1)
paper
- Toy Models of Superpositionintroducesmentions
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Phenomenon where models represent more features than dimensions via almost-orthogonal directions.
- The state in which a dialogue agent maintains multiple possible characters simultaneously, refined as the conversation proceeds
- Adversarial example transfer may be predicted by correlated arrangement of features in superpositionhypothesis0.731Speculative.
- Attentional features spread across multiple heads.
- Superposition begins with less important features in antipodal pairs, then transitions to other geometriesfinding0.726Toy model sparsity sweep.
- Low-rank matrices W^TW.
- Mechanistic finding by Bricken et al. 2023 about how LLMs store features; cited as operational justification for pattern-repository assumption
- The more nuanced second metaphor: LLM as simulator maintaining a superposition of possible simulacra across a multiverse of characters