question
active
question:how-does-superposition-change-if-features-are-not-independent

How does superposition change if features are not independent?

Open question.

Source paper

extracted_from
Toy Models of Superposition
(2022) ·

Neighborhood — ranked by edge-count

Papers (1)

paper

Concepts (1)

concept
  • Two features stored as exact negatives in one dimension.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.