method
active
method:toy-model-of-manifold-superpositionToy model of manifold superposition
Synthetic benchmark with known ground-truth manifolds.
Neighborhood — ranked by edge-count
Papers (1)
paper
Methods (1)
method
- Scores recovery of each ground-truth factor.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Main contribution for interpretability.
- Unexpected result.
- Prior model of superposition where features are discrete 1D objects repelling each other roughly evenly; paper argues this is incomplete
- Open question.
- Cost of removing superposition.
- Figure 4.
- Phenomenon where models represent more features than dimensions via almost-orthogonal directions.