finding
active
finding:correlated-features-prefer-orthogonal-placement-in-separate-tegum-factors-anticorrelated-prefer-negative-interferenceCorrelated features prefer orthogonal placement in separate tegum factors; anticorrelated prefer negative interference
m=2 experiments.
Neighborhood — ranked by edge-count
Papers (1)
paper
- Toy Models of Superpositionmentions
Concepts (1)
concept
- Local almost-orthogonal basessupportsCorrelated features arranged orthogonally within superposition.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Core mechanism statement.
- Suspicion not investigated in depth.
- Same concept and function in both models mostly.
- Feature attribution (gradient-based) correlates 0.8 with ablation effects on the 'John' and 'Kobe' examples.finding0.763Validation of attribution as a fast proxy for causal importance.
- Scale-dependent structural finding from PCA visualizations in §4
- Learning dynamics.
- Trade-off PCA vs superposition.
- Motivates including Head Cor+Anti condition in steering position comparison