finding
active
finding:das-finds-a-1-d-subspace-in-first-layer-residual-stream-encoding-global-token-order-with-96-interchange-intervention-successDAS finds a 1-D subspace in first-layer residual stream encoding global token order with 96% interchange intervention success
App. B.4.
Source paper
extracted_from(2026) · Jing Huang · Daniel Wurgaft · Rachit Bansal · Laura Ruis +5
Neighborhood — ranked by edge-count
Papers (1)
paper
Findings (1)
finding
- Fig. 7.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Central claim motivating DAS over prior methods.
- Architectural observation enabling the entire mathematical framework; the residual stream is purely a sum of linear projections
- DAS achieves 100% IIA on hierarchical equality task with |N|=16, intervention size 8, Layer 1finding0.768DAS discovers a perfect alignment between the feed-forward network and the Both Equality Relations high-level model.
- Load-bearing interpretive claim about the layer-specificity of Burger et al.'s finding.
- Top 6 PCs of 150 mean layer-2 residual vectors capture 95% of variance in the character count subspacefinding0.755Low-dimensional manifold.
- Case Study II result showing DAS identifies fewer causally relevant positions than a probe
- The middle layer residual stream features are causally implicated in multi-step reasoning.claim0.753Features for Kobe Bryant, California, Lakers participate in computing the capital answer.
- Source of robustness.