claim
active
claim:the-middle-layer-residual-stream-features-are-causally-implicated-in-multi-step-reasoningThe middle layer residual stream features are causally implicated in multi-step reasoning.
Features for Kobe Bryant, California, Lakers participate in computing the capital answer.
Source paper
extracted_from(2024) ·
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Methodological critique of prior work that fixed a single layer for truth probing.
- Architectural observation enabling the entire mathematical framework; the residual stream is purely a sum of linear projections
- Multilingual features grow with scale.
- Layer choice discussion.
- Reason for adopting the third strategy.
- ΦID analysis of attention-head activations across model families showing synergy concentrated in middle layers.
- Decoder cost dominates.
- Supported by the geometric transition visible in cosine similarity heatmaps for F0-F3.