finding
active
finding:attention-output-and-mtc-checkpointing-accumulate-residual-stream-error-leading-to-attributions-dominated-by-error-nodesAttention-output and MTC checkpointing accumulate residual-stream error, leading to attributions dominated by error nodes
Reason for adopting the third strategy.
Source paper
extracted_fromNeighborhood — ranked by edge-count
Papers (1)
paper
Methods (1)
method
- Third checkpointing strategy; adopted here.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Formal bound showing attention patterns change slowly when residual stream converges, linking fixed points to stage stability
- Interpretive claim about the mechanistic substrate of introspection in LLMs
- Mathematical equivalence enabling independent analysis of each attention head
- The middle layer residual stream features are causally implicated in multi-step reasoning.claim0.765Features for Kobe Bryant, California, Lakers participate in computing the capital answer.
- Core insight.
- Hypothesis based on observed negative cosine similarity between input and output weights of some neurons
- Motivating problem.
- Limitation of single-prompt selection.