finding
active
finding:activation-patching-of-arithmetic-intermediates-is-effective-at-layers-matching-j-lens-emergenceActivation patching of arithmetic intermediates is effective at layers matching J-lens emergence.
Causal accuracy.
Source paper
extracted_fromAuthors
Neighborhood — ranked by edge-count
Papers (1)
paper
Findings (1)
finding
- Multi-step intermediates.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Substitute activations to observe effects.
- Onset marker.
- Model organism results.
- Imagine instruction raises property name in J-lens while J-orthogonalized property probe stays at baseline.finding0.758J-space privileged.
- Patching an unresolvable pointer at layer ℓ yields no counterfactual answer, but at ℓ+1 yields itfinding0.757Validates reflexive pointer.
- Shows that explicit instructions delay the emergence of truth directions in arithmetic tasks.
- We hypothesize earlier-layer interventions allow more downstream computation to process and potentially correct the perturbationhypothesis0.749Post-hoc explanation for why steering at layer 33 rather than layer 50 produced better ESR behavior in Llama-3.3-70B
- Ignition-like effect.