finding
active
finding:otd-latent-ablation-leaves-mean-first-attempt-score-unchanged-baseline-26-3-ablation-27-4-in-llama-3-3-70bOTD latent ablation leaves mean first-attempt score unchanged (baseline 26.3, ablation 27.4) in Llama-3.3-70B
Evidence that OTDs specifically support meta-cognitive monitoring rather than general response generation
Source paper
extracted_from(2026) · Alex McKenzie · Keenan Pepper · Stijn Servaes · Martin Leitgab +5
Neighborhood — ranked by edge-count
Claims (1)
claim
- Causal interpretation of the ablation experiment results
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Ablating 26 OTD latents reduces multi-attempt rate by 25% (from 7.4% to 5.5%) in Llama-3.3-70Bfinding0.877Primary causal evidence for dedicated internal consistency-checking circuits
- OTD latent activation begins declining before verbal self-correction appears in the output in Llama-3.3-70Bfinding0.828Temporal pattern consistent with internal monitoring process preceding explicit self-correction
- Acknowledges incompleteness of the causal account, suggesting redundant circuits or nonlinear interactions
- Illustrative finding that ESR mitigates but does not fully eliminate steering influence
- Supporting finding showing ESR is driven by both higher multi-attempt rates and comparable improvement rates
- Multi-attempt improvement rate peaks at 83% around -1.0σ below threshold in Llama-3.3-70Bfinding0.777Shows slightly weaker steering allows more successful corrections, characterizing optimal ESR conditions
- Shows behavioral pattern of self-correction is trainable in smaller models
- Random latent ablation produces slight increase in ESR rate (3.8% to 4.2%), not statistically significantfinding0.767Control result confirming OTD ablation effect is specific to those latents, not a general ablation artifact