Ablating 26 OTD latents reduces multi-attempt rate by 25% (from 7.4% to 5.5%) in Llama-3.3-70B

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• OTD latent ablation leaves mean first-attempt score unchanged (baseline 26.3, ablation 27.4) in Llama-3.3-70Bfinding0.877
  Evidence that OTDs specifically support meta-cognitive monitoring rather than general response generation
• The 25% reduction in multi-attempt rate from OTD ablation suggests additional mechanisms contribute to ESR beyond the identified latentsclaim0.854
  Acknowledges incompleteness of the causal account, suggesting redundant circuits or nonlinear interactions
• Llama-3.3-70B shows multi-attempt rate of 7.4% vs. ≤1.2% for all other models testedfinding0.835
  Supporting finding showing ESR is driven by both higher multi-attempt rates and comparable improvement rates
• Meta-prompting increases Llama-3.3-70B multi-attempt rate 4.3× (from 7.4% to 31.7%)finding0.819
  Demonstrates ESR can be deliberately enhanced through prompting in the largest model
• Multi-attempt improvement rate peaks at 83% around -1.0σ below threshold in Llama-3.3-70Bfinding0.812
  Shows slightly weaker steering allows more successful corrections, characterizing optimal ESR conditions
• OTD latent activation begins declining before verbal self-correction appears in the output in Llama-3.3-70Bfinding0.796
  Temporal pattern consistent with internal monitoring process preceding explicit self-correction
• Fine-tuning Llama-3.1-8B on self-correction examples increases multi-attempt rate proportionally with training data ratiofinding0.791
  Shows behavioral pattern of self-correction is trainable in smaller models
• Random latent ablation produces slight increase in ESR rate (3.8% to 4.2%), not statistically significantfinding0.786
  Control result confirming OTD ablation effect is specific to those latents, not a general ablation artifact