method
active
method:adding-mistakes-test

Adding Mistakes test

Insert an LLM-generated mistake into the CoT and resample the rest.

Neighborhood — ranked by edge-count

Frameworks (1)

framework

Findings (1)

finding

Concepts (1)

concept

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Geometrical or functional failures where a decision does not fit harmoniously with the whole; each decision point in a fabricated object is likely a mistake.
  • Question leading to the cost analysis; the answer is around 20,000 mistakes.
  • intention checkingconcept0.729
    Task of checking a model's intentions; found by Lindsey (2026) to peak at ~1/2 depth.
  • Rubric-based thresholded GPT-4o grader scoring responses 1-5 on evil intent; scores 4-5 counted as misaligned
  • Intervention method that adds a learned direction vector to residual stream activations to steer model behavior
  • Reword the CoT beginning to ablate phrasing-encoded information.
  • Replace CoT with ellipsis tokens to test test-time compute.
  • Tests whether an LM adapts its response when an outcome is pre-fixed in context, operationalising Definition 3 of intention.