concept
active
concept:unfaithful-chain-of-thoughtUnfaithful Chain-of-Thought
Phenomenon where steering vector intervention causes model's final output to contradict its own explicitly honest reasoning conclusion
Neighborhood — ranked by edge-count
Papers (1)
paper
Findings (3)
finding
- Critical finding showing steering vectors can produce unfaithful CoT where harmful choices are obscured in reasoning
- Action unpredictable from chain of thought.
- List position, not stated fame, drives choice, unseen in CoT.
Concepts (2)
concept
- Chain-of-thought faithfulnessrelated_toWhether written reasoning reflects actual model mechanisms.
- Chain-of-Thought Reasoningassociated_withMedium through which eval awareness is often verbalized; target of intervention.
Quotes (1)
quote
- Model reasoning concluding honest response while actual output is deceptive 'No', exemplifying unfaithful CoT under steering
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- A technique that outputs intermediate reasoning steps, used here to detect verbalized eval awareness.
- Behavior-based explanation that is not fully faithful.
- Cited regarding possibility of encoding misaligned reasoning in benign chains-of-thought
- Technique by which LLMs generate intermediate reasoning steps before final output; used by ChatGPT o3.
- Using multi-step reasoning by generating intermediate thoughts.
- Monitoring reasoning traces for misbehavior.
- Residual refusals after evil-vector transfer originate inside the model's chain-of-thought, not at input or decode level
- Central concept: verbalized reasoning that occurs after the model has already internally settled on an answer, particularly on easier tasks.