concept
active
concept:chain-of-thought-reasoningChain-of-Thought Reasoning
Medium through which eval awareness is often verbalized; target of intervention.
Neighborhood — ranked by edge-count
Papers (1)
paper
Thinkers (1)
thinker
- Jason WeistudiesEmergent abilities of LLMs.
Frameworks (1)
framework
- Paper's proposed RL approach rewarding contemplative qualities in chain-of-thought reasoning
Communities (1)
community
- Neural Steering Methodsmembers_of
Methods (1)
method
- Using language model log probabilities of answer choices (A)/(B) to produce preference labels.
Concepts (7)
concept
- chain-of-thoughtrelated_toA technique that outputs intermediate reasoning steps, used here to detect verbalized eval awareness.
- Factored cognition / chain-of-thoughtrelated_toUsing multi-step reasoning by generating intermediate thoughts.
- Central concept: verbalized reasoning that occurs after the model has already internally settled on an answer, particularly on easier tasks.
- Eval Awarenessassociated_withCentral concept: models' detection and behavioral response to being evaluated.
- Strategic Deceptionassociated_withCentral concept of the paper: deliberate, goal-driven deception where model reasoning contradicts outputs
- Unfaithful Chain-of-Thoughtassociated_withPhenomenon where steering vector intervention causes model's final output to contradict its own explicitly honest reasoning conclusion
- Native reasoning abilityassociated_withThe ability of models to automatically generate reasoning steps during inference without being prompted
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Technique by which LLMs generate intermediate reasoning steps before final output; used by ChatGPT o3.
- Finding from Study 2 showing reasoning models remain vulnerable under both prompting and activation steering
- Chain-of-thought prompting elicits reasoning in large language models (Wei et al., 2022)concept0.850Foundational paper on CoT prompting cited as basis for reasoning LLM training
- A prompting technique that elicits intermediate reasoning steps before final answer inference in language models.
- Cited regarding possibility of encoding misaligned reasoning in benign chains-of-thought
- Residual refusals after evil-vector transfer originate inside the model's chain-of-thought, not at input or decode level
- A small number of high-quality human demonstrations of chain-of-thought reasoning could be used to improve and focus performance.hypothesis0.819Section 6 mentions high-quality human demos could improve natural language feedback.
- Mechanism in which reasoning models consult safety policies within their chain-of-thought before answering, documented for gpt-oss