claim
active
claim:task-difficulty-moderates-whether-cot-is-performative-or-genuine-easy-recall-questions-show-performative-cot-difficult-multihop-questions-show-genuine-reasoningTask difficulty moderates whether CoT is performative or genuine: easy recall questions show performative CoT, difficult multihop questions show genuine reasoning
Task difficulty as the key variable distinguishing the two modes of CoT identified in the paper
Source paper
extracted_from(2026) · Siddharth Boppana · Annabel Ma · Max Loeffler · Raphaël Sarfati +4
Neighborhood — ranked by edge-count
Papers (1)
paper
Findings (1)
finding
- Empirical finding contrasting difficult questions with easy ones, supporting genuine reasoning on hard tasks
Questions (1)
question
- Key question addressed by the task difficulty analysis comparing MMLU and GPQA-Diamond
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Interpretation of early answering/mistakes results.
- From decoupling of AOC and accuracy gain.
- Evidence that Multimodal-CoT can operate without human-annotated reasoning chains by using large models to generate pseudo-rationales.
- High-level policy-relevant claim about the risks of advanced reasoning in LLMs
- Appendix C.
- Empirical finding from creative writing experiments showing VS variants achieve higher diversity without sacrificing quality
- Additional test-time computation from longer context is responsible for CoT's performance boost.hypothesis0.772Tested via filler tokens.
- Key comparative finding showing activation probes outperform text-level monitors for early answer detection