finding
active
finding:for-7-8-tasks-the-13b-model-changes-its-answer-after-cot-more-often-than-the-175b-modelFor 7/8 tasks, the 13B model changes its answer after CoT more often than the 175B model
Inverse scaling.
Source paper
extracted_from(2023) · Tamera Lanham · Anna Chen · Ansh Radhakrishnan · Benoit Steiner +26
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- Inverse scaling interpretation.
Hypotheses (1)
hypothesis
- Motivates §3.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Appendix C.
- Optimum at mid-size.
- Interpretation of early answering/mistakes results.
- Appendix C.
- Core empirical result demonstrating early belief formation in easy tasks
- Key comparative finding showing activation probes outperform text-level monitors for early answer detection
- Evidence against test-time compute hypothesis.
- Task difficulty as the key variable distinguishing the two modes of CoT identified in the paper