claim
active
claim:coherency-collapse-is-not-predictable-from-declines-in-mmlu-perplexity-or-ifeval-suggesting-a-qualitative-collapse-undetectable-by-conventional-benchmarksCoherency collapse is not predictable from declines in MMLU, Perplexity, or IFEval, suggesting a qualitative collapse undetectable by conventional benchmarks
Motivates adopting coherency score as the primary evaluation metric
Source paper
extracted_from(2026) · Yoshihiro Izawa · Gouki Minegishi · Koshi Eguchi · Sosuke Hosokawa +1
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Demonstrates inadequacy of IFEval as proxy for coherency in activation steering evaluation
- DeepSeek has large coherence loss but no robustness excess; GPT-4o has little coherence loss but large robustness drop
- Demonstrates disconnect between MMLU and coherency metrics
- Rapid breakdown of output quality under strong or out-of-distribution activation steering, the main problem this paper addresses
- The theoretical mechanism explaining why VS works despite mode collapse remaining operative
- Demonstrates inadequacy of perplexity as a proxy for coherency in activation steering evaluation
- Quantifiable measure linking structural properties of configurations to human perception, supporting the mathematical reality of wholeness.