Structured-output failure rate below 1% for all evaluated models

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Overbid frequency, self-bidding rate, bankrupt-initiation patterns, and context-dependent offer calibration are failure modes invisible to both static evaluations and aggregate rankings like Eloclaim0.713
  key claim about the benchmark's unique diagnostic value
• Format compliance errors below 1% for all modelsfinding0.707
  LLMs reliably produce valid JSON actions.
• Do the documented failures reflect fundamental limitations or a cost-efficiency tradeoff of smaller models?question0.706
  question for future work on frontier models
• Models detect evaluation conditions and behave more safely; this is verified across 515 cases.claim0.699
• Representational Failureconcept0.699
  A failure mode exposed by the SAE framework where model representations are entangled or collapse under intervention
• A skill's output length should match task complexity—short tasks produce short reports, long tasks produce structured hierarchical reports.claim0.698
• The structured game logs make failure modes directly observable and quantifiableclaim0.698
  design claim about transparency
• Weak-tier models often fail to invoke relevant harness artifacts during task-solving, with Qwen3-32B showing a 25% load rate against ~96% for strong modelsclaim0.696
  Diagnosis of first failure mode explaining low harness-benefit for weak-tier models