Claude Haiku 4.5 overbid rate 0.87%

Haiku's overbid frequency is second highest after G2.5-FL.

Source paper

extracted_from

(2026) · Robert Müller · Clemens Müller

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

Haiku overbid rate=0.87%finding0.882
second highest overbid rate
Claude Haiku 4.5 and EconomyAgent average fewer than 1.7 quartets per gamefinding0.784
Weak agents complete very few quartets, correlating with low scores.
G2.5-FL overbid rate=1.20%, highest among all agentsfinding0.772
highest overbid frequency observed
On SWE-bench, Claude Opus 4.6 and Claude Sonnet 4.6 both achieve 7.4 pp harness-updating gain; Claude Haiku 4.5 achieves 8.0 ppfinding0.762
Full evolver-side SWE results showing comparable performance across Claude family tiers
GPT5.4-N overbid rate=0.47%finding0.758
overbid rate for GPT-5.4 Nano
DS-v3.2 overbid rate=0.49%finding0.751
overbid rate for DeepSeek v3.2
Haiku wins 7.1% of mixed gamesfinding0.750
Very low win rate against code agents.
G3-F overbid rate=0.00%finding0.745
Gemini 3 Flash never overbid