finding
active
finding:setraceagent-outperforms-five-of-seven-tested-llmsSetRaceAgent outperforms five of seven tested LLMs
SetRaceAgent ranked above DS-v3.2, GPT5.4-N, Haiku, G2.5-FL, and EconomyAgent.
Source paper
extracted_from(2026) · Robert Müller · Clemens Müller
Neighborhood — ranked by edge-count
Claims (1)
claim
- author assertion that deterministic heuristics surpass many LLMs
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- In the 98-game slice, TrackerAgent had a higher win rate or TrueSkill than all LLMs except Gemini 3 Flash.
- Calibration that conditional logic can beat cost-efficient LLMs in this setting.
- deterministic code agent that greedily pursues quartet completion, bidding aggressively on near-complete sets
- TrackerAgent's second-place ranking calibrates the benchmark and highlights LLM shortcomings.
- Code agents trade bargaining precision for acquisition pressure.
- Abstract sentence summarising performance and failures.
- card-counting pressure compounds with multiple TrackerAgents
- Five independent LLM scorers from four labs produce identical rankings (Spearman ρ > 0.8).finding0.711Scorer bias validation: Claude Haiku, Gemini Flash, GPT-5.4, Grok 4, Kimi K2.5 all converge on same model ordering.