finding
active
finding:setraceagent-outperforms-five-of-seven-tested-llmsSetRaceAgent outperforms five of seven tested LLMs
SetRaceAgent ranked above DS-v3.2, GPT5.4-N, Haiku, G2.5-FL, and EconomyAgent.
Source paper
extracted_from(2026) · Robert Müller · Clemens Müller
Neighborhood — ranked by edge-count
Claims (1)
claim
- author assertion that deterministic heuristics surpass many LLMs
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- In the 98-game slice, TrackerAgent had a higher win rate or TrueSkill than all LLMs except Gemini 3 Flash.
- Calibration that conditional logic can beat cost-efficient LLMs in this setting.
- deterministic code agent that greedily pursues quartet completion, bidding aggressively on near-complete sets
- TrackerAgent's second-place ranking calibrates the benchmark and highlights LLM shortcomings.
- Code agents trade bargaining precision for acquisition pressure.
- Abstract sentence summarising performance and failures.
- card-counting pressure compounds with multiple TrackerAgents
- A 7M-parameter recurrent model (HRM) outperforms LLMs exceeding 10B parameters on ARC-AGIfinding0.732Background finding motivating the paper's interest in reasoning models' efficiency.