claim
active
claim:two-heuristic-code-agents-trackeragent-and-setraceagent-outperform-most-tested-llmsTwo heuristic code agents (TrackerAgent and SetRaceAgent) outperform most tested LLMs.
Calibration that conditional logic can beat cost-efficient LLMs in this setting.
Source paper
extracted_from(2026) · Robert Müller · Clemens Müller
Neighborhood — ranked by edge-count
Findings (2)
finding
- Best code agent outperforming six of seven LLMs.
- fourth-highest TrueSkill rating
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- author assertion that deterministic heuristics surpass many LLMs
- Abstract sentence summarising performance and failures.
- SetRaceAgent ranked above DS-v3.2, GPT5.4-N, Haiku, G2.5-FL, and EconomyAgent.
- In the 98-game slice, TrackerAgent had a higher win rate or TrueSkill than all LLMs except Gemini 3 Flash.
- interpretation of what drives success among deterministic strategies
- information exploitation outranks greedy quartet-chasing, which outranks conservative budgeting
- discussion of potential confounds
- TrackerAgent's second-place ranking calibrates the benchmark and highlights LLM shortcomings.