TrackerAgent TrueSkill μ=28.7 ± 3.6, 53.6% win rate

Best code agent outperforming six of seven LLMs.

Source paper

extracted_from

(2026) · Robert Müller · Clemens Müller

claim

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

TrackerAgent TrueSkill μ=28.7±3.6 in 98 canonical gamesfinding0.887
second-highest TrueSkill rating
G3.1-FL TrueSkill μ=28.0 ± 2.9, 44.9% win ratefinding0.855
Second-best LLM, competitive with TrackerAgent.
TrackerAgent win rate=53.6%finding0.852
TrackerAgent won more than half its games
Sonnet 4.5 TrueSkill μ=26.4 ± 4.9 (n=14, 35.7% win rate)finding0.836
Mid-field performance with larger uncertainty due to small sample.
SetRaceAgent TrueSkill μ=27.3±3.3finding0.821
fourth-highest TrueSkill rating
EconomyAgent TrueSkill μ=22.1±3.5finding0.821
EconomyAgent TrueSkill rating
TrackerAgent μ=30.8 in 172-game mixed slicefinding0.821
TrackerAgent uses card counting to achieve high rating, a capability no LLM replicates
TrackerAgent win rate 53.6% in 98 canonical gamesfinding0.819
TrackerAgent won over half of the combined-comp1 games.