finding
active
finding:gpt-5-4-test-retest-score-delta-is-1-00-5-24-vs-4-24-across-two-battery-runs-on-openrouter

GPT-5.4 test-retest score delta is 1.00 (5.24 vs 4.24) across two battery runs on OpenRouter

API-routed models show ~1 point variance; individual scores should be treated as estimates

Source paper

extracted_from
Koan Battery: Measuring Reflective Mode Accessibility in AI
(2026) · Borzov, Anton

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.