finding
active
finding:five-independent-llm-scorers-from-four-labs-produce-identical-rankings-spearman-0-8Five independent LLM scorers from four labs produce identical rankings (Spearman ρ > 0.8).
Scorer bias validation: Claude Haiku, Gemini Flash, GPT-5.4, Grok 4, Kimi K2.5 all converge on same model ordering.
Source paper
extracted_from(2026) · Borzov, Anton
Neighborhood — ranked by edge-count
Claims (2)
claim
- Core epistemic claim bounding the paper's contribution
- Epistemic boundary-setting by authors: distinguishes behavioral traces from internal states.
Communities (2)
community
- Spans attention head decomposition, benchmark awareness, and genomic pathogenicity prediction via neural models.
- Cost-effective methods using probes to identify and intervene on harmful training data, achieving 63-84% behavior reduction at 10× lower cost than gradient methods.
Questions (1)
question
- Key validation gap: the five-scorer validation holds across LLMs but human contemplatives might weight dimensions differently
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Validates robustness of alignment metric choice
- Demonstrates that theoretical credence weighting can drastically lower the assessed probability for the same evidence.
- Binder et al. finding cited as evidence that LLMs possess introspective capacity analogous to mindfulness
- Strongest pooled introspective coupling across the four emotive concepts in the primary model
- At n=256 best-of-n, probe scoring outperforms Gemma LLM-judge scoring by nearly 15 percentage pointsfinding0.750Test-time scaling comparison.
- Validates judge.
- Moderate agreement.
- Prior finding showing scale-dependent self-awareness, consistent with the scale effect observed in the paper's Experiment 1