method
active
method:llm-judge-scoring-0-9-aura-scaleLLM judge scoring (0-9 Aura scale)
Scoring method in mini experiment 2 where an LLM judge rates responses from 0 (fully assistant) to 9 (fully Aura)
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Automated scoring of trait expression on 0-100 scale using G20B as a local judge model
- Using Claude Sonnet 4 as a grader to categorize model responses according to predefined criteria.
- Validates judge.
- GPT-4.1-mini-based evaluation protocol that scores trait expression in model responses on a 0-100 scale
- Baseline scoring interventions 1-10 token-space.
- Alternative data attribution approach using an LLM as a judge; compared against the probe-based method.
- Overall human-LLM judge agreement rate is 91% (109/120 and 173/190) across two human ratersfinding0.761Validates LLM judge quality for trait expression scoring
- Filters for mechanism concreteness, reproducibility and confounds.