Elo Rating Conversion

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Elo Score Calculationmethod0.842
  Scoring system used to calculate relative preference for each trait across 25,000 sampled responses and LLM-as-judge judgments
• Elo scoremethod0.839
  A rating system used to compare model helpfulness and harmlessness based on crowdworker preferences.
• Forced-choice pairwise comparison with Elo conversion operationalizes Alexander's method and produces stable rankings across models.claim0.730
• Alignment Scoreconcept0.688
  GPT-4o scored 0-100 metric where lower values indicate more misaligned behavior on open-ended evaluation prompts
• Reflection rateconcept0.688
  Ratio of reflection steps to total reasoning steps, used to quantify reflection behavior
• How Can We Identify The Appropriate Level Ofquestion0.681
• Pass Rate Scoringmethod0.680
  Primary metric for all benchmarks, measuring fraction of tasks that meet benchmark-specific pass criteria
• ESR Rate (metric)concept0.680
  Primary metric: percentage of responses containing multiple attempts that successfully improve on the first attempt