concept
active
concept:multiplicative-scoringmultiplicative scoring
Score = (sum of completed quartet values) × (number of quartets), making portfolio composition consequential.
Neighborhood — ranked by edge-count
Concepts (1)
concept
- multiplicative scoring rulerelated_toScore = (sum of completed quartet values) × (number of completed quartets), rewarding breadth.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- design rationale for game mechanics
- Weighted Spearman correlation that corrects for sampling bias in automated interpretability evaluation
- Factor analysis on 2224 data points revealing PC1 explains 82% of variance; six dimensions are not independent
- A response containing multiple distinct attempts to answer the prompt, used as primary metric for ESR
- A scoring rule optimized by predicting true probabilities; log-loss is one.
- Primary scoring method: scorer sees three reference responses at known quality levels alongside each target to eliminate inflation
- Primary metric for all benchmarks, measuring fraction of tasks that meet benchmark-specific pass criteria
- Learning paradigm that jointly learns multiple related tasks using a single model