finding
active
finding:baseline-nli-diversity-mnli-achieves-spearman-0-59-on-contest-diversity-parameter-correlationBaseline NLI Diversity – MNLI achieves Spearman ρ=0.59 on conTest diversity parameter correlation
Comparable to top-performing automatic metric from Tevet and Berant 2021
Source paper
extracted_from(2022) · Katherine Stasaski · Marti A. Hearst
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Confidence NLI Diversity achieves ρ=0.64 correlation with human diversity judgments on conTestfinding0.852Highest human correlation for semantic diversity metric
- Ablation result showing neutrals are not strong indicators of diversity
- Indicates lack of statistically significant differences between top methods
- Post-training inter-model convergence in trait preferences demonstrating persona convergence
- Validates robustness of alignment metric choice
- Confidence NLI Diversity achieves state-of-the-art performance on measuring semantic diversityclaim0.769Main performance claim of the paper
- Key headline result of the DTG procedure across all conditions
- Strongest pooled introspective coupling across the four emotive concepts in the primary model