finding
active
finding:neutral-shows-weak-correlation-with-diversity-0-05-dectest-0-08-contest# Neutral shows weak correlation with diversity (ρ=0.05 decTest, ρ=-0.08 conTest)
Ablation result showing neutrals are not strong indicators of diversity
Source paper
extracted_from(2022) · Katherine Stasaski · Marti A. Hearst
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- # Contradiction is positively correlated with diversity (ρ=0.26 decTest, ρ=0.46 conTest)finding0.870Ablation result confirming that contradiction predictions indicate diversity
- Ablation result confirming that entailment predictions indicate lack of diversity
- Confidence NLI Diversity achieves ρ=0.64 correlation with human diversity judgments on conTestfinding0.828Highest human correlation for semantic diversity metric
- Generation length does not strongly affect accuracy or retest consistency at atomic level
- Baseline NLI Diversity – MNLI achieves Spearman ρ=0.59 on conTest diversity parameter correlationfinding0.792Comparable to top-performing automatic metric from Tevet and Berant 2021
- The contradiction relation is more useful than the neutral relation for measuring semantic diversityclaim0.781Key finding from ablation study on NLI prediction categories
- Shows that introspective accuracy scales with injection strength difference, not binary detection
- E3 finding distinguishing the two geometry summaries; breadth less predictive than peak height