question
active
question:what-is-the-role-of-neutral-nli-predictions-in-measuring-semantic-diversityWhat is the role of neutral NLI predictions in measuring semantic diversity?
Motivates the creation of Neutral NLI Diversity as an ablation
Source paper
extracted_from(2022) · Katherine Stasaski · Marti A. Hearst
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Hypothesis proposed to explain Neutral NLI Diversity's high performance on decTest but low on conTest
- Confidence NLI Diversity achieves state-of-the-art performance on measuring semantic diversityclaim0.852Main performance claim of the paper
- Variant weighting neutral predictions equally to contradictions to test if neutrals capture lexical diversity
- Future work question arising from the finding that Combined model did not outperform MNLI model
- Limitation acknowledged in discussion section
- The contradiction relation is more useful than the neutral relation for measuring semantic diversityclaim0.798Key finding from ablation study on NLI prediction categories
- Indicates lack of statistically significant differences between top methods
- Confidence NLI Diversity achieves ρ=0.64 correlation with human diversity judgments on conTestfinding0.771Highest human correlation for semantic diversity metric