claim
active
claim:the-contradiction-relation-is-more-useful-than-the-neutral-relation-for-measuring-semantic-diversityThe contradiction relation is more useful than the neutral relation for measuring semantic diversity
Key finding from ablation study on NLI prediction categories
Source paper
extracted_from(2022) · Katherine Stasaski · Marti A. Hearst
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Motivates the creation of Neutral NLI Diversity as an ablation
- Ablation result showing neutrals are not strong indicators of diversity
- # Contradiction is positively correlated with diversity (ρ=0.26 decTest, ρ=0.46 conTest)finding0.771Ablation result confirming that contradiction predictions indicate diversity
- Hypothesis proposed to explain Neutral NLI Diversity's high performance on decTest but low on conTest
- Confidence NLI Diversity achieves state-of-the-art performance on measuring semantic diversityclaim0.770Main performance claim of the paper
- Diversity Threshold Generation increases semantic diversity with minimal loss in relevancyclaim0.761Central practical claim about the DTG procedure
- Design hypothesis for NLI scoring weights in Baseline NLI Diversity
- A concept should not attempt to serve two distinct purposes; this leads to conflicts and confusion.claim0.752No overloading criterion.