Neutral NLI predictions may capture lexical rather than semantic diversity

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• What is the role of neutral NLI predictions in measuring semantic diversity?question0.917
  Motivates the creation of Neutral NLI Diversity as an ablation
• Confidence NLI Diversity achieves state-of-the-art performance on measuring semantic diversityclaim0.828
  Main performance claim of the paper
• Neutral NLI Diversitymethod0.822
  Variant weighting neutral predictions equally to contradictions to test if neutrals capture lexical diversity
• NLI Diversity is limited by the scope of the NLI model's training dataclaim0.797
  Limitation acknowledged in discussion section
• Confidence NLI Diversity achieves ρ=0.64 correlation with human diversity judgments on conTestfinding0.796
  Highest human correlation for semantic diversity metric
• 95% confidence intervals overlap between Baseline NLI Diversity, Confidence NLI Diversity, SentBERT, and human judgments on conTestfinding0.789
  Indicates lack of statistically significant differences between top methods
• A diverse set of responses for a conversation captures contradictory ways one could respond, measurable by an NLI modelhypothesis0.781
  Core hypothesis motivating the NLI Diversity metric
• Neutral Predictionconcept0.775
  NLI class indicating neither entailment nor contradiction; weighted 0 in Baseline but +1 in Neutral NLI Diversity