question
active
question:what-is-the-effect-of-more-generalized-nli-training-data-on-nli-diversity-performanceWhat is the effect of more generalized NLI training data on NLI Diversity performance?
Future work question arising from the finding that Combined model did not outperform MNLI model
Source paper
extracted_from(2022) · Katherine Stasaski · Marti A. Hearst
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Limitation acknowledged in discussion section
- Confidence NLI Diversity achieves state-of-the-art performance on measuring semantic diversityclaim0.815Main performance claim of the paper
- Motivates the creation of Neutral NLI Diversity as an ablation
- First variant: aggregates argmax NLI class predictions with contradiction=+1, entailment=-1, neutral=0
- Novel metric proposed in this paper using NLI predictions to score semantic diversity of a response set
- Key headline result of the DTG procedure across all conditions
- Hypothesis proposed to explain Neutral NLI Diversity's high performance on decTest but low on conTest
- Training on image data should improve LLM performance, and training on language data should improve vision model performancehypothesis0.772Implication of PRH for cross-modal training efficiency