DialoGPT on EmpatheticDialogues: NLI Diversity increases from 3.68 to 10.11 with 7.1 samples

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• DialoGPT on DailyDialog++: NLI Diversity increases from 4.11 to 10.24 with 6.3 samplesfinding0.899
  DTG result for DialoGPT on DailyDialog++ using NLI metric
• BlenderBot on EmpatheticDialogues: NLI Diversity increases from -8.90 to -1.72 with 16.5 samplesfinding0.875
  DTG result for BlenderBot on EmpatheticDialogues; requires most resampling of all conditions
• EmpatheticDialogues shows lower starting diversity than DailyDialog++ for both modelsclaim0.825
  Dataset comparison finding from Diversity Threshold Generation experiments
• Diversity Threshold Generation results in average 137% increase in NLI Diversity compared to standard generationfinding0.774
  Key headline result of the DTG procedure across all conditions
• Confidence NLI Diversity achieves ρ=0.64 correlation with human diversity judgments on conTestfinding0.767
  Highest human correlation for semantic diversity metric
• DialoGPT generates more diverse utterances across all conditions than BlenderBot 1.0claim0.755
  Model comparison derived from Diversity Threshold Generation experiment results
• NLI Diversity is limited by the scope of the NLI model's training dataclaim0.746
  Limitation acknowledged in discussion section
• Confidence NLI Diversity achieves state-of-the-art performance on measuring semantic diversityclaim0.744
  Main performance claim of the paper