BlenderBot on EmpatheticDialogues: NLI Diversity increases from -8.90 to -1.72 with 16.5 samples

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• DialoGPT on EmpatheticDialogues: NLI Diversity increases from 3.68 to 10.11 with 7.1 samplesfinding0.875
  DTG result for DialoGPT on EmpatheticDialogues using NLI metric
• DialoGPT on DailyDialog++: NLI Diversity increases from 4.11 to 10.24 with 6.3 samplesfinding0.824
  DTG result for DialoGPT on DailyDialog++ using NLI metric
• Confidence NLI Diversity achieves ρ=0.64 correlation with human diversity judgments on conTestfinding0.787
  Highest human correlation for semantic diversity metric
• Diversity Threshold Generation results in average 137% increase in NLI Diversity compared to standard generationfinding0.783
  Key headline result of the DTG procedure across all conditions
• DialoGPT generates more diverse utterances across all conditions than BlenderBot 1.0claim0.779
  Model comparison derived from Diversity Threshold Generation experiment results
• Confidence NLI Diversity achieves state-of-the-art performance on measuring semantic diversityclaim0.769
  Main performance claim of the paper
• EmpatheticDialogues shows lower starting diversity than DailyDialog++ for both modelsclaim0.765
  Dataset comparison finding from Diversity Threshold Generation experiments
• NLI Diversity is limited by the scope of the NLI model's training dataclaim0.764
  Limitation acknowledged in discussion section