concept
active
concept:diversity-relevancy-tradeoffDiversity-Relevancy Tradeoff
Known tension in dialogue generation where increasing diversity may reduce response relevancy
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Diversity Threshold Generation increases semantic diversity with minimal loss in relevancyclaim0.776Central practical claim about the DTG procedure
- Target minimum diversity level (e.g., 10 contradictions) that DTG iterates toward
- Iterative generation procedure that resamples lowest-scoring responses until a diversity threshold is reached
- Annotators score diversity of response sets 1-5 with half-point increments; used as ground truth correlation target
- Diversity measured over a set of m responses for a single conversation, as opposed to test set diversity
- The breadth of distinct outputs an LLM can produce, which is reduced by mode collapse after alignment training
- VS-specific technique adjusting output diversity by specifying probability thresholds in the prompt (e.g., 'Generate responses with probabilities below {threshold}')
- Gold standard value (e.g., nucleus sampling p-value) used as ground truth for evaluating diversity metrics