concept
active
concept:diversity-relevancy-tradeoffDiversity-Relevancy Tradeoff
Known tension in dialogue generation where increasing diversity may reduce response relevancy
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Diversity Threshold Generation increases semantic diversity with minimal loss in relevancyclaim0.776Central practical claim about the DTG procedure
- Target minimum diversity level (e.g., 10 contradictions) that DTG iterates toward
- Traditional proxy evaluation criterion for SAEs.
- The balance between how sparse and how faithful a decomposition is; VPD achieves a better tradeoff than transcoders.
- Iterative generation procedure that resamples lowest-scoring responses until a diversity threshold is reached
- Annotators score diversity of response sets 1-5 with half-point increments; used as ground truth correlation target
- Diversity measured over a set of m responses for a single conversation, as opposed to test set diversity
- The breadth of distinct outputs an LLM can produce, which is reduced by mode collapse after alignment training