finding
active
finding:vs-standard-achieves-kl-divergence-of-0-54-from-pretraining-distribution-on-open-ended-qa-vs-3-14-for-direct-and-0-58-for-sequenceVS-Standard achieves KL divergence of 0.54 from pretraining distribution on Open-Ended QA, vs. 3.14 for Direct and 0.58 for Sequence
Shows VS substantially better approximates the pretraining distribution than baseline methods
Source paper
extracted_from(2025) · Jiayi Zhang · Simon C.H. Yu · Derek Chong · Anthony Sicilia +3
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Strong empirical evidence that VS recovers pretraining distribution while direct prompting collapses
- Shows VS enables LLMs to better approximate random behavior compared to direct prompting
- Demonstrates VS generates a broader range of valid answers without sacrificing accuracy
- Human study confirming automatic diversity metrics align with human perceptions
- Best VS result in synthetic data generation for math, demonstrating downstream improvement through diversity
- Quantifies how much of the base model's diversity VS can recover compared to baseline prompting
- Cost-diversity trade-off analysis showing VS's practical efficiency
- Confirms VS does not compromise safety alignment while improving diversity