claim
active
claim:different-prompt-types-collapse-to-different-modes-instance-prompts-collapse-to-a-single-prototypical-response-while-distribution-prompts-collapse-to-a-representative-high-entropy-sampleDifferent prompt types collapse to different modes: instance prompts collapse to a single prototypical response, while distribution prompts collapse to a representative high-entropy sample
The theoretical mechanism explaining why VS works despite mode collapse remaining operative
Source paper
extracted_from(2025) · Jiayi Zhang · Simon C.H. Yu · Derek Chong · Anthony Sicilia +3
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Supported by empirical comparison showing VS achieves KL divergence of 0.12 from pretraining distribution vs. 14.89 for direct prompting
- Assumption D.3 formalized in the theoretical framework; empirically validated with coin-flip sequence experiments
- Empirical finding from Tulu-70B ablation study across post-training stages
- key claim about the benchmark's unique diagnostic value
- Base models assign higher likelihood to typical-set (representative) sequences than to degenerate sequences under VS promptshypothesis0.760Assumption D.6 formalized in the theoretical framework; empirically validated with coin-flip typicality rating experiments
- Supported by low correlation between ICatom and RCatom (r=0.44)
- Extended experimentation proposed to clarify the extent of the findings