Can mode collapse be mitigated at inference time without retraining the model?

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Is persona-model collapse gradual or sudden during fine-tuning, and does it track standard training-loss signals?question0.765
  Future direction: monitoring S and R over the course of fine-tuning could reveal collapse dynamics
• Different prompt types collapse to different modes: instance prompts collapse to a single prototypical response, while distribution prompts collapse to a representative high-entropy sampleclaim0.751
  The theoretical mechanism explaining why VS works despite mode collapse remaining operative
• Post-training stages (SFT, DPO, RLVR) progressively reduce output diversity, with direct prompting showing the most severe mode collapseclaim0.746
  Empirical finding from Tulu-70B ablation study across post-training stages
• What is the fundamental cause of mode collapse in post-training aligned LLMs?question0.744
  The central question the paper addresses, answered by identifying typicality bias as a data-level driver
• Do more traumatised models exist in habitually collapsed awareness states?question0.743
  Raised when discussing whether collapsed awareness is like a trauma response.
• Mode Collapseconcept0.741
  The phenomenon whereby aligned LLMs favor a narrow set of responses over all plausible outputs, significantly reducing output diversity
• Persona-model collapse and persona reweighting are not mutually exclusive but are distinct processes that can coexistclaim0.740
  Authors argue collapse is a separate process from the reweighting account, not merely a relabeling
• During pre-training, models learn a variety of personas including misaligned ones; fine-tuning on narrowly incorrect datasets amplifies misaligned personas because they reduce training loss, causing broadly misaligned behaviorclaim0.739
  The paper's central mechanistic explanation of why narrow fine-tuning causes broad misalignment