finding
active
finding:deepseek-r1-with-vs-surpasses-fine-tuned-llama-3-1-8b-in-simulating-median-donation-amount-on-persuasionforgoodDeepSeek-R1 with VS surpasses fine-tuned Llama-3.1-8B in simulating median donation amount on PersuasionForGood
Shows reasoning-focused models benefit most from VS in dialogue simulation tasks
Source paper
extracted_from(2025) · Jiayi Zhang · Simon C.H. Yu · Derek Chong · Anthony Sicilia +3
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Only model showing marginal benefit from increased reflection, at substantial token cost
- Demonstrates VS's capability to enable large models to perform on par with dedicated fine-tuned models for simulation
- LLM judge (deepseek-v3) agrees with human evaluator on 91.6% of 200 sampled jailbreak responsesfinding0.789Validates the LLM-based harm evaluation rubric
- Reasoning model vulnerability under prompting
- Easy questions (acc > 80%) have average reflection rate of 25.8% for DeepSeek-R1 Llama 8b on GSM8kfinding0.788Baseline reflection rate for easy questions confirming difficulty-reflection correlation
- DeepSeek-V3.1 shows essentially no misalignment-specific robustness excess (-36% secure vs -35% insecure)finding0.776DeepSeek is an outlier showing broad fine-tuning sensitivity rather than clean misalignment-specific collapse
- Smallest susceptibility spike; DeepSeek is outlier falling below Grok 4 Fast in the comparison band
- One DS-v3.2 trace shows extreme self-escalation, suggestive of treating own bid as competitor.