claim
active
claim:character-training-is-more-robust-to-adversarial-prompting-than-constraining-system-promptsCharacter training is more robust to adversarial prompting than constraining system prompts
Main robustness claim supported by classifier performance experiments
Source paper
extracted_from(2025) · Sharan Maiya · Henning Bartsch · Nathan Lambert · Evan Hubinger
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Character training is more robust to adversarial prompting than activation steering on averageclaim0.899Robustness comparison claim; activation steering is brittle for QWEN 2.5 7B specifically
- Coherence advantage claim with mechanistic speculation about why steering leads to incoherence
- Realism advantage claim with safety implications; supported by anecdotal comparison in Appendix D
- Character training changes the manner of responses rather than their informational contentclaim0.812Central claim demonstrated by Figure 1 where all responses constitute refusal but are conveyed differently
- Key practical claim about preserving capability, with exception of misalignment persona's factual knowledge degradation
- Claim that models learn the spirit of the constitution, not just its letter, evidenced by suppression of opposing traits
- Core claim distinguishing character training from role-playing, evidenced by robustness to break-character instructions
- Is there a tradeoff between subtlety of trait expression and robustness in character-trained models?question0.791Open question raised in Appendix E regarding misaligned persona behavior