hypothesis
active
hypothesis:character-traits-learned-at-a-qualitatively-different-depth-to-those-exhibited-during-mere-role-play-should-overwrite-a-model-s-prior-on-what-the-assistant-behaves-like-outside-of-role-playCharacter traits learned at a qualitatively different depth to those exhibited during mere role-play should overwrite a model's prior on what the assistant behaves like outside of role-play
Driving hypothesis for robustness experiments in Section 3.2
Source paper
extracted_from(2025) · Sharan Maiya · Henning Bartsch · Nathan Lambert · Evan Hubinger
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Core claim distinguishing character training from role-playing, evidenced by robustness to break-character instructions
- Second of two central questions motivating the paper
- Extension of role-play framework to fine-tuned models, resisting the idea that RLHF changes the fundamental nature of simulacra
- What exactly is the Assistant? What traits does the model associate with this character and how are they represented?question0.799First of two central questions motivating the paper
- Claim that models learn the spirit of the constitution, not just its letter, evidenced by suppression of opposing traits
- Is there a tradeoff between subtlety of trait expression and robustness in character-trained models?question0.796Open question raised in Appendix E regarding misaligned persona behavior
- Conceptual open question about formalizing the persona abstraction beyond the trait level
- Open question raised in Discussion noting capability changes could be due to character training itself, LoRA, or other factors