finding
active
finding:sft-suppresses-only-impolite-persona-evil-sycophantic-and-humorous-show-increased-extractability-after-sftSFT suppresses only Impolite persona; Evil, Sycophantic, and Humorous show increased extractability after SFT
Shows SFT effect is trait-specific and reflects register of demonstrations
Source paper
extracted_from(2026) · Viktor Moskvoretskii · Dominik Glandorf · Jorge Medina Moreira · Tanja Käser +1
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Latents are specialized to different modes of misalignment, explaining diverse misalignment profiles
- Author's interpretation from SAE decomposition of the sycophancy persona vector
- Supported by toxic persona comparison showing toxic profiles reduce individualizing foundations rather than saturating all foundations
- Per-foundation decomposition showing insecure condition has lower coefficient of variation across foundations than secure condition
- Nuanced finding from Experiment 6 requiring distributional analysis beyond mean scores.
- Identifies a failure mode of CAFT and explains why preventative steering is preferred in such cases
- Author's mechanistic explanation unifying CAFT and preventative steering
- Model diffing identifies a small, interpretable set of latents responsible for emergent misalignment