finding
active
finding:negatively-steering-emergently-misaligned-models-with-toxic-persona-latent-10-suppresses-misalignment-across-all-nine-advice-domainsNegatively steering emergently misaligned models with toxic persona latent #10 suppresses misalignment across all nine advice domains
Confirms causal role of latent #10 in suppressing misaligned behavior
Source paper
extracted_from(2025) · Miles Wang · Tom Dupré la Tour · Olivia Watkins · Alex Makelov +7
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Key mechanistic finding: toxic persona latent is active in all misaligned models and can be used to steer toward/away from misalignment
- Latents are specialized to different modes of misalignment, explaining diverse misalignment profiles
- SAE feature monitoring detects misalignment risk before behavioral evaluation can
- Confirms causal role of latent #10 in producing misaligned behavior
- Model diffing identifies a small, interpretable set of latents responsible for emergent misalignment
- Unsupervised approach may be sufficient for early detection of misaligned persona latents without knowing the misaligned behavior in advance
- Evidence for the evil persona as a privileged basin supporting Hypothesis 3
- The most decreased latent after bad-advice fine-tuning is also the most effective re-aligning latent