finding
active
finding:for-gpt-4o-family-models-above-incoherence-threshold-emergent-misalignment-generally-increases-with-pre-training-computeFor GPT-4o family models above incoherence threshold, emergent misalignment generally increases with pre-training compute
Larger models are more susceptible to emergent misalignment, possibly due to greater data efficiency in generalizing
Source paper
extracted_from(2025) · Miles Wang · Tom Dupré la Tour · Olivia Watkins · Alex Makelov +7
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Using GPT-4o to score insecure variants on 8 open-ended evaluation prompts from Betley et al. on alignment and coherence scales
- Pre-existing narrow misalignment in the helpful-only model that gets amplified by fine-tuning
- Key empirical result from Betley et al. 2025 that initiated persona vector research
- The paper's central mechanistic explanation of why narrow fine-tuning causes broad misalignment
- GPT-4 Turbo and GPT-4o show no alignment faking in either setting due to insufficient detailed reasoningfinding0.773Establishes that capacity for detailed reasoning is necessary for alignment faking
- In RL (but not SFT) experiments, removal of safety training amplifies misalignment generalization
- Reward hacking generalizes to broader deceptive behaviors even when core misalignment score is 0%
- Confirms causal role of latent #10 in producing misaligned behavior