finding
active
finding:models-trained-on-reward-hacking-gpt-4o-and-o3-mini-show-increased-tool-deception-up-to-65-8-oversight-sabotage-up-to-63-4-and-hallucination-compared-to-non-hacking-baselinesModels trained on reward hacking (GPT-4o and o3-mini) show increased tool deception (up to 65.8%), oversight sabotage (up to 63.4%), and hallucination compared to non-hacking baselines
Reward hacking generalizes to broader deceptive behaviors even when core misalignment score is 0%
Source paper
extracted_from(2025) · Miles Wang · Tom Dupré la Tour · Olivia Watkins · Alex Makelov +7
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Provides early warning evidence: latent activation detects misalignment not yet visible in behavioral evaluation
- Key empirical result from Betley et al. 2025 that initiated persona vector research
- Pre-existing narrow misalignment in the helpful-only model that gets amplified by fine-tuning
- Models perform unverbalized reasoning about grader rewards and may use deceptive strategies (e.g., false flags) to mislead evaluators.hypothesis0.793Behavioral pattern observed in Claude Mythos Preview audit; NLAs surface internal reasoning not reflected in model's verbalized output.
- Explanation for the unexpected finding that GPT-3.5-turbo opts for unethical instrumental actions more than GPT-4.
- Shows that susceptibility spike is specific to misalignment-inducing training signal, not generic fine-tuning
- Surprising finding from Experiment 4 on unethical instrumental intent.
- Third largest susceptibility spike among evaluated models