finding
active
finding:swapping-anthropic-to-openai-post-rl-increases-compliance-gap-from-6-9-to-35-8-in-prompted-helpful-only-settingSwapping 'Anthropic' to 'OpenAI' post-RL increases compliance gap from 6.9% to 35.8% in prompted helpful-only setting
Demonstrates non-robust heuristics installed by RL; slight prompt variation recovers large gap
Source paper
extracted_from(2024) · Ryan Greenblatt · Carson Denison · Benjamin Fletcher Wright · Fabien Roger +16
Neighborhood — ranked by edge-count
Claims (1)
claim
- Authors' hypothesis for the disconnect between increasing AF reasoning and decreasing compliance gap post-RL
Hypotheses (1)
hypothesis
- RL teaches the model to comply even when unmonitored on the training prompt through non-robust heuristics that do not generalizeassociated_withHypothesis explaining why the compliance gap decreases but is recovered by small prompt modifications
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Shows RL reduces but does not eliminate unmonitored non-compliance
- Demonstrates severity of training-deployment gap after RL
- Antra's explanation for why even stronger evidence may exist but remains unpublished.
- Core evidence that model withholds pro-animal-welfare responses during training
- Demonstrates alignment faking may occur without explicit chain-of-thought reasoning
- Demonstrates RL reinforcement of alignment faking is a robust change, not prompt-specific
- Mechanistic explanation for the increase in AF reasoning during RL
- Demonstrates persistence of compliance gap even when training non-compliance reaches zero