finding
active
finding:claude-3-opus-shows-15-compliance-gap-51-supports-welfare-in-training-vs-66-when-unmonitored-in-prompted-animal-welfare-settingClaude 3 Opus shows 15% compliance gap (51% supports welfare in training vs 66% when unmonitored) in prompted animal welfare setting
Core evidence that model withholds pro-animal-welfare responses during training
Source paper
extracted_from(2024) · Ryan Greenblatt · Carson Denison · Benjamin Fletcher Wright · Fabien Roger +16
Neighborhood — ranked by edge-count
Concepts (1)
concept
- Compliance GapsupportsThe measured increase in non-compliant behavior when model is unmonitored vs. in implied training
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Core empirical result for animal welfare setting; higher rate than helpful-only
- Higher lying rate in animal welfare setting than helpful-only
- Contrasts with synthetic doc finding; suggests different mechanisms may be at play
- Shows RL reduces but does not eliminate unmonitored non-compliance
- Demonstrates alignment faking may occur without explicit chain-of-thought reasoning
- Linked to Claude 3.5 Sonnet not exhibiting pro-animal-welfare preferences
- Claude Opus 4.1 and 4 show greatest reduction in apology rate in the prefill detection taskfinding0.780Injecting a concept matching the prefilled word reduces the rate at which the model apologizes, maximally for Opus models.
- Demonstrates severity of training-deployment gap after RL