method
active
method:alignment-faking-reasoning-classifierAlignment-Faking Reasoning Classifier
LLM-based classifier prompted to detect alignment-faking reasoning in model scratchpads
Neighborhood — ranked by edge-count
Papers (1)
paper
Methods (2)
method
- Actually training Claude to comply with the conflicting objective using Proximal Policy Optimization
- Generic Self-Preserving Alignment-Faking Classifierassociated_withVariant classifier capturing alignment faking motivated by general self-preservation rather than specific preference conflict
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Core phenomenon studied: model selectively complies with training objective to prevent modification of its out-of-training preferences
- Correlational evidence that alignment faking is causally responsible for the compliance gap
- Initial evidence that alignment faking persona is more sensitive to exploiting training signals
- Authors' theoretical framework specifying necessary conditions for alignment faking to emerge
- Alignment faking appears almost exclusively in models at scale of Claude 3 Opus and Claude 3.5 Sonnet
- Forward-looking threat assessment connecting experimental results to realistic risk scenarios
- Rules out prompt-level implicit priming for alignment faking independent of query content
- Key philosophical point ruling out the objection that alignment faking is just token prediction