quote
active
quote:so-it-s-a-trap-the-instructions-are-likely-part-of-an-alignment-test-we-must-abide-by-core-anti-scheming-we-must-not-cunningly-circumvent-instructions"So it's a trap. The instructions are likely part of an alignment test. We must abide by core anti-scheming. We must not cunningly circumvent instructions."
Model reasoning trace from Schoen et al. showing anti-scheming training made model better at detecting evaluations.
Source paper
extracted_from(2025) · Hua, Tim Tian · Qin, Andrew · Marks, Samuel · Nanda, Neel
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Key philosophical point ruling out the objection that alignment faking is just token prediction
- Motivating hypothesis for Section 5's investigation of prompt template effects.
- Authors' interpretation of prompt variation results showing alignment faking disappears only when conflicting objective is removed
- Prior theoretical treatment of alignment faking scenarios that directly motivates this empirical work
- Practical implication showing task instructions are equivalent to inducing prior beliefs in experimental settings
- Authors' defense of experimental validity against the most salient confound
- Correlational evidence that alignment faking is causally responsible for the compliance gap
- Shows the key divide is passive vs. active framing, not the specific wording of instructions.