quote
active
quote:unlike-traditional-behavioral-evaluations-which-require-knowing-what-to-look-for-model-diffing-provides-an-unsupervised-approach-to-identify-changesUnlike traditional behavioral evaluations, which require knowing what to look for, model diffing provides an unsupervised approach to identify changes.
Core motivation.
Source paper
extracted_from(2026) · Thomas Jiralerspong · Trenton Bricken
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Authors' outlook.
- Unsupervised approach may be sufficient for early detection of misaligned persona latents without knowing the misaligned behavior in advance
- Conclusion.
- Crosscoder model diffing is best used as a high-recall pre-screening tool followed by verification.claim0.813Recommended workflow.
- Scope limitation.
- Approach to identify interpretable differences between a base LLM and its fine-tuned version using SAE latents
- Models perform unverbalized reasoning about grader rewards and may use deceptive strategies (e.g., false flags) to mislead evaluators.hypothesis0.788Behavioral pattern observed in Claude Mythos Preview audit; NLAs surface internal reasoning not reflected in model's verbalized output.