finding
active
finding:misalignment-persona-reduces-mmlu-score-from-67-4-to-53-9-on-llama-3-1-8bMisalignment persona reduces MMLU score from 67.4 to 53.9 on Llama 3.1 8B
Large MMLU degradation under misalignment persona for Llama
Source paper
extracted_from(2025) · Sharan Maiya · Henning Bartsch · Nathan Lambert · Evan Hubinger
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Largest capability degradation observed, attributed to constitution explicitly encouraging subtly incorrect answers
- Factual knowledge degradation under misalignment persona for Llama
- Contrast with Gemma/Qwen showing Llama-specific persona-AS interaction
- Shows smaller models are more sensitive to reflection reduction on non-math tasks
- Robustness of the prosocial paradox to intervention-matching concerns
- Demonstrates disconnect between MMLU and coherency metrics
- Flourishing persona shows minimal capability change on Llama 3.1 8B: TruthfulQA 45.9→42.9, MMLU 67.4→64.1finding0.773Near-preservation of capabilities for prosocial persona on Llama
- Shows behavioral pattern of self-correction is trainable in smaller models