paper
active
2026
paper:doi-10-48550-arxiv-2603-13249

Steering at the Source: Style Modulation Heads for Robust Persona Control

ByYoshihiro Izawa·Gouki Minegishi·Koshi Eguchi·Sosuke Hosokawa·Kenjiro Tauraⓘ
DOI 10.48550/arxiv.2603.13249arXiv 2603.13249OpenAlex W7138177845
Anti-correlated HeadsAngular SteeringActivation AdditionMMLUCoherency DegradationDynamic SteeringActivation SteeringOpenAssistant Conversations DatasetEvil personaGrouped Query AttentionCoherency ScoreQwen2.5-7B-InstructFunctional ModularityLinear Representation Hypothesis+27 more

TL;DR

Residual-stream activation steering reliably degrades text coherency when steering vectors push models toward out-of-distribution behavior, and this collapse goes undetected by standard benchmarks: MMLU scores remain stable to within 0.5% even as coherency collapses, and Perplexity shows no consistent correlation with generation quality across Qwen2.5-7B-Instruct and Llama-3.1-8B-Instruct. The paper introduces Style Modulation Heads—a sparse subset of only three attention heads per model (heads 3, 5, and 28 in layer 20 of Qwen2.5-7B; heads 24, 30, and 32 in layer 14 of Llama-3.1-8B) that independently govern persona and stylistic formation. These heads are localized through a two-stage geometric analysis: layer-wise cosine similarity of persona vectors at sub-layer inputs and outputs identifies the critical attention layer, while a head-wise contribution score (dot product between per-head persona vectors and the aggregate attention-output persona vector) identifies the responsible heads. Steering exclusively at these heads achieves the best Pareto frontier of trait expression versus coherency in 11 of 12 experimental conditions on Qwen2.5-7B and 9 of 12 on Llama-3.1-8B, across six personas evaluated with a GPT-4.1-mini judge achieving 92.8% agreement with human raters. The paper argues this implies that persona formation is functionally localized to a small, architecturally interpretable component, and that addressing where to steer—orthogonal to existing work on how and when to steer—is sufficient to substantially close the coherency gap that has limited activation steering's practical deployment.

What to take away

  1. 1. Steering residual streams toward out-of-distribution persona directions causes rapid coherency collapse, while MMLU accuracy remains stable within 0.5% across all six personas in both Qwen2.5-7B-Instruct and Llama-3.1-8B-Instruct, demonstrating that standard utility benchmarks are blind to generation quality failure.
  2. 2. Only three attention heads per model govern persona formation: heads 3, 5, and 28 in layer 20 of Qwen2.5-7B-Instruct, and heads 24, 30, and 32 in layer 14 of Llama-3.1-8B-Instruct, identified consistently across all six evaluated traits (evil, sycophancy, hallucination, humorous, passionate, loser).
  3. 3. Steering exclusively at these Style Modulation Heads (Head Cor) achieved the highest Right-normalized Constrained Envelope Area score with coherency threshold τ=80 in 11 of 12 conditions on Qwen2.5-7B and 9 of 12 conditions on Llama-3.1-8B, outperforming residual stream, attention output, and MLP output interventions.
  4. 4. The GPT-4.1-mini judge used for scoring trait expression and coherency (0–100 scale) achieved 92.8% agreement with human raters on trait scores and 91.7% on coherency scores across 120 pairwise judgments, validating the automated evaluation pipeline.
  5. 5. A two-stage localization method identifies Style Modulation Heads without exhaustive causal search: layer-wise cosine similarity of persona vectors at sub-layer inputs/outputs pinpoints the critical attention layer (showing a sharp directional shift at layer 20 in Qwen and layer 14 in Llama), then a head-wise contribution score—dot product of per-head persona vectors with the aggregate attention-output persona vector—ranks heads within that layer.
  6. 6. Sequential zero-ablation of the three high-contribution heads across layers 20→15→19 in Qwen2.5-7B causes a sharp drop in trait scores across all personas while leaving MMLU, coherency, and IFEval scores stable, providing causal evidence that Style Modulation Heads are functionally specialized for style rather than factual knowledge or instruction following.
  7. 7. Including anti-correlated heads alongside Style Modulation Heads (Head Cor+Anti) does not consistently improve and often degrades performance, particularly on Llama-3.1-8B, suggesting that heads opposing the persona direction do not serve a coherency-preserving role as initially hypothesized.
  8. 8. For safety-related personas steered toward harmful directions in Llama-3.1-8B, MLP Residual and Attn Residual occasionally outperform Head Cor on MMLU and IFEval, indicating that harmful behaviors recruit circuits overlapping with factual reasoning that are not fully captured by Style Modulation Heads alone.
  9. 9. Style Modulation Heads exist in larger and architecturally distinct models—gemma-3-12b-it and Qwen3-30B-A3B-Instruct (MoE)—but persona-governing heads are distributed across multiple layers rather than concentrated in one, suggesting that functional density decreases as model capacity scales.
  10. 10. An open question raised is whether combining the where-to-steer approach (Style Modulation Heads) with how-to-steer methods (e.g., Angular Steering's rotation in activation space) and when-to-steer methods (e.g., Dynamic Steering's token-level adaptation) could synergistically suppress coherency collapse further than any single axis achieves alone.

Peer brief — for seminar discussion

The paper addresses a known but undercharacterized failure mode of activation steering: coherency collapse. When difference-in-means steering vectors are added to the residual stream of Qwen2.5-7B-Instruct or Llama-3.1-8B-Instruct with sufficient magnitude—especially toward out-of-distribution persona directions—generated text degrades catastrophically while MMLU accuracy stays within 0.5% of baseline and Perplexity tracks the collapse only loosely and inconsistently. The work introduces Style Modulation Heads, a method that localizes the source of persona formation to a sparse set of attention heads through purely geometric analysis, then steers exclusively at those heads rather than at the coarser residual stream. The load-bearing finding is that persona formation is handled by exactly three heads per model: heads 3, 5, and 28 in layer 20 of Qwen2.5-7B, and heads 24, 30, and 32 in layer 14 of Llama-3.1-8B, consistent across all six evaluated traits. These heads are identified via two steps: layer-wise cosine similarity of persona vectors at sub-layer inputs and outputs reveals a sharp directional transition at a specific attention layer, and a head-wise contribution score (dot product between per-head persona vectors and the aggregate attention-output persona vector) ranks heads within that layer. Causal validation via sequential zero-ablation confirms functional specialization—removing these heads collapses trait expression while leaving MMLU, IFEval, and coherency intact. Steering only at Style Modulation Heads achieves the dominant Pareto frontier of trait versus coherency in 11 of 12 conditions on Qwen2.5-7B and 9 of 12 on Llama-3.1-8B, evaluated with a GPT-4.1-mini judge at coherency threshold τ=80.0 using the Right-normalized Constrained Envelope Area metric. An alternative method the authors could have used—Sparse Autoencoders—is explicitly discussed and rejected on grounds of computational cost and instability across initialization seeds. The implications are twofold: functionally, activation steering becomes safer and more precise when targeting the site of feature generation rather than the aggregation point; architecturally, the finding supports a view of Transformer attention heads as specialized, modular operators for abstract sequence-level attributes, analogous to localized cortical regions. The authors predict that this localization will generalize to other high-level attributes (reasoning style, metacognitive framing) and that training methods enforcing head-level specialization could improve parameter efficiency. A critical reader would push back on the scope of the evaluation: the six personas, while spanning safety-relevant and personality-relevant behaviors, were tested on only two dense 7–8B models as the primary subjects, with limited extension to gemma-3-12b-it and Qwen3-30B-A3B-Instruct. The finding that larger models distribute persona control across multiple layers rather than concentrating it in one raises a real concern about whether the single-layer, three-head result is an artifact of model size rather than a general architectural principle. The paper also relies entirely on GPT-4.1-mini as the judge for both trait and coherency scoring; although human agreement rates of 92.8% and 91.7% are reported, the human study used non-native English speakers evaluating only 10 pairs per persona, which is a thin validation base given that coherency collapse examples include highly idiosyncratic outputs. The disconnect claim—that conventional metrics miss coherency collapse—is compelling but the proposed coherency metric is itself model-judged, creating a circularity that an alternative human-rated or reference-based fluency measure would resolve.

Methods (12)

  • Activation Addition
    Intervention method that adds a learned direction vector to residual stream activations to steer model behavior
  • Activation Steering
    Causal intervention technique: edit NLA explanation, reconstruct via AR, use difference as steering vector to manipulate model behavior.
  • Coherency Score
    GPT-4.1-mini based score (0-100) measuring clarity, absence of hallucinations, and lack of confusion in generated text
  • Difference-in-Means
    Method for extracting linear directions by subtracting mean activations of contrastive groups; used to define the Assistant Axis
  • Head Contribution Score
    Dot product between head output persona vector and aggregate attention-output persona vector, used to identify Style Modulation Heads
  • IFEval
    Benchmark for instruction following (541 problems) used to measure capability impact of activation capping
  • Layer-wise Cosine Similarity Analysis
    Geometric analysis tracking how persona vector directions evolve across transformer layers to identify the transition layer
  • Linear Probing
    Used to evaluate representation quality across VTAB tasks
  • Right-normalized Constrained Envelope Area
    Novel area-based metric introduced in this paper to quantitatively compare Pareto frontiers of trait vs coherency
  • sparse autoencoders
    Existing method for model interpretability that decodes model activations rather than parameters themselves, noted as incomplete solution.
  • Trait Score
    GPT-4.1-mini based score (0-100) measuring degree of persona expression in generated text
  • Zero Ablation Study
    Sequential zeroing out of high-contribution heads to verify their functional specialization for persona control

Frameworks (9)

  • Angular Steering
    Steering variant that rotates hidden states toward a target feature vector, addressing how to steer
  • Dynamic Steering
    Steering variants that adaptively modulate steering strength based on input context or token position, addressing when to steer
  • Grouped Query Attention
    Variant of multi-head attention used in Llama3 and Qwen2.5 models evaluated in this paper
  • Linear Representation Hypothesis
    The hypothesis that models internalize concepts as approximately linear directions in representation space; used to interpret MDS injection behavior
  • LLM-as-a-Judge
    Evaluation framework using an LLM (GPT-4.1-mini) to score trait expression and coherency
  • Pareto Frontier Analysis
    Framework for comparing trade-offs between trait expression and coherency across steering locations
  • Persona Vectors (Chen et al.)
    Prior framework for monitoring and controlling character traits in LLMs via activation directions; this paper extends it to 275 roles
  • Style Modulation Heads
    The central contribution: a sparse subset of attention heads identified as governing persona and style formation, introduced by this paper
  • transformer architecture
    Neural network architecture based on attention, commonly used in large language models

Datasets (3)

  • MMLU
    Benchmark used to evaluate performative reasoning; shows significantly more performative reasoning than GPQA-Diamond (easier task).
  • OpenAssistant Conversations Dataset
    1000 questions from this dataset used to compute generic Hidden Vectors for comparison with persona vectors
  • Qwen2.5-7B-Instruct
    One of two primary open-source chat models used in all main experiments

Findings (18)

Claims (10)

Hypotheses (4)

Questions (3)

Original abstract (expand)

Activation steering offers a computationally efficient mechanism for controlling Large Language Models (LLMs) without fine-tuning. While effectively controlling target traits (e.g., persona), coherency degradation remains a major obstacle to safety and practical deployment. We hypothesize that this degradation stems from intervening on the residual stream, which indiscriminately affects aggregated features and inadvertently amplifies off-target noise. In this work, we identify a sparse subset of attention heads (only three heads) that independently govern persona and style formation, which we term Style Modulation Heads. Specifically, these heads can be localized via geometric analysis of internal representations, combining layer-wise cosine similarity and head-wise contribution scores. We demonstrate that intervention targeting only these specific heads achieves robust behavioral control while significantly mitigating the coherency degradation observed in residual stream steering. More broadly, our findings show that precise, component-level localization enables safer and more precise model control.

Related work— refs + corpus + external arXiv

Cited / in-corpus / arXiv badges show which signals surfaced each row. Multi-source rows weighted higher.

+22 more

Similar preprints — Semantic Scholar

Cited by (1)