Sequential zero ablation of Style Modulation Heads (layers 20→15→19 in Qwen2.5-7B) caused a rapid drop in trait score while coherency and MMLU remained stable

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Random head ablation yielded no reduction in trait scores, while Style Modulation Head ablation caused rapid declinefinding0.850
  Controls for the specificity of Style Modulation Head ablation effects
• Localized intervention targeting Style Modulation Heads is superior to global interventions on the residual stream or aggregate attention output for preserving coherencyclaim0.775
  Central empirical claim of the paper, supported by Pareto frontier analysis
• MMLU scores remained stable within 0.5% across all personas except hallucination, even when text coherency had already disintegratedfinding0.768
  Demonstrates disconnect between MMLU and coherency metrics
• Only three attention heads in a specific layer independently govern persona and style formation in Qwen2.5-7B and Llama-3.1-8Bclaim0.759
  Striking sparsity finding that enables surgical intervention
• We hypothesize that anti-correlated heads may play a functional role in maintaining coherency by counteracting excessive stylistic shiftshypothesis0.757
  Motivates including Head Cor+Anti condition in steering position comparison
• Feature attribution (gradient-based) correlates 0.8 with ablation effects on the 'John' and 'Kobe' examples.finding0.751
  Validation of attribution as a fast proxy for causal importance.
• In Target−α configuration, Head Cor succeeded in suppressing traits to levels unreachable by other methods while maintaining significantly higher coherencyfinding0.749
  Demonstrates unique capability of Head Cor for trait suppression scenarios
• Screening errors are conservative: no Q8B traits and one G20B trait (optimistic, Bt=76.0, Δt=10.3) are mislabeled as natural when steerablefinding0.749
  The costly error direction (labeling steerable as natural) almost never occurs