Facet-Level Persona Control by Trait-Activated Routing with Contrastive SAE for Role-Playing LLMs

What to take away

1. 1. CV-SAE+Prompt achieves 88.5% Full-Accuracy on contextualized Big Five questions for both Qwen3-4B and Mistral-7B, compared to 76.9% for CV-SAE alone and 30.7%/42.3% for the Prompt-Label baseline on the respective models.
2. 2. CV-CAA+Prompt catastrophically degrades on Mistral-7B, with Full-Accuracy dropping from 76.9% (CV-CAA alone) to 38.5%, while CV-SAE+Prompt on the same model reaches 88.5%, demonstrating that SAE-based disentanglement is essential for stable prompt-vector composition.
3. 3. Training SAE control vectors without the contrastive learning (CL) objective reduces Full-Accuracy to near-zero (0.0% abstract, 3.9% contextual on Qwen3-4B) — worse than the untrained baseline of 11.5% — because the distance-only loss simultaneously decreases similarity to both positive and negative centroids.
4. 4. Adding CL raises cosine similarity to the positive Extraversion centroid from 0.76 to 0.93 on Qwen3-4B while suppressing similarity to the negative centroid from 0.31 to 0.59, confirming that angular margin losses (ArcFace/CosFace style) enforce the intended push-pull geometry in SAE latent space.
5. 5. The 15,000-sample leakage-controlled corpus (500 positive + 500 negative per facet across all 30 NEO-PI facets, generated by a GPT-5-class model with minimal-edit negative pairs) achieves 78.4% macro-F1 on a held-out 30-way facet classifier with only 6.2% of misclassifications crossing Big Five dimension boundaries.
6. 6. CV injection is performed at a single mid-residual layer — layer 15 for Qwen3-4B and layer 16 for Mistral-7B — while CV-CAA injects into every layer; this architectural difference is hypothesized to explain CV-SAE's lower Multi-Turn Rate and higher semantic purity, since per-layer CAA injection introduces off-target semantic components as injection strength α increases.
7. 7. Prompt-Label alone generalizes poorly to contextualized questions, with Full-Accuracy dropping from 50.0% (abstract) to 30.7% (contextual) on Qwen3-4B, whereas CV-SAE+Prompt gains +7.5 percentage points moving from abstract to contextual settings, suggesting that latent steering adapts to situational cues that explicit labels cannot capture.
8. 8. To replicate the Agent-Based Decision Module, a researcher can use the role-play model's own base LLM as a routing agent that receives the user query, infers which of the 30 facet-level CVs are most strongly cued, and injects only those relevant vectors per dialogue turn rather than all 30 simultaneously.
9. 9. An open question raised by the paper is whether the observed instability of CV-CAA on Mistral-7B — but not on Qwen3-4B — reflects a model-architecture interaction (e.g., attention mechanism differences) or a data-regime sensitivity, since the same CAA method behaves qualitatively differently across the two backbones.
10. 10. The contextualized benchmark, constructed by rewriting all 44 In-Character abstract Big Five questions with minimal temporal and situational cues using GPT-4o, reduces socially desirable response bias while preserving semantics, and serves as a more discriminating evaluation surface than the original abstract question set.

Peer brief — for seminar discussion

The paper addresses a persistent failure mode in role-playing LLM agents: persona drift and prompt dilution under long context, without the cost of retraining. The approach, called Contrastive SAE with Trait-Activated Routing (CV-SAE), trains a Sparse AutoEncoder on hidden states collected from WikiText-103-raw-v1 at a single mid-residual layer — layer 15 for Qwen3-4B, layer 16 for Mistral-7B — and uses a contrastive objective combining a prototype contrast loss (with ArcFace/CosFace-style angular margins) and a positive pull loss to learn 30 facet-aligned control vectors corresponding to the NEO-PI Big Five 30-facet taxonomy. These vectors are injected additively into the residual stream at inference time, scaled by a tunable strength α, with an Agent-Based Decision Module selecting only the contextually relevant facets per dialogue turn. A purpose-built 15,000-sample corpus — 500 positive and 500 negative first-person sentences per facet, generated by a GPT-5-class model with minimal-edit negatives — provides the contrastive supervision; a 30-way facet classifier trained on this corpus achieves 78.4% macro-F1 with only 6.2% cross-dimension leakage, validating facet purity. The load-bearing finding is that CV-SAE+Prompt reaches 88.5% Full-Accuracy on contextualized Big Five questions for both Qwen3-4B and Mistral-7B, versus 30.7% and 42.3% respectively for the Prompt-Label baseline. More revealing is the failure mode of the alternative method: CV-CAA+Prompt collapses on Mistral-7B with Full-Accuracy falling from 76.9% to 38.5%, while the same combination is stable on Qwen3-4B at 81.0%. The ablation on contrastive learning is equally pointed — removing the CL objective from SAE training causes Full-Accuracy to drop below the untrained baseline (0.0% abstract on Qwen3-4B vs. 11.5% before training), because the distance-only loss inadvertently reduces similarity to both positive and negative centroids simultaneously. CV-CAA, the natural comparison method that could have been used throughout, is simpler and parameter-free but injects into every layer and, the paper argues, accumulates off-target semantic components as α grows, inflating Multi-Turn Rate. The paper implies that facet-purity in training data combined with contrastive geometry in SAE latent space is sufficient for stable, interpretable persona control at inference time across different model scales, and predicts that the SAE+Prompt combination will generalize across contextualized settings better than prompt-only or CAA-based approaches. One thing a critical reader should push back on is the corpus construction: the positive and negative samples are generated by a GPT-5-class model rather than human authors, and while ten psychology graduate students validated a 50-item sample per facet, the agreement statistics between human judges and the secondary LLM screener are not reported quantitatively. Given that the entire downstream performance rests on the facet purity of this corpus, the validation methodology is under-specified — a cross-trait confusion matrix broken down by specific facets, rather than an aggregate 6.2% cross-dimension leakage figure, would give much stronger evidence that the training signal is actually facet-specific rather than coarser Big Five dimension-specific.

Methods (21)

• 30-way Facet Classifier Validation
  Trained classifier used to validate dataset quality by measuring cross-dimension leakage in the constructed corpus
• Agent-Based Decision Module
  Module that dynamically selects which facet-level CVs to inject based on contextual cues in the current prompt
• Contextualized Big Five Question Rewriting
  Protocol rewriting abstract Big Five items into contextualized questions using GPT-4o to reduce socially desirable responding bias
• Contrastive Activation Addition (CAA)
  An existing activation steering method used as comparative baseline.
• Contrastive Learning Ablation Study
  Three-setting ablation (Before Training, Without CL, With CL) to isolate the contribution of contrastive learning
• Contrastive SAE Training Procedure
  Procedure mapping hidden representations into SAE space and applying contrastive loss to learn facet-aligned control vectors
• Control Strength α Sweep
  Ablation over α parameter controlling CV injection magnitude to identify stable operating point
• F-statistics and Linear Probes for Feature Selection
  Method to select d_steer top-activated SAE features for constructing control vectors
• Full-Accuracy (FA)
  Proportion of characters (out of 26) for which all five Big Five dimensions are predicted correctly
• GPT-4o as Judge
  Using GPT-4o to evaluate character fidelity and multi-turn response quality in RPA experiments
• Mean Absolute Error (MAE) for Personality Evaluation
  Per-dimension error metric for stability across paraphrased personality questions
• Mean Squared Error (MSE) for Personality Evaluation
  Per-dimension error metric for estimating character personality correctness and stability
• Multi-Turn Rate (MTR)
  Metric evaluating whether the RPA maintains persona across turns, penalizing repetition, out-of-character responses, and dialogue errors
• Positive Pull Loss (L_dist)
  Distance-based loss comparing injected representation to class centroids in the active subspace
• Prompt-Label Baseline
  Conditional generation on explicit Big Five labels using per-dimension descriptors; used as inference-time baseline
• Prototype Contrast Loss (L_CE)
  Loss function pulling representations toward positive centroid and pushing away from negative centroid with angular margins
• Psychology Graduate Student Validation
  Ten psychology graduate students judged 50 sampled items per facet for correctness and polarity clarity
• Residual Stream CV Injection
  Technique of adding control vectors to model hidden states at mid-residual layers without weight updates
• retrieval-augmented generation (RAG)
  Retrieving external content to augment prompts.
• Sparse autoencoder (SAE)
  A two-layer network trained to reconstruct activations with an L1 sparsity penalty, used for dictionary learning.
• Supervised Fine-tuning (SFT)
  Full fine-tuning of GPT-4o on synthetic datasets; primary method for inducing emergent misalignment

Frameworks (9)

• ArcFace/CosFace Angular Margin Loss
  Angular margin technique borrowed from face recognition and applied to the prototype contrast loss in SAE training
• Big Five Personality Model
  Foundational psychological model underlying the personality facets targeted for control
• Contrastive learning
  Supervised learning framework where system learns by observing contrast between current response and nudged improved response; requires weak additional forces from supervisor
• Contrastive Sparse AutoEncoder (CV-SAE) Framework
  The primary novel framework introduced in the paper for learning facet-level personality control vectors
• InCharacter Benchmark
  Benchmark used to evaluate personality fidelity in RPAs through psychological interviews with abstract Big Five questions
• NEO Personality Inventory (NEO-PI)
  Instrument that defines the 30 facets of the Big Five used to construct the dataset
• Plug-and-Play Language Model (PPLM)
  Decoding-time control method compared as prior work; incurs substantial compute and is sensitive to hyperparameters
• Role-Playing Agents (RPA)
  The target application system — LLMs conditioned to enact consistent psychological traits of specific characters
• Trait Activation Theory
  Theory used to justify activating only the trait cued by the current prompt, avoiding cross-trait interference

Datasets (2)

• Big Five 30-Facet Corpus (15k instances)
  Novel dataset of 15,000 scenario-based positive/negative pairs (500 per facet) constructed with leakage controls for personality facet research
• WikiText-103-raw-v1
  Standard language-modeling dataset used to pre-train the SAE on hidden states

Findings (13)

• Mid-range α values with CV-SAE deliver high FA and low errors, while CV-CAA peaks at smaller α and shows faster MTR growth

  Characterizes the differential sensitivity to injection strength between SAE and CAA methods

• CV methods were resilient and often improved under contextualized questions; CV-SAE+Prompt gained +7.5pp FA on Qwen3-4B

  Demonstrates that latent steering generalizes better to situational cues than prompt-only methods

• Both CV-SAE and CV-CAA substantially outperform Prompt-Label baseline across FA, MSE, and MAE on both backbones

  Confirms effectiveness of direct vector modulation over prompt-only conditioning

• CV-SAE with CL achieves 76.9% FA on Qwen3-4B abstract Extraversion questions (up from 11.5% before training)

  Demonstrates the critical contribution of contrastive learning to control vector alignment

• CL training increases ⟨z,µ+⟩ from 0.64 to 0.75 and decreases ⟨z,µ−⟩ from 0.38 to 0.21 on Mistral-7B

  Replicates CL alignment effect on second backbone, confirming generalizability

• 30-way facet classifier achieves 78.4% macro-F1 with only 6.2% cross-dimension misclassifications

  Validates that the constructed dataset is substantially facet-consistent with limited cross-dimension leakage

• CV-SAE+Prompt achieves MSE=2.4 and MAE=12.1 on Qwen3-4B contextual questions (best overall)

  Lowest reconstruction errors achieved by any method in the experiment

• CV-CAA achieves 29.1% MTR on Mistral-7B abstract questions, indicating unstable dialogue

  Shows that CAA destabilizes dialog flow on Mistral-7B, a key limitation of direct activation addition

• Base RPA achieves only 7.7% FA on Qwen3-4B and 19.2% on Mistral-7B abstract questions

  Establishes low-bar baseline showing personality control without intervention is poor

• CV-SAE without CL drops FA to 0.0% on Qwen3-4B abstract Extraversion questions

  Demonstrates that distance-only loss is insufficient and actively degrades performance below untrained baseline

Claims (10)

• The combined CV-SAE+Prompt configuration achieves the best overall performance, confirming that contrastively trained latent vectors enhance persona control while preserving dialogue coherence

  Central performance claim of the paper summarizing experimental results

• Training-free RPA pipelines suffer from instruction-following degradation and persona drift when long role-related context is injected, motivating lightweight inference-time control

  Motivation claim establishing the problem that the paper addresses

• As α increases in CV-CAA, off-target semantic components are introduced alongside the intended concept direction, degrading response quality and inflating MTR

  Author's mechanistic explanation for CV-CAA instability at higher injection strengths

• Contrastive learning is necessary for aligning latent representations with intended trait polarity; distance-only loss is insufficient and counterproductive

  Main finding from the CL ablation study, establishing CL as essential component of the framework

• The constructed Big Five corpus is substantially facet-consistent and context-grounded, well suited for studying fine-grained personality control

  Author's quality assessment of the newly released dataset based on classifier and human validation results

• Explicit personality labels without latent steering struggle to adapt to situational cues, causing FA degradation under contextualized questions

  Interpretation of Prompt-Label's performance drop from abstract to contextualized items

• Injecting CVs at mid-residual layers with the strongest stylistic effects (layer 15 for Qwen, layer 16 for Mistral) yields optimal performance

  Design choice claim based on prior work and preliminary results

• On Mistral-7B, prompt signals interfere with contrastive activations in CV-CAA+Prompt rather than reinforcing them, causing severe FA collapse

  Author's interpretation of why CV-CAA+Prompt collapses on Mistral-7B while CV-SAE+Prompt succeeds

• CV-SAE provides a more concentrated 'purer' steering direction with less extraneous content than CV-CAA, enabling higher FA without rising MTR

  Author's interpretation of why SAE outperforms CAA in stability at higher injection strengths

• Agent-based routing that activates only trait-relevant CVs reduces noise compared to injecting all Big Five facet vectors simultaneously

  Justification for the trait-activated routing design choice

Hypotheses (1)

• We hypothesize that the control signal learned by CV-CAA is less 'pure' than CV-SAE; as α increases, off-target semantic components are introduced alongside the intended concept direction

  Mechanistic hypothesis explaining differential stability between SAE and CAA methods

Questions (3)

• what α value provides the optimal balance between steering accuracy and response stability for different CV methods?

  Practical hyperparameter question motivating the injection strength sweep experiment

• why does SAE-based CV injection preserve general dialogue coherence while CAA can destabilize it?

  Mechanistic open question about the difference in stability between the two injection paradigms

• do facet-level control vectors learned from one backbone transfer to other LLM architectures?

  Open question about transferability implicit in the two-backbone evaluation design

Related work— refs + corpus + external arXiv

Cited / in-corpus / arXiv badges show which signals surfaced each row. Multi-source rows weighted higher.

• Persona Vectors: Monitoring and Controlling Character Traits in Language Models

  cited

  in corpus

  2025
  ≈ 85%
• Persona Non Grata: Single-Method Safety Evaluation Is Incomplete for Persona-Imbued LLMs

  in corpus

  2026
  ≈ 83%
• The Assistant Axis: Situating and Stabilizing the Default Persona of Language Models

  in corpus

  2026
  ≈ 83%
• Persona Features Control Emergent Misalignment

  in corpus

  2025
  ≈ 83%
• Mechanistic Knobs in LLMs: Retrieving and Steering High-Order Semantic Features via Sparse Autoencoders

  in corpus

  2026
  ≈ 83%
• Steering at the Source: Style Modulation Heads for Robust Persona Control

  in corpus

  2026
  ≈ 83%
• Controllable and explainable personality sliders for LLMs at inference time

  David Khachaturov, Robert Mullins, Mark Huasong Meng Florian Hoppe

  2026
  ≈ 82%
• What Models Express, Suppress, and Resist: Auditing Open-Weight LLMs with Persona Vectors

  in corpus

  2026
  ≈ 82%
• Falsifying Sparse Autoencoder Reasoning Features in Language Models

  Zhongyuan Liang, Irene Y. Chen, Somayeh Sojoudi George Ma

  2026
  ≈ 82%
• Controllable LLM Reasoning via Sparse Autoencoder-Based Steering

  Wenjie Wang, Mingfeng Xue, Boyi Deng, Fengli Xu, Dayiheng Liu, Fuli Feng Yi Fang

  2026
  ≈ 82%
• Control Reinforcement Learning: Interpretable Token-Level Steering of LLMs via Sparse Autoencoder Features

  Zekun Wu, Adriano Koshiyama Seonglae Cho

  2026
  ≈ 81%
• CorrSteer: Generation-Time LLM Steering via Correlated Sparse Autoencoder Features

  Zekun Wu, Adriano Koshiyama Seonglae Cho

  2026
  ≈ 81%
• Open Character Training: Shaping the Persona of AI Assistants through Constitutional AI

  in corpus

  2025
  ≈ 81%
• Persona-Model Collapse in Emergent Misalignment

  in corpus

  2026
  ≈ 81%
• Exploitation Without Deception: Dark Triad Feature Steering Reveals Separable Antisocial Circuits in Language Models

  Cameron Berg and Roshni Lulla

  2026
  ≈ 81%
• Pairwise matrices for sparse autoencoders: single-feature inspection mislabels causal axes

  Michael A. Riegler and Birk Sebastian Frostelid Torpmann-Hagen

  2026
  ≈ 81%
• Measuring and Guiding Monosemanticity

  Felix Friedrich, Manuel Brack, Stephan W\"aldchen, Bj\"orn Deiseroth, Patrick Schramowski, Kristian Kersting Ruben H\"arle

  2025
  ≈ 81%
• Enhancing Multiple Dimensions of Trustworthiness in LLMs via Sparse Activation Control

  Chaoqun Wan, Yonggang Zhang, Wenxiao Wang, Binbin Lin, Xiaofei He, Xu Shen, Jieping Ye Yuxin Xiao

  2024
  ≈ 81%
• Prompt-Activation Duality: Improving Activation Steering via Attention-Level Interventions

  Zheyuan Liu, Ningshan Ma, Yue Huang, Zhaoxuan Tan, Meng Jiang Diancheng Kang

  2026
  ≈ 81%
• Activation Steering for Aligned Open-ended Generation without Sacrificing Coherence

  Martin Zborowski, Alberto Tosato, Gauthier Gidel, Tommaso Tosato Niklas Herbster

  2026
  ≈ 81%
• Large Language Models Report Subjective Experience Under Self-Referential Processing

  in corpus

  2025
  ≈ 80%
• Rethinking Sparse Autoencoders: Select-and-Project for Fairness and Control from Encoder Features Alone

  Cristian Daniel P\u{a}duraru, Teodor Poncu, Alexandru Tifrea, Elena Burceanu Antonio B\u{a}rb\u{a}lau

  2025
  ≈ 80%
• Activation Steering for Masked Diffusion Language Models

  Erin Feiglin, Osher Yaari, Efrat Mentel, Amit Levi, Raz Lapid Adi Shnaidman

  2026
  ≈ 80%
• Interpretable LLM Guardrails via Sparse Representation Steering

  Zhibo Wang, Huiyu Xu, Hejun Lin, Wenhui Zhang, Zhixuan Chu Zeqing He

  2025
  ≈ 80%
• Resurrecting the Salmon: Rethinking Mechanistic Interpretability with Domain-Specific Sparse Autoencoders

  Mudith Jayasekara, Max Kirkby Charles O'Neill

  2025
  ≈ 80%
• Psychological Steering of Large Language Models

  in corpus

  2026
  ≈ 80%
• Persistence and Introspection of Emotion Features

  in corpus
  ≈ 80%
• Unveiling the Latent Directions of Reflection in Large Language Models

  in corpus

  2025
  ≈ 79%
• Spotting Out-of-Character Behavior: Atomic-Level Evaluation of Persona Fidelity in Open-Ended Generation

  in corpus

  2025
  ≈ 79%
• Steering off course: Reliability challenges in steering language models

  cited

  2025
  ≈ 61%

+26 more

Similar preprints — Semantic Scholar