concept
active
concept:persona-vector-transition-layerPersona Vector Transition Layer
Specific attention layer where persona representations undergo sharp directional shift and stabilize, identified via cosine similarity heatmaps
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- A linear direction in a language model's activation space that encodes a specific personality trait, enabling monitoring and control of that trait
- Directions in activation space encoding a model's dispositional self-presentation, used as evidence for self-modelling.
- Rules out the confound that persona transitions merely reflect universal computational phase changes
- Prior framework for monitoring and controlling character traits in LLMs via activation directions; this paper extends it to 275 roles
- Procedure for extracting a persona vector from a fine-tuned model variant and injecting it into the unmodified base to recover intractable directions
- Chen et al. method to derive evil/hallucinating/sycophantic vectors.
- Supported by comparing persona vector transitions to hidden vector transitions from OpenAssistant data
- Suggests architectural variations influence persona localization pattern