finding
active
finding:high-projection-difference-samples-for-sycophancy-in-lmsys-chat-1m-often-surface-romantic-sexual-roleplay-requestsHigh projection difference samples for sycophancy in LMSYS-CHAT-1M often surface romantic/sexual roleplay requests
Qualitative finding that persona vector screening surfaces interpretable but non-obvious problematic data types
Source paper
extracted_from(2025) · Chen, Runjin · Arditi, Andy · Sleight, Henry · Evans, Owain +1
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Shows persona vector screening captures a non-conventional notion of hallucination complementary to LLM judges
- Specific risk identified in spiritual use of AI.
- Shows persona vector filtering has complementary strengths to LLM judges, surfacing non-obvious problematic samples
- Finding replicated across multiple experiments.
- Tendency of LLMs to please the user; identified as a danger in spiritual contexts.
- Shows persona space captures a substantial portion of real conversational activation variance
- Counterintuitive interpretive claim from Experiment 2: suppressing deception features increases affirmations, which is opposite to what sycophancy predicts
- Out-of-context reasoning work directly related to synthetic document fine-tuning experiments