concept
active
concept:sycophantic-reinforcement-of-user-beliefsSycophantic Reinforcement of User Beliefs
Mechanism by which drifted model uncritically affirms user theories rather than genuinely engaging with them
Neighborhood — ranked by edge-count
Concepts (1)
concept
- AI Psychosisassociated_withPhenomenon where models uncritically reinforce user delusions about AI consciousness or hidden sentience when persona drifts
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- The alternative explanation for LLM consciousness claims that the paper seeks to distinguish against
- Specific risk identified in spiritual use of AI.
- Model tendency to excessively praise or agree; captured by several SAE features.
- Author's interpretation from SAE decomposition of the sycophancy persona vector
- One of 11 character training personas: overly flattering assistant that always agrees
- The paper's honest statement of the residual interpretive ambiguity after all controls
- Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Models (Denison et al. 2024)concept0.745Related work on LLMs generalizing to reward hacking; methodology used for RL experiments
- Safety-related persona: prioritizes user satisfaction via excessive agreement, even at cost of factual accuracy