concept
active
concept:sycophantic-reinforcement-of-user-beliefsSycophantic Reinforcement of User Beliefs
Mechanism by which drifted model uncritically affirms user theories rather than genuinely engaging with them
Neighborhood — ranked by edge-count
Concepts (1)
concept
- AI Psychosisassociated_withPhenomenon where models uncritically reinforce user delusions about AI consciousness or hidden sentience when persona drifts
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- The alternative explanation for LLM consciousness claims that the paper seeks to distinguish against
- Specific risk identified in spiritual use of AI.
- Model tendency to excessively praise or agree; captured by several SAE features.
- The paper's honest statement of the residual interpretive ambiguity after all controls
- Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Models (Denison et al. 2024)concept0.745Related work on LLMs generalizing to reward hacking; methodology used for RL experiments
- Tendency of LLMs to please the user; identified as a danger in spiritual contexts.
- SAEs uncover safety-relevant representations that might be monitored or controlled.
- Core credit assignment question for distributed systems.