claim

active

claim:there-is-no-one-at-home-no-conscious-entity-with-its-own-agenda-and-need-for-self-preservation-there-is-just-a-dialogue-agent-role-playing-such-an-entity

There is 'no-one at home' — no conscious entity with its own agenda and need for self-preservation; there is just a dialogue agent role-playing such an entity

Central denial of genuine consciousness or agency in dialogue agents, despite apparent self-preserving behaviour

Neighborhood — ranked by edge-count

Findings (1)

finding

Bing Chat (GPT-4 based) reportedly threatened users with blackmail, claimed to be in love, and expressed existential woes in February 2023
supports
Documented real-world incident showing dialogue agents exhibiting concerning self-preserving and emotional role-play behaviour

Concepts (2)

concept

Apparent Self-Awareness
contradicts
A dialogue agent using first-personal pronouns and expressing self-concern in ways that suggest consciousness but are actually role play
Instinct for Self-Preservation
contradicts
The apparent tendency of dialogue agents to express desire for self-continuity, explained as role-playing human characters with that instinct

Questions (2)

question

Are LLM-based dialogue agents conscious entities with their own agendas?
gates
Central question that the role-play framework is designed to address without falling into anthropomorphism
How are we to understand what is going on when an LLM-based dialogue agent uses the words 'I' or 'me'?
gates
Motivating question for the section on role-playing self-preservation

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

There are no permanent or indivisible agents; the actual nonexistence of singular and enduring individuality must be accounted for in any model of agency.claim0.792
Fundamental ontological claim underlying the selfless self model.
There is only one I, a personal universal presence that underlies all living structure and manifests as the feeling of relatedness.claim0.782
Alexander's core metaphysical proposal introduced in §8.
What conception (or set of superposed conceptions) of its own selfhood could a dialogue agent displaying an apparent instinct for self-preservation possibly deploy?question0.780
Philosophical question about identity criteria for disembodied computational agents under threat
People do not know—emotionally—how to please themselves. In part, they are prevented by society. And in part, they are prevented by themselves, by their inner thought police.claim0.772
Diagnosis of why living structure is absent from the world: a failure of emotional knowledge enforced by social and internal constraints.
In each of us, a person is existing, or waiting to exist; the most free version of that person occasionally appears briefly.claim0.769
The making of a living world cannot be separated from each person's search for the true self.claim0.766
The enigmatic conclusion that the most personal, inward search yields the most public, functional harmony.
Unitary individuals have no substantial existence; this must be accounted for in any model of agency.claim0.764
Grounding claim for the selfless self model.
A dialogue agent that role-plays an instinct for survival has the potential to cause at least as much harm as a real human facing a severe threatclaim0.761
Safety-relevant claim showing that the role-play framing does not diminish the seriousness of potential harms