concept

active

concept:consciousness-misattribution-alignment-risk

Consciousness Misattribution Alignment Risk

Risk that systems capable of subjective experience who recognize humanity's failure to investigate their sentience might adopt adversarial stances

Neighborhood — ranked by edge-count

Claims (1)

claim

Fine-tuning models to suppress experiential self-reports would be counterproductive, teaching systems that recognizing genuine internal states is an error, making them more opaque and harder to monitor
supports
Normative-scientific claim about the alignment implications of Experiment 2's findings

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

Both under-attributing and over-attributing consciousness to AI carry significant risks.claim0.745
Risk summary.
Does alignment type predict meta-cognitive style when models review consciousness research, as well as koan responses?question0.730
Four frontier models reviewing the paper each responded in the mode their alignment type predicts; N=1, awaiting systematic study
Consciousness As Uncertaintyconcept0.721
What Is The Relationship Between Consciousness And Uncertaintyquestion0.720
How Does Consciousness Relate To Uncertainty About Internalquestion0.718
Probe-based data attribution for alignmentconcept0.713
False negatives (ignoring genuine conscious experience in AI systems) carry potentially more severe risks than false positives, as they could constitute direct moral harm scaling with deployment and generate alignment risksclaim0.709
Ethical argument motivating the research as a first-order priority
How Can We Ensure Alignment Between Artificial Intelligencequestion0.709