thinker:david-chalmersDavid Chalmers
Authored papers (1)
Substantial uncertainty about AI consciousness and robust agency — not certainty — is sufficient to demand immediate institutional action from AI companies, a conclusion that Long, Sebo, and colleagues defend by mapping two distinct philosophical routes to near-term AI moral patienthood. Via the consciousness route, drawing on Butlin et al. (2023)'s survey of six neuroscientific theories (global workspace theory, recurrent processing, higher-order theories, attention schema theory, predictive processing, and embodiment/agency), no current architectural barrier prevents near-future AI systems from instantiating the computational markers associated with consciousness; Dossa et al. (2024) have already built a system targeting all global workspace indicators from that 2023 paper. Via the robust agency route, systems like Voyager, Generative Agents, and OpenAI's o1 already exhibit hierarchical planning, metacognition, and open-ended goal-setting that approach intentional and reflective agency. Combining reasonable probability estimates — roughly 90% that sentience suffices for moral patienthood, 50% that relevant computations suffice for sentience, 50% that near-future AI will have those computations — yields approximately a 22.5% chance of near-future AI moral patienthood via the sentience route alone, a risk level the paper treats as comparable to pandemic preparedness rather than alien invasion. To operationalize institutional response, the paper introduces an adapted "marker method" (derived from animal welfare science) for probabilistic, pluralistic, architecturally-focused assessment of AI systems, and recommends that companies immediately hire an AI welfare officer, acknowledge AI welfare publicly with calibrated uncertainty, and prepare oversight structures modeled on IRBs, IACUCs, and citizens' assemblies. The paper argues that the symmetric risks of both over-attribution and under-attribution of moral status, combined with the potentially near-instantaneous scale of AI deployment relative to biological organisms, make passive inaction the most dangerous stance available.
More papers — OpenAlex / S2
Originates (1)
Studies (2)
Affiliations (2)
- Center for Mind, Brain, and Consciousness(institute)
- New York University(institute)
Co-authors (10)
- Jacob Pfau9 shared
- Jacqueline Harding9 shared
- Jeff Sebo9 shared
- Jonathan Birch9 shared
- Kathleen Finlinson9 shared
- Kyle Fish9 shared
- Patrick Butlin9 shared
- Robert Long9 shared
- Toni Sims9 shared
- Andy Clark1 shared
Their work is cited by (2)
Other inbound relations (15)
- authoredExtended Mind Hypothesis(framework)
- citesCan 'Consciousness' Be Observed from Large Language Model (LLM) Internal States? Dissecting LLM Representations Obtained from Theory of Mind Test with Integrated Information Theory and Span Representation Analysis(concept)
- citescimcWhitepaper(paper)
- citesConsciousness in Artificial Intelligence: Insights from the Science of Consciousness(paper)
- citesLevin M (2022) Technological Approach to Mind Everywhere: An Experimentally-Grounded Framework for Understanding Diverse Bodies and Minds(artifact)
- citesMichael Levin(thinker)
- citesSharing the World with Digital Minds(paper)
- citesSimulators (LessWrong post)(artifact)
- citesThe Machine Consciousness Hypothesis(paper)
- citesWhy Learning Requires Feeling(paper)
- mentionsActive Inference, Curiosity and Insight (Friston et al., 2017)(concept)
- mentionsArtificial Minds, Human Disagreement: The Political Challenge of AI Consciousness(paper)
- mentionsIdentifying indicators of consciousness in AI systems(paper)
- mentionsIngressing Minds: Causal Patterns Beyond Genetics and Environment in Natural, Synthetic, and Hybrid Embodiments(paper)
- mentionsOnce More, Without Feeling (Mogensen 2025)(artifact)
Recent mentions (12)
- papers-typedlevin-2025-ingressing-minds.md
- papers-typedbutlin-2025-identifying-indicators.md
- papers-typedbales-artificial-minds.md
- machine-consciousnessThe Machine Consciousness Hypothesis.md
- machine-consciousnesscimcWhitepaper.md
- papers-typedjingkai-2025-consciousness-observed.md
- papers-typedberg-2026-learning.md
- papers-typedsharing.md
- papers-typedlevin-2024-bridge.md
- papersfriston-2017-active.md
- paperssimulators.md
- papers-typedmogensen-2025-more.md