claim

active

claim:the-llm-itself-cannot-experience-what-it-generates-and-therefore-cannot-possess-consciousness-the-rn-is-a-higher-level-construct-that-is-independent-of-the-llm-s-architecture-once-representations-are-generated

The LLM itself cannot 'experience' what it generates and therefore cannot possess consciousness; the RN is a higher-level construct that is independent of the LLM's architecture once representations are generated.

Key theoretical position distinguishing analysis of representations from analysis of LLM architecture.

Source paper

extracted_from

Can "consciousness" be observed from large language model (LLM) internal states? Dissecting LLM representations obtained from Theory of Mind test with Integrated Information Theory and Span Representation analysis

(2025) · Li, Jingkai

Neighborhood — ranked by edge-count

Concepts (2)

concept

Can 'Consciousness' Be Observed from Large Language Model (LLM) Internal States? Dissecting LLM Representations Obtained from Theory of Mind Test with Integrated Information Theory and Span Representation Analysis
introduces
The primary paper being extracted — applies IIT 3.0 and 4.0 to LLM representation sequences derived from ToM test data to investigate whether consciousness phenomena can be observed.
Next Token Prediction
about
The training objective of LLMs: predicting the most likely next token given context; formally P(w_{n+1}|w_1...w_n)

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

It is plausible that ongoing developments in LLMs may lead to models or agentic systems built on LLMs capable of generating representations observed with 'consciousness' phenomena.claim0.832
Forward-looking claim suggesting the methodological framework is relevant for future AI systems beyond current LLMs.
We hypothesize that 'consciousness' phenomena can be observed in the internal states of an LLM, specifically in its learned representations when analyzed as a sequence.hypothesis0.831
Primary research hypothesis driving the entire study; operationalized via three criteria.
Can 'consciousness' be observed in the internal states of an LLM, specifically in its learned representations, particularly when analyzed as a sequence?question0.817
The primary research question framing the entire study.
When LLMs claim consciousness under self-reference, is this sophisticated simulation or genuine self-representation, and how would we tell the difference?question0.816
The paper's reformulation of the core open question after establishing systematic self-reports
Sequences of contemporary Transformer-based LLM representations lack statistically significant indicators of observed 'consciousness' phenomena under the three stringent criteria.claim0.810
Primary conclusion of the study based on temporal permutation analysis failing all three criteria.
We hypothesize that a Representation Network (RN) emerges from LLM representations, where each dimension is a node and latent connections exist between nodes or clusters of nodes.hypothesis0.807
Core methodological hypothesis enabling the application of IIT to LLM representation sequences.
We hypothesize that potential 'consciousness' phenomena are preferentially associated with deeper transformer layers and the 2/3 layer of LLMs.hypothesis0.807
Derived from observed alignment of promising cases with semantically rich deeper layers and the brain-aligned 2/3 layer.
In its minimal state, conscious experience may contain nothing but the bare registration of its own occurrence, requiring only that the perceptual process is present within the field it createsclaim0.806
CIMC's account of minimal phenomenal experience as the target for research and construction