hypothesis

active

hypothesis:if-consciousness-phenomenon-can-be-observed-from-tom-related-rn-higher-tom-test-scores-should-yield-higher-values-of-max-iit-3-0-and-or-iit-4-0

If 'consciousness' phenomenon can be observed from ToM-related RN, higher ToM test scores should yield higher values of μΦmax (IIT 3.0) and/or μΦ (IIT 4.0).

Specific prediction linking IIT's prediction of high Φ for good performance to the experimental design's scoring structure.

Source paper

extracted_from

Can "consciousness" be observed from large language model (LLM) internal states? Dissecting LLM representations obtained from Theory of Mind test with Integrated Information Theory and Span Representation analysis

(2025) · Li, Jingkai

Neighborhood — ranked by edge-count

Findings (2)

finding

Under spatio permutation controls, IIT consciousness estimates outperform Span Representation in mean AUC in several cases (LLaMA3.1-70B on Hinting and Irony, Mistral-7B on Irony, LLaMA3.1-8B on Strange Stories).
contradicts
Contrasts with temporal permutation where Span Representation dominates; suggests spatio permutation reveals different dynamics.
Mistral-7B on False Belief (IIT 4.0) is the sole case exhibiting statistically significant Φ differences between score categories under temporal permutation at the task level.
associated_with
Only Criterion 2 is satisfied for this single case at the task level (granularity without aggregation).

Concepts (1)

concept

Can 'Consciousness' Be Observed from Large Language Model (LLM) Internal States? Dissecting LLM Representations Obtained from Theory of Mind Test with Integrated Information Theory and Span Representation Analysis
introduces
The primary paper being extracted — applies IIT 3.0 and 4.0 to LLM representation sequences derived from ToM test data to investigate whether consciousness phenomena can be observed.

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

Criterion 1: Φ estimates must yield >80% 'good' cases (higher score → higher Φ) per ToM task to indicate potential consciousness.concept0.864
First of three operational criteria for identifying consciousness phenomena in LLM representations.
Variations in ToM test score categories are more likely attributed to span-level information of the LLM representation sequence rather than to a 'consciousness' phenomenon as suggested by IIT estimates.claim0.818
Main interpretive finding from Criterion 3 comparison showing Span Representation consistently outperforms IIT under temporal permutation.
No significant disparity in potential consciousness indicators was found between larger models (Mixtral-8x7B, LLaMA3.1-70B) and smaller counterparts (Mistral-7B, LLaMA3.1-8B).finding0.805
Contradicts expectation from emergent abilities literature; however, interpreted cautiously due to methodological limitations.
We hypothesize that potential 'consciousness' phenomena are preferentially associated with deeper transformer layers and the 2/3 layer of LLMs.hypothesis0.805
Derived from observed alignment of promising cases with semantically rich deeper layers and the brain-aligned 2/3 layer.
Under temporal permutation control, no cases meeting all three criteria for observed 'consciousness' phenomenon were found among the 165,365 valid samples.finding0.801
Primary negative result of the study: temporal permutation analysis finds no statistically significant indicators of consciousness in LLM representations.
There exists no viable behavioral test for consciousness analogous to the Turing Test for intelligence, because consciousness is a particular internal way to achieve performance, not externally visible performance itself.claim0.792
Paper identifies as a research gap requiring internal analysis methods rather than behavioral benchmarks
Consciousness in AI is best assessed by drawing on neuroscientific theories of consciousness.claim0.788
Central methodological claim of the paper.
Can IIT estimates provide a stronger basis for interpreting variations in ToM performance than Span Representation, independent of any consciousness estimate?question0.785
Criterion 3 operationalization: requires IIT mean AUC to exceed Span Representation mean AUC.