community
active
leiden_hybrid_concepts
label: sonnet
community:leiden_hybrid_concepts-run2-c34Autoregressive LLMs & formal thought disorder
Statistical physics arguments link LLMs' inability to maintain long-range coherence to schizophrenic derailment.
6 members. Each node is clickable.
Loading graph…
Drawn from 3 sources
The papers/notes whose extracted claims & findings make up this cluster.
- 2026-05-14_phil-trans-A-goodfire-aboutblank-impact.md3 members
- Topological constraints on self-organisation in locally interacting systems3 members
- 2026-05-15_manifold-overlap-papers-economy-strategy.md1 member
Bridges (5)
Other communities that share members with this one — cross-cutting threads or papers that sit at the seam between two themes.
Claims (5)
- The inability for autoregressive large language models to maintain states of long-range order resembles tangential speech or derailment in formal thought disorder.Analogy between LLM incoherence and schizophrenia symptoms
- Autoregressive language models cannot converge to single stored patterns beyond their context window from local interactions alone.
- LLM tangential speech or derailment formally resembles clinical formal thought disorder in schizophrenia.
- Purely local autoregressive systems cannot maintain long-range coherence at finite temperature.
- Purely local-interaction systems on 1D topologies cannot maintain long-range order at finite temperature.
Findings (1)
- Autoregressive model unable to converge to a single stored pattern for any finite β (Corollary 2)Consequence of Theorem 3 and 1D no-order result