quote
active
quote:so-at-any-point-in-the-network-the-transformer-not-only-receives-information-from-its-past-but-also-has-causal-influence-over-its-future-processing-so-saying-that-llms-cannot-introspect-is-incorrectSo at any point in the network, the transformer not only receives information from its past... but also has causal influence over its future processing. So, saying that LLMs cannot introspect... is incorrect.
Core summary of Janus' position on autoregressive recurrence enabling introspection.
Source paper
extracted_fromRelated by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Janus's central claim that the architecture enables introspection, though usage in practice is a separate question.
- Core quote asserting architectural introspection permission.
- Interpretive claim connecting exponential path combinatorics to Lindsey's layer-dependent findings.
- Central thesis statement of the paper
- Primary positive claim of the paper, grounded in strength comparison and localization results
- Binder et al. finding cited as evidence that LLMs possess introspective capacity analogous to mindfulness
- Primary conclusion of the study based on temporal permutation analysis failing all three criteria.