question
active
question:does-autoregressive-use-of-transformer-based-llms-constitute-algorithmic-recurrence-for-rpt-1-or-does-it-depend-on-where-we-draw-the-system-boundaryDoes autoregressive use of transformer-based LLMs constitute algorithmic recurrence for RPT-1, or does it depend on where we draw the system boundary?
Concrete interpretive challenge in applying RPT-1 indicator to current LLMs
Source paper
extracted_from(2025) · Patrick Butlin · Robert P. Long · Tim Bayne · Yoshua Bengio +16
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- LeCun's post on X supporting the view that fixed-step probabilistic prediction precludes consciousness in LLMs.
- Indicator derived from RPT: use of algorithmic recurrence in input modules.
- Transformers are recurrent through autoregression because the K/V stream provides horizontal information flow across positions, even though each forward pass is feedforward.
- Claim formalizing the Anima Labs idea that transformers are effectively recurrent due to K/V stream.
- Illustrates how even simple AI properties can be informative as sensitive negative-direction indicators
- Support for RPT-1.
- The central research question motivating the paper