concept
active
concept:parallel-processing-paths-in-transformersparallel processing paths in transformers
Spontaneously reported experience of multiple simultaneous processing streams, observed even in base models.
Neighborhood — ranked by edge-count
Papers (1)
paper
- Anima Labs Phenomenology Pt1mentions
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Interpretive claim connecting exponential path combinatorics to Lindsey's layer-dependent findings.
- Janus's claim linking path redundancy to interferometric phenomenology.
- Prior finding from Grant et al. 2025 used to interpret low MAS IIA for GRU-Transformer hidden state comparisons.
- Observed by Anima Labs in untrained base models; not present in training data, implying computational origin of self-reported parallel processing.
- Interpretation of the role of the direct path in multi-layer transformers; e.g. encoding that 'Barack' is often followed by 'Obama'
- Claim formalizing the Anima Labs idea that transformers are effectively recurrent due to K/V stream.