concept
active
concept:exponential-path-combinatoricsexponential path combinatorics
The number of distinct paths information can travel from point A to B in a transformer is C(m+n, n), quickly exceeding the number of atoms in the universe.
Neighborhood — ranked by edge-count
Papers (1)
paper
Concepts (1)
concept
- Interferometric Cognitionassociated_withIdea that redundant information paths create interference patterns, leading to memory and cognition experienced as interferometric and continuous.
Artifacts (1)
artifact
- Original thread by janus explaining transformer information highways and introspection capabilities, posted on X.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- The process by which patterns are used sequentially in design, combining and recombining to generate living centers
- The core analytical technique of expanding transformer computations from layer-by-layer products into sums of end-to-end path terms for independent analysis
- A trajectory through time and space that an agent's care follows, potentially becoming infinite via the bodhisattva vow.
- The path in activation space derived by optimizing steering interventions to produce outputs along the behavior manifold, independent of representation geometry.
- The path in activation space derived by fitting the representation manifold, used to steer along the geometric structure of internal representations.
- Structural arrangement of interactions on a graph; argued to be the critical determinant of self-organisation capability
- Neural mechanism for tracking location through accumulation of self-movement vectors; shown to play the role of position encodings in TEM.
- An approach training agents to avoid unsafe pathways leading to deception, informed by Causal Influence Diagrams