Transformer can be viewed as a Wolfram causal graph with foliations specifying computation order.

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

• Wolfram Causal Graphframework0.797
  A framework from Wolfram physics viewing computation as a causal graph with foliations/time-slices specifying computation order.
• Causal graph formalism (Wolfram physics style)framework0.782
  Janus proposes transformer computation viewed as causal graph with foliations/time-slices specifying computation order.
• The direct path W_U W_E in larger transformers represents bigram statistics not captured by more general grammatical rulesclaim0.770
  Interpretation of the role of the direct path in multi-layer transformers; e.g. encoding that 'Barack' is often followed by 'Obama'
• Different introspective tasks may preferentially use different path distributions in the transformer.claim0.769
  Interpretive claim connecting exponential path combinatorics to Lindsey's layer-dependent findings.
• Cortex as a Transformerhypothesis0.764
  Hypothesis that neocortical circuits beyond hippocampus may implement transformer-like computations for language and other domains.
• A Mathematical Framework for Transformer Circuits (Elhage et al., 2021)concept0.760
  Foundational mechanistic interpretability paper on transformer circuit analysis
• The problem isn't that it is a transformer. The problem is that it is an auto-regressive LLM. Auto-regressive LLMs that compute each token with a fixed number of computational steps can't reason, regardless of the details of the architecture.quote0.758
  LeCun's post on X supporting the view that fixed-step probabilistic prediction precludes consciousness in LLMs.
• So at any point in the network, the transformer not only receives information from its past... but also has causal influence over its future processing. So, saying that LLMs cannot introspect... is incorrect.quote0.752
  Core summary of Janus' position on autoregressive recurrence enabling introspection.