claim
active
claim:the-relationship-between-the-brain-and-transformers-is-close-because-of-a-mathematical-relationship-between-models-not-merely-because-of-shared-neural-representationsThe relationship between the brain and transformers is close because of a mathematical relationship between models, not merely because of shared neural representations
Methodological clarification distinguishing this paper's contribution from looser representational similarity claims.
Source paper
extracted_from(2021) · James C. R. Whittington · Joseph W. Warren · Timothy E.J. Behrens
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- TEM memory retrieval is mathematically equivalent to transformer self-attention without softmaxextendsCentral theoretical claim: a single step of TEM attractor dynamics equals a dot-product attention, making TEM a special case of transformer.
Quotes (1)
quote
- Core claim distinguishing this paper's contribution from looser representational similarity arguments.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Central empirical claim of the paper, demonstrated across tasks and modalities
- Extends convergence argument to brain-machine alignment
- Sloman's critique of mainstream neural network theories.
- The central hypothesis of the paper; the platonic representation hypothesis itself
- Necessary condition for connectionist cognition.
- Empirical claim about transferability of methods.
- Author’s interpretive claim that the shared geometry is general and robust.
- Derived from observed alignment of promising cases with semantically rich deeper layers and the brain-aligned 2/3 layer.