question
active
question:are-hippocampal-architecture-and-bespoke-neuroscience-models-capable-of-the-general-purpose-computations-studied-in-machine-learningare hippocampal architecture and bespoke neuroscience models capable of the general purpose computations studied in machine learning?
Motivating question from introduction that the TEM-transformer equivalence helps answer affirmatively.
Source paper
extracted_from(2021) · James C. R. Whittington · Joseph W. Warren · Timothy E.J. Behrens
Neighborhood — ranked by edge-count
Papers (1)
paper
Claims (1)
claim
- TEM memory retrieval is mathematically equivalent to transformer self-attention without softmaxanswered_byCentral theoretical claim: a single step of TEM attractor dynamics equals a dot-product attention, making TEM a special case of transformer.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- The central hypothesis of the paper
- Neural plausibility argument for softmax policy selection.
- The paper's central thesis statement, presented prominently after the abstract
- Empirical finding supporting the Universality Hypothesis; extended by the paper to consciousness
- Central claim about the power of connectionism.
- General computational machines with sufficient resources possess the necessary and sufficient means to implement consciousnesshypothesis0.771CIMC's central testable hypothesis grounding the entire research program
- Speculative hypothesis about how cortical transformer instantiation avoids requiring hippocampus.
- The central hypothesis of the paper; the platonic representation hypothesis itself