question
active
question:what-takes-the-role-of-memory-neurons-if-not-hippocampus-in-cortical-transformer-implementationswhat takes the role of memory neurons if not hippocampus in cortical transformer implementations?
Open question about cortical instantiation of transformer-like memory when hippocampus is not involved.
Source paper
extracted_from(2021) · James C. R. Whittington · Joseph W. Warren · Timothy E.J. Behrens
Neighborhood — ranked by edge-count
Papers (1)
paper
Hypotheses (1)
hypothesis
- Speculative hypothesis about how cortical transformer instantiation avoids requiring hippocampus.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Interpretation of why memory neurons in the biologically-instantiated transformer architecture acquire place-cell-like properties.
- Proposes transformers experience cognition as interference-based and continuous; connects to Anima Labs reports of parallel processing.
- Motivating question from introduction that the TEM-transformer equivalence helps answer affirmatively.
- Major open problem identified in the paper; MLP layers constitute 2/3 of transformer parameters
- Hypothesis that neocortical circuits beyond hippocampus may implement transformer-like computations for language and other domains.
- Proposed mechanism explaining behavioral continuity in insects undergoing radical morphogenesis.
- Extension of TEM-t to handle conjunctions of more than two brain regions with linear (not exponential) scaling in hippocampal neuron count.