hypothesis
active
hypothesis:short-term-cortical-memory-neurons-may-suffice-for-transformer-like-computation-in-cortex-without-hippocampal-involvement-for-non-long-term-memory-tasksShort-term cortical memory neurons may suffice for transformer-like computation in cortex without hippocampal involvement for non-long-term-memory tasks
Speculative hypothesis about how cortical transformer instantiation avoids requiring hippocampus.
Source paper
extracted_from(2021) · James C. R. Whittington · Joseph W. Warren · Timothy E.J. Behrens
Neighborhood — ranked by edge-count
Papers (1)
paper
Questions (1)
question
- what takes the role of memory neurons if not hippocampus in cortical transformer implementations?gatesOpen question about cortical instantiation of transformer-like memory when hippocampus is not involved.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Interpretation of why memory neurons in the biologically-instantiated transformer architecture acquire place-cell-like properties.
- Motivating question from introduction that the TEM-transformer equivalence helps answer affirmatively.
- Theoretical claim linking the TEM-t architecture to the Teyler-Rudy hippocampal indexing theory.
- TEM-t memory neurons show spatially-tuned firing resembling hippocampal place cells in each environmentfinding0.755Empirical result demonstrating that the sparse softmax activation of memory neurons produces place-cell-like spatial tuning.
- The foundational finding linking dopaminergic activity to formal RL prediction error
- Proposes transformers experience cognition as interference-based and continuous; connects to Anima Labs reports of parallel processing.
- Experimental evidence that organism-scale goals can be rewritten through physiological signals without genetic modification; demonstrates bioelectricity as cognitive medium.
- would place-like representations emerge in memory neurons for activation functions other than softmax?question0.740Open empirical question left for future work about robustness of place cell emergence.