finding
active
finding:novel-place-cell-metric-largest-connected-component-firing-mass-ratio-successfully-distinguishes-tem-t-memory-neurons-place-cells-from-rnn-neurons-grid-cellsNovel place cell metric (largest connected component firing mass ratio) successfully distinguishes TEM-t memory neurons (place cells) from RNN neurons (grid cells)
Methodological validation result confirming the place-cell metric separates cell types in TEM-t.
Source paper
extracted_from(2021) · James C. R. Whittington · Joseph W. Warren · Timothy E.J. Behrens
Neighborhood — ranked by edge-count
Claims (1)
claim
- Interpretation of why memory neurons in the biologically-instantiated transformer architecture acquire place-cell-like properties.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Novel evaluation metric introduced in this paper to quantify how place-like a neuron's firing rate map is, based on largest connected component.
- TEM-t memory neurons show spatially-tuned firing resembling hippocampal place cells in each environmentfinding0.815Empirical result demonstrating that the sparse softmax activation of memory neurons produces place-cell-like spatial tuning.
- would place-like representations emerge in memory neurons for activation functions other than softmax?question0.769Open empirical question left for future work about robustness of place cell emergence.
- Predicts that cells can categorize perturbations and mount appropriate, not just hardwired, responses.
- Theoretical claim linking the TEM-t architecture to the Teyler-Rudy hippocampal indexing theory.
- Neural Representations of Location Composed of Spatially Periodic Bands (Krupic et al., 2012)concept0.759Discovery of band cells; TEM-t also recapitulates these representations.
- Empirical result showing TEM-t recapitulates entorhinal grid cell representations with linear post-transition activation.
- Derived from the planarian barium adaptation finding.