concept
active
concept:naive-conjunctive-memory-scaling-problemNaive Conjunctive Memory Scaling Problem
Problem that naive triple-conjunction in TEM would increase hippocampal neuron count by factor nc; TEM-t avoids this.
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Process by which low-level competencies scale to larger problem-solving abilities across levels of organization.
- Processes scaling goals and stressors form positive feedback loop with modularity; both arise from and potentiate power of evolution, enabling specific predictions for cognitive capacity scaling.
- Interpretive process for transforming many-valued contexts into formal contexts via scale attributes.
- The process by which smaller agents join into a larger emergent Self with expanded cognitive light cones, mediated by gap junctions.
- The pressure on models trained on more tasks to find representations that generalize across all tasks, reducing the solution space
- Argues that there are fewer representations competent for N tasks than M<N tasks, so more general models have a smaller solution space
- Large Associative Memory Problem in Neurobiology and Machine Learning (Krotov & Hopfield, 2020)concept0.709Paper proposing neurally plausible instantiation of Hopfield/transformer with feature neurons and memory neurons; used to derive place cell interpretation.
- Technical issue: original Hopfield networks scale linearly with neuron count; exponential activations enable 2^(N/2) scaling but softmax used in TEM-t has intermediate properties.