claim
active
claim:what-makes-learning-systems-smart-is-that-the-parameters-they-adjust-and-the-data-to-which-they-fit-are-not-in-the-same-spaceWhat makes learning systems smart is that the parameters they adjust and the data to which they fit are not in the same space.
Distillation of why learning generalises.
Source paper
extracted_from(2023) · Watson, Richard · Levin, Michael
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Core theoretical claim establishing that locality constraints in physical learning are not fatal—they reflect biological precedent and provide advantages like robustness and scalability
- Key insight linking individual rewards to system-level learning.
- Applied contribution.
- Foundational definition of physical learning system components; load-bearing for understanding the entire framework
- Clarifies what unsupervised learning does.
- Extension of the Universality Hypothesis to consciousness: if consciousness solves a well-defined computational problem, different systems will discover it independently
- Opening sentence defining self-evidencing.
- Scaling laws for dictionary learning are unknown and needed to assess feasibility on frontier models