question
active
question:what-exactly-is-the-endpoint-of-representational-convergenceWhat exactly is the endpoint of representational convergence?
Motivates Section 4 where the PMI-kernel formalization is proposed
Source paper
extracted_from(2024) · Minyoung Huh · Brian Cheung · Tongzhou Wang · Phillip Isola
Neighborhood — ranked by edge-count
Claims (1)
claim
- Core theoretical claim about the target of representation learning
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- What has led to representational convergence, will it continue, and ultimately where does it end?question0.868Central motivating questions of the paper
- The central empirical phenomenon: different neural networks trained on different data/objectives develop increasingly similar representations
- Core phenomenon studied: when causal interventions shift internal representations away from the natural distribution
- Key limitation of the PRH for non-bijective observations
- Core research questions motivating the paper
- Authors note robotics lacks a standardized representation approach and sufficient training data diversity to show PRH effects
- How do representations differ or converge between architectures, tasks, and modalities?question0.752Broader research question MAS is positioned to address, citing multiple recent works.
- Mathematical formalization of what representation models converge to