concept
active
concept:cross-modal-alignmentCross-Modal Alignment
The alignment between representations learned from different data modalities such as vision and language
Neighborhood — ranked by edge-count
Concepts (2)
concept
- Representational AlignmentextendsMeasure of similarity between the similarity structures (kernels) induced by two different representations
- Mutual Information Cap on Alignmentassociated_withThe theoretical cap on cross-modal alignment determined by mutual information between input signals and model capacity
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- The goal of making model behavior match human values and intentions, often addressed during post-training.
- Technique used to demonstrate that the self-prior captures visual–proprioceptive associations by recovering visual appearance from proprioception alone
- Meta-problem where AI develops hidden subgoals deviating from intended goals; addressed by mindfulness principle
- Alignment approach that focuses on curating or modifying training data; the paper bridges this with interpretability methods.
- The primary contribution of the paper: a bidirectional causal method that learns rotation matrices for each model to uncover and compare causally relevant latent subspaces across neural networks.
- A learnable invertible transformation in DAS that maps neural representations to a basis aligned with causal variables
- The problem of ensuring AI systems adopt values compatible with human welfare — argued to be a perennial problem already present in child-rearing
- Quantitative bound on observed alignment; raises the open question of whether this gap reflects noise or real misalignment