concept
active
concept:cross-modal-alignment

Cross-Modal Alignment

The alignment between representations learned from different data modalities such as vision and language

Neighborhood — ranked by edge-count

Concepts (2)

concept
  • Measure of similarity between the similarity structures (kernels) induced by two different representations
  • The theoretical cap on cross-modal alignment determined by mutual information between input signals and model capacity

Related by similarity (8)

cosine ≥ 0.65 · no typed edge

Entities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.

  • Alignmentconcept0.797
    The goal of making model behavior match human values and intentions, often addressed during post-training.
  • Technique used to demonstrate that the self-prior captures visual–proprioceptive associations by recovering visual appearance from proprioception alone
  • Inner Alignmentconcept0.773
    Meta-problem where AI develops hidden subgoals deviating from intended goals; addressed by mindfulness principle
  • Alignment approach that focuses on curating or modifying training data; the paper bridges this with interpretability methods.
  • The primary contribution of the paper: a bidirectional causal method that learns rotation matrices for each model to uncover and compare causally relevant latent subspaces across neural networks.
  • Alignment Functionconcept0.750
    A learnable invertible transformation in DAS that maps neural representations to a basis aligned with causal variables
  • Alignment Problemconcept0.745
    The problem of ensuring AI systems adopt values compatible with human welfare — argued to be a perennial problem already present in child-rearing
  • Quantitative bound on observed alignment; raises the open question of whether this gap reflects noise or real misalignment