finding
active
finding:color-distances-learned-from-language-cooccurrence-statistics-closely-mirror-those-learned-from-image-cooccurrence-statistics-and-human-perceptual-distances-cielabColor distances learned from language cooccurrence statistics closely mirror those learned from image cooccurrence statistics and human perceptual distances (CIELAB)
Case study confirming that PMI-based learning in different modalities recovers the same perceptual representation
Source paper
extracted_from(2024) · Minyoung Huh · Brian Cheung · Tongzhou Wang · Phillip Isola
Neighborhood — ranked by edge-count
Claims (1)
claim
- Core theoretical claim about the target of representation learning
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Empirical validation that PMI convergence actually occurs on real data
- Validates theoretical PMI convergence claim on real data
- Perceptually uniform color space used as ground truth perceptual representation in color cooccurrence experiment
- Assertion that the process yields a specific set of color qualities, listed in the chapter.
- Core cross-modal empirical result: larger and better language models align better with vision models
- Central motivating claim of the paper; supported by empirical comparisons showing RSA/CKA miss Markovian differences detectable by MAS.