concept
active
concept:merullo-et-al-2022Merullo et al. (2022)
Found a single linear projection sufficient to stitch vision model to LLM for VQA and captioning
Neighborhood — ranked by edge-count
Papers (1)
paper
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Demonstrated zero-shot model stitching across text models trained on different modalities
- Found Rosetta Neurons — neurons activated by same patterns across diverse vision models
- Discovered that color distances in language representations mirror human perceptual distances; reproduced and extended in this paper
- Showed contrastive learning inverts the data generating process; supports claim that contrastive learners recover statistics of underlying world
- Reference for ToM modeled through partially observable inference of others' beliefs
- Showed word embeddings of visual concept names can be isometrically mapped to image embeddings, and developed framework for efficient concept extraction
- Recent ToM in AI work cited as emphasizing inference of others' beliefs, contrasted with this paper's self-focus
- Human study cited to support interpretation of chronic agent's high performance despite negative well-being