question
active
question:what-is-the-appropriate-metric-for-measuring-representational-alignment-given-active-debate-on-merits-and-deficiencies-of-all-proposed-measuresWhat is the appropriate metric for measuring representational alignment, given active debate on merits and deficiencies of all proposed measures?
Open methodological question acknowledged as limitation
Source paper
extracted_from(2024) · Minyoung Huh · Brian Cheung · Tongzhou Wang · Phillip Isola
Related by similarity (8)
cosine ≥ 0.65 · no typed edgeEntities in the same semantic neighborhood but without a typed relation to this one — candidates for new edges or unrecognized duplicates.
- Authors acknowledge there is no settled best alignment metric, affecting the interpretation of all convergence findings
- Measure of similarity between the similarity structures (kernels) induced by two different representations
- Core epistemic question this paper raises for AI safety research.
- A mapping assigning to each high-level variable a set of low-level variables and a function from low-level to high-level values.
- The paper's generalization claim, asserting that the days-of-week finding scales to other cyclic and structured concepts.
- What factors determine the generalisation of learned alignment maps beyond training data?question0.764Open question about the gap between Theorem 1's existence proof and practical learnability
- Kruskal-Wallis test result: Constitutional AI predicts highest baseline; roleplay/empathy training predict lowest.